2024-04-26T22:49:03.336 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T22:49:03.336 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --verbose --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/orig.config.yaml 2024-04-26T22:49:03.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T22:49:03.479 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285 branch: wip-rishabh-testing-20240426.111959 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7675285' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - overall HEALTH_ - \(MON_DOWN\) sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFMQsndgvOkE+HQfFMhiZazJy3D/9qYbaan3SWWXeYmBZ+sl1S45UpNNqC2XaJ1tXxu6qlBWjs5wg8r8Yt/6Q6I= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmUkvWwwxZnswDMsTyvhZ/VuWmsNZNQIsdDa9amuctC1APVnQaJ64IJpMvDSFBboPdd5lH+nvjFB2BYeExWVNU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T22:49:03.479 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T22:49:03.480 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T22:49:03.480 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T22:49:03.482 INFO:teuthology.task.internal:Checking packages... 2024-04-26T22:49:03.504 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T22:49:03.504 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T22:49:03.504 INFO:teuthology.packaging:ref: None 2024-04-26T22:49:03.504 INFO:teuthology.packaging:tag: None 2024-04-26T22:49:03.504 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T22:49:03.504 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:49:03.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T22:49:03.644 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:49:03.646 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T22:49:03.652 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T22:49:03.652 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T22:49:03.684 INFO:teuthology.task.internal:Saving configuration 2024-04-26T22:49:03.702 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T22:49:03.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:49:03.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 22:42:47.356624', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGoURpVX+Znovie5tJv9KXKQ2Hkb8ELHkuCoc0ezjpHS'} 2024-04-26T22:49:03.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 22:42:47.358303', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBeFCfka4/jV77xxim5pCRDzg7bZV/73iYQb7GG+/Ik5'} 2024-04-26T22:49:03.802 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T22:49:03.808 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T22:49:03.808 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T22:49:03.808 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T22:49:03.903 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f295cbb84c0>, signals=[15]) 2024-04-26T22:49:03.904 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T22:49:04.128 INFO:teuthology.task.internal:Opening connections... 2024-04-26T22:49:04.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T22:49:04.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:49:04.210 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T22:49:04.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:49:04.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T22:49:04.296 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-04-26T22:49:04.301 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-04-26T22:49:04.301 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-04-26T22:49:04.348 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T22:49:04.349 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-04-26T22:49:04.350 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-04-26T22:49:04.373 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-04-26T22:49:04.378 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-04-26T22:49:04.379 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-26T22:49:04.426 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T22:49:04.426 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-04-26T22:49:04.426 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-04-26T22:49:04.426 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T22:49:04.426 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T22:49:04.427 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-04-26T22:49:04.427 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-26T22:49:04.447 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T22:49:04.460 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T22:49:04.483 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T22:49:04.484 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-04-26T22:49:04.486 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-04-26T22:49:04.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T22:49:04.544 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T22:49:04.545 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-04-26T22:49:04.547 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-04-26T22:49:04.626 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T22:49:04.683 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T22:49:04.698 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T22:49:04.698 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-26T22:49:04.698 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-26T22:49:04.699 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T22:49:04.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:49:04.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T22:49:04.872 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:49:04.872 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T22:49:04.873 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-04-26T22:49:04.878 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-56-generic 2024-04-26T22:49:04.878 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:49:04.879 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T22:49:04.879 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-26T22:49:04.879 DEBUG:teuthology.orchestra.run.smithi148:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T22:49:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: git config --global init.defaultBranch 2024-04-26T22:49:05.070 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2024-04-26T22:49:05.071 INFO:teuthology.orchestra.run.smithi148.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T22:49:05.071 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T22:49:05.071 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2024-04-26T22:49:05.071 INFO:teuthology.orchestra.run.smithi148.stderr:hint: git branch -m 2024-04-26T22:49:05.071 INFO:teuthology.orchestra.run.smithi148.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T22:49:05.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T22:49:05.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T22:49:05.195 DEBUG:teuthology.orchestra.run.smithi148:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T22:49:56.331 INFO:teuthology.orchestra.run.smithi148.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T22:49:56.331 INFO:teuthology.orchestra.run.smithi148.stderr: * [new branch] main -> origin/main 2024-04-26T22:49:56.364 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T22:49:56.364 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T22:49:56.365 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T22:49:56.369 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T22:49:56.370 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T22:49:56.371 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T22:49:56.372 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T22:49:56.372 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T22:49:56.373 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T22:49:56.373 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T22:49:56.373 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T22:49:56.373 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T22:50:00.634 INFO:teuthology.orchestra.run.smithi148.stderr:Updating files: 45% (1538/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2020/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2821/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T22:50:00.639 INFO:teuthology.orchestra.run.smithi148.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T22:50:00.660 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T22:50:00.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:50:00.811 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:50:00.811 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T22:50:00.814 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi148.front.sepia.ceph.com to complete... 2024-04-26T22:50:02.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26 22:50:02 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T22:50:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:FINISHED --2024-04-26 22:50:02-- 2024-04-26T22:50:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:Total wall clock time: 1.7s 2024-04-26T22:50:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-04-26T22:50:02.600 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T22:50:02.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T22:50:02.983 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T22:50:04.916 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T22:50:04.920 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T22:50:05.071 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:50:09.052 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:50:09.161 INFO:teuthology.orchestra.run.smithi148.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:50:30.763 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:50:30.793 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-04-26T22:50:31.090 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:31.104 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:31.404 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:50:31.415 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:50:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:50:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:50:31.631 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:50:31.631 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:50:31.631 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:50:31.682 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-04-26T22:50:31.875 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T22:50:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T22:50:31.884 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T22:50:31.884 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:31.901 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:31.901 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T22:50:31.923 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T22:50:31.924 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T22:50:31.924 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T22:50:31.924 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T22:50:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T22:50:31.928 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T22:50:31.929 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T22:50:31.929 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T22:50:31.929 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T22:50:31.951 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T22:50:31.952 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T22:50:31.953 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T22:50:31.954 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T22:50:31.955 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T22:50:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T22:50:31.957 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T22:50:31.958 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T22:50:31.959 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T22:50:31.960 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T22:50:31.961 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T22:50:31.962 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T22:50:31.963 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T22:50:31.964 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T22:50:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T22:50:31.966 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T22:50:31.967 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T22:50:32.025 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T22:50:32.026 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T22:50:32.027 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T22:50:32.028 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T22:50:32.029 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T22:50:32.030 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T22:50:32.031 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T22:50:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T22:50:32.033 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T22:50:32.034 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T22:50:32.035 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T22:50:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T22:50:32.037 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T22:50:32.038 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T22:50:32.040 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T22:50:32.041 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T22:50:32.042 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T22:50:32.043 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T22:50:32.044 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T22:50:32.045 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T22:50:32.046 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T22:50:32.047 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T22:50:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T22:50:32.049 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T22:50:32.050 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T22:50:32.051 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T22:50:32.052 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T22:50:32.053 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T22:50:32.054 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T22:50:32.055 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T22:50:32.056 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T22:50:32.057 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T22:50:32.058 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T22:50:32.059 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T22:50:32.060 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T22:50:32.061 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T22:50:32.062 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T22:50:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T22:50:32.064 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T22:50:32.065 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T22:50:32.066 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T22:50:32.067 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T22:50:32.068 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T22:50:32.069 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T22:50:32.070 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T22:50:32.071 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T22:50:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T22:50:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T22:50:32.074 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T22:50:32.075 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T22:50:32.149 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T22:50:32.150 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T22:50:32.151 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T22:50:32.152 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T22:50:32.153 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T22:50:32.154 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T22:50:32.155 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T22:50:32.156 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T22:50:32.157 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T22:50:32.158 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T22:50:32.159 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T22:50:32.160 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T22:50:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T22:50:32.162 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T22:50:32.163 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T22:50:32.164 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T22:50:32.165 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T22:50:32.166 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T22:50:32.167 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T22:50:32.168 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T22:50:32.169 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T22:50:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T22:50:32.171 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T22:50:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T22:50:32.173 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T22:50:32.174 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T22:50:32.175 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T22:50:32.176 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T22:50:32.177 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T22:50:32.178 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T22:50:32.179 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T22:50:32.180 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T22:50:32.181 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T22:50:32.182 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T22:50:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T22:50:32.184 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T22:50:32.185 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T22:50:32.186 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T22:50:32.187 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T22:50:32.188 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T22:50:32.189 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T22:50:32.190 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T22:50:32.191 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T22:50:32.192 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T22:50:32.193 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T22:50:32.194 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T22:50:32.195 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T22:50:32.196 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T22:50:32.197 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T22:50:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T22:50:32.199 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T22:50:32.200 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T22:50:32.202 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T22:50:32.203 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T22:50:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T22:50:32.205 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T22:50:32.206 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T22:50:32.207 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T22:50:32.208 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T22:50:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T22:50:32.210 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T22:50:32.211 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T22:50:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T22:50:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T22:50:32.214 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T22:50:32.268 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T22:50:32.268 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T22:50:32.268 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T22:50:32.268 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T22:50:32.269 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T22:50:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T22:50:32.271 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T22:50:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T22:50:32.273 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T22:50:32.274 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T22:50:32.275 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T22:50:32.276 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T22:50:32.277 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T22:50:32.278 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T22:50:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T22:50:32.280 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T22:50:32.281 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T22:50:32.282 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T22:50:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T22:50:32.284 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T22:50:32.285 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T22:50:32.286 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T22:50:32.287 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T22:50:32.288 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T22:50:32.289 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T22:50:32.290 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T22:50:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T22:50:32.292 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T22:50:32.293 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T22:50:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T22:50:32.295 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T22:50:32.296 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T22:50:32.297 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T22:50:32.298 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T22:50:32.299 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T22:50:32.300 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T22:50:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T22:50:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T22:50:32.303 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T22:50:32.304 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T22:50:32.305 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T22:50:32.306 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T22:50:32.307 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T22:50:32.308 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T22:50:32.309 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T22:50:32.310 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T22:50:32.311 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T22:50:32.312 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T22:50:32.313 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T22:50:32.314 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T22:50:32.315 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T22:50:32.316 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T22:50:32.317 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T22:50:32.317 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:50:32.317 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T22:50:32.317 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T22:50:32.322 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:32.322 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:32.322 DEBUG:teuthology.orchestra.run.smithi148:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T22:50:32.330 INFO:teuthology.orchestra.run.smithi148.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:50:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:50:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:50:32.331 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T22:50:32.331 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:32.331 DEBUG:teuthology.orchestra.run.smithi148:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T22:50:32.373 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi148.front.sepia.ceph.com to complete... 2024-04-26T22:50:32.773 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:50:32.774 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:50:32.800 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-04-26T22:50:32.971 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:32.978 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:50:33.208 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:50:33.213 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:50:33.256 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:50:33.261 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:50:33.394 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:50:33.394 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:50:33.394 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:50:33.416 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-04-26T22:51:04.542 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T22:51:04.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T22:51:04.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:51:23.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-26T22:51:32.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T22:51:32.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:51:35.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-26T22:51:47.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T22:51:47.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:52:47.110 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T22:53:02.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T22:53:02.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:53:02.340 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-26T22:53:03.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T22:53:03.034 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T22:53:03.034 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-04-26T22:53:03.085 INFO:teuthology.orchestra.run.smithi148.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T22:53:03.086 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T22:53:03.086 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T22:53:03.086 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T22:53:04.087 DEBUG:teuthology.parallel:result is None 2024-04-26T22:53:04.087 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T22:53:04.101 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T22:53:04.101 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T22:53:04.104 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T22:53:04.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T22:53:04.148 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T22:53:04.249 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T22:53:04.250 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T22:53:04.253 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T22:53:04.284 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T22:53:04.317 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T22:53:04.318 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T22:53:04.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:53:04.322 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T22:53:04.326 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T22:53:04.387 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:53:04.396 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:53:04.399 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:53:04.420 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:53:04.423 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T22:53:04.430 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T22:53:04.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T22:53:04.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T22:53:04.456 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T22:53:04.471 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T22:53:04.471 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T22:53:04.497 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T22:53:04.504 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T22:53:04.559 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T22:53:04.614 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T22:53:04.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T22:53:04.694 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T22:53:04.699 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T22:53:04.749 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T22:53:04.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T22:53:04.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-04-26T22:53:04.812 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-04-26T22:53:04.911 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T22:53:04.921 INFO:teuthology.task.internal:Starting timer... 2024-04-26T22:53:04.921 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T22:53:04.957 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T22:53:05.040 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2024-04-26T22:53:05.040 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-04-26T22:53:05.040 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T22:53:05.040 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T22:53:05.041 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T22:53:05.041 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T22:53:05.093 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T22:53:05.098 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T22:53:05.222 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T22:53:05.238 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T22:53:05.239 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:00:39.263 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-04-26T23:00:39.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T23:00:39.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:00:39.351 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-26T23:00:39.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-26T23:00:39.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-26T23:00:39.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:00:39.555 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-26T23:00:39.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-26T23:00:39.654 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:00:39.667 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:00:39.668 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:00:39.668 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:00:39.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:00:39.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:00:39.706 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:00:39.706 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Command line: ntpd -gq 2024-04-26T23:00:39.706 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: ---------------------------------------------------- 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: corporation. Support and training for ntp-4 are 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: available at https://www.nwtime.org/support 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: ---------------------------------------------------- 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: proto: precision = 0.044 usec (-24) 2024-04-26T23:00:39.707 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: basedate set to 2022-02-04 2024-04-26T23:00:39.708 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:00:39.708 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:00:39.708 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:00:39.708 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:00:39.708 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:00:39.709 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:00:39.709 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:00:39.709 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:00:39.710 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2024-04-26T23:00:39.710 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen normally on 4 lo [::1]:123 2024-04-26T23:00:39.710 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2024-04-26T23:00:39.710 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:39 ntpd[17209]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Command line: ntpd -gq 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: ---------------------------------------------------- 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: corporation. Support and training for ntp-4 are 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: available at https://www.nwtime.org/support 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: ---------------------------------------------------- 2024-04-26T23:00:39.724 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: proto: precision = 0.057 usec (-24) 2024-04-26T23:00:39.725 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: basedate set to 2022-02-04 2024-04-26T23:00:39.725 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:00:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:00:39.725 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:00:39.725 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:00:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:00:39.730 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen normally on 4 lo [::1]:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-04-26T23:00:39.731 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:39 ntpd[17683]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:40.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:40 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:40.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:40.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:40.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:40.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:40.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:40 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:41.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:41 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:42.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:42.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:42 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:42 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:43.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:43 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:44.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:44.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:44 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:44.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:44.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:44.727 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:44.727 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:44.727 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:44.727 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:44 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:45 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.707 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stdout:26 Apr 23:00:46 ntpd[17209]: ntpd: time slew +0.000117 s 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time slew +0.000117s 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:00:46.708 INFO:teuthology.orchestra.run.smithi148.stderr:26 Apr 23:00:46 ntpd[17209]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:00:46.725 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:00:46.726 INFO:teuthology.orchestra.run.smithi157.stdout:26 Apr 23:00:46 ntpd[17683]: ntpd: time slew +0.001525 s 2024-04-26T23:00:46.726 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew +0.001525s 2024-04-26T23:00:46.726 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:00:46.727 INFO:teuthology.orchestra.run.smithi157.stderr:26 Apr 23:00:46 ntpd[17683]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.806 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:00:46.806 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-04-26T23:00:46.806 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.807 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.807 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.807 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:00:46.807 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:00:46.817 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:00:46.817 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:00:46.817 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:00:46.818 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:00:46.823 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:00:46.823 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:00:46.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2024-04-26T23:00:46.824 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-04-26T23:00:46.906 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:00:46.935 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:00:46.935 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:00:46.935 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:00:46.935 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:00:46.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:00:46.951 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:00:47.002 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:00:47.002 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:00:47.003 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:00:47.003 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:00:47.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:00:47.083 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:00:47.084 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:00:47.147 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:00:47.147 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:00:47.256 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:00:47.256 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:00:47.258 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:00:47.258 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:00:47.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-04-26T23:00:47.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-04-26T23:00:47.446 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:00:47.493 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:00:47.515 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:00:47.544 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:00:47.560 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:00:47.565 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:00:47.567 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:00:47.586 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:00:47.586 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:00:47.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:00:47.603 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:00:47.640 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:00:47.642 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:00:47.657 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:00:47.676 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:00:47.723 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:00:47.724 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:00:47.738 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:00:47.863 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 29.2 kB in 0s (71.1 kB/s) 2024-04-26T23:00:48.169 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 29.2 kB in 1s (43.2 kB/s) 2024-04-26T23:00:48.849 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-26T23:00:48.865 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:00:48.916 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-26T23:00:49.093 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-26T23:00:49.093 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-26T23:00:49.157 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-26T23:00:49.172 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:00:49.247 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-26T23:00:49.264 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:00:49.264 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:00:49.265 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:00:49.265 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:00:49.265 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T23:00:49.265 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-04-26T23:00:49.265 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:00:49.267 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:00:49.268 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:00:49.269 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:00:49.270 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-04-26T23:00:49.270 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-04-26T23:00:49.373 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-04-26T23:00:49.373 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:00:49.373 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:00:49.374 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:00:49.374 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:00:49.375 INFO:teuthology.orchestra.run.smithi157.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:00:49.376 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:00:49.377 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:00:49.377 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:00:49.377 INFO:teuthology.orchestra.run.smithi157.stdout: socat unzip xmlstarlet zip 2024-04-26T23:00:49.422 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-26T23:00:49.422 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-26T23:00:49.572 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:00:49.572 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 182 MB of archives. 2024-04-26T23:00:49.572 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:00:49.572 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:00:49.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:00:49.594 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:00:49.594 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:00:49.594 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:00:49.594 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:00:49.595 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:00:49.595 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:00:49.595 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:00:49.596 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-04-26T23:00:49.596 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:00:49.596 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:00:49.596 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:00:49.596 INFO:teuthology.orchestra.run.smithi148.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:00:49.597 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:00:49.597 INFO:teuthology.orchestra.run.smithi148.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:00:49.597 INFO:teuthology.orchestra.run.smithi148.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:00:49.597 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:00:49.598 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:00:49.599 INFO:teuthology.orchestra.run.smithi148.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:00:49.600 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2024-04-26T23:00:49.600 INFO:teuthology.orchestra.run.smithi148.stdout: btrfs-tools 2024-04-26T23:00:49.659 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:00:49.708 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:00:49.749 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-04-26T23:00:49.750 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:00:49.750 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:00:49.750 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:00:49.750 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:00:49.751 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:00:49.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:00:49.753 INFO:teuthology.orchestra.run.smithi148.stdout: socat unzip xmlstarlet zip 2024-04-26T23:00:49.826 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:00:49.827 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 182 MB of archives. 2024-04-26T23:00:49.827 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:00:49.827 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:00:49.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:00:49.860 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:00:49.912 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:00:49.937 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:00:49.940 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:00:49.955 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:00:49.975 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:00:49.979 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:00:50.004 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:00:50.006 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:00:50.013 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:00:50.016 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:00:50.017 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:00:50.023 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:00:50.024 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:00:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:00:50.027 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:00:50.030 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:00:50.049 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:00:50.051 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:00:50.053 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:00:50.053 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:00:50.054 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:00:50.055 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:00:50.055 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:00:50.055 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:00:50.056 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:00:50.074 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:00:50.077 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:00:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:00:50.081 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:00:50.081 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:00:50.082 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:00:50.082 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:00:50.083 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:00:50.084 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:00:50.094 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:00:50.105 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:00:50.106 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:00:50.106 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:00:50.111 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:00:50.111 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:00:50.112 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:00:50.112 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:00:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:00:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:00:50.135 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:00:50.137 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:00:50.137 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:00:50.139 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:00:50.140 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:00:50.141 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:00:50.143 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:00:50.189 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:00:50.190 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:00:50.191 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:00:50.191 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:00:50.193 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:00:50.212 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:00:50.215 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:00:50.215 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:00:50.233 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:00:50.233 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:00:50.244 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:00:50.244 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:00:50.245 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:00:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:00:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:00:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:00:50.251 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:00:50.253 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:00:50.265 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:00:50.266 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:00:50.270 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:00:50.285 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:00:50.288 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:00:50.288 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:00:50.290 INFO:teuthology.orchestra.run.smithi148.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:00:50.290 INFO:teuthology.orchestra.run.smithi148.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:00:50.295 INFO:teuthology.orchestra.run.smithi148.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:00:50.296 INFO:teuthology.orchestra.run.smithi148.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:00:50.306 INFO:teuthology.orchestra.run.smithi148.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:00:50.306 INFO:teuthology.orchestra.run.smithi148.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:00:50.307 INFO:teuthology.orchestra.run.smithi148.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:00:50.317 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:00:50.327 INFO:teuthology.orchestra.run.smithi148.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:00:50.329 INFO:teuthology.orchestra.run.smithi148.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:00:50.330 INFO:teuthology.orchestra.run.smithi148.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:00:50.337 INFO:teuthology.orchestra.run.smithi148.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:00:50.337 INFO:teuthology.orchestra.run.smithi148.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:00:50.337 INFO:teuthology.orchestra.run.smithi148.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:00:50.340 INFO:teuthology.orchestra.run.smithi148.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:00:50.348 INFO:teuthology.orchestra.run.smithi148.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:00:50.419 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:00:50.697 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:00:50.760 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:00:50.808 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:00:50.848 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:00:50.850 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:00:50.864 INFO:teuthology.orchestra.run.smithi148.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:00:50.879 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:00:50.884 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:00:50.900 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:00:51.319 INFO:teuthology.orchestra.run.smithi148.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:00:51.407 INFO:teuthology.orchestra.run.smithi148.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:00:51.420 INFO:teuthology.orchestra.run.smithi148.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:00:51.420 INFO:teuthology.orchestra.run.smithi148.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:00:51.446 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:00:51.449 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:00:51.457 INFO:teuthology.orchestra.run.smithi148.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:00:51.459 INFO:teuthology.orchestra.run.smithi148.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:00:51.463 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:00:51.492 INFO:teuthology.orchestra.run.smithi148.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:00:52.103 INFO:teuthology.orchestra.run.smithi148.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:00:52.104 INFO:teuthology.orchestra.run.smithi148.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:00:52.169 INFO:teuthology.orchestra.run.smithi148.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:00:52.922 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:00:53.066 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:00:53.130 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:00:53.136 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:00:53.147 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:00:53.225 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:00:53.523 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:00:53.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:00:54.212 INFO:teuthology.orchestra.run.smithi148.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:00:54.450 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:00:54.594 INFO:teuthology.orchestra.run.smithi148.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:00:54.612 INFO:teuthology.orchestra.run.smithi148.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:00:54.616 INFO:teuthology.orchestra.run.smithi148.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:00:54.747 INFO:teuthology.orchestra.run.smithi148.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:00:54.964 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:00:55.022 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:00:55.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:00:55.040 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:00:55.082 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:00:55.107 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:00:55.112 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:00:55.129 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:00:55.236 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:00:55.242 INFO:teuthology.orchestra.run.smithi148.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:00:55.701 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:00:55.702 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:00:55.703 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:00:55.716 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:00:55.732 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:00:55.740 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:00:55.741 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:00:55.757 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:00:55.796 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:00:55.810 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:00:55.814 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:00:55.814 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:00:55.985 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:00:56.069 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:00:56.090 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:00:56.151 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:00:56.190 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:00:56.213 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:00:56.241 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:00:56.426 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:00:56.442 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:00:56.449 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:00:56.454 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:00:56.639 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:00:56.723 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:00:56.739 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:00:56.929 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:00:56.981 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:00:56.995 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:00:57.149 INFO:teuthology.orchestra.run.smithi148.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:00:57.149 INFO:teuthology.orchestra.run.smithi148.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:00:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:00:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:00:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:00:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:00:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:00:57.222 INFO:teuthology.orchestra.run.smithi148.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:00:57.365 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:00:57.430 INFO:teuthology.orchestra.run.smithi148.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:00:57.499 INFO:teuthology.orchestra.run.smithi148.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:00:57.503 INFO:teuthology.orchestra.run.smithi148.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:00:57.631 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:00:57.709 INFO:teuthology.orchestra.run.smithi148.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:00:57.747 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:00:57.790 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:00:57.875 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:00:57.887 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:00:57.901 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:00:57.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:00:58.207 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:00:58.209 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:00:58.212 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:00:58.381 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:00:58.466 INFO:teuthology.orchestra.run.smithi148.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:00:58.467 INFO:teuthology.orchestra.run.smithi148.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:00:58.702 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:00:58.705 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:00:58.710 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:00:58.711 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:00:58.712 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:00:58.755 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:00:58.786 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:00:59.336 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:01:00.990 INFO:teuthology.orchestra.run.smithi148.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:01:00.991 INFO:teuthology.orchestra.run.smithi148.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:01:00.993 INFO:teuthology.orchestra.run.smithi148.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:01:00.993 INFO:teuthology.orchestra.run.smithi148.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:01:00.994 INFO:teuthology.orchestra.run.smithi148.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:01:00.994 INFO:teuthology.orchestra.run.smithi148.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:01:01.380 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:01:01.542 INFO:teuthology.orchestra.run.smithi148.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:01:01.681 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:01:01.702 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:01:02.176 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 182 MB in 12s (15.4 MB/s) 2024-04-26T23:01:02.288 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:01:02.353 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:01:02.356 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:01:02.403 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:01:02.948 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:01:02.961 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:01:03.006 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:01:03.317 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:01:03.331 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:01:03.375 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:01:03.705 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:01:03.717 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:01:03.804 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:01:04.165 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:01:04.180 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:01:04.223 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:01:04.501 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:01:04.516 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:01:04.553 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:01:04.940 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:01:04.955 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:05.006 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:05.125 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:01:05.138 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:01:05.300 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 2024-04-26T23:01:05.426 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:01:05.441 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:05.469 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:01:05.484 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:05.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:01:05.672 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:01:05.740 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:01:05.759 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:01:05.771 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:01:05.786 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:05.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:01:05.829 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:06.057 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:01:06.130 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:01:06.176 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:01:06.185 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:01:06.191 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:01:06.206 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:01:06.249 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:01:06.250 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:01:06.467 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:01:06.578 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librados2. 2024-04-26T23:01:06.591 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:06.626 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:06.657 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:01:06.807 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:01:06.845 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:01:07.004 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:01:07.019 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:07.028 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:01:07.037 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:01:07.063 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:07.084 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:01:07.085 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:01:07.091 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:01:07.093 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:01:07.110 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:01:07.281 INFO:teuthology.orchestra.run.smithi157.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:01:07.492 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:01:07.506 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:07.549 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:07.818 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:01:07.832 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:07.875 INFO:teuthology.orchestra.run.smithi157.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:01:07.876 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:07.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:01:07.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:01:08.086 INFO:teuthology.orchestra.run.smithi157.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:01:08.099 INFO:teuthology.orchestra.run.smithi157.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:01:08.162 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:01:08.176 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:08.212 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:08.414 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:01:08.429 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:08.465 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:08.810 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:01:08.817 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:01:08.833 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:08.875 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:09.203 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:01:09.218 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:01:09.261 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:01:09.423 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 182 MB in 19s (9,346 kB/s) 2024-04-26T23:01:09.514 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:01:09.529 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:09.539 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:01:09.572 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:09.618 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-26T23:01:09.622 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:01:09.671 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:01:09.867 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:01:09.882 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:01:09.932 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:01:09.943 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:01:09.950 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:01:09.982 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:01:10.203 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:01:10.218 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:01:10.261 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:01:10.318 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:01:10.338 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:01:10.376 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:01:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:01:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:01:10.622 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:01:10.754 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:01:10.774 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:01:10.863 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:01:10.959 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:01:10.974 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:01:11.017 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:01:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:01:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:01:11.299 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:01:11.312 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:01:11.327 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:01:11.370 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:01:11.569 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:01:11.590 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:01:11.619 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:01:11.622 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package zip. 2024-04-26T23:01:11.638 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:01:11.681 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:01:11.992 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package unzip. 2024-04-26T23:01:12.007 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:01:12.050 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:01:12.106 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:01:12.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:12.172 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:12.438 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:01:12.453 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:01:12.488 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:01:12.634 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:01:12.654 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:12.692 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:12.862 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:01:12.875 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:12.920 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:13.029 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:01:13.049 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:01:13.087 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:01:13.431 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:01:13.432 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:01:13.444 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:01:13.446 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:13.473 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:01:13.489 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:13.842 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:01:13.843 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-04-26T23:01:13.857 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:01:13.863 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:13.900 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:01:13.901 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:14.153 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:01:14.168 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:14.203 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:14.615 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:01:14.630 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:14.638 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:01:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:14.673 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:14.696 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:15.107 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:01:15.119 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:15.149 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:15.434 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:01:15.446 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:15.484 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:15.770 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:01:15.785 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:15.829 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:01:15.836 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:15.849 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:15.887 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:16.165 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:01:16.176 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:16.215 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:16.390 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:01:16.404 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:01:16.448 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:01:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:01:16.504 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:16.534 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:16.726 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:01:16.740 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:01:16.784 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:01:16.845 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:01:16.866 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:01:16.904 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:01:17.087 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:01:17.101 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:01:17.146 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:01:17.173 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:01:17.194 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:17.231 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:17.474 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:01:17.489 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:01:17.532 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:01:17.609 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:01:17.630 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:01:17.693 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:01:17.810 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:01:17.825 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:01:17.859 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:01:17.995 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:01:18.016 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:01:18.054 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:01:18.113 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:01:18.127 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:01:18.170 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:01:18.332 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:01:18.344 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:01:18.373 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:01:18.499 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:01:18.514 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:01:18.557 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:01:18.710 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:01:18.731 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:01:18.768 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:01:18.860 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:01:18.875 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:01:18.918 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:01:19.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:01:19.116 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:01:19.154 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:01:19.171 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:01:19.186 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:01:19.221 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:01:19.390 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-04-26T23:01:19.402 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:01:19.432 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:01:19.541 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:01:19.556 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:01:19.599 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:01:19.744 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-04-26T23:01:19.764 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:01:19.802 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:01:19.936 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:01:19.951 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:01:19.994 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:01:20.231 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:01:20.251 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:01:20.273 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:01:20.287 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:01:20.289 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:01:20.322 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:01:20.574 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:01:20.589 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:01:20.641 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:01:20.672 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:01:20.693 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:20.730 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:20.969 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:01:20.985 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:01:21.027 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:01:21.249 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:01:21.261 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:21.324 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:21.330 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:01:21.345 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:01:21.389 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:01:21.602 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:01:21.623 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:01:21.660 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:01:21.691 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:01:21.707 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:01:21.741 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:01:22.044 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:01:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:01:22.059 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:01:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:22.113 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:01:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:22.397 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:01:22.413 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:01:22.455 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:01:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:01:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:23.667 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:01:23.682 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:01:23.725 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:01:23.995 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:01:24.009 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:01:24.053 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:01:24.365 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:01:24.379 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:01:24.422 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:01:24.742 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:01:24.757 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:01:24.792 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:01:25.028 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:01:25.043 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:01:25.065 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:01:25.078 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:01:25.086 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:25.132 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:25.441 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:01:25.456 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:01:25.499 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:01:25.778 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:01:25.801 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:01:25.835 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:01:25.844 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:01:25.850 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:01:25.885 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:01:26.163 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:01:26.178 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:01:26.221 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:01:26.247 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:01:26.268 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:01:26.314 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:01:26.533 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:01:26.548 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:01:26.591 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:01:26.701 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:01:26.721 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:01:26.767 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:01:26.902 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:01:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:01:26.961 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:01:27.137 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:01:27.157 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:01:27.195 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:01:27.272 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:01:27.287 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:27.330 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:27.548 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:01:27.568 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:01:27.614 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:01:27.701 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:01:27.716 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:27.760 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:27.984 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:01:28.004 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:01:28.029 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:01:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:01:28.050 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:01:28.079 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:01:28.390 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:01:28.405 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:01:28.437 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:01:28.448 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:01:28.457 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:01:28.503 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:01:28.760 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:01:28.775 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:28.809 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:28.823 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:01:28.843 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:01:28.898 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:01:29.112 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:01:29.127 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:29.162 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:29.267 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:01:29.288 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:01:29.334 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:01:29.721 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:01:29.742 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:01:29.774 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:01:29.779 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:01:29.788 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:29.832 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:30.091 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:01:30.111 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:01:30.149 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:01:30.510 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:01:30.531 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:01:30.560 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2024-04-26T23:01:30.568 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:01:30.574 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:30.618 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:30.830 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:01:30.850 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:01:30.904 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:01:30.905 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:01:30.919 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:30.954 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:31.191 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:01:31.212 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:01:31.249 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:01:31.316 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:01:31.331 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:31.374 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:31.577 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:01:31.598 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:01:31.635 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:01:31.752 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:01:31.767 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:31.810 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:31.930 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:01:31.950 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:01:31.988 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:01:32.146 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:01:32.161 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:01:32.204 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:01:32.383 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:01:32.403 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:01:32.436 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:01:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:01:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:01:32.574 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:01:32.719 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:01:32.740 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:01:32.777 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:01:33.122 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:01:33.142 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:01:33.180 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:01:33.500 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:01:33.512 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:01:33.545 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:01:33.559 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:01:33.575 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:01:33.595 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:01:33.877 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:01:33.898 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:01:33.936 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:01:34.040 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:01:34.054 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:01:34.098 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:01:34.264 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:01:34.284 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:01:34.322 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:01:34.451 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:01:34.465 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:34.509 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:34.600 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:01:34.621 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:01:34.658 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:01:34.812 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:01:34.827 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:01:34.870 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:01:35.046 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:01:35.067 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:01:35.096 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:01:35.182 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:01:35.197 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:01:35.240 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:01:35.526 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:01:35.541 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:35.601 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:35.666 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:01:35.687 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:01:35.724 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:01:36.044 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:01:36.064 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:01:36.102 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:01:36.455 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:01:36.476 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:01:36.513 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:01:36.739 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:01:36.753 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:01:36.823 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:01:36.825 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:01:36.845 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:01:36.883 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:01:37.186 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:01:37.206 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:37.244 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:37.301 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:01:37.315 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:01:37.359 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:01:37.649 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:01:37.670 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:37.699 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:37.729 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:01:37.743 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:01:37.867 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:01:38.002 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:01:38.022 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:01:38.060 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:01:38.184 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:01:38.199 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:01:38.242 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:01:38.346 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:01:38.367 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:01:38.396 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:01:38.732 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:01:38.753 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:38.799 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:38.918 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:01:38.932 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:38.976 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:39.302 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:01:39.323 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:39.369 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:39.863 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:01:39.878 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:01:39.912 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:01:40.106 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:01:40.126 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:40.172 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:40.201 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:01:40.215 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:01:40.259 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:01:40.571 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:01:40.585 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:01:40.620 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:01:40.898 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:01:40.913 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:01:40.956 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:01:41.269 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:01:41.284 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:01:41.327 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:01:41.417 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-04-26T23:01:41.439 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:41.475 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:41.663 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:01:41.679 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:01:41.722 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:01:41.878 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:01:41.900 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:41.945 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:42.016 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:01:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:01:42.075 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:01:42.378 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:01:42.393 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:01:42.406 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:01:42.427 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:01:42.472 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:42.960 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:01:42.981 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:43.026 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:43.116 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:01:43.129 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:43.183 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:43.362 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:01:43.387 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:01:43.428 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:01:43.502 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:01:43.516 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:01:43.560 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:01:43.814 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:01:43.826 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:01:43.847 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:01:43.863 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:01:43.864 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:01:43.896 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:01:44.474 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2024-04-26T23:01:44.490 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:01:44.532 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:01:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2024-04-26T23:01:44.801 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:01:44.843 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:01:45.095 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:01:45.116 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:01:45.138 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:01:45.153 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:01:45.153 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:01:45.196 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:01:45.481 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:01:45.502 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:01:45.530 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:01:45.567 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:01:45.581 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:45.625 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:45.876 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:01:45.897 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:45.925 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:46.263 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:01:46.283 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:01:46.329 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:01:46.607 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:01:46.628 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:01:46.665 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:01:47.018 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:01:47.039 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:47.076 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:47.605 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:01:47.620 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:47.663 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:48.017 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:01:48.032 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:48.067 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:48.403 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:01:48.415 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:01:48.419 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:01:48.436 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:01:48.461 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:01:48.481 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:01:48.722 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:01:48.737 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:48.780 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:49.002 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:01:49.023 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:01:49.032 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:01:49.048 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:49.085 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:01:49.090 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:49.360 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:01:49.376 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:49.418 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:49.422 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:01:49.443 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:01:49.565 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:01:49.680 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:01:49.695 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:01:49.729 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:01:49.901 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:01:49.914 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:01:49.951 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:01:50.067 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:01:50.083 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:01:50.125 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:01:50.463 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:01:50.479 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:01:50.520 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:01:50.652 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:01:50.674 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:50.718 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:50.942 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:01:50.958 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:01:51.000 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:01:51.245 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:01:51.260 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:01:51.303 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:01:51.698 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:01:51.712 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:01:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:01:52.013 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:01:52.034 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:01:52.071 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:01:52.076 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:01:52.091 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:01:52.134 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:01:52.341 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:01:52.362 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:01:52.399 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:01:52.437 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:01:52.452 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:01:52.495 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:01:52.744 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:01:52.765 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:01:52.806 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:01:52.810 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:01:52.821 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:01:52.865 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:01:53.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:01:53.126 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:01:53.180 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:01:53.226 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:01:53.238 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:01:53.276 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:01:53.517 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:01:53.538 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:01:53.575 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:01:53.604 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:01:53.616 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:01:53.654 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:01:53.929 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:01:53.950 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:01:53.995 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:01:54.099 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:01:54.110 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:01:54.149 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:01:54.298 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:01:54.319 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:01:54.356 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:01:54.452 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:01:54.463 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:01:54.502 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:01:54.685 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:01:54.706 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:01:54.751 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:01:54.788 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:01:54.799 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:01:54.838 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:01:55.200 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:01:55.210 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:01:55.249 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:01:55.465 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:01:55.478 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:01:55.514 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:55.544 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:01:55.555 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:01:55.594 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:01:55.868 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:01:55.889 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:01:55.934 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:01:56.254 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:01:56.275 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:01:56.306 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:01:56.317 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:56.320 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:01:56.357 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:56.615 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-04-26T23:01:56.627 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:01:56.664 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:01:56.951 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-04-26T23:01:56.963 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:01:57.001 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:01:57.017 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:01:57.029 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:57.067 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:57.312 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:01:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:01:57.334 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:01:57.362 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:01:57.614 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:01:57.733 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:01:57.740 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:01:57.755 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:01:57.799 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:57.970 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:01:58.381 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:01:59.006 INFO:teuthology.orchestra.run.smithi148.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:01:59.056 INFO:teuthology.orchestra.run.smithi148.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:01:59.091 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:01:59.902 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user cephadm....done 2024-04-26T23:02:00.073 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:02:00.104 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:02:00.125 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:02:00.162 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:00.349 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:02:00.525 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:02:00.547 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:02:00.600 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:02:00.616 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:00.701 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:02:00.894 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:02:00.907 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:02:00.936 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:02:00.961 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:02:01.180 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:02:01.192 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:02:01.230 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:01.254 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:02:01.379 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:02:01.516 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:02:01.538 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:02:01.583 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:01.698 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:02:01.810 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:02:01.823 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:02:01.860 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:02:02.213 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:02:02.235 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:02:02.279 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:02:02.309 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:02:02.578 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:02:02.643 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:02:02.664 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:02:02.709 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:02:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:02:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:02:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:02:03.155 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:02:03.230 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:02:03.489 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:02:03.671 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:02:03.692 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:02:03.745 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:02:03.765 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:02:04.000 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:04.073 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:02:04.095 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:02:04.148 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:02:04.284 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:02:04.410 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:02:04.510 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:02:04.531 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:02:04.536 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:02:04.584 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:02:04.804 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:02:04.921 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:02:04.929 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:02:04.942 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:02:04.987 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:02:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:02:05.357 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:02:05.379 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:02:05.424 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:02:05.649 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:02:05.677 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:02:05.725 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:02:05.744 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:02:05.765 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:02:05.810 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:02:05.851 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:02:06.163 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:02:06.185 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:02:06.219 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:02:06.229 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:02:06.345 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:02:06.541 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:02:06.563 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:02:06.607 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:02:06.621 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:02:06.897 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:02:07.207 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:02:07.308 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:02:07.378 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:02:07.400 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:02:07.445 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:02:07.764 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:02:07.786 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:02:07.831 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:02:07.985 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:02:08.117 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:02:08.139 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:02:08.183 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:02:08.253 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:02:08.395 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:02:08.522 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:02:08.529 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:02:08.551 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:02:08.595 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:02:08.839 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:02:08.898 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:02:08.910 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:02:08.948 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:02:09.265 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:02:09.508 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:02:09.735 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:02:09.757 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:02:09.802 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:09.893 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:02:10.195 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:02:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:02:10.630 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:02:10.642 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:02:10.679 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:10.863 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:02:11.015 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:02:11.131 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:02:11.240 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:02:11.386 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:02:11.558 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:02:11.650 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:02:11.885 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:02:11.980 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:02:12.436 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:02:12.671 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:13.123 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:02:13.204 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-04-26T23:02:13.327 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:02:13.342 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:13.459 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:02:13.604 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:02:13.727 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:02:13.846 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:02:13.886 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:02:13.972 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:02:14.012 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:02:14.232 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:02:14.322 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:02:14.491 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:02:14.590 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:02:14.617 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:02:14.824 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:14.928 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:02:14.934 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:02:15.269 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:02:15.288 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:02:15.528 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:02:15.555 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:02:15.804 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:02:15.823 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:02:16.072 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:02:16.100 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:02:16.340 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:02:16.401 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:02:16.590 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:02:16.652 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:02:16.691 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:02:16.929 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:02:16.968 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:02:17.094 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:02:17.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:17.386 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:02:17.439 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:02:17.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:02:17.712 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:02:17.724 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:02:17.980 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:02:17.992 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:02:18.106 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:02:18.118 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:02:18.207 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:02:18.279 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:02:18.378 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:02:18.526 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:02:18.676 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:02:18.789 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:02:18.834 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:02:18.923 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:02:19.049 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:02:19.078 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:02:19.346 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:02:19.408 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:02:19.472 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:02:19.568 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:02:19.731 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:19.819 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:02:19.857 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:02:20.062 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:02:20.167 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:02:20.355 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:02:20.459 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:02:20.481 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:02:20.752 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:02:20.955 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:02:21.166 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:02:21.256 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:02:21.425 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:02:21.507 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:02:21.577 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:02:21.678 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:02:21.767 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:02:21.954 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:02:22.152 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:02:22.445 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:02:22.814 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:02:22.915 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:22.983 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:02:23.024 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:23.134 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:02:23.275 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:02:23.500 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:23.594 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:02:23.630 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:23.756 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:02:23.929 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:02:24.041 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:24.141 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:24.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:02:24.276 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:24.322 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:24.486 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:02:24.486 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:02:24.615 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:02:24.950 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:02:25.177 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:25.312 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:25.455 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:25.581 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:25.773 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:02:26.098 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:02:26.358 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:26.492 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:02:26.760 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:02:26.861 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:02:26.995 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:02:27.029 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.180 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.297 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:02:27.297 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.398 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.499 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.548 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:02:27.617 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:27.857 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:27.983 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:02:28.170 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2024-04-26T23:02:28.318 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:02:28.563 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2024-04-26T23:02:28.569 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:02:28.707 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2024-04-26T23:02:28.726 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:02:28.812 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:02:28.869 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:02:29.072 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:02:29.256 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:02:29.323 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:02:29.582 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:02:29.741 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:02:29.934 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:30.026 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:02:30.136 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:02:30.143 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:02:30.143 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:02:30.412 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:02:30.713 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:02:30.809 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:30.937 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:30.965 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:02:31.115 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:02:31.241 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:02:31.330 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:02:31.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:02:31.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:02:31.568 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:02:31.711 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:02:32.096 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:02:32.097 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:32.380 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:02:32.433 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:02:32.506 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:02:32.757 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:02:32.883 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:02:33.107 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:33.201 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:02:33.313 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:02:33.313 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:02:33.502 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:02:33.762 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:02:33.950 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:33.973 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:02:34.163 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:02:34.163 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:02:34.240 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:02:34.517 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:02:34.793 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:02:34.810 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:35.146 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:02:35.146 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:02:35.153 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:02:35.429 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:02:35.773 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:02:35.804 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:35.899 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:35.938 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:36.042 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:36.073 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:36.168 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:02:36.265 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:02:36.265 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:02:36.496 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:36.622 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:36.748 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:02:36.899 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.025 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.066 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.150 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.192 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.302 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.327 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:37.539 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:02:37.539 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:02:37.663 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:02:37.772 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:02:37.915 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:02:38.078 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:38.213 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:38.339 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:38.498 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:38.733 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:02:39.158 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:02:39.882 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:02:39.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:02:39.961 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-26T23:02:40.014 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.137 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-26T23:02:40.138 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-26T23:02:40.140 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.266 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:02:40.307 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:02:40.308 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:02:40.308 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:02:40.308 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:02:40.309 INFO:teuthology.orchestra.run.smithi148.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:02:40.310 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-04-26T23:02:40.310 INFO:teuthology.orchestra.run.smithi148.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:02:40.310 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:02:40.310 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:02:40.365 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-04-26T23:02:40.365 INFO:teuthology.orchestra.run.smithi148.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:02:40.366 INFO:teuthology.orchestra.run.smithi148.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:02:40.366 INFO:teuthology.orchestra.run.smithi148.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:02:40.366 INFO:teuthology.orchestra.run.smithi148.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:02:40.367 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:02:40.367 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:02:40.367 INFO:teuthology.orchestra.run.smithi148.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:02:40.368 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2024-04-26T23:02:40.368 INFO:teuthology.orchestra.run.smithi148.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:02:40.418 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.455 INFO:teuthology.orchestra.run.smithi148.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:02:40.455 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:02:40.455 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:02:40.455 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:02:40.552 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.625 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:02:40.630 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:02:40.653 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:40.663 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:02:40.664 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:02:40.665 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:02:40.672 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:02:40.672 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:02:40.674 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:02:40.675 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:02:40.676 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:02:40.677 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:02:40.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:02:40.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:02:40.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:02:40.713 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:02:41.028 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:02:41.030 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:02:41.030 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:02:41.036 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:02:41.037 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:02:41.043 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:02:41.045 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:02:41.118 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:02:41.119 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:02:41.140 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:02:41.140 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:02:41.152 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:02:41.179 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:02:41.188 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:02:41.189 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:02:41.190 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:02:41.191 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:02:41.213 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:02:41.215 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:02:41.238 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-04-26T23:02:41.497 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:02:41.498 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:02:41.498 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:02:41.498 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:02:41.499 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:02:41.499 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:02:41.524 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:02:41.525 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:02:41.707 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-04-26T23:02:41.875 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-04-26T23:02:41.886 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:02:41.905 INFO:teuthology.orchestra.run.smithi148.stdout:Preconfiguring packages ... 2024-04-26T23:02:42.029 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:02:42.049 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 55.7 MB in 1s (48.5 MB/s) 2024-04-26T23:02:42.336 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:02:42.340 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:42.364 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:02:42.473 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:42.929 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:43.123 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:02:43.138 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:02:43.138 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:02:43.634 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:43.782 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:44.197 INFO:teuthology.orchestra.run.smithi148.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:02:44.255 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:02:44.255 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:02:44.462 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package flex. 2024-04-26T23:02:44.532 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:02:44.536 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:02:44.577 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:02:44.776 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:45.071 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:02:45.113 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:02:45.407 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:02:45.653 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:45.798 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:02:45.877 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:02:45.877 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:02:46.396 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:46.428 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:02:46.432 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:46.558 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:46.637 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:02:46.637 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:02:46.945 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:47.064 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:47.388 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:02:47.453 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:02:47.454 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:02:47.756 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package bison. 2024-04-26T23:02:47.831 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:02:47.835 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:02:47.884 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:02:47.991 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:48.142 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:48.276 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:02:48.285 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:48.290 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:02:48.326 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:02:48.481 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:02:48.481 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:02:48.637 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package dump. 2024-04-26T23:02:48.652 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:02:48.704 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:02:48.983 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package indent. 2024-04-26T23:02:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:02:49.029 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:49.063 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:02:49.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:49.306 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:49.318 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:02:49.334 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:02:49.377 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:02:49.457 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:02:49.698 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:02:49.713 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:02:49.756 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:02:49.827 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:02:49.936 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:02:50.008 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:02:50.024 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:02:50.066 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:02:50.080 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:02:50.437 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:02:50.453 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:02:50.487 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:02:50.706 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:02:50.722 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:02:50.764 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:02:50.855 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:02:51.017 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:02:51.033 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:02:51.075 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:02:51.438 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:02:51.453 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:02:51.520 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:02:51.522 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:02:51.525 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:02:51.628 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-26T23:02:51.828 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-26T23:02:51.829 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:02:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:02:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:02:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T23:02:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-04-26T23:02:52.022 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:02:52.023 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-04-26T23:02:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:02:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:02:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:02:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:02:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:02:52.025 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-04-26T23:02:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:02:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:02:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:02:52.065 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-04-26T23:02:52.066 INFO:teuthology.orchestra.run.smithi157.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:02:52.066 INFO:teuthology.orchestra.run.smithi157.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:02:52.067 INFO:teuthology.orchestra.run.smithi157.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:02:52.067 INFO:teuthology.orchestra.run.smithi157.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:02:52.067 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:02:52.067 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:02:52.067 INFO:teuthology.orchestra.run.smithi157.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:02:52.068 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-04-26T23:02:52.069 INFO:teuthology.orchestra.run.smithi157.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:02:52.128 INFO:teuthology.orchestra.run.smithi157.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:02:52.128 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:02:52.128 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:02:52.128 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:02:52.295 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:02:52.302 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:02:52.341 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:02:52.342 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:02:52.343 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:02:52.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:02:52.355 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:02:52.357 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:02:52.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:02:52.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:02:52.361 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:02:52.363 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:02:52.385 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:02:52.385 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:02:52.387 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:02:52.792 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:02:52.794 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:02:52.794 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:02:52.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:02:52.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:02:52.806 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:02:52.806 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:02:52.807 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:02:52.815 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:02:52.816 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:02:52.823 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:02:52.843 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:02:52.843 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:02:52.854 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:02:52.857 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:02:52.880 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:02:52.884 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:02:52.885 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:02:52.885 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:02:52.885 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:02:52.909 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:02:52.910 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:02:53.101 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:02:53.116 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:02:53.159 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:02:53.244 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:02:53.244 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:02:53.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:02:53.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:02:53.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:02:53.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:02:53.261 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:02:53.261 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:02:53.496 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:02:53.511 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:02:53.554 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:02:53.670 INFO:teuthology.orchestra.run.smithi157.stdout:Preconfiguring packages ... 2024-04-26T23:02:53.864 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 55.7 MB in 1s (47.0 MB/s) 2024-04-26T23:02:53.890 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:02:53.906 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:02:53.957 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:02:54.162 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-26T23:02:54.167 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:54.268 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:02:54.283 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:02:54.301 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:54.326 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:02:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:02:54.687 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:02:54.729 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:02:54.958 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:02:55.040 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:02:55.056 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:02:55.099 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:02:55.385 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:02:55.401 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:02:55.443 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:02:55.695 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:02:55.711 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:02:55.753 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:02:56.019 INFO:teuthology.orchestra.run.smithi157.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:02:56.249 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:02:56.264 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:02:56.307 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:02:56.329 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package flex. 2024-04-26T23:02:56.418 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-26T23:02:56.423 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:02:56.476 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:02:56.770 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:02:56.786 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:02:56.820 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:02:57.054 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:02:57.233 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:02:57.434 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:02:57.451 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:02:57.501 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:02:57.665 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:02:58.159 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ppp. 2024-04-26T23:02:58.174 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:02:58.216 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-26T23:02:58.221 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:58.465 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:58.537 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:02:58.888 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:02:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:02:58.946 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:02:59.053 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:02:59.182 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:02:59.190 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:02:59.197 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:02:59.241 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:02:59.519 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:02:59.533 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:02:59.547 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:02:59.568 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:02:59.849 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package bison. 2024-04-26T23:02:59.855 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:02:59.870 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:02:59.914 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:02:59.928 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-26T23:02:59.932 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:03:00.001 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:03:00.452 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:03:00.474 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:03:00.477 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:03:00.491 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:03:00.527 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:03:00.544 INFO:teuthology.orchestra.run.smithi148.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:03:00.567 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:03:00.922 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package dump. 2024-04-26T23:03:00.944 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:03:00.989 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:03:01.034 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:03:01.049 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:01.095 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:01.359 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package indent. 2024-04-26T23:03:01.381 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:01.434 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:03:01.745 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:03:01.767 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:03:01.828 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:03:02.207 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:03:02.229 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:03:02.274 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:03:02.577 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:03:02.599 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:03:02.652 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:03:02.714 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:03:02.729 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:03:02.772 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:03:03.016 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:03:03.031 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:03:03.074 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:03:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:03:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:03:03.164 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:03.318 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:03:03.333 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:03:03.376 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:03:03.533 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:03:03.545 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:03:03.583 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:03.662 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:03:03.677 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:03:03.712 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:03:03.852 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:03:03.874 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:03:03.936 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:03:03.998 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package tcl. 2024-04-26T23:03:04.014 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:03:04.061 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:03:04.409 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:03:04.423 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:03:04.425 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:03:04.445 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:03:04.467 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:03:04.498 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:03:04.830 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:03:04.846 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:03:04.880 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:03:05.258 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:03:05.274 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:03:05.324 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:03:05.611 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:03:05.822 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:03:05.940 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:03:06.041 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:06.192 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:03:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:03:06.314 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:03:06.318 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:03:06.359 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:06.444 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:06.645 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:03:06.658 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:03:06.704 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:07.115 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:03:07.137 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:03:07.190 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:07.398 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:03:07.500 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:03:07.618 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:03:07.640 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:03:07.684 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:03:07.877 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:03:07.877 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:03:08.054 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:03:08.076 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:03:08.154 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:03:08.569 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:03:08.574 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:03:08.596 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:08.649 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:08.720 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:03:08.854 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:03:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:03:09.102 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:03:09.106 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:03:09.113 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:09.152 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:09.224 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:09.341 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:03:09.468 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:03:09.547 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:03:09.569 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:09.614 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:09.842 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:03:09.854 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:03:09.883 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:03:10.225 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:03:10.351 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:03:10.420 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:03:10.442 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:03:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:03:10.487 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:03:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:10.636 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:03:10.762 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:03:10.798 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:03:10.820 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:03:10.865 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:10.888 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:03:11.062 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:03:11.146 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:03:11.208 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:03:11.317 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:03:11.470 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:03:11.522 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:03:11.544 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:03:11.594 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:11.596 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:03:11.720 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:03:11.888 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:03:12.014 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:03:12.254 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ppp. 2024-04-26T23:03:12.276 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:03:12.594 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout:- enp3s0f1 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:03:12.615 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:12.748 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:03:12.984 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:03:13.006 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:03:13.051 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:03:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:03:13.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:03:13.291 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:03:13.320 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:03:13.607 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:03:13.657 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:03:13.678 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:03:13.724 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:03:14.027 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:03:14.049 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:14.093 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:14.309 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:14.452 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:14.577 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:03:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:03:15.642 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:03:15.654 INFO:teuthology.orchestra.run.smithi148.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:03:15.664 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:03:15.726 INFO:teuthology.orchestra.run.smithi157.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:03:15.756 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:03:15.910 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:15.910 INFO:teuthology.orchestra.run.smithi148.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:03:16.193 INFO:teuthology.orchestra.run.smithi148.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:03:16.193 INFO:teuthology.orchestra.run.smithi148.stdout:Removing obsolete dictionary files: 2024-04-26T23:03:16.307 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:03:16.329 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:03:16.385 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:16.909 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:03:17.521 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:17.794 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:03:17.817 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:03:17.846 INFO:teuthology.orchestra.run.smithi148.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:03:17.860 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:03:17.861 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:03:17.902 INFO:teuthology.orchestra.run.smithi148.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:This user must also own the server process. 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:The default text search configuration will be set to "english". 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:Data page checksums are disabled. 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:03:17.904 INFO:teuthology.orchestra.run.smithi148.stdout:creating subdirectories ... ok 2024-04-26T23:03:17.904 INFO:teuthology.orchestra.run.smithi148.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:03:17.927 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default max_connections ... 100 2024-04-26T23:03:17.960 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:03:17.975 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:03:17.976 INFO:teuthology.orchestra.run.smithi148.stdout:creating configuration files ... ok 2024-04-26T23:03:18.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:03:18.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:03:18.139 INFO:teuthology.orchestra.run.smithi148.stdout:running bootstrap script ... ok 2024-04-26T23:03:18.171 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:03:18.415 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:03:18.428 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:03:18.465 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:03:18.784 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:03:18.798 INFO:teuthology.orchestra.run.smithi148.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:03:18.806 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:03:18.850 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:03:19.162 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl. 2024-04-26T23:03:19.183 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:03:19.232 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:03:19.291 INFO:teuthology.orchestra.run.smithi148.stdout:syncing data to disk ... ok 2024-04-26T23:03:19.564 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:03:19.587 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:03:19.648 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:03:19.835 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:03:20.027 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:03:20.049 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:03:20.094 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:03:20.472 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:03:20.495 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:03:20.548 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:03:20.867 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:03:21.103 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:03:21.238 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:03:21.364 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:21.490 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:03:21.599 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:03:21.734 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:22.226 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:03:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:03:22.695 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:03:22.695 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:03:22.812 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:22.938 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:03:23.047 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:03:23.165 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:23.209 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:03:23.316 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:23.343 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:03:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:03:23.576 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:03:23.576 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:03:23.612 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:03:23.780 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:03:23.906 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:24.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:03:24.132 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:03:24.334 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:03:24.452 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:03:24.779 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:03:24.813 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:03:24.931 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:03:25.055 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:03:25.148 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:03:25.199 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:25.317 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:03:25.935 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:03:26.061 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:03:26.212 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:03:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:03:26.333 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:03:26.406 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:03:26.450 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:03:26.531 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:03:26.683 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:03:26.809 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:26.935 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:03:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:03:26.990 DEBUG:teuthology.parallel:result is None 2024-04-26T23:03:27.136 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:03:27.263 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:- enp3s0f1 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:03:27.770 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:27.891 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:03:28.236 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:03:28.595 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:03:29.115 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:03:29.258 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:03:29.384 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:03:29.510 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:03:30.386 INFO:teuthology.orchestra.run.smithi157.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:03:30.585 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:30.586 INFO:teuthology.orchestra.run.smithi157.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:03:30.785 INFO:teuthology.orchestra.run.smithi157.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:03:30.786 INFO:teuthology.orchestra.run.smithi157.stdout:Removing obsolete dictionary files: 2024-04-26T23:03:31.403 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:03:31.846 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:03:32.171 INFO:teuthology.orchestra.run.smithi157.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:03:32.192 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:This user must also own the server process. 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:The default text search configuration will be set to "english". 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:32.241 INFO:teuthology.orchestra.run.smithi157.stdout:Data page checksums are disabled. 2024-04-26T23:03:32.242 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:32.242 INFO:teuthology.orchestra.run.smithi157.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:03:32.242 INFO:teuthology.orchestra.run.smithi157.stdout:creating subdirectories ... ok 2024-04-26T23:03:32.242 INFO:teuthology.orchestra.run.smithi157.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:03:32.257 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default max_connections ... 100 2024-04-26T23:03:32.277 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:03:32.287 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:03:32.288 INFO:teuthology.orchestra.run.smithi157.stdout:creating configuration files ... ok 2024-04-26T23:03:32.404 INFO:teuthology.orchestra.run.smithi157.stdout:running bootstrap script ... ok 2024-04-26T23:03:33.150 INFO:teuthology.orchestra.run.smithi157.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:03:33.966 INFO:teuthology.orchestra.run.smithi157.stdout:syncing data to disk ... ok 2024-04-26T23:03:34.377 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:03:37.186 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:37.306 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:03:37.432 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:03:37.558 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:03:37.684 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:03:37.938 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:03:37.938 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:03:38.562 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:03:38.662 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:03:38.981 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:03:39.125 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:03:40.578 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:03:40.677 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:03:41.178 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:03:41.183 DEBUG:teuthology.parallel:result is None 2024-04-26T23:03:41.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:03:41.333 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:03:41.357 INFO:teuthology.orchestra.run.smithi148.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:03:41.358 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:03:41.358 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:03:41.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:03:41.501 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:03:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:03:41.520 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:03:41.520 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:03:41.522 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:03:41.522 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:41.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:03:41.544 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:41.544 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:03:41.575 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:03:41.575 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:41.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:03:41.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:03:41.672 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:41.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:03:41.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:03:41.738 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:03:41.738 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:41.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:03:41.759 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:03:41.820 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:41.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:03:41.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:03:41.887 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:03:41.887 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:41.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:03:41.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:03:41.968 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:41.968 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:03:41.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:03:42.034 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:03:42.112 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:03:42.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-04-26T23:03:42.116 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-04-26T23:03:42.133 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:03:42.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:03:42.179 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:03:42.196 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:03:42.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:03:42.243 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:03:42.267 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:03:42.267 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:03:42.267 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:03:42.267 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:42.267 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:03:42.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:03:42.409 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:42.409 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:03:42.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:03:42.495 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:03:42.495 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:03:42.496 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7675285', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFMQsndgvOkE+HQfFMhiZazJy3D/9qYbaan3SWWXeYmBZ+sl1S45UpNNqC2XaJ1tXxu6qlBWjs5wg8r8Yt/6Q6I=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmUkvWwwxZnswDMsTyvhZ/VuWmsNZNQIsdDa9amuctC1APVnQaJ64IJpMvDSFBboPdd5lH+nvjFB2BYeExWVNU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:03:42.496 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:03:42.499 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:03:42.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:03:42.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:03:42.595 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:42.595 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:03:42.625 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:03:42.625 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 885 Links: 1 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-26 22:57:12.449595694 +0000 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-26 22:57:12.169598196 +0000 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-26 22:57:12.169598196 +0000 2024-04-26T23:03:42.677 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-04-26 22:57:12.169598196 +0000 2024-04-26T23:03:42.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:03:42.738 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-26T23:03:42.738 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-26T23:03:42.739 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000408076 s, 1.3 MB/s 2024-04-26T23:03:42.741 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:03:42.795 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 904 Links: 1 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-26 22:57:13.029590514 +0000 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-26 22:57:12.721593265 +0000 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-26 22:57:12.721593265 +0000 2024-04-26T23:03:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-04-26 22:57:12.721593265 +0000 2024-04-26T23:03:42.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:03:42.907 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-26T23:03:42.907 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-26T23:03:42.907 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000381449 s, 1.3 MB/s 2024-04-26T23:03:42.909 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:03:42.963 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-04-26T23:03:43.013 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:03:43.013 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.013 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-04-26T23:03:43.014 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.014 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-26 22:57:13.625585191 +0000 2024-04-26T23:03:43.014 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-26 22:57:13.329587835 +0000 2024-04-26T23:03:43.014 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-26 22:57:13.329587835 +0000 2024-04-26T23:03:43.014 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-04-26 22:57:13.329587835 +0000 2024-04-26T23:03:43.014 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:03:43.073 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-26T23:03:43.073 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-26T23:03:43.073 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000357448 s, 1.4 MB/s 2024-04-26T23:03:43.075 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:03:43.130 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-26 22:57:14.185580189 +0000 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-26 22:57:13.921582547 +0000 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-26 22:57:13.921582547 +0000 2024-04-26T23:03:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-04-26 22:57:13.921582547 +0000 2024-04-26T23:03:43.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:03:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-26T23:03:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-26T23:03:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000615365 s, 832 kB/s 2024-04-26T23:03:43.244 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:03:43.298 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:43.298 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:43.298 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:03:43.304 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:03:43.304 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-26 22:56:53.015317310 +0000 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-26 22:56:52.755319631 +0000 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-26 22:56:52.755319631 +0000 2024-04-26T23:03:43.352 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-26T23:03:43.352 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:03:43.406 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-26T23:03:43.410 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-26T23:03:43.410 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000357997 s, 1.4 MB/s 2024-04-26T23:03:43.411 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:03:43.461 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-04-26T23:03:43.507 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-26 22:56:53.235315344 +0000 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-26 22:56:53.231315380 +0000 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-26 22:56:53.231315380 +0000 2024-04-26T23:03:43.508 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-26T23:03:43.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:03:43.562 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-26T23:03:43.562 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-26T23:03:43.562 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000345483 s, 1.5 MB/s 2024-04-26T23:03:43.563 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:03:43.613 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-26 22:56:54.015308378 +0000 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-26 22:56:53.751310736 +0000 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-26 22:56:53.751310736 +0000 2024-04-26T23:03:43.660 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-26T23:03:43.660 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:03:43.714 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-26T23:03:43.714 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-26T23:03:43.714 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000327845 s, 1.6 MB/s 2024-04-26T23:03:43.716 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:03:43.769 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-04-26T23:03:43.815 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-26 22:56:54.523303839 +0000 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-26 22:56:54.259306197 +0000 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-26 22:56:54.259306197 +0000 2024-04-26T23:03:43.816 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-26T23:03:43.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:03:43.870 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-26T23:03:43.870 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-26T23:03:43.870 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000342747 s, 1.5 MB/s 2024-04-26T23:03:43.871 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:03:43.921 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:43.921 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:03:43.921 INFO:tasks.ceph:Generating config... 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:03:43.922 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:03:43.923 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-26T23:03:43.923 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:03:43.924 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:03:43.924 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:03:43.924 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T23:03:43.925 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:03:43.926 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T23:03:43.926 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:03:43.926 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:03:43.926 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:03:43.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:03:43.970 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:03:43.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:03:44.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:03:44.144 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.148'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2024-04-26T23:03:44.144 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.148,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:03:44.145 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:44.145 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:03:44.192 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.148 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:44.279 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:44.279 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: generated fsid d6966320-e81f-47bf-b2a0-b4169b90f47b 2024-04-26T23:03:44.279 INFO:teuthology.orchestra.run.smithi148.stdout:setting min_mon_release = quincy 2024-04-26T23:03:44.279 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 0 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:fsid d6966320-e81f-47bf-b2a0-b4169b90f47b 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:last_changed 2024-04-26T23:03:44.286356+0000 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-04-26T23:03:44.286356+0000 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:min_mon_release 17 (quincy) 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:election_strategy: 1 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-04-26T23:03:44.280 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:03:44.283 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:03:44.290 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d6966320-e81f-47bf-b2a0-b4169b90f47b... 2024-04-26T23:03:44.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:03:44.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.366 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:03:44.367 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.368 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.148,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on skipped message = False 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = d6966320-e81f-47bf-b2a0-b4169b90f47b 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-04-26T23:03:44.369 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-04-26T23:03:44.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression mode = aggressive 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-04-26T23:03:44.371 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay max = 1 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay probability = 0.005 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay type = client mds 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 2500 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: osd blocked scrub grace period = 3600 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: osd max markdown count = 1000 2024-04-26T23:03:44.372 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-26T23:03:44.373 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:03:44.374 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: mon down mkfs grace = 300 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: client_shutdown_timeout = 120 2024-04-26T23:03:44.375 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-04-26T23:03:44.376 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal fragment size max = 10000 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal merge size = 5 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split bits = 3 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split size = 100 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds oft prefetch dirfrags = True 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds_dir_prefetch = True 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay max = 1 2024-04-26T23:03:44.377 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay probability = 0.005 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay type = client mds osd 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 2500 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-04-26T23:03:44.378 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:03:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:03:44.380 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.148,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = d6966320-e81f-47bf-b2a0-b4169b90f47b 2024-04-26T23:03:44.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-04-26T23:03:44.382 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-04-26T23:03:44.383 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression mode = aggressive 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay max = 1 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay probability = 0.005 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay type = client mds 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 2500 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-04-26T23:03:44.384 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-26T23:03:44.385 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:03:44.386 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: mon down mkfs grace = 300 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:03:44.387 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: client_shutdown_timeout = 120 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.e] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.f] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2024-04-26T23:03:44.388 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds balancer = 20 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal fragment size max = 10000 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal merge size = 5 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal split bits = 3 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds bal split size = 100 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds oft prefetch dirfrags = True 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds_dir_prefetch = True 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay max = 1 2024-04-26T23:03:44.389 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay probability = 0.005 2024-04-26T23:03:44.390 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject delay type = client mds osd 2024-04-26T23:03:44.390 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 2500 2024-04-26T23:03:44.390 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2024-04-26T23:03:44.390 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2024-04-26T23:03:44.390 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2024-04-26T23:03:44.392 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:03:44.392 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:03:44.488 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:03:44.488 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:44.488 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:03:44.496 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:44.497 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:03:44.548 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:03:44.548 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:44.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:03:44.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:03:44.619 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:03:44.619 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:44.668 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:03:44.668 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:44.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:03:44.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:03:44.691 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:03:44.691 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:44.740 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:03:44.740 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:03:44.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:03:44.793 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:03:44.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:03:44.845 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:03:44.860 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:03:44.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:03:44.914 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:03:44.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:03:44.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:03:45.033 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:03:45.038 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T23:03:45.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T23:03:45.152 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T23:03:45.156 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-26T23:03:45.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:03:45.221 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:03:45.224 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:03:45.279 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:03:45.362 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:03:45.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T23:03:45.419 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T23:03:45.504 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T23:03:45.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-26T23:03:45.563 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:03:45.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:03:45.606 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:03:45.623 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:03:45.623 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:03:45.623 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:03:45.687 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:45.687 INFO:tasks.ceph:role: osd.0 2024-04-26T23:03:45.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:03:45.687 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:03:45.754 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:03:45.754 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:03:45.754 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:03:45.755 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:03:46.167 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-04-26T23:03:46.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-04-26T23:03:46.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:03:46.294 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:03:46.310 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:03:46.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:03:46.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:03:46.375 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:46.375 INFO:tasks.ceph:role: osd.1 2024-04-26T23:03:46.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:03:46.375 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:03:46.443 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:03:46.807 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-04-26T23:03:46.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-04-26T23:03:46.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:03:46.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:03:46.948 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:03:46.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:03:46.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:03:47.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:47.011 INFO:tasks.ceph:role: osd.2 2024-04-26T23:03:47.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:03:47.011 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:03:47.078 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:03:47.078 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:03:47.078 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:03:47.079 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:03:47.461 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-04-26T23:03:47.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-04-26T23:03:47.464 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:03:47.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:03:47.613 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:03:47.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:03:47.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:03:47.676 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:03:47.676 INFO:tasks.ceph:role: osd.3 2024-04-26T23:03:47.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:03:47.676 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:03:47.752 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:03:47.753 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:03:48.140 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-04-26T23:03:48.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-04-26T23:03:48.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:03:48.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:03:48.281 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:03:48.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:03:48.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:48.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.406+0000 7f533f97a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:03:48.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.414+0000 7f533f97a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:03:48.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.414+0000 7f533f97a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:03:48.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.414+0000 7f533f97a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:03:48.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.414+0000 7f533f97a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:03:48.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:48.418+0000 7f533f97a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:03:51.475 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:03:51.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:51.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:03:51.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:03:51.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:03:51.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:03:51.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:03:51.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:51.594+0000 7fea065887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:03:54.627 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:03:54.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:54.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.746+0000 7f384e2727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:03:54.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.750+0000 7f384e2727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:03:54.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.750+0000 7f384e2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:03:54.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.750+0000 7f384e2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:03:54.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.750+0000 7f384e2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:03:54.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:54.750+0000 7f384e2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:03:57.799 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:03:57.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:03:57.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.926+0000 7f1c2fe127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:03:57.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.926+0000 7f1c2fe127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:03:57.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.926+0000 7f1c2fe127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:03:57.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.926+0000 7f1c2fe127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:03:57.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.926+0000 7f1c2fe127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:03:57.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:03:57.930+0000 7f1c2fe127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:04:00.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:04:00.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:04:00.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:04:00.991 INFO:tasks.ceph:role: osd.4 2024-04-26T23:04:00.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:04:00.991 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:04:01.048 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:04:01.073 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-26T23:04:01.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-26T23:04:01.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:04:01.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:04:01.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:04:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:04:01.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:04:01.237 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:04:01.237 INFO:tasks.ceph:role: osd.5 2024-04-26T23:04:01.237 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:04:01.237 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:04:01.292 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:04:01.315 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-26T23:04:01.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-26T23:04:01.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:04:01.375 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:04:01.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:04:01.428 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:04:01.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:04:01.480 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:04:01.480 INFO:tasks.ceph:role: osd.6 2024-04-26T23:04:01.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:04:01.480 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:04:01.535 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:04:01.535 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:04:01.535 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:04:01.535 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:04:01.535 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:04:01.536 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:04:01.536 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:04:01.536 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:04:01.536 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:04:01.536 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:04:01.559 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-26T23:04:01.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-26T23:04:01.560 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:04:01.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:04:01.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:04:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:04:01.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:04:01.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:04:01.720 INFO:tasks.ceph:role: osd.7 2024-04-26T23:04:01.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:04:01.720 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:04:01.775 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:04:01.775 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:04:01.775 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:04:01.775 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:04:01.775 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:04:01.776 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:04:01.776 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:04:01.776 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:04:01.776 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:04:01.776 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:04:01.801 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-26T23:04:01.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-26T23:04:01.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:04:01.863 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:04:01.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:04:01.916 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:04:01.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:02.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:04:02.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:04:02.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:04:02.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:04:02.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:04:02.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:02.077+0000 7f4dc7d877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:04:05.043 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:04:05.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:05.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:04:05.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:04:05.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:04:05.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:04:05.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:04:05.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:05.140+0000 7f63a59617c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:04:08.107 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:04:08.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:08.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:04:08.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:04:08.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:04:08.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:04:08.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:04:08.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:08.252+0000 7fe2615de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:04:11.210 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:04:11.269 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:04:11.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:11.355+0000 7f0df806c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:04:12.498 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:04:12.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:04:14.316 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:04:14.329 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:04:14.330 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:04:14.351 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.351 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:04:14.414 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T23:04:14.478 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-26T23:04:14.541 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:04:14.606 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.606 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:04:14.670 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:04:14.733 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:14.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:04:14.792 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:14.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:04:14.806 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:14.806 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:04:14.860 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:14.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T23:04:14.916 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:14.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-26T23:04:14.967 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:14.967 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:04:15.020 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:15.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:04:15.072 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:15.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:04:15.123 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:15.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:04:15.177 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:15.177 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:04:15.185 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:04:15.185 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:04:15.232 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDQMixmpZq4LxAABplOS3FlzMw0S9yfSPMGXw== 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDQMixmTwvqNhAAdD5l23eUxZ6nB13mbT1iLA== 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixm3hdrAhAA1ZYYZCMo4oFqKeeiobsKRw== 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixmW7mCCRAAmPmGeyoquwNuIA/dGh3jlA== 2024-04-26T23:04:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDUMixmP0FPGBAAWvTN/VNbg088SRS7zc97ew== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDXMixmtN2TIxAAl1zYECoK93hTd2BvbiX8EQ== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDaMixmrbHELBAAyrfBBMVZBCJZZOwSjATuZA== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDdMixmZmFoNxAA4U9CcNb3NwGRIUPdM8Ucyg== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDQMixmXYy8MhAA5hitMO5NWHDd7b1D91pmOA== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixmyFCRDRAAaurHVpDeHKhBDDwksgNdGA== 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-26T23:04:15.245 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixmhxP3FRAAqWAbEbMogAt0QO2kTqEnXQ== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixmynZwHhAAQ6HVIOUtp1imWyLfTBD09A== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDiMixmqD3HBBAAaHMWihtKyngtyX4vMMSPMg== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDlMixm2uqICBAAsGtw+ZdzWz+GZ7ZEwulPUA== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDoMixm6J82DxAAg9ftcmTA6z+qnda3HlNW4g== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDrMixmIsdfFRAAvOXz8ivTGylz5Upnl+Ygpg== 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-04-26T23:04:15.246 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDRMixmVsiKJBAA55NcSLS7tF2ldaB3XVi46Q== 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDQMixmpZq4LxAABplOS3FlzMw0S9yfSPMGXw== 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDQMixmTwvqNhAAdD5l23eUxZ6nB13mbT1iLA== 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2024-04-26T23:04:15.250 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixm3hdrAhAA1ZYYZCMo4oFqKeeiobsKRw== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.e] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixmW7mCCRAAmPmGeyoquwNuIA/dGh3jlA== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDUMixmP0FPGBAAWvTN/VNbg088SRS7zc97ew== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDXMixmtN2TIxAAl1zYECoK93hTd2BvbiX8EQ== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDaMixmrbHELBAAyrfBBMVZBCJZZOwSjATuZA== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDdMixmZmFoNxAA4U9CcNb3NwGRIUPdM8Ucyg== 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2024-04-26T23:04:15.251 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDQMixmXYy8MhAA5hitMO5NWHDd7b1D91pmOA== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixmyFCRDRAAaurHVpDeHKhBDDwksgNdGA== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixmhxP3FRAAqWAbEbMogAt0QO2kTqEnXQ== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.f] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixmynZwHhAAQ6HVIOUtp1imWyLfTBD09A== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDiMixmqD3HBBAAaHMWihtKyngtyX4vMMSPMg== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDlMixm2uqICBAAsGtw+ZdzWz+GZ7ZEwulPUA== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDoMixm6J82DxAAg9ftcmTA6z+qnda3HlNW4g== 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2024-04-26T23:04:15.252 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDrMixmIsdfFRAAvOXz8ivTGylz5Upnl+Ygpg== 2024-04-26T23:04:15.253 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-04-26T23:04:15.253 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDRMixmVsiKJBAA55NcSLS7tF2ldaB3XVi46Q== 2024-04-26T23:04:15.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:04:15.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:04:15.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.472 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.545 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.548 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.696 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:15.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:04:15.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:04:15.925 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:15.927 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:16.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:16.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:16.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:16.074 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:04:16.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.150 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.399 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:04:16.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:04:16.482 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:04:16.563 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:04:16.564 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:04:16.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:04:16.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:04:16.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:04:16.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:04:16.822 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:04:16.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:04:16.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:04:16.975 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:04:16.985 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:16.988 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:04:17.032 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:04:17.033 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:04:17.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:04:17.036 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:04:17.036 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:04:17.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:04:17.078 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:04:17.078 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:04:17.079 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:04:17.080 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:04:17.080 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:04:17.081 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:04:17.081 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:04:17.084 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:04:17.084 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:04:17.084 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:04:17.086 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:04:17.086 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:04:17.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:04:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.224+0000 7fec6dc00640 1 Processor -- start 2024-04-26T23:04:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.224+0000 7fec6dc00640 1 -- start start 2024-04-26T23:04:17.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec6dc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec6dc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec6dc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680c49e0 con 0x7fec68157250 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec6dc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fec680cbb50 con 0x7fec680c9e80 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec6dc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fec680caf80 con 0x7fec680c44a0 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec66a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fec68157250 0x7fec6806ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:41204/0 (socket says 172.21.15.148:41204) 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 learned_addr learned my addr 172.21.15.148:0/1341840613 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:04:17.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:04:17.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.228+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.432+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:17.835+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:18.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:04:18.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:04:18.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec5e000640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:18.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:18.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:18.639+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 msgr2=0x7fec6815d190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.157:3300/0 conn(0x7fec680c44a0 0x7fec6815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 -- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 msgr2=0x7fec6815d6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 --2- 172.21.15.148:0/1341840613 >> v2:172.21.15.148:3300/0 conn(0x7fec680c9e80 0x7fec6815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 -- 172.21.15.148:0/1341840613 >> v1:172.21.15.148:6789/0 conn(0x7fec68157250 legacy=0x7fec6806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:20.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 -- 172.21.15.148:0/1341840613 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680c6450 con 0x7fec44006160 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec64c00640 1 -- 172.21.15.148:0/1341840613 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec680cbb50 con 0x7fec440036a0 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:20.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.231+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:04:20.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.435+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:20.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.435+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:20.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.435+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:20.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.435+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:20.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.435+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:04:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.839+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.839+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.839+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.839+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:20.839+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:04:21.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:21.643+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:21.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:21.643+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:04:21.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:21.643+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:21.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:21.643+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:21.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:21.643+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478411774 0 0) 0x7fec680c6450 con 0x7fec44006160 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec4c003530 con 0x7fec44006160 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2627480450 0 0) 0x7fec4c003530 con 0x7fec44006160 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 msgr2=0x7fec44005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec440036a0 0x7fec44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4400af50 con 0x7fec44006160 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fec50009a00 con 0x7fec44006160 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 >> v1:172.21.15.157:6789/0 conn(0x7fec44006160 legacy=0x7fec44008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec67400640 1 -- 172.21.15.148:0/1341840613 reap_dead start 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 0x7fec4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004810 0x7fec4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec680cbb50 con 0x7fec4c0039c0 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c00c1f0 con 0x7fec4c004810 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c00c3f0 con 0x7fec4c0052a0 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 0x7fec4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec67400640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.427+0000 7fec5e000640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004810 0x7fec4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 msgr2=0x7fec4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004810 msgr2=0x7fec4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:22.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004810 0x7fec4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 -- 172.21.15.148:0/1341840613 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c003530 con 0x7fec4c0039c0 2024-04-26T23:04:22.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66a00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 0x7fec4c003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec58005f80 tx=0x7fec5801d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1291e1cf04b88789 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:22.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580ab070 con 0x7fec4c0039c0 2024-04-26T23:04:22.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec580af400 con 0x7fec4c0039c0 2024-04-26T23:04:22.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.431+0000 7fec66000640 1 -- 172.21.15.148:0/1341840613 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58005bd0 con 0x7fec4c0039c0 2024-04-26T23:04:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 msgr2=0x7fec4c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 0x7fec4c003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec58005f80 tx=0x7fec5801d1a0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- 172.21.15.148:0/1341840613 shutdown_connections 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec4c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c004810 0x7fec4c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- 172.21.15.148:0/1341840613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c0039c0 0x7fec4c003dc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- 172.21.15.148:0/1341840613 >> 172.21.15.148:0/1341840613 conn(0x7fec68068140 msgr2=0x7fec68068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- 172.21.15.148:0/1341840613 shutdown_connections 2024-04-26T23:04:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- 172.21.15.148:0/1341840613 wait complete. 2024-04-26T23:04:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 Processor -- start 2024-04-26T23:04:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- start start 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 0x7fec681e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec68147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec680b26c0 con 0x7fec4c004810 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec68157630 con 0x7fec4c0039c0 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.435+0000 7fec6dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec680b2840 con 0x7fec4c0052a0 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52876/0 (socket says 172.21.15.148:52876) 2024-04-26T23:04:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 -- 172.21.15.148:0/352601085 learned_addr learned my addr 172.21.15.148:0/352601085 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec66a00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 0x7fec681e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec67400640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec68147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 -- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 msgr2=0x7fec68147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec68147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 -- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 msgr2=0x7fec681e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 0x7fec681e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 -- 172.21.15.148:0/352601085 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec680c94e0 con 0x7fec4c004810 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec66a00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 0x7fec681e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5e000640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec500049d0 tx=0x7fec50014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5001b030 con 0x7fec4c004810 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec50017440 con 0x7fec4c004810 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec681f2010 con 0x7fec4c004810 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50017690 con 0x7fec4c004810 2024-04-26T23:04:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681f25d0 con 0x7fec4c004810 2024-04-26T23:04:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec5001e030 con 0x7fec4c004810 2024-04-26T23:04:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fec5001f700 con 0x7fec4c004810 2024-04-26T23:04:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.439+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68077c20 con 0x7fec4c004810 2024-04-26T23:04:22.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.443+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fec50010070 con 0x7fec4c004810 2024-04-26T23:04:22.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.503+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fec680ca540 con 0x7fec4c004810 2024-04-26T23:04:22.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec5f400640 1 -- 172.21.15.148:0/352601085 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fec50020da0 con 0x7fec4c004810 2024-04-26T23:04:22.504 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 msgr2=0x7fec680cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec500049d0 tx=0x7fec50014690 comp rx=0 tx=0).stop 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 shutdown_connections 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec4c0052a0 0x7fec68147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec4c004810 0x7fec680cdfb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 --2- 172.21.15.148:0/352601085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec4c0039c0 0x7fec681e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 >> 172.21.15.148:0/352601085 conn(0x7fec68068140 msgr2=0x7fec680cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 shutdown_connections 2024-04-26T23:04:22.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:22.507+0000 7fec6dc00640 1 -- 172.21.15.148:0/352601085 wait complete. 2024-04-26T23:04:22.523 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:04:22.523 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:04:22.524 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:22.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:04:22.543 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:22.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:04:22.605 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:22.605 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:04:22.664 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:22.664 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:04:22.728 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:22.728 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:04:22.743 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:22.743 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:04:22.801 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:22.801 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:04:22.859 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-26T23:04:22.859 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:04:22.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 10a69ee9-4018-402f-8547-13adf2c2574d 0 2024-04-26T23:04:23.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.082+0000 7f801265b640 1 Processor -- start 2024-04-26T23:04:23.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.082+0000 7f801265b640 1 -- start start 2024-04-26T23:04:23.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f801265b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f800c0c8d60 0x7f800c0d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f801265b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c0cd8a0 con 0x7f800c0d1b10 2024-04-26T23:04:23.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f801265b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c15ce20 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f801265b640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f800c15bfc0 con 0x7f800c0c8d60 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800bfff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f800c0b71d0 0x7f800c0cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:58414/0 (socket says 172.21.15.157:58414) 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800bfff640 1 -- 172.21.15.157:0/2822452540 learned_addr learned my addr 172.21.15.157:0/2822452540 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800b7fe640 1 --2- 172.21.15.157:0/2822452540 >> v2:172.21.15.148:3300/0 conn(0x7f800c0c8d60 0x7f800c0d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738308044 0 0) 0x7f800c15ce20 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff4003530 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098371422 0 0) 0x7f7ff4003530 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 >> v2:172.21.15.148:3300/0 conn(0x7f800c0c8d60 msgr2=0x7f800c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 --2- 172.21.15.157:0/2822452540 >> v2:172.21.15.148:3300/0 conn(0x7f800c0c8d60 0x7f800c0d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 >> v1:172.21.15.148:6789/0 conn(0x7f800c0d1b10 legacy=0x7f800c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c15c2a0 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f7ffc001680 con 0x7f800c0b71d0 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 >> v1:172.21.15.157:6789/0 conn(0x7f800c0b71d0 legacy=0x7f800c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40039c0 0x7f7ff4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 0x7f7ff400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f800c15bfc0 con 0x7f7ff4004810 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff400c080 con 0x7f7ff40051d0 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff400c280 con 0x7f7ff40039c0 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800bfff640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40039c0 0x7f7ff4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 0x7f7ff400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f800b7fe640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 -- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40039c0 msgr2=0x7f7ff4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40039c0 0x7f7ff4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 -- 172.21.15.157:0/2822452540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ff4004810 msgr2=0x7f7ff4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.086+0000 7f8010bf8640 1 -- 172.21.15.157:0/2822452540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff4003530 con 0x7f7ff40051d0 2024-04-26T23:04:23.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f8010bf8640 1 -- 172.21.15.157:0/2822452540 reap_dead start 2024-04-26T23:04:23.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f8010bf8640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 0x7f7ff400b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8004001e70 tx=0x7f800401c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f605ca88146bcb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004001a90 con 0x7f7ff40051d0 2024-04-26T23:04:23.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8004003ba0 con 0x7f7ff40051d0 2024-04-26T23:04:23.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800affd640 1 -- 172.21.15.157:0/2822452540 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004005020 con 0x7f7ff40051d0 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 msgr2=0x7f7ff400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 0x7f7ff400b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8004001e70 tx=0x7f800401c780 comp rx=0 tx=0).stop 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- 172.21.15.157:0/2822452540 shutdown_connections 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 --2- 172.21.15.157:0/2822452540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ff40051d0 0x7f7ff400b9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- 172.21.15.157:0/2822452540 >> 172.21.15.157:0/2822452540 conn(0x7f800c06d0d0 msgr2=0x7f800c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- 172.21.15.157:0/2822452540 shutdown_connections 2024-04-26T23:04:23.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- 172.21.15.157:0/2822452540 wait complete. 2024-04-26T23:04:23.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 Processor -- start 2024-04-26T23:04:23.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- start start 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 0x7f800c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f800c1f2480 0x7f800c0c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f800c15cb40 con 0x7f800c1f2480 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f800c15c860 con 0x7f800c0c50e0 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f801265b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f800c0b4350 con 0x7f7ff40051d0 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 0x7f800c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37192/0 (socket says 172.21.15.157:37192) 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.090+0000 7f800b7fe640 1 -- 172.21.15.157:0/3387983286 learned_addr learned my addr 172.21.15.157:0/3387983286 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8010bf8640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f800c1f2480 0x7f800c0c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 -- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 msgr2=0x7f800c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 0x7f800c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 -- 172.21.15.157:0/3387983286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f800c1f2480 msgr2=0x7f800c0c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f800c1f2480 0x7f800c0c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 -- 172.21.15.157:0/3387983286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c0b6580 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800bfff640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 0x7f800c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f800b7fe640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8000011960 tx=0x7f8000011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800000f9d0 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800000fb70 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c1f5cb0 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000014440 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c1f19e0 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8000012040 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f800001da40 con 0x7f800c0c50e0 2024-04-26T23:04:23.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c077c20 con 0x7f800c0c50e0 2024-04-26T23:04:23.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.094+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f800002b020 con 0x7f800c0c50e0 2024-04-26T23:04:23.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.166+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10a69ee9-4018-402f-8547-13adf2c2574d", "id": 0} v 0) -- 0x7f800c0b75c0 con 0x7f800c0c50e0 2024-04-26T23:04:23.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f8008ff9640 1 -- 172.21.15.157:0/3387983286 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10a69ee9-4018-402f-8547-13adf2c2574d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8000019030 con 0x7f800c0c50e0 2024-04-26T23:04:23.170 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-04-26T23:04:23.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 msgr2=0x7f800c1f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8000011960 tx=0x7f8000011d60 comp rx=0 tx=0).stop 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 shutdown_connections 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f800c1f2480 0x7f800c0c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f800c0c50e0 0x7f800c1f5770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 --2- 172.21.15.157:0/3387983286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ff40051d0 0x7f800c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 >> 172.21.15.157:0/3387983286 conn(0x7f800c06d0d0 msgr2=0x7f800c155a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 shutdown_connections 2024-04-26T23:04:23.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.170+0000 7f801265b640 1 -- 172.21.15.157:0/3387983286 wait complete. 2024-04-26T23:04:23.187 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 0b9f989e-da91-488e-9df8-af5cf73cdc20 1 2024-04-26T23:04:23.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.306+0000 7fcbbd81e640 1 Processor -- start 2024-04-26T23:04:23.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 -- start start 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcbb80c8d60 0x7fcbb80d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcbb80d1b10 0x7fcbb80cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb80cd8a0 con 0x7fcbb80b71d0 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb815ce20 con 0x7fcbb80d1b10 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbbd81e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb815bfc0 con 0x7fcbb80c8d60 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcbb80c8d60 0x7fcbb80d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcbb80c8d60 0x7fcbb80d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37216/0 (socket says 172.21.15.157:37216) 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 -- 172.21.15.157:0/2830235995 learned_addr learned my addr 172.21.15.157:0/2830235995 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbb77fe640 1 --2- 172.21.15.157:0/2830235995 >> v2:172.21.15.148:3300/0 conn(0x7fcbb80d1b10 0x7fcbb80cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 -- 172.21.15.157:0/2830235995 >> v2:172.21.15.148:3300/0 conn(0x7fcbb80d1b10 msgr2=0x7fcbb80cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 --2- 172.21.15.157:0/2830235995 >> v2:172.21.15.148:3300/0 conn(0x7fcbb80d1b10 0x7fcbb80cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 -- 172.21.15.157:0/2830235995 >> v1:172.21.15.148:6789/0 conn(0x7fcbb80b71d0 legacy=0x7fcbb80cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 -- 172.21.15.157:0/2830235995 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb815c2a0 con 0x7fcbb80c8d60 2024-04-26T23:04:23.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbaffff640 1 --2- 172.21.15.157:0/2830235995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80d15d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbb81567f0 tx=0x7fcba001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8dcaacefb34ab5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.310+0000 7fcbb67fc640 1 -- 172.21.15.157:0/2830235995 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00b5070 con 0x7fcbb80c8d60 2024-04-26T23:04:23.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb67fc640 1 -- 172.21.15.157:0/2830235995 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba00a89d0 con 0x7fcbb80c8d60 2024-04-26T23:04:23.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb67fc640 1 -- 172.21.15.157:0/2830235995 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00a8da0 con 0x7fcbb80c8d60 2024-04-26T23:04:23.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/2830235995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80c8d60 msgr2=0x7fcbb80d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/2830235995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80d15d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbb81567f0 tx=0x7fcba001ecd0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/2830235995 shutdown_connections 2024-04-26T23:04:23.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/2830235995 >> v2:172.21.15.148:3300/0 conn(0x7fcbb80d1b10 0x7fcbb80cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/2830235995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80d15d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/2830235995 >> 172.21.15.157:0/2830235995 conn(0x7fcbb806d0d0 msgr2=0x7fcbb806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/2830235995 shutdown_connections 2024-04-26T23:04:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/2830235995 wait complete. 2024-04-26T23:04:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 Processor -- start 2024-04-26T23:04:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- start start 2024-04-26T23:04:23.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb815cb40 con 0x7fcbb80c8d60 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb815c860 con 0x7fcbb80d0100 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb80b4350 con 0x7fcbb80d1b10 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37232/0 (socket says 172.21.15.157:37232) 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb77fe640 1 -- 172.21.15.157:0/1338181865 learned_addr learned my addr 172.21.15.157:0/1338181865 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:53090/0 (socket says 172.21.15.157:53090) 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb6ffd640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 -- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 msgr2=0x7fcbb8157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 -- 172.21.15.157:0/1338181865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbb80c8d60 msgr2=0x7fcbb80b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 -- 172.21.15.157:0/1338181865 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb81f1fd0 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb77fe640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbaffff640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcba00af000 tx=0x7fcba001ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00b5070 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba00b0b10 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00bb410 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.314+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb80b6610 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.318+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb81f2570 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.318+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcba00c2060 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.318+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fcba00c4930 con 0x7fcbb80d1b10 2024-04-26T23:04:23.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.318+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb8077c20 con 0x7fcbb80d1b10 2024-04-26T23:04:23.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.318+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcba00c9020 con 0x7fcbb80d1b10 2024-04-26T23:04:23.386 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:23.386+0000 7ff49bcd1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:04:23.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.390+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b9f989e-da91-488e-9df8-af5cf73cdc20", "id": 1} v 0) -- 0x7fcbb80d1150 con 0x7fcbb80d1b10 2024-04-26T23:04:23.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbb4ff9640 1 -- 172.21.15.157:0/1338181865 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b9f989e-da91-488e-9df8-af5cf73cdc20", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fcba0018830 con 0x7fcbb80d1b10 2024-04-26T23:04:23.398 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-26T23:04:23.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 msgr2=0x7fcbb81f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcba00af000 tx=0x7fcba001ba70 comp rx=0 tx=0).stop 2024-04-26T23:04:23.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 shutdown_connections 2024-04-26T23:04:23.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbb80d0100 0x7fcbb8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcbb80d1b10 0x7fcbb81f5f50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 --2- 172.21.15.157:0/1338181865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbb80c8d60 0x7fcbb80b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 >> 172.21.15.157:0/1338181865 conn(0x7fcbb806d0d0 msgr2=0x7fcbb80c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 shutdown_connections 2024-04-26T23:04:23.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.398+0000 7fcbbd81e640 1 -- 172.21.15.157:0/1338181865 wait complete. 2024-04-26T23:04:23.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 0d6172ac-4f3e-4ef9-9f02-1507d9902fde 2 2024-04-26T23:04:23.425 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:23.427+0000 7f778f647180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:04:23.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 Processor -- start 2024-04-26T23:04:23.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 -- start start 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f036c0ccd60 0x7f036c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 0x7f036c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f036c0cf610 con 0x7f036c0ccd60 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f036c0cb310 con 0x7f036c070290 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.526+0000 7f0372104640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f036c0cb5f0 con 0x7f036c070670 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 0x7f036c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37240/0 (socket says 172.21.15.157:37240) 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036b7fe640 1 -- 172.21.15.157:0/1117177375 learned_addr learned my addr 172.21.15.157:0/1117177375 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0363fff640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.148:3300/0 conn(0x7f036c0ccd60 0x7f036c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 -- 172.21.15.157:0/1117177375 >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 msgr2=0x7f036c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 -- 172.21.15.157:0/1117177375 >> v2:172.21.15.148:3300/0 conn(0x7f036c0ccd60 msgr2=0x7f036c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.148:3300/0 conn(0x7f036c0ccd60 0x7f036c0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 -- 172.21.15.157:0/1117177375 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c0cb8d0 con 0x7f036c070670 2024-04-26T23:04:23.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036b7fe640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:23.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036bfff640 1 --2- 172.21.15.157:0/1117177375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 0x7f036c0cffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f036c0c69a0 tx=0x7f036401f110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1877e3d9ec40c5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036affd640 1 -- 172.21.15.157:0/1117177375 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03640b5070 con 0x7f036c070670 2024-04-26T23:04:23.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036affd640 1 -- 172.21.15.157:0/1117177375 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03640b0440 con 0x7f036c070670 2024-04-26T23:04:23.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f036affd640 1 -- 172.21.15.157:0/1117177375 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03640b0810 con 0x7f036c070670 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 -- 172.21.15.157:0/1117177375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 msgr2=0x7f036c0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 --2- 172.21.15.157:0/1117177375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 0x7f036c0cffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f036c0c69a0 tx=0x7f036401f110 comp rx=0 tx=0).stop 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 -- 172.21.15.157:0/1117177375 shutdown_connections 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.148:3300/0 conn(0x7f036c0ccd60 0x7f036c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 --2- 172.21.15.157:0/1117177375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070670 0x7f036c0cffe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 --2- 172.21.15.157:0/1117177375 >> v2:172.21.15.157:3300/0 conn(0x7f036c070290 0x7f036c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 -- 172.21.15.157:0/1117177375 >> 172.21.15.157:0/1117177375 conn(0x7f036c068140 msgr2=0x7f036c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 -- 172.21.15.157:0/1117177375 shutdown_connections 2024-04-26T23:04:23.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.530+0000 7f0372104640 1 -- 172.21.15.157:0/1117177375 wait complete. 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 Processor -- start 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- start start 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f036c070670 0x7f036c1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 0x7f036c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f036c0ca410 con 0x7f036c0ccd60 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f036c0cbe90 con 0x7f036c070670 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f036c0c4b30 con 0x7f036c070290 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:53110/0 (socket says 172.21.15.157:53110) 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0363fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f036c070670 0x7f036c1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 -- 172.21.15.157:0/255680465 learned_addr learned my addr 172.21.15.157:0/255680465 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036bfff640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 0x7f036c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 -- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f036c070670 msgr2=0x7f036c1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f036c070670 0x7f036c1f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 -- 172.21.15.157:0/255680465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 msgr2=0x7f036c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 0x7f036c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 -- 172.21.15.157:0/255680465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c151070 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036bfff640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 0x7f036c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f036b7fe640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f035c00e980 tx=0x7f035c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c00ca00 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c00cba0 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c004030 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c0b1870 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c0b1e30 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f035c0059a0 con 0x7f036c070290 2024-04-26T23:04:23.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f035c003d00 con 0x7f036c070290 2024-04-26T23:04:23.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.534+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036c0696e0 con 0x7f036c070290 2024-04-26T23:04:23.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.538+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f035c017020 con 0x7f036c070290 2024-04-26T23:04:23.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.606+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d6172ac-4f3e-4ef9-9f02-1507d9902fde", "id": 2} v 0) -- 0x7f036c0ca6b0 con 0x7f036c070290 2024-04-26T23:04:23.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0368ff9640 1 -- 172.21.15.157:0/255680465 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d6172ac-4f3e-4ef9-9f02-1507d9902fde", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f035c003620 con 0x7f036c070290 2024-04-26T23:04:23.611 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-04-26T23:04:23.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 msgr2=0x7f036c0ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f035c00e980 tx=0x7f035c00ee40 comp rx=0 tx=0).stop 2024-04-26T23:04:23.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 shutdown_connections 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f036c0ccd60 0x7f036c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f036c070670 0x7f036c1f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 --2- 172.21.15.157:0/255680465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f036c070290 0x7f036c0ceab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 >> 172.21.15.157:0/255680465 conn(0x7f036c068140 msgr2=0x7f036c14ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 shutdown_connections 2024-04-26T23:04:23.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.610+0000 7f0372104640 1 -- 172.21.15.157:0/255680465 wait complete. 2024-04-26T23:04:23.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new f67fe7d2-584e-4a47-84f6-724fd887b0d6 3 2024-04-26T23:04:23.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.742+0000 7f160f422640 1 Processor -- start 2024-04-26T23:04:23.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.742+0000 7f160f422640 1 -- start start 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160f422640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f16080c9f90 0x7f16080c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160f422640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1608071540 con 0x7f160806cd50 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160f422640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1608071820 con 0x7f1608070960 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160f422640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f16080c8bc0 con 0x7f16080c9f90 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160c9bd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f16080c9f90 0x7f16080c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160d9bf640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1608070960 0x7f16081666a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:58416/0 (socket says 172.21.15.157:58416) 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160d9bf640 1 -- 172.21.15.157:0/161919532 learned_addr learned my addr 172.21.15.157:0/161919532 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160c9bd640 1 -- 172.21.15.157:0/161919532 >> v1:172.21.15.157:6789/0 conn(0x7f1608070960 legacy=0x7f16081666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160c9bd640 1 -- 172.21.15.157:0/161919532 >> v1:172.21.15.148:6789/0 conn(0x7f160806cd50 legacy=0x7f160815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f15fffff640 1 -- 172.21.15.157:0/161919532 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41725092 0 0) 0x7f1608071820 con 0x7f1608070960 2024-04-26T23:04:23.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160c9bd640 1 -- 172.21.15.157:0/161919532 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1608071b00 con 0x7f16080c9f90 2024-04-26T23:04:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f160c9bd640 1 --2- 172.21.15.157:0/161919532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16080c9f90 0x7f16080c8360 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15f80097c0 tx=0x7f15f801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd75a4f0776c9524 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f15fffff640 1 -- 172.21.15.157:0/161919532 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f80b5070 con 0x7f16080c9f90 2024-04-26T23:04:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f15fffff640 1 -- 172.21.15.157:0/161919532 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f80a8990 con 0x7f16080c9f90 2024-04-26T23:04:23.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.746+0000 7f15fffff640 1 -- 172.21.15.157:0/161919532 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f80a8d60 con 0x7f16080c9f90 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/161919532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16080c9f90 msgr2=0x7f16080c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 --2- 172.21.15.157:0/161919532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16080c9f90 0x7f16080c8360 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15f80097c0 tx=0x7f15f801ec90 comp rx=0 tx=0).stop 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/161919532 shutdown_connections 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 --2- 172.21.15.157:0/161919532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16080c9f90 0x7f16080c8360 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/161919532 >> 172.21.15.157:0/161919532 conn(0x7f16080ce220 msgr2=0x7f16080ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/161919532 shutdown_connections 2024-04-26T23:04:23.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/161919532 wait complete. 2024-04-26T23:04:23.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 Processor -- start 2024-04-26T23:04:23.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- start start 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 0x7f1608153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16080c9f90 0x7f1608154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f160815cbe0 con 0x7f1608070960 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16080c8e10 con 0x7f160806cd50 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f160815cd60 con 0x7f16080c9f90 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37270/0 (socket says 172.21.15.157:37270) 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 -- 172.21.15.157:0/4191471896 learned_addr learned my addr 172.21.15.157:0/4191471896 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d9bf640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16080c9f90 0x7f1608154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160c9bd640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 0x7f1608153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 -- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16080c9f90 msgr2=0x7f1608154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16080c9f90 0x7f1608154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 -- 172.21.15.157:0/4191471896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 msgr2=0x7f1608153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 0x7f1608153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 -- 172.21.15.157:0/4191471896 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1608154ac0 con 0x7f160806cd50 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160c9bd640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 0x7f1608153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160d1be640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f160000c7a0 tx=0x7f160000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600003b80 con 0x7f160806cd50 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600003d20 con 0x7f160806cd50 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16081f2c20 con 0x7f160806cd50 2024-04-26T23:04:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000aa90 con 0x7f160806cd50 2024-04-26T23:04:23.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1608152f40 con 0x7f160806cd50 2024-04-26T23:04:23.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f160000ac30 con 0x7f160806cd50 2024-04-26T23:04:23.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.750+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f16000129f0 con 0x7f160806cd50 2024-04-26T23:04:23.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.754+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16080696e0 con 0x7f160806cd50 2024-04-26T23:04:23.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.754+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1600012c90 con 0x7f160806cd50 2024-04-26T23:04:23.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.822+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f67fe7d2-584e-4a47-84f6-724fd887b0d6", "id": 3} v 0) -- 0x7f16081587b0 con 0x7f160806cd50 2024-04-26T23:04:23.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.826+0000 7f15fdffb640 1 -- 172.21.15.157:0/4191471896 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f67fe7d2-584e-4a47-84f6-724fd887b0d6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1600012560 con 0x7f160806cd50 2024-04-26T23:04:23.828 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 msgr2=0x7f160815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f160000c7a0 tx=0x7f160000cc60 comp rx=0 tx=0).stop 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 shutdown_connections 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16080c9f90 0x7f1608154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1608070960 0x7f1608153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 --2- 172.21.15.157:0/4191471896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160806cd50 0x7f160815aee0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 >> 172.21.15.157:0/4191471896 conn(0x7f16080ce220 msgr2=0x7f16080c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 shutdown_connections 2024-04-26T23:04:23.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.830+0000 7f160f422640 1 -- 172.21.15.157:0/4191471896 wait complete. 2024-04-26T23:04:23.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 61fcfd7e-1353-4932-8174-c4fe21917be8 4 2024-04-26T23:04:23.861 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:23.862+0000 7ff49bcd1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:04:23.907 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:23.911+0000 7f778f647180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:04:23.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 Processor -- start 2024-04-26T23:04:23.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 -- start start 2024-04-26T23:04:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 0x7f62581592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 0x7f6258152910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62580c5e80 con 0x7f62580c7660 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6258073f10 con 0x7f62580715e0 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f626026a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6258158e20 con 0x7f62580c7a40 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f625e006640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f62580c7660 0x7f62580c8b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:58420/0 (socket says 172.21.15.157:58420) 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f625e006640 1 -- 172.21.15.157:0/3683231547 learned_addr learned my addr 172.21.15.157:0/3683231547 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f625e807640 1 --2- 172.21.15.157:0/3683231547 >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 0x7f6258152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.958+0000 7f625d805640 1 --2- 172.21.15.157:0/3683231547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 0x7f62581592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411440131 0 0) 0x7f62580c5e80 con 0x7f62580c7660 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6244003530 con 0x7f62580c7660 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d805640 1 -- 172.21.15.157:0/3683231547 >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 msgr2=0x7f6258152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d805640 1 --2- 172.21.15.157:0/3683231547 >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 0x7f6258152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d805640 1 -- 172.21.15.157:0/3683231547 >> v1:172.21.15.157:6789/0 conn(0x7f62580c7660 legacy=0x7f62580c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1767719222 0 0) 0x7f6244003530 con 0x7f62580c7660 2024-04-26T23:04:23.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d805640 1 -- 172.21.15.157:0/3683231547 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6258074410 con 0x7f62580c7a40 2024-04-26T23:04:23.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625e807640 1 --2- 172.21.15.157:0/3683231547 >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 0x7f6258152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:23.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d805640 1 --2- 172.21.15.157:0/3683231547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 0x7f62581592b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62480097c0 tx=0x7f624801ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f5995268768fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62480b5070 con 0x7f62580c7a40 2024-04-26T23:04:23.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62480a85f0 con 0x7f62580c7a40 2024-04-26T23:04:23.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f625d004640 1 -- 172.21.15.157:0/3683231547 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250001a00 con 0x7f62580c7a40 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 -- 172.21.15.157:0/3683231547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 msgr2=0x7f62581592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 --2- 172.21.15.157:0/3683231547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 0x7f62581592b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62480097c0 tx=0x7f624801ebb0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 -- 172.21.15.157:0/3683231547 shutdown_connections 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 --2- 172.21.15.157:0/3683231547 >> v2:172.21.15.157:3300/0 conn(0x7f62580715e0 0x7f6258152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 --2- 172.21.15.157:0/3683231547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7a40 0x7f62581592b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 -- 172.21.15.157:0/3683231547 >> 172.21.15.157:0/3683231547 conn(0x7f62580ce220 msgr2=0x7f62580ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:23.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 -- 172.21.15.157:0/3683231547 shutdown_connections 2024-04-26T23:04:23.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.962+0000 7f626026a640 1 -- 172.21.15.157:0/3683231547 wait complete. 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 Processor -- start 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- start start 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7660 0x7f62581f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 0x7f6258153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:23.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62580740d0 con 0x7f62580c7a40 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f62580c5ba0 con 0x7f62580715e0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f62581597f0 con 0x7f62580c7660 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625d805640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7660 0x7f62581f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37294/0 (socket says 172.21.15.157:37294) 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 -- 172.21.15.157:0/1599881967 learned_addr learned my addr 172.21.15.157:0/1599881967 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e807640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 0x7f6258153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 -- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7660 msgr2=0x7f62581f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7660 0x7f62581f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 -- 172.21.15.157:0/1599881967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 msgr2=0x7f6258153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 0x7f6258153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 -- 172.21.15.157:0/1599881967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6258153870 con 0x7f62580715e0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e807640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 0x7f6258153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f625e006640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6250001950 tx=0x7f625000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:23.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250012400 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62500125c0 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62581f1a00 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500129b0 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6258155540 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6250012b50 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f625001b910 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.966+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62580696e0 con 0x7f62580715e0 2024-04-26T23:04:23.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:23.970+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f625001b400 con 0x7f62580715e0 2024-04-26T23:04:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.038+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61fcfd7e-1353-4932-8174-c4fe21917be8", "id": 4} v 0) -- 0x7f62580c6260 con 0x7f62580715e0 2024-04-26T23:04:24.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f624effd640 1 -- 172.21.15.157:0/1599881967 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61fcfd7e-1353-4932-8174-c4fe21917be8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f625001b5e0 con 0x7f62580715e0 2024-04-26T23:04:24.043 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-04-26T23:04:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 msgr2=0x7f6258163b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6250001950 tx=0x7f625000a430 comp rx=0 tx=0).stop 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 shutdown_connections 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62580c7a40 0x7f6258153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62580c7660 0x7f62581f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 --2- 172.21.15.157:0/1599881967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62580715e0 0x7f6258163b70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 >> 172.21.15.157:0/1599881967 conn(0x7f62580ce220 msgr2=0x7f62580731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 shutdown_connections 2024-04-26T23:04:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.042+0000 7f626026a640 1 -- 172.21.15.157:0/1599881967 wait complete. 2024-04-26T23:04:24.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 7b2beef6-eb63-4291-ac63-a44c15afaa16 5 2024-04-26T23:04:24.069 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.066+0000 7ff49bcd1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:04:24.153 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:24.155+0000 7f778f647180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:04:24.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 Processor -- start 2024-04-26T23:04:24.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 -- start start 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0120070290 0x7f01200c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01200d01b0 0x7f0120153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01200cb310 con 0x7f01200ccd60 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f01200cf610 con 0x7f0120070290 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f012879a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f01200cb5f0 con 0x7f01200d01b0 2024-04-26T23:04:24.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01200d01b0 0x7f0120153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01200d01b0 0x7f0120153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37306/0 (socket says 172.21.15.157:37306) 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 -- 172.21.15.157:0/2780379562 learned_addr learned my addr 172.21.15.157:0/2780379562 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126536640 1 --2- 172.21.15.157:0/2780379562 >> v2:172.21.15.148:3300/0 conn(0x7f0120070290 0x7f01200c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 -- 172.21.15.157:0/2780379562 >> v2:172.21.15.148:3300/0 conn(0x7f0120070290 msgr2=0x7f01200c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 --2- 172.21.15.157:0/2780379562 >> v2:172.21.15.148:3300/0 conn(0x7f0120070290 0x7f01200c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 -- 172.21.15.157:0/2780379562 >> v1:172.21.15.157:6789/0 conn(0x7f01200ccd60 legacy=0x7f01200cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 -- 172.21.15.157:0/2780379562 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01200cb8d0 con 0x7f01200d01b0 2024-04-26T23:04:24.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0125534640 1 -- 172.21.15.157:0/2780379562 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169861389 0 0) 0x7f01200cb310 con 0x7f01200ccd60 2024-04-26T23:04:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0126d37640 1 --2- 172.21.15.157:0/2780379562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200d01b0 0x7f0120153970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f012015d0d0 tx=0x7f011801f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f19119d9143b5b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0125534640 1 -- 172.21.15.157:0/2780379562 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180b4070 con 0x7f01200d01b0 2024-04-26T23:04:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0125534640 1 -- 172.21.15.157:0/2780379562 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01180af400 con 0x7f01200d01b0 2024-04-26T23:04:24.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.174+0000 7f0125534640 1 -- 172.21.15.157:0/2780379562 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180af7d0 con 0x7f01200d01b0 2024-04-26T23:04:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/2780379562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200d01b0 msgr2=0x7f0120153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- 172.21.15.157:0/2780379562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200d01b0 0x7f0120153970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f012015d0d0 tx=0x7f011801f1e0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/2780379562 shutdown_connections 2024-04-26T23:04:24.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- 172.21.15.157:0/2780379562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200d01b0 0x7f0120153970 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- 172.21.15.157:0/2780379562 >> v2:172.21.15.148:3300/0 conn(0x7f0120070290 0x7f01200c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/2780379562 >> 172.21.15.157:0/2780379562 conn(0x7f0120068140 msgr2=0x7f0120068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/2780379562 shutdown_connections 2024-04-26T23:04:24.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/2780379562 wait complete. 2024-04-26T23:04:24.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 Processor -- start 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- start start 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0120070290 0x7f012006e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 0x7f01200b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01200ca410 con 0x7f01200d01b0 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f01200cbe90 con 0x7f01200ccd60 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f01200c4b30 con 0x7f0120070290 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37314/0 (socket says 172.21.15.157:37314) 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 -- 172.21.15.157:0/1079495788 learned_addr learned my addr 172.21.15.157:0/1079495788 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0126536640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0120070290 0x7f012006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0126d37640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 0x7f01200b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 -- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0120070290 msgr2=0x7f012006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0120070290 0x7f012006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 -- 172.21.15.157:0/1079495788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 msgr2=0x7f01200b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 0x7f01200b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 -- 172.21.15.157:0/1079495788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01201f2190 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0126d37640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 0x7f01200b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0125d35640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f011000c520 tx=0x7f011000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110017070 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110003600 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100039f0 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01201f2450 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01200b3300 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f011001a070 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.178+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0110012980 con 0x7f01200ccd60 2024-04-26T23:04:24.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.182+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01200696e0 con 0x7f01200ccd60 2024-04-26T23:04:24.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.182+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0110021020 con 0x7f01200ccd60 2024-04-26T23:04:24.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.262+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7b2beef6-eb63-4291-ac63-a44c15afaa16", "id": 5} v 0) -- 0x7f0120157580 con 0x7f01200ccd60 2024-04-26T23:04:24.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f0116ffd640 1 -- 172.21.15.157:0/1079495788 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b2beef6-eb63-4291-ac63-a44c15afaa16", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0110003dc0 con 0x7f01200ccd60 2024-04-26T23:04:24.268 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 msgr2=0x7f01200b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f011000c520 tx=0x7f011000c9e0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 shutdown_connections 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01200d01b0 0x7f01200b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01200ccd60 0x7f01200b3b00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 --2- 172.21.15.157:0/1079495788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0120070290 0x7f012006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 >> 172.21.15.157:0/1079495788 conn(0x7f0120068140 msgr2=0x7f0120152050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 shutdown_connections 2024-04-26T23:04:24.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.266+0000 7f012879a640 1 -- 172.21.15.157:0/1079495788 wait complete. 2024-04-26T23:04:24.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c 6 2024-04-26T23:04:24.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 Processor -- start 2024-04-26T23:04:24.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 -- start start 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 0x7f23cc0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23cc154140 con 0x7f23cc0c52c0 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc15a920 con 0x7f23cc15d9c0 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.394+0000 7f23d4148640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc0c5730 con 0x7f23cc153d60 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:53158/0 (socket says 172.21.15.157:53158) 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 -- 172.21.15.157:0/83684233 learned_addr learned my addr 172.21.15.157:0/83684233 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d16e3640 1 --2- 172.21.15.157:0/83684233 >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 0x7f23cc0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 -- 172.21.15.157:0/83684233 >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 msgr2=0x7f23cc0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 --2- 172.21.15.157:0/83684233 >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 0x7f23cc0c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 -- 172.21.15.157:0/83684233 >> v1:172.21.15.148:6789/0 conn(0x7f23cc0c52c0 legacy=0x7f23cc0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 -- 172.21.15.157:0/83684233 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc159d10 con 0x7f23cc153d60 2024-04-26T23:04:24.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d16e3640 1 --2- 172.21.15.157:0/83684233 >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 0x7f23cc0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d1ee4640 1 --2- 172.21.15.157:0/83684233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009870 tx=0x7f23bc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383836e4045746df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d0ee2640 1 -- 172.21.15.157:0/83684233 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0b1070 con 0x7f23cc153d60 2024-04-26T23:04:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d0ee2640 1 -- 172.21.15.157:0/83684233 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc0ac630 con 0x7f23cc153d60 2024-04-26T23:04:24.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d0ee2640 1 -- 172.21.15.157:0/83684233 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0a8050 con 0x7f23cc153d60 2024-04-26T23:04:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 -- 172.21.15.157:0/83684233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 msgr2=0x7f23cc0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 --2- 172.21.15.157:0/83684233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009870 tx=0x7f23bc01c520 comp rx=0 tx=0).stop 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 -- 172.21.15.157:0/83684233 shutdown_connections 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 --2- 172.21.15.157:0/83684233 >> v2:172.21.15.148:3300/0 conn(0x7f23cc15d9c0 0x7f23cc0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 --2- 172.21.15.157:0/83684233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc0c44e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.398+0000 7f23d4148640 1 -- 172.21.15.157:0/83684233 >> 172.21.15.157:0/83684233 conn(0x7f23cc068740 msgr2=0x7f23cc071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- 172.21.15.157:0/83684233 shutdown_connections 2024-04-26T23:04:24.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- 172.21.15.157:0/83684233 wait complete. 2024-04-26T23:04:24.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 Processor -- start 2024-04-26T23:04:24.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- start start 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc13ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 0x7f23cc140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc15dda0 con 0x7f23cc15d9c0 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc1599c0 con 0x7f23cc0c52c0 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc0ca070 con 0x7f23cc153d60 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d16e3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37324/0 (socket says 172.21.15.157:37324) 2024-04-26T23:04:24.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 -- 172.21.15.157:0/2325733200 learned_addr learned my addr 172.21.15.157:0/2325733200 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d26e5640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 0x7f23cc140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 -- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 msgr2=0x7f23cc13ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc13ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 -- 172.21.15.157:0/2325733200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 msgr2=0x7f23cc140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 0x7f23cc140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 -- 172.21.15.157:0/2325733200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc1f3680 con 0x7f23cc0c52c0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d16e3640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc13ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d26e5640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 0x7f23cc140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d1ee4640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0af040 tx=0x7f23bc0192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0bc070 con 0x7f23cc0c52c0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc0ab5e0 con 0x7f23cc0c52c0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc1f3940 con 0x7f23cc0c52c0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0b1070 con 0x7f23cc0c52c0 2024-04-26T23:04:24.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.402+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc151490 con 0x7f23cc0c52c0 2024-04-26T23:04:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.406+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23bc0ab9f0 con 0x7f23cc0c52c0 2024-04-26T23:04:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.406+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f23bc0b7ad0 con 0x7f23cc0c52c0 2024-04-26T23:04:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.406+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc0696e0 con 0x7f23cc0c52c0 2024-04-26T23:04:24.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.406+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f23bc0c5080 con 0x7f23cc0c52c0 2024-04-26T23:04:24.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.470+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c", "id": 6} v 0) -- 0x7f23cc0cb450 con 0x7f23cc0c52c0 2024-04-26T23:04:24.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.474+0000 7f23c27fc640 1 -- 172.21.15.157:0/2325733200 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f23bc016110 con 0x7f23cc0c52c0 2024-04-26T23:04:24.477 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 msgr2=0x7f23cc1531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0af040 tx=0x7f23bc0192c0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 shutdown_connections 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23cc15d9c0 0x7f23cc140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23cc153d60 0x7f23cc13ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 --2- 172.21.15.157:0/2325733200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23cc0c52c0 0x7f23cc1531f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 >> 172.21.15.157:0/2325733200 conn(0x7f23cc068740 msgr2=0x7f23cc14c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 shutdown_connections 2024-04-26T23:04:24.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.478+0000 7f23d4148640 1 -- 172.21.15.157:0/2325733200 wait complete. 2024-04-26T23:04:24.493 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new fc166f8d-f54d-4a5d-81a3-23ad10f3dea9 7 2024-04-26T23:04:24.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.598+0000 7fe614c2a640 1 Processor -- start 2024-04-26T23:04:24.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.598+0000 7fe614c2a640 1 -- start start 2024-04-26T23:04:24.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe614c2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 0x7fe6100ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe614c2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 0x7fe61015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe614c2a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61006cd80 con 0x7fe61006c890 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe614c2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe6100690a0 con 0x7fe6101563c0 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe614c2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe610068c10 con 0x7fe610155fe0 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 0x7fe6100ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60ed9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe61006c890 0x7fe61006d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:58446/0 (socket says 172.21.15.157:58446) 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60ed9d640 1 -- 172.21.15.157:0/1151689287 learned_addr learned my addr 172.21.15.157:0/1151689287 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60dd9b640 1 --2- 172.21.15.157:0/1151689287 >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 0x7fe61015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 -- 172.21.15.157:0/1151689287 >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 msgr2=0x7fe61015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 --2- 172.21.15.157:0/1151689287 >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 0x7fe61015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 -- 172.21.15.157:0/1151689287 >> v1:172.21.15.157:6789/0 conn(0x7fe61006c890 legacy=0x7fe61006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 -- 172.21.15.157:0/1151689287 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6100682e0 con 0x7fe610155fe0 2024-04-26T23:04:24.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60dd9b640 1 --2- 172.21.15.157:0/1151689287 >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 0x7fe61015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60e59c640 1 --2- 172.21.15.157:0/1151689287 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 0x7fe6100ca410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6040097c0 tx=0x7fe60401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79afc82fa04232f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60d59a640 1 -- 172.21.15.157:0/1151689287 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040b2070 con 0x7fe610155fe0 2024-04-26T23:04:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60d59a640 1 -- 172.21.15.157:0/1151689287 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6040ad640 con 0x7fe610155fe0 2024-04-26T23:04:24.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.602+0000 7fe60d59a640 1 -- 172.21.15.157:0/1151689287 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040ada10 con 0x7fe610155fe0 2024-04-26T23:04:24.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- 172.21.15.157:0/1151689287 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 msgr2=0x7fe6100ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- 172.21.15.157:0/1151689287 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 0x7fe6100ca410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6040097c0 tx=0x7fe60401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- 172.21.15.157:0/1151689287 shutdown_connections 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- 172.21.15.157:0/1151689287 >> v2:172.21.15.148:3300/0 conn(0x7fe6101563c0 0x7fe61015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- 172.21.15.157:0/1151689287 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe610155fe0 0x7fe6100ca410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- 172.21.15.157:0/1151689287 >> 172.21.15.157:0/1151689287 conn(0x7fe6100ce5f0 msgr2=0x7fe6100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- 172.21.15.157:0/1151689287 shutdown_connections 2024-04-26T23:04:24.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- 172.21.15.157:0/1151689287 wait complete. 2024-04-26T23:04:24.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 Processor -- start 2024-04-26T23:04:24.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- start start 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 0x7fe6100bf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 0x7fe61014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe61006da20 con 0x7fe610155fe0 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe61006d8a0 con 0x7fe61006c890 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.606+0000 7fe614c2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe6101690a0 con 0x7fe6101563c0 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60ed9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 0x7fe61014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37328/0 (socket says 172.21.15.157:37328) 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 -- 172.21.15.157:0/560477023 learned_addr learned my addr 172.21.15.157:0/560477023 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60dd9b640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 0x7fe6100bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 -- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 msgr2=0x7fe61014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 0x7fe61014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 -- 172.21.15.157:0/560477023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 msgr2=0x7fe6100bf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 0x7fe6100bf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 -- 172.21.15.157:0/560477023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6100be3e0 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60ed9d640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 0x7fe61014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60dd9b640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 0x7fe6100bf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe60e59c640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6040b0040 tx=0x7fe604019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040b2040 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6040bb070 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6100be680 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040b6850 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6100c5300 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe6040b69f0 con 0x7fe61006c890 2024-04-26T23:04:24.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fe6040bf3c0 con 0x7fe61006c890 2024-04-26T23:04:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6100506d0 con 0x7fe61006c890 2024-04-26T23:04:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.610+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe604016090 con 0x7fe61006c890 2024-04-26T23:04:24.676 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.674+0000 7ff49bcd1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:04:24.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.682+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc166f8d-f54d-4a5d-81a3-23ad10f3dea9", "id": 7} v 0) -- 0x7fe6100748b0 con 0x7fe61006c890 2024-04-26T23:04:24.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe5feffd640 1 -- 172.21.15.157:0/560477023 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc166f8d-f54d-4a5d-81a3-23ad10f3dea9", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe6040ad540 con 0x7fe61006c890 2024-04-26T23:04:24.687 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-04-26T23:04:24.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 msgr2=0x7fe6100c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6040b0040 tx=0x7fe604019240 comp rx=0 tx=0).stop 2024-04-26T23:04:24.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 shutdown_connections 2024-04-26T23:04:24.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6101563c0 0x7fe61014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe610155fe0 0x7fe6100bf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 --2- 172.21.15.157:0/560477023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe61006c890 0x7fe6100c3e50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 >> 172.21.15.157:0/560477023 conn(0x7fe6100ce5f0 msgr2=0x7fe610150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 shutdown_connections 2024-04-26T23:04:24.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-26T23:04:24.686+0000 7fe614c2a640 1 -- 172.21.15.157:0/560477023 wait complete. 2024-04-26T23:04:24.703 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:04:24.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:04:24.707 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:04:24.707 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:04:24.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:04:24.710 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:04:24.710 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:04:24.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:04:24.713 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:04:24.713 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:04:24.713 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:04:24.717 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:04:24.717 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:04:24.718 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:04:24.719 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:04:24.720 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:04:24.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:04:24.721 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:04:24.721 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:04:24.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:04:24.723 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:04:24.724 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:04:24.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:04:24.726 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:04:24.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:24.735 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.734+0000 7ff49bcd1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:04:24.783 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:24.783+0000 7f778f647180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:04:24.806 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.806+0000 7ff49bcd1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:04:24.869 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:24.871+0000 7f778f647180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:04:24.885 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.882+0000 7ff49bcd1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:04:24.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.899+0000 7f6db5c00640 1 Processor -- start 2024-04-26T23:04:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.899+0000 7f6db5c00640 1 -- start start 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6db5c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6db00b1d80 0x7f6db006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 0x7f6db00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6db5c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db00cfb50 con 0x7f6db00c9e80 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6db5c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6db00cce10 con 0x7f6db00b1d80 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6db5c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6db00cfe10 con 0x7f6db00c6340 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6dae000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 0x7f6db00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daea00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6db00b1d80 0x7f6db006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6dae000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 0x7f6db00703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:51940/0 (socket says 172.21.15.148:51940) 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daf400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6db00c9e80 0x7f6db015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:32872/0 (socket says 172.21.15.148:32872) 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6dae000640 1 -- 172.21.15.148:0/1918553640 learned_addr learned my addr 172.21.15.148:0/1918553640 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daea00640 1 -- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 msgr2=0x7f6db00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daea00640 1 --2- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 0x7f6db00703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daea00640 1 -- 172.21.15.148:0/1918553640 >> v1:172.21.15.157:6789/0 conn(0x7f6db00c9e80 legacy=0x7f6db015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.903+0000 7f6daea00640 1 -- 172.21.15.148:0/1918553640 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db006d650 con 0x7f6db00b1d80 2024-04-26T23:04:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6daea00640 1 --2- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00b1d80 0x7f6db006feb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6da00097c0 tx=0x7f6da001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9894070a5a66d096 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6dad600640 1 -- 172.21.15.148:0/1918553640 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00b5070 con 0x7f6db00b1d80 2024-04-26T23:04:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6dad600640 1 -- 172.21.15.148:0/1918553640 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00a8990 con 0x7f6db00b1d80 2024-04-26T23:04:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6dad600640 1 -- 172.21.15.148:0/1918553640 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00a8d60 con 0x7f6db00b1d80 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00b1d80 msgr2=0x7f6db006feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 --2- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00b1d80 0x7f6db006feb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6da00097c0 tx=0x7f6da001ec90 comp rx=0 tx=0).stop 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- 172.21.15.148:0/1918553640 shutdown_connections 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 --2- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00c6340 0x7f6db00703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 --2- 172.21.15.148:0/1918553640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00b1d80 0x7f6db006feb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- 172.21.15.148:0/1918553640 >> 172.21.15.148:0/1918553640 conn(0x7f6db0071160 msgr2=0x7f6db0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- 172.21.15.148:0/1918553640 shutdown_connections 2024-04-26T23:04:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- 172.21.15.148:0/1918553640 wait complete. 2024-04-26T23:04:24.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 Processor -- start 2024-04-26T23:04:24.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.907+0000 7f6db5c00640 1 -- start start 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00b1d80 0x7f6db0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00c9e80 0x7f6db0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6db00b2160 con 0x7f6db00c6340 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6db006dc10 con 0x7f6db00c9e80 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6db0071970 con 0x7f6db00b1d80 2024-04-26T23:04:24.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52896/0 (socket says 172.21.15.148:52896) 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 -- 172.21.15.148:0/2172000479 learned_addr learned my addr 172.21.15.148:0/2172000479 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6daf400640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00c9e80 0x7f6db0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6daea00640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00b1d80 0x7f6db0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 -- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00b1d80 msgr2=0x7f6db0153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00b1d80 0x7f6db0153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 -- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00c9e80 msgr2=0x7f6db0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00c9e80 0x7f6db0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 -- 172.21.15.148:0/2172000479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db01f5610 con 0x7f6db00c6340 2024-04-26T23:04:24.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6dae000640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00e890 tx=0x7f6d9c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:24.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c017070 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00c940 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00cd30 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db01f58f0 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db01f1ae0 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d9c01a070 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6d9c013b40 con 0x7f6db00c6340 2024-04-26T23:04:24.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.911+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db0077c20 con 0x7f6db00c6340 2024-04-26T23:04:24.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.915+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6d9c013470 con 0x7f6db00c6340 2024-04-26T23:04:24.933 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:24.935+0000 7f778f647180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:04:24.937 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:24.938+0000 7ff49bcd1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:04:24.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6db00d0210 con 0x7f6db00c6340 2024-04-26T23:04:24.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6da6a00640 1 -- 172.21.15.148:0/2172000479 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6d9c013650 con 0x7f6db00c6340 2024-04-26T23:04:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:24.970 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":10,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:24.688439+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 msgr2=0x7f6db01528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00e890 tx=0x7f6d9c00ed50 comp rx=0 tx=0).stop 2024-04-26T23:04:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 shutdown_connections 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6db00c9e80 0x7f6db0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6db00c6340 0x7f6db01528a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 --2- 172.21.15.148:0/2172000479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6db00b1d80 0x7f6db0153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 >> 172.21.15.148:0/2172000479 conn(0x7f6db0071160 msgr2=0x7f6db00c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 shutdown_connections 2024-04-26T23:04:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:24.971+0000 7f6db5c00640 1 -- 172.21.15.148:0/2172000479 wait complete. 2024-04-26T23:04:24.990 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:04:24.991 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:04:25.014 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:25.014+0000 7ff49bcd1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:04:25.025 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.027+0000 7f778f647180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:04:25.067 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:25.066+0000 7ff49bcd1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:04:25.085 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.086+0000 7f778f647180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:04:25.173 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.174+0000 7f778f647180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:04:25.216 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:25.214+0000 7ff49bcd1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:04:25.235 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.238+0000 7f778f647180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:04:25.277 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:25.274+0000 7ff49bcd1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:04:25.352 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-26T23:04:25.354+0000 7f641d3fb7c0 -1 Falling back to public interface 2024-04-26T23:04:25.354 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-26T23:04:25.354+0000 7f33d48207c0 -1 Falling back to public interface 2024-04-26T23:04:25.366 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-26T23:04:25.366+0000 7fba74bc17c0 -1 Falling back to public interface 2024-04-26T23:04:25.366 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-26T23:04:25.366+0000 7f21a03737c0 -1 Falling back to public interface 2024-04-26T23:04:25.384 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-04-26T23:04:25.386+0000 7f923015a7c0 -1 Falling back to public interface 2024-04-26T23:04:25.386 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-26T23:04:25.386+0000 7f7ea2c067c0 -1 Falling back to public interface 2024-04-26T23:04:25.392 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-04-26T23:04:25.394+0000 7fefdaf9b7c0 -1 Falling back to public interface 2024-04-26T23:04:25.392 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-04-26T23:04:25.394+0000 7fd0c7c3b7c0 -1 Falling back to public interface 2024-04-26T23:04:25.405 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.406+0000 7f778f647180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:04:25.480 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:25.482+0000 7f778f647180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:04:25.796 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:25.932 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:04:25.932 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:04:25.932 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:04:25.953 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 Processor -- start 2024-04-26T23:04:25.953 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 -- start start 2024-04-26T23:04:25.954 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc524155e30 0x7fc5240cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.954 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5240c9e30 con 0x7fc52415f1e0 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5240ca0d0 con 0x7fc5240ca760 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc52a800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc5240cb280 con 0x7fc524155e30 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc51be00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc52415f1e0 0x7fc52406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:41256/0 (socket says 172.21.15.148:41256) 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc51be00640 1 -- 172.21.15.148:0/2373721684 learned_addr learned my addr 172.21.15.148:0/2373721684 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc523400640 1 --2- 172.21.15.148:0/2373721684 >> v2:172.21.15.157:3300/0 conn(0x7fc524155e30 0x7fc5240cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727761109 0 0) 0x7fc5240c9e30 con 0x7fc52415f1e0 2024-04-26T23:04:25.955 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc508003530 con 0x7fc52415f1e0 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2469707843 0 0) 0x7fc508003530 con 0x7fc52415f1e0 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 >> v2:172.21.15.157:3300/0 conn(0x7fc524155e30 msgr2=0x7fc5240cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 --2- 172.21.15.148:0/2373721684 >> v2:172.21.15.157:3300/0 conn(0x7fc524155e30 0x7fc5240cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 >> v1:172.21.15.157:6789/0 conn(0x7fc5240ca760 legacy=0x7fc524166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5240cbc50 con 0x7fc52415f1e0 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.954+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fc50c001680 con 0x7fc52415f1e0 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 >> v1:172.21.15.148:6789/0 conn(0x7fc52415f1e0 legacy=0x7fc52406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5080039c0 0x7fc508003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc508004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5080051d0 0x7fc50800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc5240cb280 con 0x7fc508004810 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800c080 con 0x7fc5080039c0 2024-04-26T23:04:25.957 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc50800c280 con 0x7fc5080051d0 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc508004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc523400640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5080039c0 0x7fc508003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc523e00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5080051d0 0x7fc50800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 -- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5080051d0 msgr2=0x7fc50800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5080051d0 0x7fc50800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 -- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5080039c0 msgr2=0x7fc508003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5080039c0 0x7fc508003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 -- 172.21.15.148:0/2373721684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508003530 con 0x7fc508004810 2024-04-26T23:04:25.958 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc523e00640 1 -- 172.21.15.148:0/2373721684 reap_dead start 2024-04-26T23:04:25.959 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc51be00640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc508004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00c1c0 tx=0x7fc50c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd268ac0a665ddc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:25.959 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c007d00 con 0x7fc508004810 2024-04-26T23:04:25.959 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c0a9020 con 0x7fc508004810 2024-04-26T23:04:25.959 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.958+0000 7fc522a00640 1 -- 172.21.15.148:0/2373721684 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0a5b60 con 0x7fc508004810 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 msgr2=0x7fc508004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc508004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00c1c0 tx=0x7fc50c01cc60 comp rx=0 tx=0).stop 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- 172.21.15.148:0/2373721684 shutdown_connections 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 --2- 172.21.15.148:0/2373721684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc508004c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- 172.21.15.148:0/2373721684 >> 172.21.15.148:0/2373721684 conn(0x7fc524071620 msgr2=0x7fc5240706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- 172.21.15.148:0/2373721684 shutdown_connections 2024-04-26T23:04:25.960 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- 172.21.15.148:0/2373721684 wait complete. 2024-04-26T23:04:25.961 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 Processor -- start 2024-04-26T23:04:25.961 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- start start 2024-04-26T23:04:25.964 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc524154860 0x7fc52414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc524154e80 0x7fc52414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc524072280 con 0x7fc508004810 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc524071fa0 con 0x7fc524154e80 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.962+0000 7fc52a800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc524072560 con 0x7fc524154860 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52916/0 (socket says 172.21.15.148:52916) 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 -- 172.21.15.148:0/447072583 learned_addr learned my addr 172.21.15.148:0/447072583 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51be00640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc524154860 0x7fc52414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523e00640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc524154e80 0x7fc52414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 -- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc524154860 msgr2=0x7fc52414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc524154860 0x7fc52414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.965 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 -- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc524154e80 msgr2=0x7fc52414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc524154e80 0x7fc52414c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 -- 172.21.15.148:0/447072583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52414ed00 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc523400640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc514011ad0 tx=0x7fc514011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51400fbb0 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51400fd50 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514014680 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5240ceee0 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52415e8e0 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc514012040 con 0x7fc508004810 2024-04-26T23:04:25.966 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc51401d770 con 0x7fc508004810 2024-04-26T23:04:25.967 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.966+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5240cf0b0 con 0x7fc508004810 2024-04-26T23:04:25.967 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:25.970+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc514019030 con 0x7fc508004810 2024-04-26T23:04:25.996 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:25.994+0000 7ff49bcd1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:04:26.025 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.026+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5240506d0 con 0x7fc508004810 2024-04-26T23:04:26.026 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.026+0000 7fc51b400640 1 -- 172.21.15.148:0/447072583 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc51401da00 con 0x7fc508004810 2024-04-26T23:04:26.026 INFO:teuthology.misc.health.smithi148.stdout: 2024-04-26T23:04:26.026 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":10,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:24.688439+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:26.027 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 msgr2=0x7fc52415e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:26.027 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc514011ad0 tx=0x7fc514011f90 comp rx=0 tx=0).stop 2024-04-26T23:04:26.027 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 shutdown_connections 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc524154e80 0x7fc52414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc524154860 0x7fc52414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 --2- 172.21.15.148:0/447072583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc508004810 0x7fc52415e3a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 >> 172.21.15.148:0/447072583 conn(0x7fc524071620 msgr2=0x7fc5240c5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 shutdown_connections 2024-04-26T23:04:26.028 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:26.030+0000 7fc52a800640 1 -- 172.21.15.148:0/447072583 wait complete. 2024-04-26T23:04:26.044 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:04:26.110 INFO:tasks.ceph.mgr.y.smithi148.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:04:26.110 INFO:tasks.ceph.mgr.y.smithi148.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:04:26.110 INFO:tasks.ceph.mgr.y.smithi148.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:04:26.143 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:26.142+0000 7ff49bcd1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:04:26.158 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:26.158+0000 7f778f647180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:04:26.300 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:26.298+0000 7ff49bcd1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:04:26.306 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:26.306+0000 7f778f647180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:04:26.364 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:26.362+0000 7ff49bcd1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:04:26.476 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:26.478+0000 7f778f647180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:04:26.499 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:26.498+0000 7ff49bcd1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:04:26.549 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:26.550+0000 7f778f647180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:04:26.700 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:26.702+0000 7f778f647180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:04:27.122 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.118+0000 7ff49bcd1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:04:27.195 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.194+0000 7ff49bcd1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:04:27.375 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.373+0000 7ff49bcd1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:04:27.390 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:27.390+0000 7f778f647180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:04:27.450 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.445+0000 7ff49bcd1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:04:27.476 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:27.478+0000 7f778f647180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:04:27.678 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:27.678+0000 7f778f647180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:04:27.741 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.737+0000 7ff49bcd1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:04:27.762 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:27.762+0000 7f778f647180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:04:27.803 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:27.801+0000 7ff49bcd1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:04:28.097 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:28.098+0000 7f778f647180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:04:28.171 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-04-26T23:04:28.170+0000 7f778f647180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:04:28.844 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:28.841+0000 7ff442918640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:04:28.846 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-26T23:04:28.845+0000 7ff442918640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:04:28.987 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-26T23:04:28.985+0000 7fba74bc17c0 -1 osd.7 0 log_to_monitors true 2024-04-26T23:04:29.144 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-26T23:04:29.141+0000 7f33d48207c0 -1 osd.5 0 log_to_monitors true 2024-04-26T23:04:29.161 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-26T23:04:29.157+0000 7f21a03737c0 -1 osd.4 0 log_to_monitors true 2024-04-26T23:04:29.261 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-26T23:04:29.257+0000 7f7ea2c067c0 -1 osd.6 0 log_to_monitors true 2024-04-26T23:04:29.289 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-26T23:04:29.290+0000 7f641d3fb7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T23:04:29.347 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-04-26T23:04:29.346+0000 7f923015a7c0 -1 osd.0 0 log_to_monitors true 2024-04-26T23:04:29.471 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-04-26T23:04:29.474+0000 7fd0c7c3b7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T23:04:29.494 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-04-26T23:04:29.494+0000 7fefdaf9b7c0 -1 osd.3 0 log_to_monitors true 2024-04-26T23:04:32.026 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-26T23:04:32.025+0000 7fba7137c640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:04:32.034 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-26T23:04:32.033+0000 7f33d07c9640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:04:32.051 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-26T23:04:32.049+0000 7fba6899e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.062 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-26T23:04:32.061+0000 7f7e9ebaf640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:04:32.066 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-26T23:04:32.065+0000 7f33c85fd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.086 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-26T23:04:32.085+0000 7f219c31c640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:04:32.098 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-26T23:04:32.097+0000 7f7e969e3640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.107 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-26T23:04:32.105+0000 7f2194150640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.286 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-04-26T23:04:32.286+0000 7fd0c2a00640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:04:32.304 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-04-26T23:04:32.306+0000 7f922b000640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:04:32.307 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-04-26T23:04:32.306+0000 7fefd5e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:04:32.317 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-04-26T23:04:32.318+0000 7fd0b8a00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.329 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-04-26T23:04:32.330+0000 7f9221000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.341 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-04-26T23:04:32.342+0000 7fefcbe00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.363 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-26T23:04:32.362+0000 7f6418c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:04:32.393 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-26T23:04:32.394+0000 7f640e200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:04:32.850 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:32.979 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.978+0000 7f11c0e00640 1 Processor -- start 2024-04-26T23:04:32.979 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.978+0000 7f11c0e00640 1 -- start start 2024-04-26T23:04:32.981 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc153c60 0x7f11bc15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.981 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11bc0c4710 0x7f11bc15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.981 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 0x7f11bc0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc06c4a0 con 0x7f11bc0c4710 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc0c8030 con 0x7f11bc0c73e0 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11c0e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc06c740 con 0x7f11bc153c60 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11bc0c4710 0x7f11bc15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11bc0c4710 0x7f11bc15d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57138/0 (socket says 172.21.15.148:57138) 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 -- 172.21.15.148:0/2932609207 learned_addr learned my addr 172.21.15.148:0/2932609207 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11ba800640 1 --2- 172.21.15.148:0/2932609207 >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 0x7f11bc0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b9e00640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc153c60 0x7f11bc15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 -- 172.21.15.148:0/2932609207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc153c60 msgr2=0x7f11bc15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc153c60 0x7f11bc15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 -- 172.21.15.148:0/2932609207 >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 msgr2=0x7f11bc0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:32.982 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 --2- 172.21.15.148:0/2932609207 >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 0x7f11bc0c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.983 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11b1400640 1 -- 172.21.15.148:0/2932609207 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc06ca20 con 0x7f11bc0c4710 2024-04-26T23:04:32.983 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.982+0000 7f11ba800640 1 --2- 172.21.15.148:0/2932609207 >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 0x7f11bc0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:32.983 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b1400640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c4710 0x7f11bc15d3d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0cdd30 tx=0x7f11ac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b26f8356c7cc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b9400640 1 -- 172.21.15.148:0/2932609207 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0b5070 con 0x7f11bc0c4710 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b9400640 1 -- 172.21.15.148:0/2932609207 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ac0a89d0 con 0x7f11bc0c4710 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b9400640 1 -- 172.21.15.148:0/2932609207 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0a8da0 con 0x7f11bc0c4710 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- 172.21.15.148:0/2932609207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c4710 msgr2=0x7f11bc15d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c4710 0x7f11bc15d3d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0cdd30 tx=0x7f11ac01ed10 comp rx=0 tx=0).stop 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- 172.21.15.148:0/2932609207 shutdown_connections 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c4710 0x7f11bc15d3d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- 172.21.15.148:0/2932609207 >> v2:172.21.15.157:3300/0 conn(0x7f11bc0c73e0 0x7f11bc0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- 172.21.15.148:0/2932609207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc153c60 0x7f11bc15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.985 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- 172.21.15.148:0/2932609207 >> 172.21.15.148:0/2932609207 conn(0x7f11bc0cd210 msgr2=0x7f11bc0cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:32.986 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- 172.21.15.148:0/2932609207 shutdown_connections 2024-04-26T23:04:32.986 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- 172.21.15.148:0/2932609207 wait complete. 2024-04-26T23:04:32.986 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 Processor -- start 2024-04-26T23:04:32.986 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- start start 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc0c4710 0x7f11bc14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11bc153c60 0x7f11bc1f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0c5cd0 con 0x7f11bc0c73e0 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0c8310 con 0x7f11bc153c60 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11c0e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc0c7c10 con 0x7f11bc0c4710 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57154/0 (socket says 172.21.15.148:57154) 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.986+0000 7f11b1400640 1 -- 172.21.15.148:0/940852617 learned_addr learned my addr 172.21.15.148:0/940852617 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:32.989 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b9e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc0c4710 0x7f11bc14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11ba800640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11bc153c60 0x7f11bc1f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 -- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc0c4710 msgr2=0x7f11bc14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc0c4710 0x7f11bc14eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 -- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11bc153c60 msgr2=0x7f11bc1f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11bc153c60 0x7f11bc1f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 -- 172.21.15.148:0/940852617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc14d8f0 con 0x7f11bc0c73e0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b1400640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0b3040 tx=0x7f11ac01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0b5070 con 0x7f11bc0c73e0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ac0b0a50 con 0x7f11bc0c73e0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc14fd90 con 0x7f11bc0c73e0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0b0e20 con 0x7f11bc0c73e0 2024-04-26T23:04:32.990 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc14e090 con 0x7f11bc0c73e0 2024-04-26T23:04:32.991 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc0506d0 con 0x7f11bc0c73e0 2024-04-26T23:04:32.991 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f11ac0c2060 con 0x7f11bc0c73e0 2024-04-26T23:04:32.992 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 0x7f119806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:32.992 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f11ac122d50 con 0x7f11bc0c73e0 2024-04-26T23:04:32.992 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.990+0000 7f11b9e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 0x7f119806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:32.992 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.994+0000 7f11b9e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 0x7f119806a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11a400b950 tx=0x7f11a4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:32.996 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:32.998+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11ac018870 con 0x7f11bc0c73e0 2024-04-26T23:04:33.163 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.162+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11bc0c8590 con 0x7f11bc0c73e0 2024-04-26T23:04:33.164 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11b2a00640 1 -- 172.21.15.148:0/940852617 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10933 (secure 0 0 0) 0x7f11ac0f4050 con 0x7f11bc0c73e0 2024-04-26T23:04:33.164 INFO:teuthology.misc.health.smithi148.stdout: 2024-04-26T23:04:33.164 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":13,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:33.042351+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 msgr2=0x7f119806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 0x7f119806a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11a400b950 tx=0x7f11a4008040 comp rx=0 tx=0).stop 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 msgr2=0x7f11bc14b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0b3040 tx=0x7f11ac01bab0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 shutdown_connections 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f11980682f0 0x7f119806a7b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11bc153c60 0x7f11bc1f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11bc0c73e0 0x7f11bc14b980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.166 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 --2- 172.21.15.148:0/940852617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11bc0c4710 0x7f11bc14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.167 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 >> 172.21.15.148:0/940852617 conn(0x7f11bc0cd210 msgr2=0x7f11bc075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:33.167 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 shutdown_connections 2024-04-26T23:04:33.167 INFO:teuthology.misc.health.smithi148.stderr:2024-04-26T23:04:33.166+0000 7f11c0e00640 1 -- 172.21.15.148:0/940852617 wait complete. 2024-04-26T23:04:33.183 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:04:33.183 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:04:33.183 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:04:33.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:04:33.187 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:04:33.187 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:04:33.187 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:04:33.190 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:04:33.190 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-26T23:04:33.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-26T23:04:33.192 INFO:tasks.ceph.mds.e:Started 2024-04-26T23:04:33.193 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:04:33.193 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:04:33.195 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:04:33.195 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:04:33.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:04:33.198 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:04:33.198 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-26T23:04:33.198 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-26T23:04:33.200 INFO:tasks.ceph.mds.f:Started 2024-04-26T23:04:33.201 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:04:33.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:33.292 INFO:tasks.ceph.mds.e.smithi148.stdout:starting mds.e at 2024-04-26T23:04:33.293 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2024-04-26T23:04:33.293 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2024-04-26T23:04:33.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 Processor -- start 2024-04-26T23:04:33.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 -- start start 2024-04-26T23:04:33.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fadd406c5e0 0x7fadd40c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd415f3f0 con 0x7fadd40cb970 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fadd415f690 con 0x7fadd406c5e0 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7faddac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fadd415f930 con 0x7fadd406c9c0 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:47404/0 (socket says 172.21.15.148:47404) 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fadd406c5e0 0x7fadd40c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 -- 172.21.15.148:0/814360090 learned_addr learned my addr 172.21.15.148:0/814360090 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:33.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 -- 172.21.15.148:0/814360090 >> v2:172.21.15.157:3300/0 conn(0x7fadd406c5e0 msgr2=0x7fadd40c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:33.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 --2- 172.21.15.148:0/814360090 >> v2:172.21.15.157:3300/0 conn(0x7fadd406c5e0 0x7fadd40c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 -- 172.21.15.148:0/814360090 >> v1:172.21.15.157:6789/0 conn(0x7fadd40cb970 legacy=0x7fadd415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.354+0000 7fadd3400640 1 -- 172.21.15.148:0/814360090 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd415fc10 con 0x7fadd406c9c0 2024-04-26T23:04:33.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7fadd3400640 1 --2- 172.21.15.148:0/814360090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9618b0e505aab6b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7fadd2a00640 1 -- 172.21.15.148:0/814360090 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00b2070 con 0x7fadd406c9c0 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7fadd2a00640 1 -- 172.21.15.148:0/814360090 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc00a9070 con 0x7fadd406c9c0 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7fadd2a00640 1 -- 172.21.15.148:0/814360090 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00ad880 con 0x7fadd406c9c0 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 -- 172.21.15.148:0/814360090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 msgr2=0x7fadd4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 --2- 172.21.15.148:0/814360090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc001c560 comp rx=0 tx=0).stop 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 -- 172.21.15.148:0/814360090 shutdown_connections 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 --2- 172.21.15.148:0/814360090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c9c0 0x7fadd4155d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 --2- 172.21.15.148:0/814360090 >> v2:172.21.15.157:3300/0 conn(0x7fadd406c5e0 0x7fadd40c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 -- 172.21.15.148:0/814360090 >> 172.21.15.148:0/814360090 conn(0x7fadd4073240 msgr2=0x7fadd4073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:33.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.358+0000 7faddac00640 1 -- 172.21.15.148:0/814360090 shutdown_connections 2024-04-26T23:04:33.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 -- 172.21.15.148:0/814360090 wait complete. 2024-04-26T23:04:33.361 INFO:tasks.ceph.mds.f.smithi157.stdout:starting mds.f at 2024-04-26T23:04:33.362 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-04-26T23:04:33.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 Processor -- start 2024-04-26T23:04:33.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 -- start start 2024-04-26T23:04:33.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadd406c9c0 0x7fadd40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd40cb970 0x7fadd40ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadd415cd40 con 0x7fadd40cb970 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadd415cbc0 con 0x7fadd406c9c0 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7faddac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fadd4156250 con 0x7fadd406c5e0 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadd406c9c0 0x7fadd40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:47408/0 (socket says 172.21.15.148:47408) 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 -- 172.21.15.148:0/2929934500 learned_addr learned my addr 172.21.15.148:0/2929934500 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd8c00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd40cb970 0x7fadd40ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 -- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadd406c9c0 msgr2=0x7fadd40cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadd406c9c0 0x7fadd40cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 -- 172.21.15.148:0/2929934500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd40cb970 msgr2=0x7fadd40ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd40cb970 0x7fadd40ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.362+0000 7fadd3e00640 1 -- 172.21.15.148:0/2929934500 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd414eb10 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadd3e00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fadc400e930 tx=0x7fadc400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4017070 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc400ca00 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd40cde40 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc400cdb0 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd40ce400 con 0x7fadd406c5e0 2024-04-26T23:04:33.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd4077c20 con 0x7fadd406c5e0 2024-04-26T23:04:33.367 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-04-26T23:04:33.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fadc401a070 con 0x7fadd406c5e0 2024-04-26T23:04:33.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.366+0000 7fadcbe00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 0x7fadb406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.370+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fadc4086820 con 0x7fadd406c5e0 2024-04-26T23:04:33.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.370+0000 7fadd3400640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 0x7fadb406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.370+0000 7fadd3400640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 0x7fadb406a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadc00af000 tx=0x7fadc0008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.374+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fadc4056cd0 con 0x7fadd406c5e0 2024-04-26T23:04:33.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.534+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadd4070f50 con 0x7fadd406c5e0 2024-04-26T23:04:33.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.534+0000 7fadcbe00640 1 -- 172.21.15.148:0/2929934500 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10933 (secure 0 0 0) 0x7fadc405afd0 con 0x7fadd406c5e0 2024-04-26T23:04:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:33.534 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":13,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:33.042351+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:33.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 msgr2=0x7fadb406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 0x7fadb406a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadc00af000 tx=0x7fadc0008040 comp rx=0 tx=0).stop 2024-04-26T23:04:33.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 msgr2=0x7fadd40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fadc400e930 tx=0x7fadc400edf0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 shutdown_connections 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadb40682f0 0x7fadb406a7b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd40cb970 0x7fadd40ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadd406c9c0 0x7fadd40cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 --2- 172.21.15.148:0/2929934500 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadd406c5e0 0x7fadd40ceb50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 >> 172.21.15.148:0/2929934500 conn(0x7fadd4073240 msgr2=0x7fadd414c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 shutdown_connections 2024-04-26T23:04:33.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.538+0000 7faddac00640 1 -- 172.21.15.148:0/2929934500 wait complete. 2024-04-26T23:04:33.555 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-26T23:04:33.555 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:33.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 Processor -- start 2024-04-26T23:04:33.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 -- start start 2024-04-26T23:04:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe448152bc0 0x7fe4480c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe448152fa0 con 0x7fe448073480 2024-04-26T23:04:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe448159790 con 0x7fe4480c9340 2024-04-26T23:04:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe44da00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe448158930 con 0x7fe448152bc0 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe447400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe448073480 0x7fe4480c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57682/0 (socket says 172.21.15.148:57682) 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe447400640 1 -- 172.21.15.148:0/2638141084 learned_addr learned my addr 172.21.15.148:0/2638141084 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe446a00640 1 --2- 172.21.15.148:0/2638141084 >> v2:172.21.15.157:3300/0 conn(0x7fe448152bc0 0x7fe4480c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe445600640 1 -- 172.21.15.148:0/2638141084 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327375786 0 0) 0x7fe448152fa0 con 0x7fe448073480 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe445600640 1 -- 172.21.15.148:0/2638141084 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe42c005740 con 0x7fe448073480 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe446a00640 1 -- 172.21.15.148:0/2638141084 >> v1:172.21.15.157:6789/0 conn(0x7fe4480c9340 legacy=0x7fe448072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe446a00640 1 -- 172.21.15.148:0/2638141084 >> v1:172.21.15.148:6789/0 conn(0x7fe448073480 legacy=0x7fe4480c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.694+0000 7fe446a00640 1 -- 172.21.15.148:0/2638141084 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe448158c10 con 0x7fe448152bc0 2024-04-26T23:04:33.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe446a00640 1 --2- 172.21.15.148:0/2638141084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448152bc0 0x7fe4480c8e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097f0 tx=0x7fe43801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70abc56677e840b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe445600640 1 -- 172.21.15.148:0/2638141084 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b5070 con 0x7fe448152bc0 2024-04-26T23:04:33.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe445600640 1 -- 172.21.15.148:0/2638141084 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380a8990 con 0x7fe448152bc0 2024-04-26T23:04:33.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe445600640 1 -- 172.21.15.148:0/2638141084 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380a8d40 con 0x7fe448152bc0 2024-04-26T23:04:33.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 -- 172.21.15.148:0/2638141084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448152bc0 msgr2=0x7fe4480c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 --2- 172.21.15.148:0/2638141084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448152bc0 0x7fe4480c8e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097f0 tx=0x7fe43801ec90 comp rx=0 tx=0).stop 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 -- 172.21.15.148:0/2638141084 shutdown_connections 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 --2- 172.21.15.148:0/2638141084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448152bc0 0x7fe4480c8e00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 -- 172.21.15.148:0/2638141084 >> 172.21.15.148:0/2638141084 conn(0x7fe44806c380 msgr2=0x7fe44806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 -- 172.21.15.148:0/2638141084 shutdown_connections 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.698+0000 7fe44da00640 1 -- 172.21.15.148:0/2638141084 wait complete. 2024-04-26T23:04:33.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 Processor -- start 2024-04-26T23:04:33.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- start start 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448073480 0x7fe448145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4480c9340 0x7fe4481462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe4481594b0 con 0x7fe448152bc0 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe4481591d0 con 0x7fe448073480 2024-04-26T23:04:33.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe4480c47d0 con 0x7fe4480c9340 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe446a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448073480 0x7fe448145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57228/0 (socket says 172.21.15.148:57228) 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 -- 172.21.15.148:0/415107973 learned_addr learned my addr 172.21.15.148:0/415107973 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe446000640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4480c9340 0x7fe4481462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 -- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4480c9340 msgr2=0x7fe4481462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4480c9340 0x7fe4481462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 -- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448073480 msgr2=0x7fe448145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448073480 0x7fe448145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 -- 172.21.15.148:0/415107973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4481571a0 con 0x7fe448152bc0 2024-04-26T23:04:33.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe447400640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe44000cb70 tx=0x7fe44000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440017070 con 0x7fe448152bc0 2024-04-26T23:04:33.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44000ad40 con 0x7fe448152bc0 2024-04-26T23:04:33.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440012620 con 0x7fe448152bc0 2024-04-26T23:04:33.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4481e3f80 con 0x7fe448152bc0 2024-04-26T23:04:33.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.702+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4481576f0 con 0x7fe448152bc0 2024-04-26T23:04:33.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe448077c20 con 0x7fe448152bc0 2024-04-26T23:04:33.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fe44001a070 con 0x7fe448152bc0 2024-04-26T23:04:33.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe43ea00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 0x7fe42806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:33.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fe440086160 con 0x7fe448152bc0 2024-04-26T23:04:33.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe446a00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 0x7fe42806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:33.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.706+0000 7fe446a00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 0x7fe42806a7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b2000 tx=0x7fe4380aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:33.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.710+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe440056680 con 0x7fe448152bc0 2024-04-26T23:04:33.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4480c9940 con 0x7fe448152bc0 2024-04-26T23:04:33.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe43ea00640 1 -- 172.21.15.148:0/415107973 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fe44005a980 con 0x7fe448152bc0 2024-04-26T23:04:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:33.901 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:04:33.902 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 2 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 msgr2=0x7fe42806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 0x7fe42806a7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b2000 tx=0x7fe4380aa070 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 msgr2=0x7fe4481f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe44000cb70 tx=0x7fe44000a430 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 shutdown_connections 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe4280682f0 0x7fe42806a7b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe448152bc0 0x7fe4481f07a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4480c9340 0x7fe4481462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 --2- 172.21.15.148:0/415107973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe448073480 0x7fe448145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 >> 172.21.15.148:0/415107973 conn(0x7fe44806c380 msgr2=0x7fe44806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:33.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 shutdown_connections 2024-04-26T23:04:33.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:33.902+0000 7fe44da00640 1 -- 172.21.15.148:0/415107973 wait complete. 2024-04-26T23:04:35.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:36.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.065+0000 7fb9e7400640 1 Processor -- start 2024-04-26T23:04:36.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.065+0000 7fb9e7400640 1 -- start start 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9e0153af0 0x7fb9e015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e7400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e00c9d90 con 0x7fb9e00c7b80 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e7400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e00ca630 con 0x7fb9e0153af0 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00ca070 con 0x7fb9e00c9720 2024-04-26T23:04:36.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:47436/0 (socket says 172.21.15.148:47436) 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 -- 172.21.15.148:0/2191043857 learned_addr learned my addr 172.21.15.148:0/2191043857 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e4a00640 1 --2- 172.21.15.148:0/2191043857 >> v2:172.21.15.157:3300/0 conn(0x7fb9e0153af0 0x7fb9e015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 -- 172.21.15.148:0/2191043857 >> v2:172.21.15.157:3300/0 conn(0x7fb9e0153af0 msgr2=0x7fb9e015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 --2- 172.21.15.148:0/2191043857 >> v2:172.21.15.157:3300/0 conn(0x7fb9e0153af0 0x7fb9e015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 -- 172.21.15.148:0/2191043857 >> v1:172.21.15.157:6789/0 conn(0x7fb9e00c7b80 legacy=0x7fb9e00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.069+0000 7fb9e5400640 1 -- 172.21.15.148:0/2191043857 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00ca350 con 0x7fb9e00c9720 2024-04-26T23:04:36.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e5400640 1 --2- 172.21.15.148:0/2191043857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ec41e98e05add17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9df400640 1 -- 172.21.15.148:0/2191043857 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80b5070 con 0x7fb9e00c9720 2024-04-26T23:04:36.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9df400640 1 -- 172.21.15.148:0/2191043857 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d80a8a50 con 0x7fb9e00c9720 2024-04-26T23:04:36.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9df400640 1 -- 172.21.15.148:0/2191043857 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80a8e20 con 0x7fb9e00c9720 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- 172.21.15.148:0/2191043857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 msgr2=0x7fb9e00c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 --2- 172.21.15.148:0/2191043857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d801ed50 comp rx=0 tx=0).stop 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- 172.21.15.148:0/2191043857 shutdown_connections 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 --2- 172.21.15.148:0/2191043857 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e00c7f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 --2- 172.21.15.148:0/2191043857 >> v2:172.21.15.157:3300/0 conn(0x7fb9e0153af0 0x7fb9e015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- 172.21.15.148:0/2191043857 >> 172.21.15.148:0/2191043857 conn(0x7fb9e006c380 msgr2=0x7fb9e006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- 172.21.15.148:0/2191043857 shutdown_connections 2024-04-26T23:04:36.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- 172.21.15.148:0/2191043857 wait complete. 2024-04-26T23:04:36.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 Processor -- start 2024-04-26T23:04:36.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.073+0000 7fb9e7400640 1 -- start start 2024-04-26T23:04:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e0153af0 0x7fb9e01500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0153ed0 con 0x7fb9e0153af0 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e015d290 con 0x7fb9e00c7b80 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e0154050 con 0x7fb9e00c9720 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:59530/0 (socket says 172.21.15.148:59530) 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 -- 172.21.15.148:0/3320418867 learned_addr learned my addr 172.21.15.148:0/3320418867 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e5400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e0153af0 0x7fb9e01500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9dfe00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 -- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 msgr2=0x7fb9e014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 -- 172.21.15.148:0/3320418867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e0153af0 msgr2=0x7fb9e01500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e0153af0 0x7fb9e01500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 -- 172.21.15.148:0/3320418867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01564b0 con 0x7fb9e00c7b80 2024-04-26T23:04:36.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9dfe00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:04:36.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e4a00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000efc0 tx=0x7fb9d000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0018020 con 0x7fb9e00c7b80 2024-04-26T23:04:36.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0014480 con 0x7fb9e00c7b80 2024-04-26T23:04:36.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e0156790 con 0x7fb9e00c7b80 2024-04-26T23:04:36.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0014850 con 0x7fb9e00c7b80 2024-04-26T23:04:36.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.077+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01f4ff0 con 0x7fb9e00c7b80 2024-04-26T23:04:36.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.081+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e0077c20 con 0x7fb9e00c7b80 2024-04-26T23:04:36.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.081+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fb9d001b020 con 0x7fb9e00c7b80 2024-04-26T23:04:36.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.081+0000 7fb9dcc00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 0x7fb9c006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.081+0000 7fb9dfe00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 0x7fb9c006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.081+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb9d005e330 con 0x7fb9e00c7b80 2024-04-26T23:04:36.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.085+0000 7fb9dfe00640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 0x7fb9c006a7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9e01ec2c0 tx=0x7fb9cc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.089+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb9d0022030 con 0x7fb9e00c7b80 2024-04-26T23:04:36.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.281+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9e00c8670 con 0x7fb9e00c7b80 2024-04-26T23:04:36.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.281+0000 7fb9dcc00640 1 -- 172.21.15.148:0/3320418867 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5530 (secure 0 0 0) 0x7fb9d0010040 con 0x7fb9e00c7b80 2024-04-26T23:04:36.284 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:36.284 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:04:36.284 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 3 2024-04-26T23:04:36.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 msgr2=0x7fb9c006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 0x7fb9c006a7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9e01ec2c0 tx=0x7fb9cc009040 comp rx=0 tx=0).stop 2024-04-26T23:04:36.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 msgr2=0x7fb9e01510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000efc0 tx=0x7fb9d000c490 comp rx=0 tx=0).stop 2024-04-26T23:04:36.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 shutdown_connections 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9c00682f0 0x7fb9c006a7b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e0153af0 0x7fb9e01500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9e00c9720 0x7fb9e014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 --2- 172.21.15.148:0/3320418867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9e00c7b80 0x7fb9e01510d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 >> 172.21.15.148:0/3320418867 conn(0x7fb9e006c380 msgr2=0x7fb9e00cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 shutdown_connections 2024-04-26T23:04:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.285+0000 7fb9e7400640 1 -- 172.21.15.148:0/3320418867 wait complete. 2024-04-26T23:04:36.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:36.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 Processor -- start 2024-04-26T23:04:36.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 -- start start 2024-04-26T23:04:36.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b0c1574b0 0x7f1b0c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c0c9e80 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c0cb7f0 con 0x7f1b0c1574b0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b12200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0ca0d0 con 0x7f1b0c0b47e0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57248/0 (socket says 172.21.15.148:57248) 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 -- 172.21.15.148:0/3885134693 learned_addr learned my addr 172.21.15.148:0/3885134693 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0aa00640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0b400640 1 --2- 172.21.15.148:0/3885134693 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c1574b0 0x7f1b0c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 -- 172.21.15.148:0/3885134693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 msgr2=0x7f1b0c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 -- 172.21.15.148:0/3885134693 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c1574b0 msgr2=0x7f1b0c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 --2- 172.21.15.148:0/3885134693 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c1574b0 0x7f1b0c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0be00640 1 -- 172.21.15.148:0/3885134693 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0cba90 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.441+0000 7f1b0aa00640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:36.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b0be00640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0c6850 tx=0x7f1b0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4638b4ef50fbe8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b0a000640 1 -- 172.21.15.148:0/3885134693 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040b1070 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b0a000640 1 -- 172.21.15.148:0/3885134693 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b040ac630 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b0a000640 1 -- 172.21.15.148:0/3885134693 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040a8050 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 -- 172.21.15.148:0/3885134693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 msgr2=0x7f1b0c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0c6850 tx=0x7f1b0401c520 comp rx=0 tx=0).stop 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 -- 172.21.15.148:0/3885134693 shutdown_connections 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c0703f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 --2- 172.21.15.148:0/3885134693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 --2- 172.21.15.148:0/3885134693 >> v2:172.21.15.157:3300/0 conn(0x7f1b0c1574b0 0x7f1b0c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 -- 172.21.15.148:0/3885134693 >> 172.21.15.148:0/3885134693 conn(0x7f1b0c071160 msgr2=0x7f1b0c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 -- 172.21.15.148:0/3885134693 shutdown_connections 2024-04-26T23:04:36.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.445+0000 7f1b12200640 1 -- 172.21.15.148:0/3885134693 wait complete. 2024-04-26T23:04:36.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 Processor -- start 2024-04-26T23:04:36.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- start start 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b0c1574b0 0x7f1b0c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c0cc700 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c0cc580 con 0x7f1b0c1574b0 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0cc880 con 0x7f1b0c0b47e0 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57254/0 (socket says 172.21.15.148:57254) 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 -- 172.21.15.148:0/3072026745 learned_addr learned my addr 172.21.15.148:0/3072026745 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0b400640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0be00640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b0c1574b0 0x7f1b0c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 -- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 msgr2=0x7f1b0c06dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 -- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b0c1574b0 msgr2=0x7f1b0c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b0c1574b0 0x7f1b0c1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 -- 172.21.15.148:0/3072026745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c1f8a30 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b0aa00640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e7e0 tx=0x7f1af400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af400f040 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af4004030 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c1f8d10 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af40043e0 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1f92d0 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.449+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c077c20 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.453+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f1af400c6d0 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.453+0000 7f1b03400640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 0x7f1ae806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.453+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1af40862b0 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.453+0000 7f1b0b400640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 0x7f1ae806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.453+0000 7f1b0b400640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 0x7f1ae806a7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1afc003fd0 tx=0x7f1afc0039a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.465+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1af4017020 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.621+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b0c0d01a0 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b03400640 1 -- 172.21.15.148:0/3072026745 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f1af4056c00 con 0x7f1b0c0c63f0 2024-04-26T23:04:36.624 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:36.624 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":16,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:36.058305+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 msgr2=0x7f1ae806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 0x7f1ae806a7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1afc003fd0 tx=0x7f1afc0039a0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 msgr2=0x7f1b0c070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e7e0 tx=0x7f1af400eca0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 shutdown_connections 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1ae80682f0 0x7f1ae806a7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b0c1574b0 0x7f1b0c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b0c0c63f0 0x7f1b0c070110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 --2- 172.21.15.148:0/3072026745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b0c0b47e0 0x7f1b0c06dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 >> 172.21.15.148:0/3072026745 conn(0x7f1b0c071160 msgr2=0x7f1b0c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 shutdown_connections 2024-04-26T23:04:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.625+0000 7f1b12200640 1 -- 172.21.15.148:0/3072026745 wait complete. 2024-04-26T23:04:36.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:04:36.646 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:04:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 Processor -- start 2024-04-26T23:04:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 -- start start 2024-04-26T23:04:36.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3d38156040 0x7f3d38070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d380706c0 con 0x7f3d380c7b10 2024-04-26T23:04:36.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d380709a0 con 0x7f3d38073760 2024-04-26T23:04:36.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d3d800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3d38070c80 con 0x7f3d38156040 2024-04-26T23:04:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d2e000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3d380c7b10 0x7f3d3815c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49460/0 (socket says 172.21.15.148:49460) 2024-04-26T23:04:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d2e000640 1 -- 172.21.15.148:0/3409143453 learned_addr learned my addr 172.21.15.148:0/3409143453 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.781+0000 7f3d36a00640 1 --2- 172.21.15.148:0/3409143453 >> v2:172.21.15.157:3300/0 conn(0x7f3d38156040 0x7f3d38070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611521492 0 0) 0x7f3d380706c0 con 0x7f3d380c7b10 2024-04-26T23:04:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d1c003530 con 0x7f3d380c7b10 2024-04-26T23:04:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672025282 0 0) 0x7f3d1c003530 con 0x7f3d380c7b10 2024-04-26T23:04:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36a00640 1 -- 172.21.15.148:0/3409143453 >> v1:172.21.15.157:6789/0 conn(0x7f3d38073760 legacy=0x7f3d3806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36a00640 1 -- 172.21.15.148:0/3409143453 >> v1:172.21.15.148:6789/0 conn(0x7f3d380c7b10 legacy=0x7f3d3815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36a00640 1 -- 172.21.15.148:0/3409143453 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38072c80 con 0x7f3d38156040 2024-04-26T23:04:36.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36a00640 1 --2- 172.21.15.148:0/3409143453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d38156040 0x7f3d38070010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097c0 tx=0x7f3d2801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c254d3ad14da0ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d280b1070 con 0x7f3d38156040 2024-04-26T23:04:36.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d280ac440 con 0x7f3d38156040 2024-04-26T23:04:36.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.785+0000 7f3d36000640 1 -- 172.21.15.148:0/3409143453 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20001680 con 0x7f3d38156040 2024-04-26T23:04:36.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- 172.21.15.148:0/3409143453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d38156040 msgr2=0x7f3d38070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 --2- 172.21.15.148:0/3409143453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d38156040 0x7f3d38070010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097c0 tx=0x7f3d2801c390 comp rx=0 tx=0).stop 2024-04-26T23:04:36.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- 172.21.15.148:0/3409143453 shutdown_connections 2024-04-26T23:04:36.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 --2- 172.21.15.148:0/3409143453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d38156040 0x7f3d38070010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- 172.21.15.148:0/3409143453 >> 172.21.15.148:0/3409143453 conn(0x7f3d380c9d10 msgr2=0x7f3d380ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- 172.21.15.148:0/3409143453 shutdown_connections 2024-04-26T23:04:36.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- 172.21.15.148:0/3409143453 wait complete. 2024-04-26T23:04:36.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 Processor -- start 2024-04-26T23:04:36.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- start start 2024-04-26T23:04:36.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 0x7f3d38144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 0x7f3d381f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380c94b0 con 0x7f3d38156040 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380c9330 con 0x7f3d380c7b10 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d3d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3806fb70 con 0x7f3d38073760 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44956/0 (socket says 172.21.15.148:44956) 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 -- 172.21.15.148:0/2412629075 learned_addr learned my addr 172.21.15.148:0/2412629075 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d36a00640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 0x7f3d38144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d2e000640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 0x7f3d381f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 -- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 msgr2=0x7f3d38144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 0x7f3d38144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 -- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 msgr2=0x7f3d381f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 0x7f3d381f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d37400640 1 -- 172.21.15.148:0/2412629075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38146eb0 con 0x7f3d38156040 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d36a00640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 0x7f3d38144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:36.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.789+0000 7f3d2e000640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 0x7f3d381f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d37400640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c770 tx=0x7f3d3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30003b80 con 0x7f3d38156040 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d30003d20 con 0x7f3d38156040 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d38147190 con 0x7f3d38156040 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000aa90 con 0x7f3d38156040 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d38147750 con 0x7f3d38156040 2024-04-26T23:04:36.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d38077c20 con 0x7f3d38156040 2024-04-26T23:04:36.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f3d3000ac30 con 0x7f3d38156040 2024-04-26T23:04:36.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 0x7f3d1406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:36.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3d300865b0 con 0x7f3d38156040 2024-04-26T23:04:36.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.793+0000 7f3d36a00640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 0x7f3d1406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:36.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.797+0000 7f3d36a00640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 0x7f3d1406a7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d280ae000 tx=0x7f3d280a6070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:36.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.797+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3d30056e70 con 0x7f3d38156040 2024-04-26T23:04:36.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.845+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d30052de0 con 0x7f3d38156040 2024-04-26T23:04:36.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.957+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d3814fea0 con 0x7f3d38156040 2024-04-26T23:04:36.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.957+0000 7f3d2f400640 1 -- 172.21.15.148:0/2412629075 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3d30086030 con 0x7f3d38156040 2024-04-26T23:04:36.960 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 msgr2=0x7f3d1406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 0x7f3d1406a7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d280ae000 tx=0x7f3d280a6070 comp rx=0 tx=0).stop 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 msgr2=0x7f3d380cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c770 tx=0x7f3d3000cc30 comp rx=0 tx=0).stop 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 shutdown_connections 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d140682f0 0x7f3d1406a7b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d38156040 0x7f3d380cc990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d380c7b10 0x7f3d381f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 --2- 172.21.15.148:0/2412629075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d38073760 0x7f3d38144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:36.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 >> 172.21.15.148:0/2412629075 conn(0x7f3d380c9d10 msgr2=0x7f3d380c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:36.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 shutdown_connections 2024-04-26T23:04:36.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:36.961+0000 7f3d3d800640 1 -- 172.21.15.148:0/2412629075 wait complete. 2024-04-26T23:04:36.981 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:04:37.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.117+0000 7ff1f9800640 1 Processor -- start 2024-04-26T23:04:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.117+0000 7ff1f9800640 1 -- start start 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.117+0000 7ff1f9800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1f40ca170 0x7ff1f40ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.117+0000 7ff1f9800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f40c9560 con 0x7ff1f415ca90 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f9800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f40cab00 con 0x7ff1f41594f0 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f9800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f41598d0 con 0x7ff1f40ca170 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff1f415ca90 0x7ff1f4070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49468/0 (socket says 172.21.15.148:49468) 2024-04-26T23:04:37.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 -- 172.21.15.148:0/372914534 learned_addr learned my addr 172.21.15.148:0/372914534 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:37.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f3400640 1 --2- 172.21.15.148:0/372914534 >> v2:172.21.15.157:3300/0 conn(0x7ff1f40ca170 0x7ff1f40ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507158541 0 0) 0x7ff1f40c9560 con 0x7ff1f415ca90 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1d8003530 con 0x7ff1f415ca90 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247200797 0 0) 0x7ff1d8003530 con 0x7ff1f415ca90 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 >> v2:172.21.15.157:3300/0 conn(0x7ff1f40ca170 msgr2=0x7ff1f40ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 --2- 172.21.15.148:0/372914534 >> v2:172.21.15.157:3300/0 conn(0x7ff1f40ca170 0x7ff1f40ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 >> v1:172.21.15.157:6789/0 conn(0x7ff1f41594f0 legacy=0x7ff1f40c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f4160240 con 0x7ff1f415ca90 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7ff1e0001680 con 0x7ff1f415ca90 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 >> v1:172.21.15.148:6789/0 conn(0x7ff1f415ca90 legacy=0x7ff1f4070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80039c0 0x7ff1d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 0x7ff1d8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d8005090 0x7ff1d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41598d0 con 0x7ff1d80043c0 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d800bf40 con 0x7ff1d8005090 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d800c140 con 0x7ff1d80039c0 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 0x7ff1d8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f3400640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d8005090 0x7ff1d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2a00640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80039c0 0x7ff1d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 -- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80039c0 msgr2=0x7ff1d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80039c0 0x7ff1d8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 -- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d8005090 msgr2=0x7ff1d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d8005090 0x7ff1d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f2000640 1 -- 172.21.15.148:0/372914534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d8003530 con 0x7ff1d80043c0 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.121+0000 7ff1f3400640 1 -- 172.21.15.148:0/372914534 reap_dead start 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f2000640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 0x7ff1d8004890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c210 tx=0x7ff1e001f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d98d24501efe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007cf0 con 0x7ff1d80043c0 2024-04-26T23:04:37.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e0005b00 con 0x7ff1d80043c0 2024-04-26T23:04:37.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f1600640 1 -- 172.21.15.148:0/372914534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007070 con 0x7ff1d80043c0 2024-04-26T23:04:37.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 msgr2=0x7ff1d8004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 0x7ff1d8004890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c210 tx=0x7ff1e001f330 comp rx=0 tx=0).stop 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- 172.21.15.148:0/372914534 shutdown_connections 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 --2- 172.21.15.148:0/372914534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1d80043c0 0x7ff1d8004890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- 172.21.15.148:0/372914534 >> 172.21.15.148:0/372914534 conn(0x7ff1f40ce2c0 msgr2=0x7ff1f40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- 172.21.15.148:0/372914534 shutdown_connections 2024-04-26T23:04:37.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- 172.21.15.148:0/372914534 wait complete. 2024-04-26T23:04:37.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 Processor -- start 2024-04-26T23:04:37.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.125+0000 7ff1f9800640 1 -- start start 2024-04-26T23:04:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 0x7ff1f41f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f4153320 0x7ff1f41537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f415fc80 con 0x7ff1f4154660 2024-04-26T23:04:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f415f9a0 con 0x7ff1f4153320 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f415ff60 con 0x7ff1d80043c0 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44968/0 (socket says 172.21.15.148:44968) 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 -- 172.21.15.148:0/1795841933 learned_addr learned my addr 172.21.15.148:0/1795841933 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2a00640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 0x7ff1f41f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f3400640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f4153320 0x7ff1f41537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 -- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 msgr2=0x7ff1f41f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 0x7ff1f41f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 -- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f4153320 msgr2=0x7ff1f41537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f4153320 0x7ff1f41537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 -- 172.21.15.148:0/1795841933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f4153ce0 con 0x7ff1f4154660 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2a00640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 0x7ff1f41f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:37.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f2000640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0025fa0 tx=0x7ff1d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007cf0 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e00b6070 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f41f18c0 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0001680 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41f1e60 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f4077c20 con 0x7ff1f4154660 2024-04-26T23:04:37.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.129+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1e0004a30 con 0x7ff1f4154660 2024-04-26T23:04:37.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.133+0000 7ff1eaa00640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.133+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff1e0123b20 con 0x7ff1f4154660 2024-04-26T23:04:37.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.133+0000 7ff1f2a00640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.133+0000 7ff1f2a00640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406adf0 tx=0x7ff1e4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.137+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff1f4153ce0 con 0x7ff1f4154660 2024-04-26T23:04:37.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.293+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff1f40c9990 con 0x7ff1f4154660 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.293+0000 7ff1eaa00640 1 -- 172.21.15.148:0/1795841933 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff1e0019040 con 0x7ff1f4154660 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": ".mgr" 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:04:37.296 INFO:teuthology.orchestra.run.smithi148.stdout:] 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 msgr2=0x7ff1d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406adf0 tx=0x7ff1e4009040 comp rx=0 tx=0).stop 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 msgr2=0x7ff1f415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0025fa0 tx=0x7ff1d8005840 comp rx=0 tx=0).stop 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 shutdown_connections 2024-04-26T23:04:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f4153320 0x7ff1f41537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f4154660 0x7ff1f415e570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 --2- 172.21.15.148:0/1795841933 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1d80043c0 0x7ff1f41f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 >> 172.21.15.148:0/1795841933 conn(0x7ff1f40ce2c0 msgr2=0x7ff1f40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 shutdown_connections 2024-04-26T23:04:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.297+0000 7ff1f9800640 1 -- 172.21.15.148:0/1795841933 wait complete. 2024-04-26T23:04:37.317 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:04:37.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:04:37.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 Processor -- start 2024-04-26T23:04:37.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 -- start start 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3e10155ee0 0x7f3e1006d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3e1015fbb0 0x7f3e1006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e10070380 con 0x7f3e1006e270 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f3e10070660 con 0x7f3e10155ee0 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e18400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3e10070940 con 0x7f3e1015fbb0 2024-04-26T23:04:37.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3e10155ee0 0x7f3e1006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3e10155ee0 0x7f3e1006d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44978/0 (socket says 172.21.15.148:44978) 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 -- 172.21.15.148:0/83098851 learned_addr learned my addr 172.21.15.148:0/83098851 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15000640 1 --2- 172.21.15.148:0/83098851 >> v2:172.21.15.157:3300/0 conn(0x7f3e1015fbb0 0x7f3e1006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 -- 172.21.15.148:0/83098851 >> v2:172.21.15.157:3300/0 conn(0x7f3e1015fbb0 msgr2=0x7f3e1006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 --2- 172.21.15.148:0/83098851 >> v2:172.21.15.157:3300/0 conn(0x7f3e1015fbb0 0x7f3e1006dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 -- 172.21.15.148:0/83098851 >> v1:172.21.15.157:6789/0 conn(0x7f3e1006e270 legacy=0x7f3e100c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:37.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.457+0000 7f3e15a00640 1 -- 172.21.15.148:0/83098851 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e10070c20 con 0x7f3e10155ee0 2024-04-26T23:04:37.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e15a00640 1 --2- 172.21.15.148:0/83098851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e10155ee0 0x7f3e1006d490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e10071850 tx=0x7f3e0401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df183f84e586e0c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e0fe00640 1 -- 172.21.15.148:0/83098851 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040b0070 con 0x7f3e10155ee0 2024-04-26T23:04:37.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e0fe00640 1 -- 172.21.15.148:0/83098851 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e040ab600 con 0x7f3e10155ee0 2024-04-26T23:04:37.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e0fe00640 1 -- 172.21.15.148:0/83098851 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040ab9d0 con 0x7f3e10155ee0 2024-04-26T23:04:37.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 -- 172.21.15.148:0/83098851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e10155ee0 msgr2=0x7f3e1006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 --2- 172.21.15.148:0/83098851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e10155ee0 0x7f3e1006d490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e10071850 tx=0x7f3e0401c4c0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 -- 172.21.15.148:0/83098851 shutdown_connections 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 --2- 172.21.15.148:0/83098851 >> v2:172.21.15.157:3300/0 conn(0x7f3e1015fbb0 0x7f3e1006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 --2- 172.21.15.148:0/83098851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e10155ee0 0x7f3e1006d490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 -- 172.21.15.148:0/83098851 >> 172.21.15.148:0/83098851 conn(0x7f3e10071f60 msgr2=0x7f3e10072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 -- 172.21.15.148:0/83098851 shutdown_connections 2024-04-26T23:04:37.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.461+0000 7f3e18400640 1 -- 172.21.15.148:0/83098851 wait complete. 2024-04-26T23:04:37.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 Processor -- start 2024-04-26T23:04:37.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- start start 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 0x7f3e101f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e10155ee0 0x7f3e1014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10160110 con 0x7f3e1015fbb0 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1015ff90 con 0x7f3e1006e270 2024-04-26T23:04:37.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3e100c61b0 con 0x7f3e10155ee0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44984/0 (socket says 172.21.15.148:44984) 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 -- 172.21.15.148:0/2852474053 learned_addr learned my addr 172.21.15.148:0/2852474053 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e15000640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e10155ee0 0x7f3e1014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e15a00640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 0x7f3e101f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 -- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e10155ee0 msgr2=0x7f3e1014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e10155ee0 0x7f3e1014d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 -- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 msgr2=0x7f3e101f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 0x7f3e101f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 -- 172.21.15.148:0/2852474053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101f8c00 con 0x7f3e1015fbb0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e15a00640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 0x7f3e101f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e16400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c780 tx=0x7f3e0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08004b70 con 0x7f3e1015fbb0 2024-04-26T23:04:37.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e08004d10 con 0x7f3e1015fbb0 2024-04-26T23:04:37.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e10143de0 con 0x7f3e1015fbb0 2024-04-26T23:04:37.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800aa90 con 0x7f3e1015fbb0 2024-04-26T23:04:37.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.465+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101eee30 con 0x7f3e1015fbb0 2024-04-26T23:04:37.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e101eec50 con 0x7f3e1015fbb0 2024-04-26T23:04:37.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e0800ac30 con 0x7f3e1015fbb0 2024-04-26T23:04:37.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e0d600640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 0x7f3df006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:37.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3e08086990 con 0x7f3e1015fbb0 2024-04-26T23:04:37.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e15a00640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 0x7f3df006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:37.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.469+0000 7f3e15a00640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 0x7f3df006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3e040ad000 tx=0x7f3e040a6000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:37.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.473+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e101eec50 con 0x7f3e1015fbb0 2024-04-26T23:04:37.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:37.641+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3e101ef030 con 0x7f3e1015fbb0 2024-04-26T23:04:38.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.093+0000 7f3e0d600640 1 -- 172.21.15.148:0/2852474053 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f3e101ef030 con 0x7f3e1015fbb0 2024-04-26T23:04:38.094 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2024-04-26T23:04:38.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 msgr2=0x7f3df006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 0x7f3df006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3e040ad000 tx=0x7f3e040a6000 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 msgr2=0x7f3e1014d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c780 tx=0x7f3e0800cc40 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 shutdown_connections 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3df00683b0 0x7f3df006a870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1015fbb0 0x7f3e1014d690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e10155ee0 0x7f3e1014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 --2- 172.21.15.148:0/2852474053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1006e270 0x7f3e101f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 >> 172.21.15.148:0/2852474053 conn(0x7f3e10071f60 msgr2=0x7f3e10158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 shutdown_connections 2024-04-26T23:04:38.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.097+0000 7f3e18400640 1 -- 172.21.15.148:0/2852474053 wait complete. 2024-04-26T23:04:38.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T23:04:38.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.265+0000 7f1051600640 1 Processor -- start 2024-04-26T23:04:38.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.265+0000 7f1051600640 1 -- start start 2024-04-26T23:04:38.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f104c1661e0 0x7f104c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c168c80 0x7f104c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f104c08d8c0 0x7f104c06f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f104c072ea0 con 0x7f104c1661e0 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f104c070c70 con 0x7f104c08d8c0 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f1051600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f104c169130 con 0x7f104c168c80 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f104aa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f104c1661e0 0x7f104c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f104aa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f104c1661e0 0x7f104c0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45000/0 (socket says 172.21.15.148:45000) 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f104a000640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c168c80 0x7f104c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f104b400640 1 --2- 172.21.15.148:0/1983359700 >> v2:172.21.15.157:3300/0 conn(0x7f104c08d8c0 0x7f104c06f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.269+0000 7f104aa00640 1 -- 172.21.15.148:0/1983359700 learned_addr learned my addr 172.21.15.148:0/1983359700 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.513+0000 7f104aa00640 1 -- 172.21.15.148:0/1983359700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c168c80 msgr2=0x7f104c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.513+0000 7f104aa00640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c168c80 0x7f104c06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.513+0000 7f104aa00640 1 -- 172.21.15.148:0/1983359700 >> v2:172.21.15.157:3300/0 conn(0x7f104c08d8c0 msgr2=0x7f104c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.513+0000 7f104aa00640 1 --2- 172.21.15.148:0/1983359700 >> v2:172.21.15.157:3300/0 conn(0x7f104c08d8c0 0x7f104c06f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.513+0000 7f104aa00640 1 -- 172.21.15.148:0/1983359700 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c169410 con 0x7f104c1661e0 2024-04-26T23:04:38.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f104aa00640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c9720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f104c06d960 tx=0x7f103c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d2bed97296ca22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:38.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1049600640 1 -- 172.21.15.148:0/1983359700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c0b0070 con 0x7f104c1661e0 2024-04-26T23:04:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1049600640 1 -- 172.21.15.148:0/1983359700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c0ab600 con 0x7f104c1661e0 2024-04-26T23:04:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1049600640 1 -- 172.21.15.148:0/1983359700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c0ab9d0 con 0x7f104c1661e0 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 -- 172.21.15.148:0/1983359700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 msgr2=0x7f104c0c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c9720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f104c06d960 tx=0x7f103c01c490 comp rx=0 tx=0).stop 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 -- 172.21.15.148:0/1983359700 shutdown_connections 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 --2- 172.21.15.148:0/1983359700 >> v2:172.21.15.157:3300/0 conn(0x7f104c08d8c0 0x7f104c06f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c168c80 0x7f104c06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 --2- 172.21.15.148:0/1983359700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c9720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 -- 172.21.15.148:0/1983359700 >> 172.21.15.148:0/1983359700 conn(0x7f104c0c9d10 msgr2=0x7f104c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 -- 172.21.15.148:0/1983359700 shutdown_connections 2024-04-26T23:04:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.517+0000 7f1051600640 1 -- 172.21.15.148:0/1983359700 wait complete. 2024-04-26T23:04:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 Processor -- start 2024-04-26T23:04:38.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 -- start start 2024-04-26T23:04:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c08d8c0 0x7f104c171c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f104c168c80 0x7f104c169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f104c073cc0 con 0x7f104c1661e0 2024-04-26T23:04:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f104c073b40 con 0x7f104c168c80 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f1051600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f104c16c1f0 con 0x7f104c08d8c0 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45002/0 (socket says 172.21.15.148:45002) 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 -- 172.21.15.148:0/3893526608 learned_addr learned my addr 172.21.15.148:0/3893526608 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104b400640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f104c168c80 0x7f104c169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104aa00640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c08d8c0 0x7f104c171c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 -- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c08d8c0 msgr2=0x7f104c171c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c08d8c0 0x7f104c171c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 -- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f104c168c80 msgr2=0x7f104c169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f104c168c80 0x7f104c169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.521+0000 7f104a000640 1 -- 172.21.15.148:0/3893526608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c1fce90 con 0x7f104c1661e0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f104a000640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1038009b50 tx=0x7f103800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103801a070 con 0x7f104c1661e0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1038009e50 con 0x7f104c1661e0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c16be20 con 0x7f104c1661e0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038015440 con 0x7f104c1661e0 2024-04-26T23:04:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c2059f0 con 0x7f104c1661e0 2024-04-26T23:04:38.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c08d630 con 0x7f104c1661e0 2024-04-26T23:04:38.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.525+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f103801d070 con 0x7f104c1661e0 2024-04-26T23:04:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.529+0000 7f1042a00640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.529+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f1038086ae0 con 0x7f104c1661e0 2024-04-26T23:04:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.529+0000 7f104aa00640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:38.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.529+0000 7f104aa00640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 0x7f102c06a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f104c071ed0 tx=0x7f103c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:38.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.537+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1038024020 con 0x7f104c1661e0 2024-04-26T23:04:38.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:38.693+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f104c172800 con 0x7f104c1661e0 2024-04-26T23:04:39.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.097+0000 7f1042a00640 1 -- 172.21.15.148:0/3893526608 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f1038056da0 con 0x7f104c1661e0 2024-04-26T23:04:39.098 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2024-04-26T23:04:39.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 msgr2=0x7f102c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 0x7f102c06a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f104c071ed0 tx=0x7f103c008040 comp rx=0 tx=0).stop 2024-04-26T23:04:39.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 msgr2=0x7f104c0c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1038009b50 tx=0x7f103800e490 comp rx=0 tx=0).stop 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 shutdown_connections 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f104c168c80 0x7f104c169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c1661e0 0x7f104c0c11a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 --2- 172.21.15.148:0/3893526608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f104c08d8c0 0x7f104c171c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 >> 172.21.15.148:0/3893526608 conn(0x7f104c0c9d10 msgr2=0x7f104c0c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:39.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 shutdown_connections 2024-04-26T23:04:39.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.101+0000 7f1051600640 1 -- 172.21.15.148:0/3893526608 wait complete. 2024-04-26T23:04:39.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:04:39.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.285+0000 7ff394000640 1 Processor -- start 2024-04-26T23:04:39.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.285+0000 7ff394000640 1 -- start start 2024-04-26T23:04:39.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.285+0000 7ff394000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff38c0c9520 0x7ff38c071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff394000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38c0c8e50 con 0x7ff38c15c770 2024-04-26T23:04:39.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff394000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38c160290 con 0x7ff38c070da0 2024-04-26T23:04:39.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff394000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c0c9110 con 0x7ff38c0c9520 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff390c00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff38c15c770 0x7ff38c164850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49470/0 (socket says 172.21.15.148:49470) 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff390c00640 1 -- 172.21.15.148:0/2536009349 learned_addr learned my addr 172.21.15.148:0/2536009349 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 --2- 172.21.15.148:0/2536009349 >> v2:172.21.15.157:3300/0 conn(0x7ff38c0c9520 0x7ff38c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438644748 0 0) 0x7ff38c0c8e50 con 0x7ff38c15c770 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff374003530 con 0x7ff38c15c770 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2223204590 0 0) 0x7ff374003530 con 0x7ff38c15c770 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 >> v2:172.21.15.157:3300/0 conn(0x7ff38c0c9520 msgr2=0x7ff38c071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 --2- 172.21.15.148:0/2536009349 >> v2:172.21.15.157:3300/0 conn(0x7ff38c0c9520 0x7ff38c071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 >> v1:172.21.15.157:6789/0 conn(0x7ff38c070da0 legacy=0x7ff38c15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c0c9d70 con 0x7ff38c15c770 2024-04-26T23:04:39.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7ff378001680 con 0x7ff38c15c770 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 >> v1:172.21.15.148:6789/0 conn(0x7ff38c15c770 legacy=0x7ff38c164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740039c0 0x7ff374003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff374004810 0x7ff374004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 0x7ff37400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c0c9110 con 0x7ff3740051d0 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff37400c070 con 0x7ff3740039c0 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff37400c270 con 0x7ff374004810 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 0x7ff37400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff391600640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740039c0 0x7ff374003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff390c00640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff374004810 0x7ff374004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 -- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff374004810 msgr2=0x7ff374004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff374004810 0x7ff374004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 -- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740039c0 msgr2=0x7ff374003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:39.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740039c0 0x7ff374003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.289+0000 7ff392000640 1 -- 172.21.15.148:0/2536009349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff374003530 con 0x7ff3740051d0 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff392000640 1 -- 172.21.15.148:0/2536009349 reap_dead start 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff392000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 0x7ff37400b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff384009ae0 tx=0x7ff38401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66e5b9234c5382b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3840096b0 con 0x7ff3740051d0 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff384004020 con 0x7ff3740051d0 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff38be00640 1 -- 172.21.15.148:0/2536009349 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384004410 con 0x7ff3740051d0 2024-04-26T23:04:39.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 msgr2=0x7ff37400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 0x7ff37400b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff384009ae0 tx=0x7ff38401cab0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- 172.21.15.148:0/2536009349 shutdown_connections 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 --2- 172.21.15.148:0/2536009349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3740051d0 0x7ff37400b9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- 172.21.15.148:0/2536009349 >> 172.21.15.148:0/2536009349 conn(0x7ff38c0ce2c0 msgr2=0x7ff38c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- 172.21.15.148:0/2536009349 shutdown_connections 2024-04-26T23:04:39.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- 172.21.15.148:0/2536009349 wait complete. 2024-04-26T23:04:39.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 Processor -- start 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- start start 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740051d0 0x7ff38c1e5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff38c15c0f0 0x7ff38c1e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c160060 con 0x7ff38c159ba0 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c15fee0 con 0x7ff3740051d0 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.293+0000 7ff394000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c0ca710 con 0x7ff38c15c0f0 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45014/0 (socket says 172.21.15.148:45014) 2024-04-26T23:04:39.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 -- 172.21.15.148:0/2091532034 learned_addr learned my addr 172.21.15.148:0/2091532034 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff392000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff38c15c0f0 0x7ff38c1e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff391600640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740051d0 0x7ff38c1e5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 -- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff38c15c0f0 msgr2=0x7ff38c1e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff38c15c0f0 0x7ff38c1e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 -- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740051d0 msgr2=0x7ff38c1e5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740051d0 0x7ff38c1e5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 -- 172.21.15.148:0/2091532034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c14e980 con 0x7ff38c159ba0 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff390c00640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff37800e7e0 tx=0x7ff37800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37800c870 con 0x7ff38c159ba0 2024-04-26T23:04:39.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378018070 con 0x7ff38c159ba0 2024-04-26T23:04:39.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38c1f26b0 con 0x7ff38c159ba0 2024-04-26T23:04:39.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37800cc50 con 0x7ff38c159ba0 2024-04-26T23:04:39.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38c1f2990 con 0x7ff38c159ba0 2024-04-26T23:04:39.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38c077c20 con 0x7ff38c159ba0 2024-04-26T23:04:39.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.297+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff37801d460 con 0x7ff38c159ba0 2024-04-26T23:04:39.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.301+0000 7ff389600640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 0x7ff36c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:39.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.301+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7ff3780867e0 con 0x7ff38c159ba0 2024-04-26T23:04:39.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.301+0000 7ff391600640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 0x7ff36c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:39.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.301+0000 7ff391600640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 0x7ff36c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff380005110 tx=0x7ff380009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:39.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.305+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff378056df0 con 0x7ff38c159ba0 2024-04-26T23:04:39.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:39.493+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff38c0c8e50 con 0x7ff38c159ba0 2024-04-26T23:04:40.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.145+0000 7ff389600640 1 -- 172.21.15.148:0/2091532034 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff3780566f0 con 0x7ff38c159ba0 2024-04-26T23:04:40.152 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 msgr2=0x7ff36c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 0x7ff36c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff380005110 tx=0x7ff380009040 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 msgr2=0x7ff38c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff37800e7e0 tx=0x7ff37800eca0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 shutdown_connections 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff36c068380 0x7ff36c06a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff38c15c0f0 0x7ff38c1e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c159ba0 0x7ff38c14f420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 --2- 172.21.15.148:0/2091532034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3740051d0 0x7ff38c1e5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 >> 172.21.15.148:0/2091532034 conn(0x7ff38c0ce2c0 msgr2=0x7ff38c14fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 shutdown_connections 2024-04-26T23:04:40.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.157+0000 7ff394000640 1 -- 172.21.15.148:0/2091532034 wait complete. 2024-04-26T23:04:40.190 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T23:04:40.191 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T23:04:40.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 Processor -- start 2024-04-26T23:04:40.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 -- start start 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45cc0c9760 0x7f45cc152880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45cc06f810 0x7f45cc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45cc15ce80 con 0x7f45cc15c0e0 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f45cc15cbd0 con 0x7f45cc0c9760 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d4200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f45cc0c6f80 con 0x7f45cc06f810 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d0e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45cc0c9760 0x7f45cc152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d0e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45cc0c9760 0x7f45cc152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45024/0 (socket says 172.21.15.148:45024) 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d0e00640 1 -- 172.21.15.148:0/280741511 learned_addr learned my addr 172.21.15.148:0/280741511 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:40.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.333+0000 7f45d2200640 1 --2- 172.21.15.148:0/280741511 >> v2:172.21.15.157:3300/0 conn(0x7f45cc06f810 0x7f45cc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d0e00640 1 -- 172.21.15.148:0/280741511 >> v2:172.21.15.157:3300/0 conn(0x7f45cc06f810 msgr2=0x7f45cc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:40.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d0e00640 1 --2- 172.21.15.148:0/280741511 >> v2:172.21.15.157:3300/0 conn(0x7f45cc06f810 0x7f45cc152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d0e00640 1 -- 172.21.15.148:0/280741511 >> v1:172.21.15.157:6789/0 conn(0x7f45cc15c0e0 legacy=0x7f45cc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d0e00640 1 -- 172.21.15.148:0/280741511 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc0c7520 con 0x7f45cc0c9760 2024-04-26T23:04:40.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d0e00640 1 --2- 172.21.15.148:0/280741511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc152880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0cabc0 tx=0x7f45c001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fcc8fe8becfe4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45cbe00640 1 -- 172.21.15.148:0/280741511 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b5070 con 0x7f45cc0c9760 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45cbe00640 1 -- 172.21.15.148:0/280741511 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c00a8a10 con 0x7f45cc0c9760 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45cbe00640 1 -- 172.21.15.148:0/280741511 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00a8de0 con 0x7f45cc0c9760 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 -- 172.21.15.148:0/280741511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 msgr2=0x7f45cc152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 --2- 172.21.15.148:0/280741511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc152880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0cabc0 tx=0x7f45c001ed10 comp rx=0 tx=0).stop 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 -- 172.21.15.148:0/280741511 shutdown_connections 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 --2- 172.21.15.148:0/280741511 >> v2:172.21.15.157:3300/0 conn(0x7f45cc06f810 0x7f45cc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 --2- 172.21.15.148:0/280741511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc152880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 -- 172.21.15.148:0/280741511 >> 172.21.15.148:0/280741511 conn(0x7f45cc0c9d10 msgr2=0x7f45cc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.337+0000 7f45d4200640 1 -- 172.21.15.148:0/280741511 shutdown_connections 2024-04-26T23:04:40.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- 172.21.15.148:0/280741511 wait complete. 2024-04-26T23:04:40.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 Processor -- start 2024-04-26T23:04:40.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- start start 2024-04-26T23:04:40.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc06f810 0x7f45cc0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 0x7f45cc1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc0c4a90 con 0x7f45cc0c9760 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc0c47b0 con 0x7f45cc15c0e0 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45cc0c4d70 con 0x7f45cc06f810 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45038/0 (socket says 172.21.15.148:45038) 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 -- 172.21.15.148:0/2779275400 learned_addr learned my addr 172.21.15.148:0/2779275400 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d1800640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc06f810 0x7f45cc0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d2200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 0x7f45cc1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 -- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc06f810 msgr2=0x7f45cc0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc06f810 0x7f45cc0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 -- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 msgr2=0x7f45cc1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 0x7f45cc1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 -- 172.21.15.148:0/2779275400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc1f2e30 con 0x7f45cc0c9760 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d2200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 0x7f45cc1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d0e00640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45c001b920 tx=0x7f45c001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b5070 con 0x7f45cc0c9760 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c00b0b30 con 0x7f45cc0c9760 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00bb410 con 0x7f45cc0c9760 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc1f3110 con 0x7f45cc0c9760 2024-04-26T23:04:40.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.341+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc1f36d0 con 0x7f45cc0c9760 2024-04-26T23:04:40.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45cc077c20 con 0x7f45cc0c9760 2024-04-26T23:04:40.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45c00c2060 con 0x7f45cc0c9760 2024-04-26T23:04:40.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45c9600640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 0x7f45b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:40.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f45c0123a90 con 0x7f45cc0c9760 2024-04-26T23:04:40.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45d1800640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 0x7f45b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:40.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.345+0000 7f45d1800640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 0x7f45b006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0015b0 tx=0x7f45bc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.349+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45c0018870 con 0x7f45cc0c9760 2024-04-26T23:04:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:40.513+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f45cc072990 con 0x7f45cc0c9760 2024-04-26T23:04:41.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.153+0000 7f45c9600640 1 -- 172.21.15.148:0/2779275400 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f45c00f4030 con 0x7f45cc0c9760 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 msgr2=0x7f45b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 0x7f45b006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0015b0 tx=0x7f45bc009040 comp rx=0 tx=0).stop 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 msgr2=0x7f45cc153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45c001b920 tx=0x7f45c001bab0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 shutdown_connections 2024-04-26T23:04:41.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45b00683b0 0x7f45b006a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc15c0e0 0x7f45cc1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0c9760 0x7f45cc153290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 --2- 172.21.15.148:0/2779275400 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc06f810 0x7f45cc0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 >> 172.21.15.148:0/2779275400 conn(0x7f45cc0c9d10 msgr2=0x7f45cc0cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 shutdown_connections 2024-04-26T23:04:41.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.157+0000 7f45d4200640 1 -- 172.21.15.148:0/2779275400 wait complete. 2024-04-26T23:04:41.180 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:04:41.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 Processor -- start 2024-04-26T23:04:41.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 -- start start 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1cb0165500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb00ca280 con 0x7f1cb0157130 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb00c4b90 con 0x7f1cb00cb980 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1caf200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb00c4e50 con 0x7f1cb015d9d0 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.325+0000 7f1cade00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1cb0157130 0x7f1cb0072130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49482/0 (socket says 172.21.15.148:49482) 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cade00640 1 -- 172.21.15.148:0/1551956888 learned_addr learned my addr 172.21.15.148:0/1551956888 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:41.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cae800640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1cb0165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585097024 0 0) 0x7f1cb00ca280 con 0x7f1cb0157130 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c94003530 con 0x7f1cb0157130 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3069227456 0 0) 0x7f1c94003530 con 0x7f1cb0157130 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 msgr2=0x7f1cb0165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1cb0165500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 >> v1:172.21.15.157:6789/0 conn(0x7f1cb00cb980 legacy=0x7f1cb015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb00c5130 con 0x7f1cb0157130 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f1ca0001a00 con 0x7f1cb0157130 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 >> v1:172.21.15.148:6789/0 conn(0x7f1cb0157130 legacy=0x7f1cb0072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1c940039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c94003f70 0x7f1c94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c94004d50 0x7f1c940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb00c4e50 con 0x7f1c94003f70 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9400bab0 con 0x7f1c94004d50 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9400bcb0 con 0x7f1cb015d9d0 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c94003f70 0x7f1c94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cade00640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1c940039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1cae800640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c94004d50 0x7f1c940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 -- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 msgr2=0x7f1c940039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:41.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb015d9d0 0x7f1c940039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 -- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c94004d50 msgr2=0x7f1c940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:41.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c94004d50 0x7f1c940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.329+0000 7f1ca5400640 1 -- 172.21.15.148:0/1551956888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c94003530 con 0x7f1c94003f70 2024-04-26T23:04:41.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c94003f70 0x7f1c94004810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001780 tx=0x7f1c9801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64226a7f0e7374ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:41.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980013a0 con 0x7f1c94003f70 2024-04-26T23:04:41.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c980a9070 con 0x7f1c94003f70 2024-04-26T23:04:41.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1cad400640 1 -- 172.21.15.148:0/1551956888 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98003600 con 0x7f1c94003f70 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- 172.21.15.148:0/1551956888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c94003f70 msgr2=0x7f1c94004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 --2- 172.21.15.148:0/1551956888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c94003f70 0x7f1c94004810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001780 tx=0x7f1c9801c420 comp rx=0 tx=0).stop 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1cae800640 1 -- 172.21.15.148:0/1551956888 reap_dead start 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- 172.21.15.148:0/1551956888 shutdown_connections 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- 172.21.15.148:0/1551956888 >> 172.21.15.148:0/1551956888 conn(0x7f1cb00703b0 msgr2=0x7f1cb00707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- 172.21.15.148:0/1551956888 shutdown_connections 2024-04-26T23:04:41.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- 172.21.15.148:0/1551956888 wait complete. 2024-04-26T23:04:41.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 Processor -- start 2024-04-26T23:04:41.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 -- start start 2024-04-26T23:04:41.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.333+0000 7f1caf200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb00c87f0 0x7f1cb015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb015be70 0x7f1cb01f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb00b24a0 con 0x7f1cb0153950 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb00c56f0 con 0x7f1cb015be70 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb0072840 con 0x7f1cb00c87f0 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45046/0 (socket says 172.21.15.148:45046) 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 -- 172.21.15.148:0/1790975336 learned_addr learned my addr 172.21.15.148:0/1790975336 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb00c87f0 0x7f1cb015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cae800640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb015be70 0x7f1cb01f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 -- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb00c87f0 msgr2=0x7f1cb015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb00c87f0 0x7f1cb015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 -- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb015be70 msgr2=0x7f1cb01f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:41.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb015be70 0x7f1cb01f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 -- 172.21.15.148:0/1790975336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb015c2f0 con 0x7f1cb0153950 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1cade00640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001ad0 tx=0x7f1ca000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007170 con 0x7f1cb0153950 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca001a070 con 0x7f1cb0153950 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007530 con 0x7f1cb0153950 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb00c7260 con 0x7f1cb0153950 2024-04-26T23:04:41.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb00c77a0 con 0x7f1cb0153950 2024-04-26T23:04:41.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb00506d0 con 0x7f1cb0153950 2024-04-26T23:04:41.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ca0013040 con 0x7f1cb0153950 2024-04-26T23:04:41.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.337+0000 7f1ca6a00640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 0x7f1c8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:41.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.341+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f1ca008a3c0 con 0x7f1cb0153950 2024-04-26T23:04:41.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.341+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 0x7f1c8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:41.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.341+0000 7f1ca5400640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 0x7f1c8c06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001750 tx=0x7f1c980011a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:41.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.345+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1cb015c2f0 con 0x7f1cb0153950 2024-04-26T23:04:41.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:41.505+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1cb00ca5d0 con 0x7f1cb0153950 2024-04-26T23:04:42.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:04:42.581 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:04:43.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.169+0000 7f1ca6a00640 1 -- 172.21.15.148:0/1790975336 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f1ca005a840 con 0x7f1cb0153950 2024-04-26T23:04:43.171 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data_ec' created 2024-04-26T23:04:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 msgr2=0x7f1c8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 0x7f1c8c06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001750 tx=0x7f1c980011a0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 msgr2=0x7f1cb0153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001ad0 tx=0x7f1ca000f5a0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 shutdown_connections 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c8c0683b0 0x7f1c8c06a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb015be70 0x7f1cb01f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb00c87f0 0x7f1cb015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 --2- 172.21.15.148:0/1790975336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb0153950 0x7f1cb0153d30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 >> 172.21.15.148:0/1790975336 conn(0x7f1cb00703b0 msgr2=0x7f1cb0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 shutdown_connections 2024-04-26T23:04:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.173+0000 7f1caf200640 1 -- 172.21.15.148:0/1790975336 wait complete. 2024-04-26T23:04:43.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T23:04:43.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 Processor -- start 2024-04-26T23:04:43.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 -- start start 2024-04-26T23:04:43.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a4815c0e0 0x7f6a4815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a4815ca00 0x7f6a48152880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4815ce80 con 0x7f6a480c9760 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6a480c6f80 con 0x7f6a4815ca00 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a4e200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a480c7520 con 0x7f6a4815c0e0 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a4815ca00 0x7f6a48152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a47e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a480c9760 0x7f6a48073000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49492/0 (socket says 172.21.15.148:49492) 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a47e00640 1 -- 172.21.15.148:0/4271451323 learned_addr learned my addr 172.21.15.148:0/4271451323 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:43.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a47400640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a4815c0e0 0x7f6a4815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46a00640 1 -- 172.21.15.148:0/4271451323 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a4815c0e0 msgr2=0x7f6a4815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:43.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46a00640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a4815c0e0 0x7f6a4815c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46a00640 1 -- 172.21.15.148:0/4271451323 >> v1:172.21.15.148:6789/0 conn(0x7f6a480c9760 legacy=0x7f6a48073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46a00640 1 -- 172.21.15.148:0/4271451323 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a480c7240 con 0x7f6a4815ca00 2024-04-26T23:04:43.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.349+0000 7f6a46000640 1 -- 172.21.15.148:0/4271451323 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456143407 0 0) 0x7f6a4815ce80 con 0x7f6a480c9760 2024-04-26T23:04:43.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a46a00640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815ca00 0x7f6a48152880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a340097c0 tx=0x7f6a3401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bec0924db2329 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:43.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a46000640 1 -- 172.21.15.148:0/4271451323 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340b5070 con 0x7f6a4815ca00 2024-04-26T23:04:43.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a46000640 1 -- 172.21.15.148:0/4271451323 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a340a8990 con 0x7f6a4815ca00 2024-04-26T23:04:43.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a46000640 1 -- 172.21.15.148:0/4271451323 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340a8d60 con 0x7f6a4815ca00 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 -- 172.21.15.148:0/4271451323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815ca00 msgr2=0x7f6a48152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815ca00 0x7f6a48152880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a340097c0 tx=0x7f6a3401ec90 comp rx=0 tx=0).stop 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 -- 172.21.15.148:0/4271451323 shutdown_connections 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815ca00 0x7f6a48152880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 --2- 172.21.15.148:0/4271451323 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a4815c0e0 0x7f6a4815c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 -- 172.21.15.148:0/4271451323 >> 172.21.15.148:0/4271451323 conn(0x7f6a480c9d10 msgr2=0x7f6a480ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 -- 172.21.15.148:0/4271451323 shutdown_connections 2024-04-26T23:04:43.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.353+0000 7f6a4e200640 1 -- 172.21.15.148:0/4271451323 wait complete. 2024-04-26T23:04:43.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 Processor -- start 2024-04-26T23:04:43.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- start start 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a480c9760 0x7f6a481f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 0x7f6a4814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480c4d70 con 0x7f6a4815c0e0 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480c4a90 con 0x7f6a4815ca00 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a480723d0 con 0x7f6a480c9760 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45070/0 (socket says 172.21.15.148:45070) 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 -- 172.21.15.148:0/1909112924 learned_addr learned my addr 172.21.15.148:0/1909112924 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a47400640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a480c9760 0x7f6a481f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a47e00640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 0x7f6a4814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 -- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a480c9760 msgr2=0x7f6a481f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a480c9760 0x7f6a481f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 -- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 msgr2=0x7f6a4814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 0x7f6a4814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 -- 172.21.15.148:0/1909112924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4814b790 con 0x7f6a4815c0e0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a47e00640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 0x7f6a4814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a46a00640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a3401d340 tx=0x7f6a3401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340b5040 con 0x7f6a4815c0e0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a340b06e0 con 0x7f6a4815c0e0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340b0ad0 con 0x7f6a4815c0e0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a48145d20 con 0x7f6a4815c0e0 2024-04-26T23:04:43.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.357+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4814a520 con 0x7f6a4815c0e0 2024-04-26T23:04:43.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a48077c20 con 0x7f6a4815c0e0 2024-04-26T23:04:43.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a340b0c70 con 0x7f6a4815c0e0 2024-04-26T23:04:43.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a3f400640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 0x7f6a2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:43.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f6a341245c0 con 0x7f6a4815c0e0 2024-04-26T23:04:43.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a47400640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 0x7f6a2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:43.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.361+0000 7f6a47400640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 0x7f6a2806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ac0 tx=0x7f6a38009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:43.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.365+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a340187f0 con 0x7f6a4815c0e0 2024-04-26T23:04:43.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:43.521+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6a48072990 con 0x7f6a4815c0e0 2024-04-26T23:04:44.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.177+0000 7f6a3f400640 1 -- 172.21.15.148:0/1909112924 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f6a340f48f0 con 0x7f6a4815c0e0 2024-04-26T23:04:44.179 INFO:teuthology.orchestra.run.smithi148.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 msgr2=0x7f6a2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 0x7f6a2806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ac0 tx=0x7f6a38009190 comp rx=0 tx=0).stop 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 msgr2=0x7f6a481457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a3401d340 tx=0x7f6a3401ba30 comp rx=0 tx=0).stop 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 shutdown_connections 2024-04-26T23:04:44.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a28068380 0x7f6a2806a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a4815ca00 0x7f6a4814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4815c0e0 0x7f6a481457e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 --2- 172.21.15.148:0/1909112924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a480c9760 0x7f6a481f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 >> 172.21.15.148:0/1909112924 conn(0x7f6a480c9d10 msgr2=0x7f6a480759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:44.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.181+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 shutdown_connections 2024-04-26T23:04:44.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.185+0000 7f6a4e200640 1 -- 172.21.15.148:0/1909112924 wait complete. 2024-04-26T23:04:44.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T23:04:44.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 Processor -- start 2024-04-26T23:04:44.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 -- start start 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 0x7f08280c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f082815d510 0x7f082815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08280cadc0 con 0x7f08280cb760 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f08280c9200 con 0x7f082815d510 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f082e600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0828071130 con 0x7f0828153f70 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f082815d510 0x7f082815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f081ea00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f08280cb760 0x7f0828073c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49508/0 (socket says 172.21.15.148:49508) 2024-04-26T23:04:44.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f081ea00640 1 -- 172.21.15.148:0/338572586 learned_addr learned my addr 172.21.15.148:0/338572586 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:44.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827400640 1 --2- 172.21.15.148:0/338572586 >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 0x7f08280c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:44.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0826a00640 1 -- 172.21.15.148:0/338572586 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080160647 0 0) 0x7f08280cadc0 con 0x7f08280cb760 2024-04-26T23:04:44.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0826a00640 1 -- 172.21.15.148:0/338572586 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f080c003530 con 0x7f08280cb760 2024-04-26T23:04:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827e00640 1 -- 172.21.15.148:0/338572586 >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 msgr2=0x7f08280c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827e00640 1 --2- 172.21.15.148:0/338572586 >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 0x7f08280c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827e00640 1 -- 172.21.15.148:0/338572586 >> v1:172.21.15.148:6789/0 conn(0x7f08280cb760 legacy=0x7f0828073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827e00640 1 -- 172.21.15.148:0/338572586 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082815de80 con 0x7f082815d510 2024-04-26T23:04:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.361+0000 7f0827400640 1 --2- 172.21.15.148:0/338572586 >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 0x7f08280c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f0827e00640 1 --2- 172.21.15.148:0/338572586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082815d940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f082806d440 tx=0x7f082001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0235e8e43a1f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f0826a00640 1 -- 172.21.15.148:0/338572586 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200b2070 con 0x7f082815d510 2024-04-26T23:04:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f0826a00640 1 -- 172.21.15.148:0/338572586 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200a5900 con 0x7f082815d510 2024-04-26T23:04:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f0826a00640 1 -- 172.21.15.148:0/338572586 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200a5cd0 con 0x7f082815d510 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 -- 172.21.15.148:0/338572586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 msgr2=0x7f082815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 --2- 172.21.15.148:0/338572586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082815d940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f082806d440 tx=0x7f082001c930 comp rx=0 tx=0).stop 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 -- 172.21.15.148:0/338572586 shutdown_connections 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 --2- 172.21.15.148:0/338572586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082815d940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 --2- 172.21.15.148:0/338572586 >> v2:172.21.15.157:3300/0 conn(0x7f0828153f70 0x7f08280c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 -- 172.21.15.148:0/338572586 >> 172.21.15.148:0/338572586 conn(0x7f082806d490 msgr2=0x7f082806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 -- 172.21.15.148:0/338572586 shutdown_connections 2024-04-26T23:04:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.365+0000 7f082e600640 1 -- 172.21.15.148:0/338572586 wait complete. 2024-04-26T23:04:44.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 Processor -- start 2024-04-26T23:04:44.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- start start 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08280cb760 0x7f08281f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0828153f70 0x7f0828149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0828074340 con 0x7f082815d510 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08280c9420 con 0x7f0828153f70 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08280744c0 con 0x7f08280cb760 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45090/0 (socket says 172.21.15.148:45090) 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 -- 172.21.15.148:0/901352481 learned_addr learned my addr 172.21.15.148:0/901352481 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 -- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08280cb760 msgr2=0x7f08281f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08280cb760 0x7f08281f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 -- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0828153f70 msgr2=0x7f0828149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0828153f70 0x7f0828149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 -- 172.21.15.148:0/901352481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08280c53a0 con 0x7f082815d510 2024-04-26T23:04:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f0827e00640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0820019540 tx=0x7f08200196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200b2050 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200be070 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200ada70 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0828074170 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.369+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0828150430 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.373+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0828077c20 con 0x7f082815d510 2024-04-26T23:04:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.373+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08200a5780 con 0x7f082815d510 2024-04-26T23:04:44.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.373+0000 7f081fe00640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 0x7f080406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:44.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.373+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f0820121640 con 0x7f082815d510 2024-04-26T23:04:44.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.373+0000 7f0827400640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 0x7f080406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:44.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.377+0000 7f0827400640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 0x7f080406a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0818006f10 tx=0x7f0818008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:44.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.381+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08200c7020 con 0x7f082815d510 2024-04-26T23:04:44.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:44.577+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f08281642a0 con 0x7f082815d510 2024-04-26T23:04:45.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f081fe00640 1 -- 172.21.15.148:0/901352481 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f0820016520 con 0x7f082815d510 2024-04-26T23:04:45.181 INFO:teuthology.orchestra.run.smithi148.stderr:added data pool 4 to fsmap 2024-04-26T23:04:45.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 msgr2=0x7f080406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 0x7f080406a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0818006f10 tx=0x7f0818008040 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 msgr2=0x7f082814a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0820019540 tx=0x7f08200196d0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 shutdown_connections 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08040683b0 0x7f080406a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082815d510 0x7f082814a360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0828153f70 0x7f0828149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 --2- 172.21.15.148:0/901352481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08280cb760 0x7f08281f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 >> 172.21.15.148:0/901352481 conn(0x7f082806d490 msgr2=0x7f0828152340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 shutdown_connections 2024-04-26T23:04:45.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.181+0000 7f082e600640 1 -- 172.21.15.148:0/901352481 wait complete. 2024-04-26T23:04:45.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.337+0000 7f7b20a00640 1 Processor -- start 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.337+0000 7f7b20a00640 1 -- start start 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b20a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7b1c15c580 0x7f7b1c0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b20a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0cb7d0 con 0x7f7b1c0c97f0 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b20a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0cba70 con 0x7f7b1c0ca410 2024-04-26T23:04:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b20a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0c83d0 con 0x7f7b1c15c580 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b1a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7b1c15c580 0x7f7b1c0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b19400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7b1c0c97f0 0x7f7b1c164630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49512/0 (socket says 172.21.15.148:49512) 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b19400640 1 -- 172.21.15.148:0/1083094583 learned_addr learned my addr 172.21.15.148:0/1083094583 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b1a800640 1 -- 172.21.15.148:0/1083094583 >> v1:172.21.15.157:6789/0 conn(0x7f7b1c0ca410 legacy=0x7f7b1c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b1a800640 1 -- 172.21.15.148:0/1083094583 >> v1:172.21.15.148:6789/0 conn(0x7f7b1c0c97f0 legacy=0x7f7b1c164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b1a800640 1 -- 172.21.15.148:0/1083094583 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0c8620 con 0x7f7b1c15c580 2024-04-26T23:04:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.341+0000 7f7b18a00640 1 -- 172.21.15.148:0/1083094583 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681095927 0 0) 0x7f7b1c0cb7d0 con 0x7f7b1c0c97f0 2024-04-26T23:04:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b1a800640 1 --2- 172.21.15.148:0/1083094583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c0ca7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0c8550 tx=0x7f7b1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150913b9b9b838ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b18a00640 1 -- 172.21.15.148:0/1083094583 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b0070 con 0x7f7b1c15c580 2024-04-26T23:04:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b18a00640 1 -- 172.21.15.148:0/1083094583 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b140ab600 con 0x7f7b1c15c580 2024-04-26T23:04:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b18a00640 1 -- 172.21.15.148:0/1083094583 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140ab9d0 con 0x7f7b1c15c580 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- 172.21.15.148:0/1083094583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 msgr2=0x7f7b1c0ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 --2- 172.21.15.148:0/1083094583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c0ca7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0c8550 tx=0x7f7b1401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- 172.21.15.148:0/1083094583 shutdown_connections 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 --2- 172.21.15.148:0/1083094583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c0ca7f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- 172.21.15.148:0/1083094583 >> 172.21.15.148:0/1083094583 conn(0x7f7b1c06c380 msgr2=0x7f7b1c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- 172.21.15.148:0/1083094583 shutdown_connections 2024-04-26T23:04:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- 172.21.15.148:0/1083094583 wait complete. 2024-04-26T23:04:45.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 Processor -- start 2024-04-26T23:04:45.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- start start 2024-04-26T23:04:45.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0c97f0 0x7f7b1c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0ca410 0x7f7b1c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0ccbe0 con 0x7f7b1c15c580 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0cd4c0 con 0x7f7b1c0c97f0 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b20a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c156140 con 0x7f7b1c0ca410 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.345+0000 7f7b1a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45096/0 (socket says 172.21.15.148:45096) 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 -- 172.21.15.148:0/3291106672 learned_addr learned my addr 172.21.15.148:0/3291106672 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b19e00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0c97f0 0x7f7b1c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b19400640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0ca410 0x7f7b1c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 -- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0ca410 msgr2=0x7f7b1c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0ca410 0x7f7b1c0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 -- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0c97f0 msgr2=0x7f7b1c14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0c97f0 0x7f7b1c14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 -- 172.21.15.148:0/3291106672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c14ab00 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b1a800640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b140ae040 tx=0x7f7b14019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b0040 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b140b9070 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b4650 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c14b6a0 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c14ad70 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c077c20 con 0x7f7b1c15c580 2024-04-26T23:04:45.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b140b47f0 con 0x7f7b1c15c580 2024-04-26T23:04:45.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 0x7f7afc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.349+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7b14120930 con 0x7f7b1c15c580 2024-04-26T23:04:45.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.353+0000 7f7b19e00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 0x7f7afc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.353+0000 7f7b19e00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 0x7f7afc06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0012f0 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.357+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b14016090 con 0x7f7b1c15c580 2024-04-26T23:04:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.545+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b1c1f5360 con 0x7f7b1c15c580 2024-04-26T23:04:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.545+0000 7f7b12000640 1 -- 172.21.15.148:0/3291106672 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6838 (secure 0 0 0) 0x7f7b140f0ba0 con 0x7f7b1c15c580 2024-04-26T23:04:45.549 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:45.549 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:04:44.580623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T23:04:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 5 2024-04-26T23:04:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 msgr2=0x7f7afc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 0x7f7afc06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0012f0 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-04-26T23:04:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 msgr2=0x7f7b1c1f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b140ae040 tx=0x7f7b14019240 comp rx=0 tx=0).stop 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 shutdown_connections 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7afc068380 0x7f7afc06a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c15c580 0x7f7b1c1f5600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b1c0ca410 0x7f7b1c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 --2- 172.21.15.148:0/3291106672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b1c0c97f0 0x7f7b1c14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 >> 172.21.15.148:0/3291106672 conn(0x7f7b1c06c380 msgr2=0x7f7b1c072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 shutdown_connections 2024-04-26T23:04:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.549+0000 7f7b20a00640 1 -- 172.21.15.148:0/3291106672 wait complete. 2024-04-26T23:04:45.568 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:45.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 Processor -- start 2024-04-26T23:04:45.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 -- start start 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b47e0 0x7f4eac06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac0cb7f0 con 0x7f4eac0c63f0 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac0ca0d0 con 0x7f4eac1574b0 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eb0a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac0ccd80 con 0x7f4eac0b47e0 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eaa800640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4eac0c63f0 0x7f4eac164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49522/0 (socket says 172.21.15.148:49522) 2024-04-26T23:04:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eaa800640 1 -- 172.21.15.148:0/1172794514 learned_addr learned my addr 172.21.15.148:0/1172794514 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 --2- 172.21.15.148:0/1172794514 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b47e0 0x7f4eac06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388354788 0 0) 0x7f4eac0cb7f0 con 0x7f4eac0c63f0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e90003530 con 0x7f4eac0c63f0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271903984 0 0) 0x7f4e90003530 con 0x7f4eac0c63f0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b47e0 msgr2=0x7f4eac06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 --2- 172.21.15.148:0/1172794514 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b47e0 0x7f4eac06feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 >> v1:172.21.15.157:6789/0 conn(0x7f4eac1574b0 legacy=0x7f4eac0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac0cba90 con 0x7f4eac0c63f0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f4ea4001680 con 0x7f4eac0c63f0 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 >> v1:172.21.15.148:6789/0 conn(0x7f4eac0c63f0 legacy=0x7f4eac164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e900039c0 0x7f4e90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 0x7f4e90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e900051d0 0x7f4e9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0ccd80 con 0x7f4e90004810 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9000c070 con 0x7f4e900051d0 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9000c270 con 0x7f4e900039c0 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 0x7f4e90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eaa800640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e900051d0 0x7f4e9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9e00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e900039c0 0x7f4e90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 -- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e900039c0 msgr2=0x7f4e90003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4e900039c0 0x7f4e90003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 -- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e900051d0 msgr2=0x7f4e9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e900051d0 0x7f4e9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4ea9400640 1 -- 172.21.15.148:0/1172794514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e90003530 con 0x7f4e90004810 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eaa800640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e900051d0 0x7f4e9000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:45.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.705+0000 7f4eaa800640 1 -- 172.21.15.148:0/1172794514 reap_dead start 2024-04-26T23:04:45.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4ea9400640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 0x7f4e90004c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009ab0 tx=0x7f4e9801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c9956e49bd24d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b2070 con 0x7f4e90004810 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980a5640 con 0x7f4e90004810 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4ea8a00640 1 -- 172.21.15.148:0/1172794514 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980096b0 con 0x7f4e90004810 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 -- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 msgr2=0x7f4e90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 0x7f4e90004c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009ab0 tx=0x7f4e9801ca50 comp rx=0 tx=0).stop 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 -- 172.21.15.148:0/1172794514 shutdown_connections 2024-04-26T23:04:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/1172794514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e90004810 0x7f4e90004c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 -- 172.21.15.148:0/1172794514 >> 172.21.15.148:0/1172794514 conn(0x7f4eac071160 msgr2=0x7f4eac068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 -- 172.21.15.148:0/1172794514 shutdown_connections 2024-04-26T23:04:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.709+0000 7f4eb0a00640 1 -- 172.21.15.148:0/1172794514 wait complete. 2024-04-26T23:04:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 Processor -- start 2024-04-26T23:04:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- start start 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 0x7f4eac14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0cd280 0x7f4eac0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0ca3b0 con 0x7f4eac1f06f0 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0c9e80 con 0x7f4e90004810 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac0b1900 con 0x7f4eac0cd280 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45116/0 (socket says 172.21.15.148:45116) 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 -- 172.21.15.148:0/3902377860 learned_addr learned my addr 172.21.15.148:0/3902377860 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea9e00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 0x7f4eac14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea9400640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0cd280 0x7f4eac0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 -- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0cd280 msgr2=0x7f4eac0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0cd280 0x7f4eac0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 -- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 msgr2=0x7f4eac14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 0x7f4eac14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 -- 172.21.15.148:0/3902377860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac0cf190 con 0x7f4eac1f06f0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea9e00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 0x7f4eac14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eaa800640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4eac15ad90 tx=0x7f4ea40118b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401c070 con 0x7f4eac1f06f0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea4013700 con 0x7f4eac1f06f0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1557c0 con 0x7f4eac1f06f0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4010040 con 0x7f4eac1f06f0 2024-04-26T23:04:45.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.713+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac14bb30 con 0x7f4eac1f06f0 2024-04-26T23:04:45.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac077c20 con 0x7f4eac1f06f0 2024-04-26T23:04:45.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ea401f070 con 0x7f4eac1f06f0 2024-04-26T23:04:45.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4ea2000640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:45.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4ea40895a0 con 0x7f4eac1f06f0 2024-04-26T23:04:45.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4ea9e00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:45.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.717+0000 7f4ea9e00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000f90 tx=0x7f4e9c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:45.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.721+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ea4059780 con 0x7f4eac1f06f0 2024-04-26T23:04:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.877+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eac075f30 con 0x7f4eac1f06f0 2024-04-26T23:04:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4ea2000640 1 -- 172.21.15.148:0/3902377860 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f4ea4059080 con 0x7f4eac1f06f0 2024-04-26T23:04:45.881 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:45.881 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 msgr2=0x7f4e8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000f90 tx=0x7f4e9c009040 comp rx=0 tx=0).stop 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 msgr2=0x7f4eac144c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4eac15ad90 tx=0x7f4ea40118b0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 shutdown_connections 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac1f06f0 0x7f4eac144c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0cd280 0x7f4eac0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 --2- 172.21.15.148:0/3902377860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e90004810 0x7f4eac14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:45.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 >> 172.21.15.148:0/3902377860 conn(0x7f4eac071160 msgr2=0x7f4eac06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:45.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 shutdown_connections 2024-04-26T23:04:45.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:45.881+0000 7f4eb0a00640 1 -- 172.21.15.148:0/3902377860 wait complete. 2024-04-26T23:04:45.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:46.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 Processor -- start 2024-04-26T23:04:46.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 -- start start 2024-04-26T23:04:46.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c156280 0x7fc36c0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc36c06d490 0x7fc36c166800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36c15bf60 con 0x7fc36c0c6340 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc36c06d9f0 con 0x7fc36c06d490 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc372000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c06dcd0 con 0x7fc36c156280 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc36c06d490 0x7fc36c166800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc362a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc36c0c6340 0x7fc36c06feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49532/0 (socket says 172.21.15.148:49532) 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc362a00640 1 -- 172.21.15.148:0/3917619837 learned_addr learned my addr 172.21.15.148:0/3917619837 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:46.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36b400640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c156280 0x7fc36c0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36be00640 1 -- 172.21.15.148:0/3917619837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c156280 msgr2=0x7fc36c0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:46.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36be00640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c156280 0x7fc36c0c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36be00640 1 -- 172.21.15.148:0/3917619837 >> v1:172.21.15.148:6789/0 conn(0x7fc36c0c6340 legacy=0x7fc36c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.037+0000 7fc36be00640 1 -- 172.21.15.148:0/3917619837 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c15c1e0 con 0x7fc36c06d490 2024-04-26T23:04:46.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc36be00640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c06d490 0x7fc36c166800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc36401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef32ce62248c5c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc36aa00640 1 -- 172.21.15.148:0/3917619837 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640b2070 con 0x7fc36c06d490 2024-04-26T23:04:46.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc36aa00640 1 -- 172.21.15.148:0/3917619837 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3640a57a0 con 0x7fc36c06d490 2024-04-26T23:04:46.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc36aa00640 1 -- 172.21.15.148:0/3917619837 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5b70 con 0x7fc36c06d490 2024-04-26T23:04:46.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 -- 172.21.15.148:0/3917619837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c06d490 msgr2=0x7fc36c166800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c06d490 0x7fc36c166800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc36401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 -- 172.21.15.148:0/3917619837 shutdown_connections 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c06d490 0x7fc36c166800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 --2- 172.21.15.148:0/3917619837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c156280 0x7fc36c0c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 -- 172.21.15.148:0/3917619837 >> 172.21.15.148:0/3917619837 conn(0x7fc36c071160 msgr2=0x7fc36c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 -- 172.21.15.148:0/3917619837 shutdown_connections 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.041+0000 7fc372000640 1 -- 172.21.15.148:0/3917619837 wait complete. 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 Processor -- start 2024-04-26T23:04:46.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- start start 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc36c06d490 0x7fc36c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c0c6340 0x7fc36c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c156660 con 0x7fc36c156280 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c0c49e0 con 0x7fc36c06d490 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c0705c0 con 0x7fc36c0c6340 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45136/0 (socket says 172.21.15.148:45136) 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 -- 172.21.15.148:0/3999430619 learned_addr learned my addr 172.21.15.148:0/3999430619 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc362a00640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c0c6340 0x7fc36c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36b400640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc36c06d490 0x7fc36c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 -- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c0c6340 msgr2=0x7fc36c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c0c6340 0x7fc36c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 -- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc36c06d490 msgr2=0x7fc36c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc36c06d490 0x7fc36c1513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 -- 172.21.15.148:0/3999430619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c1f4b30 con 0x7fc36c156280 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc36be00640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc364019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640bd020 con 0x7fc36c156280 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3640b8470 con 0x7fc36c156280 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c1f4df0 con 0x7fc36c156280 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640b2040 con 0x7fc36c156280 2024-04-26T23:04:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c1f53b0 con 0x7fc36c156280 2024-04-26T23:04:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.045+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36c077c20 con 0x7fc36c156280 2024-04-26T23:04:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.049+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3640c0020 con 0x7fc36c156280 2024-04-26T23:04:46.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.049+0000 7fc363e00640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 0x7fc34806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.049+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc3641217f0 con 0x7fc36c156280 2024-04-26T23:04:46.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.049+0000 7fc36b400640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 0x7fc34806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.049+0000 7fc36b400640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 0x7fc34806a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009a50 tx=0x7fc35c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.053+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3640c8020 con 0x7fc36c156280 2024-04-26T23:04:46.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.213+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc36c0d0210 con 0x7fc36c156280 2024-04-26T23:04:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.213+0000 7fc363e00640 1 -- 172.21.15.148:0/3999430619 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fc364016560 con 0x7fc36c156280 2024-04-26T23:04:46.215 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:46.215 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:46.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 msgr2=0x7fc34806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 0x7fc34806a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009a50 tx=0x7fc35c008040 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 msgr2=0x7fc36c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc364019680 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 shutdown_connections 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc3480683b0 0x7fc34806a870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc36c156280 0x7fc36c152c90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc36c0c6340 0x7fc36c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 --2- 172.21.15.148:0/3999430619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc36c06d490 0x7fc36c1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 >> 172.21.15.148:0/3999430619 conn(0x7fc36c071160 msgr2=0x7fc36c0cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 shutdown_connections 2024-04-26T23:04:46.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.217+0000 7fc372000640 1 -- 172.21.15.148:0/3999430619 wait complete. 2024-04-26T23:04:46.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:46.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.385+0000 7fb3f9200640 1 Processor -- start 2024-04-26T23:04:46.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.385+0000 7fb3f9200640 1 -- start start 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3f4155ee0 0x7fb3f406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f415fbb0 0x7fb3f406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3f406e270 0x7fb3f40c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f4070380 con 0x7fb3f406e270 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f4070660 con 0x7fb3f4155ee0 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f4070940 con 0x7fb3f415fbb0 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3f406e270 0x7fb3f40c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3f406e270 0x7fb3f40c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45152/0 (socket says 172.21.15.148:45152) 2024-04-26T23:04:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 -- 172.21.15.148:0/155482327 learned_addr learned my addr 172.21.15.148:0/155482327 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f1e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3f4155ee0 0x7fb3f406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3e9400640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f415fbb0 0x7fb3f406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 -- 172.21.15.148:0/155482327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f415fbb0 msgr2=0x7fb3f406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f415fbb0 0x7fb3f406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 -- 172.21.15.148:0/155482327 >> v2:172.21.15.157:3300/0 conn(0x7fb3f4155ee0 msgr2=0x7fb3f406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 --2- 172.21.15.148:0/155482327 >> v2:172.21.15.157:3300/0 conn(0x7fb3f4155ee0 0x7fb3f406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.389+0000 7fb3f2800640 1 -- 172.21.15.148:0/155482327 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f4070c20 con 0x7fb3f406e270 2024-04-26T23:04:46.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f2800640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f40c4d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4071850 tx=0x7fb3ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582d4cb6ab65f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f1400640 1 -- 172.21.15.148:0/155482327 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0b0070 con 0x7fb3f406e270 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f1400640 1 -- 172.21.15.148:0/155482327 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0ab600 con 0x7fb3f406e270 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f1400640 1 -- 172.21.15.148:0/155482327 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0ab9d0 con 0x7fb3f406e270 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- 172.21.15.148:0/155482327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 msgr2=0x7fb3f40c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f40c4d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4071850 tx=0x7fb3ec01c520 comp rx=0 tx=0).stop 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- 172.21.15.148:0/155482327 shutdown_connections 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f40c4d00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 --2- 172.21.15.148:0/155482327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f415fbb0 0x7fb3f406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 --2- 172.21.15.148:0/155482327 >> v2:172.21.15.157:3300/0 conn(0x7fb3f4155ee0 0x7fb3f406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- 172.21.15.148:0/155482327 >> 172.21.15.148:0/155482327 conn(0x7fb3f4071f60 msgr2=0x7fb3f4072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- 172.21.15.148:0/155482327 shutdown_connections 2024-04-26T23:04:46.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- 172.21.15.148:0/155482327 wait complete. 2024-04-26T23:04:46.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 Processor -- start 2024-04-26T23:04:46.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.393+0000 7fb3f9200640 1 -- start start 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f4155ee0 0x7fb3f41eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3f415fbb0 0x7fb3f40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40ca160 con 0x7fb3f406e270 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40c9fe0 con 0x7fb3f415fbb0 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f415ff90 con 0x7fb3f4155ee0 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45156/0 (socket says 172.21.15.148:45156) 2024-04-26T23:04:46.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 -- 172.21.15.148:0/22423821 learned_addr learned my addr 172.21.15.148:0/22423821 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f2800640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3f415fbb0 0x7fb3f40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3e9400640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f4155ee0 0x7fb3f41eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 -- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f4155ee0 msgr2=0x7fb3f41eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f4155ee0 0x7fb3f41eed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 -- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3f415fbb0 msgr2=0x7fb3f40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3f415fbb0 0x7fb3f40cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 -- 172.21.15.148:0/22423821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f41f51b0 con 0x7fb3f406e270 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f1e00640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400ef00 tx=0x7fb3e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4018020 con 0x7fb3f406e270 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e4014400 con 0x7fb3f406e270 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f41f5490 con 0x7fb3f406e270 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40147d0 con 0x7fb3f406e270 2024-04-26T23:04:46.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f40ce420 con 0x7fb3f406e270 2024-04-26T23:04:46.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f4077c20 con 0x7fb3f406e270 2024-04-26T23:04:46.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.397+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3e401b020 con 0x7fb3f406e270 2024-04-26T23:04:46.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.401+0000 7fb3eaa00640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.401+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb3e4087790 con 0x7fb3f406e270 2024-04-26T23:04:46.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.401+0000 7fb3e9400640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.401+0000 7fb3e9400640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 0x7fb3d006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3f415ed10 tx=0x7fb3dc008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.405+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb3e4022030 con 0x7fb3f406e270 2024-04-26T23:04:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3f40696e0 con 0x7fb3f406e270 2024-04-26T23:04:46.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3eaa00640 1 -- 172.21.15.148:0/22423821 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6838 (secure 0 0 0) 0x7fb3e4057970 con 0x7fb3f406e270 2024-04-26T23:04:46.594 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:46.594 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:04:44.580623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T23:04:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 5 2024-04-26T23:04:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 msgr2=0x7fb3d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 0x7fb3d006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3f415ed10 tx=0x7fb3dc008040 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 msgr2=0x7fb3f41f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400ef00 tx=0x7fb3e400b480 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 shutdown_connections 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3f415fbb0 0x7fb3f40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3f4155ee0 0x7fb3f41eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 --2- 172.21.15.148:0/22423821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3f406e270 0x7fb3f41f4b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 >> 172.21.15.148:0/22423821 conn(0x7fb3f4071f60 msgr2=0x7fb3f415ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 shutdown_connections 2024-04-26T23:04:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.593+0000 7fb3f9200640 1 -- 172.21.15.148:0/22423821 wait complete. 2024-04-26T23:04:46.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:46.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 Processor -- start 2024-04-26T23:04:46.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 -- start start 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a3c0c9340 0x7f4a3c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c152fa0 con 0x7f4a3c0732b0 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3c073700 con 0x7f4a3c0c9340 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a42000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c159790 con 0x7f4a3c152bc0 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3be00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4a3c0732b0 0x7f4a3c0c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59254/0 (socket says 172.21.15.148:59254) 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3be00640 1 -- 172.21.15.148:0/489521372 learned_addr learned my addr 172.21.15.148:0/489521372 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3aa00640 1 --2- 172.21.15.148:0/489521372 >> v2:172.21.15.157:3300/0 conn(0x7f4a3c0c9340 0x7f4a3c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3b400640 1 --2- 172.21.15.148:0/489521372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291790868 0 0) 0x7f4a3c152fa0 con 0x7f4a3c0732b0 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003530 con 0x7f4a3c0732b0 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4281395591 0 0) 0x7f4a20003530 con 0x7f4a3c0732b0 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3b400640 1 -- 172.21.15.148:0/489521372 >> v2:172.21.15.157:3300/0 conn(0x7f4a3c0c9340 msgr2=0x7f4a3c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3b400640 1 --2- 172.21.15.148:0/489521372 >> v2:172.21.15.157:3300/0 conn(0x7f4a3c0c9340 0x7f4a3c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3b400640 1 -- 172.21.15.148:0/489521372 >> v1:172.21.15.148:6789/0 conn(0x7f4a3c0732b0 legacy=0x7f4a3c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.749+0000 7f4a3b400640 1 -- 172.21.15.148:0/489521372 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c158930 con 0x7f4a3c152bc0 2024-04-26T23:04:46.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a3b400640 1 --2- 172.21.15.148:0/489521372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0c8e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009d90 tx=0x7f4a2c01f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39944e2d891dea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b5070 con 0x7f4a3c152bc0 2024-04-26T23:04:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0a8bd0 con 0x7f4a3c152bc0 2024-04-26T23:04:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a3a000640 1 -- 172.21.15.148:0/489521372 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34001680 con 0x7f4a3c152bc0 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 -- 172.21.15.148:0/489521372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 msgr2=0x7f4a3c0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 --2- 172.21.15.148:0/489521372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0c8e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009d90 tx=0x7f4a2c01f080 comp rx=0 tx=0).stop 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 -- 172.21.15.148:0/489521372 shutdown_connections 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 --2- 172.21.15.148:0/489521372 >> v2:172.21.15.157:3300/0 conn(0x7f4a3c0c9340 0x7f4a3c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 --2- 172.21.15.148:0/489521372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0c8e00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 -- 172.21.15.148:0/489521372 >> 172.21.15.148:0/489521372 conn(0x7f4a3c06c380 msgr2=0x7f4a3c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 -- 172.21.15.148:0/489521372 shutdown_connections 2024-04-26T23:04:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.753+0000 7f4a42000640 1 -- 172.21.15.148:0/489521372 wait complete. 2024-04-26T23:04:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 Processor -- start 2024-04-26T23:04:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- start start 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a3c0732b0 0x7f4a3c1f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1591d0 con 0x7f4a3c0c9340 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c158ef0 con 0x7f4a3c0732b0 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c1594b0 con 0x7f4a3c152bc0 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34822/0 (socket says 172.21.15.148:34822) 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 -- 172.21.15.148:0/2337924045 learned_addr learned my addr 172.21.15.148:0/2337924045 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:46.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3be00640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 -- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 msgr2=0x7f4a3c0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 -- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a3c0732b0 msgr2=0x7f4a3c1f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a3c0732b0 0x7f4a3c1f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 -- 172.21.15.148:0/2337924045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c1f3cb0 con 0x7f4a3c0c9340 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a3aa00640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e930 tx=0x7f4a2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28017070 con 0x7f4a3c0c9340 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2800ca00 con 0x7f4a3c0c9340 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800cdb0 con 0x7f4a3c0c9340 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c1f3f90 con 0x7f4a3c0c9340 2024-04-26T23:04:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.757+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c1f4550 con 0x7f4a3c0c9340 2024-04-26T23:04:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c077c20 con 0x7f4a3c0c9340 2024-04-26T23:04:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a2801a070 con 0x7f4a3c0c9340 2024-04-26T23:04:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a33400640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 0x7f4a1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4a280870e0 con 0x7f4a3c0c9340 2024-04-26T23:04:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a3b400640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 0x7f4a1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.761+0000 7f4a3b400640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 0x7f4a1c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b2000 tx=0x7f4a2c004ac0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:46.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.765+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a28057410 con 0x7f4a3c0c9340 2024-04-26T23:04:46.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.921+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a3c0c9940 con 0x7f4a3c0c9340 2024-04-26T23:04:46.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a33400640 1 -- 172.21.15.148:0/2337924045 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f4a28056d10 con 0x7f4a3c0c9340 2024-04-26T23:04:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:46.925 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 msgr2=0x7f4a1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 0x7f4a1c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b2000 tx=0x7f4a2c004ac0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 msgr2=0x7f4a3c0cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e930 tx=0x7f4a2800edf0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 shutdown_connections 2024-04-26T23:04:46.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4a1c068380 0x7f4a1c06a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3c152bc0 0x7f4a3c0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a3c0c9340 0x7f4a3c0cd900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 --2- 172.21.15.148:0/2337924045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a3c0732b0 0x7f4a3c1f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 >> 172.21.15.148:0/2337924045 conn(0x7f4a3c06c380 msgr2=0x7f4a3c0c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 shutdown_connections 2024-04-26T23:04:46.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:46.925+0000 7f4a42000640 1 -- 172.21.15.148:0/2337924045 wait complete. 2024-04-26T23:04:47.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:04:39.499207+0000', 'modified': '2024-04-26T23:04:44.580623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4312': {'gid': 4312, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.157:6839/1573676603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 1573676603}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 1573676603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T23:04:47.550 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4312:up:creating 2024-04-26T23:04:48.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:48.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 Processor -- start 2024-04-26T23:04:48.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 -- start start 2024-04-26T23:04:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d4152fa0 con 0x7fc2d4072d70 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d4159790 con 0x7fc2d4152bc0 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.692+0000 7fc2dac00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d4158930 con 0x7fc2d40c9b60 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34824/0 (socket says 172.21.15.148:34824) 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 -- 172.21.15.148:0/2453823644 learned_addr learned my addr 172.21.15.148:0/2453823644 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2cb400640 1 --1- 172.21.15.148:0/2453823644 >> v1:172.21.15.148:6789/0 conn(0x7fc2d4072d70 0x7fc2d40731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59268/0 (socket says 172.21.15.148:59268) 2024-04-26T23:04:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 -- 172.21.15.148:0/2453823644 >> v1:172.21.15.157:6789/0 conn(0x7fc2d4152bc0 legacy=0x7fc2d40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 -- 172.21.15.148:0/2453823644 >> v1:172.21.15.148:6789/0 conn(0x7fc2d4072d70 legacy=0x7fc2d40731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 -- 172.21.15.148:0/2453823644 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d4158c10 con 0x7fc2d40c9b60 2024-04-26T23:04:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d3400640 1 -- 172.21.15.148:0/2453823644 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438813873 0 0) 0x7fc2d4152fa0 con 0x7fc2d4072d70 2024-04-26T23:04:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d8c00640 1 --2- 172.21.15.148:0/2453823644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009e50 tx=0x7fc2cc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443dada449b06a00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d3400640 1 -- 172.21.15.148:0/2453823644 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0b4070 con 0x7fc2d40c9b60 2024-04-26T23:04:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d3400640 1 -- 172.21.15.148:0/2453823644 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0af400 con 0x7fc2d40c9b60 2024-04-26T23:04:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.696+0000 7fc2d3400640 1 -- 172.21.15.148:0/2453823644 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0af7d0 con 0x7fc2d40c9b60 2024-04-26T23:04:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- 172.21.15.148:0/2453823644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d40c9b60 msgr2=0x7fc2d40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 --2- 172.21.15.148:0/2453823644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009e50 tx=0x7fc2cc01f210 comp rx=0 tx=0).stop 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- 172.21.15.148:0/2453823644 shutdown_connections 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 --2- 172.21.15.148:0/2453823644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40c9fb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- 172.21.15.148:0/2453823644 >> 172.21.15.148:0/2453823644 conn(0x7fc2d406c380 msgr2=0x7fc2d406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- 172.21.15.148:0/2453823644 shutdown_connections 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- 172.21.15.148:0/2453823644 wait complete. 2024-04-26T23:04:48.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 Processor -- start 2024-04-26T23:04:48.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- start start 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d4152bc0 0x7fc2d41f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41594b0 con 0x7fc2d4072d70 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41591d0 con 0x7fc2d40c9b60 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2dac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d40ca4f0 con 0x7fc2d4152bc0 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34830/0 (socket says 172.21.15.148:34830) 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 -- 172.21.15.148:0/1290162180 learned_addr learned my addr 172.21.15.148:0/1290162180 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:48.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d8c00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d4152bc0 0x7fc2d41f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2cb400640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 -- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d4152bc0 msgr2=0x7fc2d41f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d4152bc0 0x7fc2d41f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 -- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 msgr2=0x7fc2d40cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2d3e00640 1 -- 172.21.15.148:0/1290162180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d41f60d0 con 0x7fc2d4072d70 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.700+0000 7fc2cb400640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d3e00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c3f0 tx=0x7fc2c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4017070 con 0x7fc2d4072d70 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c40052d0 con 0x7fc2d4072d70 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d41f6370 con 0x7fc2d4072d70 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4003840 con 0x7fc2d4072d70 2024-04-26T23:04:48.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d414d150 con 0x7fc2d4072d70 2024-04-26T23:04:48.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d4077c20 con 0x7fc2d4072d70 2024-04-26T23:04:48.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2c401a070 con 0x7fc2d4072d70 2024-04-26T23:04:48.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 0x7fc2b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:48.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc2c4086070 con 0x7fc2d4072d70 2024-04-26T23:04:48.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.704+0000 7fc2cb400640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 0x7fc2b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:48.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.708+0000 7fc2cb400640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 0x7fc2b006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40cc8e0 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:48.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.708+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc2c4005480 con 0x7fc2d4072d70 2024-04-26T23:04:48.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.900+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2d4076010 con 0x7fc2d4072d70 2024-04-26T23:04:48.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.900+0000 7fc2d0c00640 1 -- 172.21.15.148:0/1290162180 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6838 (secure 0 0 0) 0x7fc2c40562e0 con 0x7fc2d4072d70 2024-04-26T23:04:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:48.903 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:04:44.580623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T23:04:48.903 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 5 2024-04-26T23:04:48.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 msgr2=0x7fc2b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 0x7fc2b006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40cc8e0 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2024-04-26T23:04:48.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 msgr2=0x7fc2d415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c3f0 tx=0x7fc2c400c8b0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 shutdown_connections 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc2b0068380 0x7fc2b006a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d4152bc0 0x7fc2d41f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d40c9b60 0x7fc2d40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 --2- 172.21.15.148:0/1290162180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d4072d70 0x7fc2d415a730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 >> 172.21.15.148:0/1290162180 conn(0x7fc2d406c380 msgr2=0x7fc2d40c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 shutdown_connections 2024-04-26T23:04:48.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:48.904+0000 7fc2dac00640 1 -- 172.21.15.148:0/1290162180 wait complete. 2024-04-26T23:04:49.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:04:39.499207+0000', 'modified': '2024-04-26T23:04:44.580623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4312': {'gid': 4312, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.157:6839/1573676603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 1573676603}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 1573676603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T23:04:49.529 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4312:up:creating 2024-04-26T23:04:50.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:04:50.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.672+0000 7f8203600640 1 Processor -- start 2024-04-26T23:04:50.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.672+0000 7f8203600640 1 -- start start 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8203600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81fc152bc0 0x7f81fc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8203600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81fc152fa0 con 0x7f81fc073480 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8203600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81fc159790 con 0x7f81fc0c9340 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8203600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc158930 con 0x7f81fc152bc0 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8201600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f81fc073480 0x7f81fc0c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59280/0 (socket says 172.21.15.148:59280) 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8201600640 1 -- 172.21.15.148:0/1922697578 learned_addr learned my addr 172.21.15.148:0/1922697578 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:50.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 --2- 172.21.15.148:0/1922697578 >> v2:172.21.15.157:3300/0 conn(0x7f81fc152bc0 0x7f81fc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249828674 0 0) 0x7f81fc152fa0 con 0x7f81fc073480 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e0003530 con 0x7f81fc073480 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196922074 0 0) 0x7f81fc159790 con 0x7f81fc0c9340 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81fc152fa0 con 0x7f81fc0c9340 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1082138034 0 0) 0x7f81e0003530 con 0x7f81fc073480 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 >> v2:172.21.15.157:3300/0 conn(0x7f81fc152bc0 msgr2=0x7f81fc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:50.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 --2- 172.21.15.148:0/1922697578 >> v2:172.21.15.157:3300/0 conn(0x7f81fc152bc0 0x7f81fc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 >> v1:172.21.15.157:6789/0 conn(0x7f81fc0c9340 legacy=0x7f81fc072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc158c10 con 0x7f81fc073480 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f81f4001a00 con 0x7f81fc073480 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 >> v1:172.21.15.148:6789/0 conn(0x7f81fc073480 legacy=0x7f81fc0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81e0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81e0004810 0x7f81e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81e00051d0 0x7f81e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc158930 con 0x7f81e0003ba0 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f81e000bff0 con 0x7f81e0004810 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f81e000c1f0 con 0x7f81e00051d0 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81e0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8201600640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81e00051d0 0x7f81e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f81fbe00640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81e0004810 0x7f81e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 -- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81e00051d0 msgr2=0x7f81e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81e00051d0 0x7f81e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 -- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81e0004810 msgr2=0x7f81e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81e0004810 0x7f81e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8200c00640 1 -- 172.21.15.148:0/1922697578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e0003530 con 0x7f81e0003ba0 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.676+0000 7f8201600640 1 -- 172.21.15.148:0/1922697578 reap_dead start 2024-04-26T23:04:50.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8200c00640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81e0003fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009670 tx=0x7f81e401eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf14afd61233c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:50.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40b4070 con 0x7f81e0003ba0 2024-04-26T23:04:50.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e40a78a0 con 0x7f81e0003ba0 2024-04-26T23:04:50.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f81fb400640 1 -- 172.21.15.148:0/1922697578 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40096b0 con 0x7f81e0003ba0 2024-04-26T23:04:50.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 -- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 msgr2=0x7f81e0003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81e0003fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009670 tx=0x7f81e401eca0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 -- 172.21.15.148:0/1922697578 shutdown_connections 2024-04-26T23:04:50.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 --2- 172.21.15.148:0/1922697578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81e0003fa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 -- 172.21.15.148:0/1922697578 >> 172.21.15.148:0/1922697578 conn(0x7f81fc06c380 msgr2=0x7f81fc06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:50.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 -- 172.21.15.148:0/1922697578 shutdown_connections 2024-04-26T23:04:50.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.680+0000 7f8203600640 1 -- 172.21.15.148:0/1922697578 wait complete. 2024-04-26T23:04:50.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 Processor -- start 2024-04-26T23:04:50.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- start start 2024-04-26T23:04:50.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81fc0cbdf0 0x7f81fc0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 0x7f81fc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1594b0 con 0x7f81e0003ba0 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1591d0 con 0x7f81fc0cc250 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc0c47d0 con 0x7f81fc0cbdf0 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34852/0 (socket says 172.21.15.148:34852) 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 -- 172.21.15.148:0/3428761488 learned_addr learned my addr 172.21.15.148:0/3428761488 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f81fbe00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81fc0cbdf0 0x7f81fc0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8201600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 0x7f81fc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 -- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81fc0cbdf0 msgr2=0x7f81fc0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81fc0cbdf0 0x7f81fc0ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 -- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 msgr2=0x7f81fc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 0x7f81fc0cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 -- 172.21.15.148:0/3428761488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc1f5330 con 0x7f81e0003ba0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8201600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 0x7f81fc0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8200c00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81e40251d0 tx=0x7f81e401ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40b4030 con 0x7f81e0003ba0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e40b6070 con 0x7f81e0003ba0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004230 con 0x7f81e0003ba0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc1f5610 con 0x7f81e0003ba0 2024-04-26T23:04:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1f5bd0 con 0x7f81e0003ba0 2024-04-26T23:04:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.684+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc077c20 con 0x7f81e0003ba0 2024-04-26T23:04:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.688+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81e40b8070 con 0x7f81e0003ba0 2024-04-26T23:04:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.688+0000 7f81f8c00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 0x7f81d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.688+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f81e411fdc0 con 0x7f81e0003ba0 2024-04-26T23:04:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.688+0000 7f81fbe00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 0x7f81d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.688+0000 7f81fbe00640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 0x7f81d806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007af0 tx=0x7f81ec007210 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:50.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.692+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f81e40189b0 con 0x7f81e0003ba0 2024-04-26T23:04:50.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.880+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81fc0c9940 con 0x7f81e0003ba0 2024-04-26T23:04:50.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.880+0000 7f81f8c00640 1 -- 172.21.15.148:0/3428761488 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6843 (secure 0 0 0) 0x7f81e40ef950 con 0x7f81e0003ba0 2024-04-26T23:04:50.883 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:50.883 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:04:49.197910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4312,"qdb_cluster":[4312]},"id":1}]} 2024-04-26T23:04:50.884 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 7 2024-04-26T23:04:50.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 msgr2=0x7f81d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 0x7f81d806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007af0 tx=0x7f81ec007210 comp rx=0 tx=0).stop 2024-04-26T23:04:50.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 msgr2=0x7f81fc1deb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81e40251d0 tx=0x7f81e401ba40 comp rx=0 tx=0).stop 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 shutdown_connections 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f81d80683b0 0x7f81d806a870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81fc0cc250 0x7f81fc0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81fc0cbdf0 0x7f81fc0ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 --2- 172.21.15.148:0/3428761488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81e0003ba0 0x7f81fc1deb60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 >> 172.21.15.148:0/3428761488 conn(0x7f81fc06c380 msgr2=0x7f81fc0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 shutdown_connections 2024-04-26T23:04:50.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:50.884+0000 7f8203600640 1 -- 172.21.15.148:0/3428761488 wait complete. 2024-04-26T23:04:51.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:04:39.499207+0000', 'modified': '2024-04-26T23:04:49.197910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4312': {'gid': 4312, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.157:6839/1573676603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 1573676603}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 1573676603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4312, 'qdb_cluster': [4312]} 2024-04-26T23:04:51.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:04:51.508 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:04:51.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 Processor -- start 2024-04-26T23:04:51.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 -- start start 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92bc0c44a0 0x7f92bc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f92bc0c9e80 0x7f92bc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92bc0c49e0 con 0x7f92bc157250 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc0cbb50 con 0x7f92bc0c44a0 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92c1c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc0caf80 con 0x7f92bc0c9e80 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92bc0c44a0 0x7f92bc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92bc0c44a0 0x7f92bc15d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34858/0 (socket says 172.21.15.148:34858) 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 -- 172.21.15.148:0/1459513408 learned_addr learned my addr 172.21.15.148:0/1459513408 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92baa00640 1 --1- 172.21.15.148:0/1459513408 >> v1:172.21.15.148:6789/0 conn(0x7f92bc157250 0x7f92bc06ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59282/0 (socket says 172.21.15.148:59282) 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92bb400640 1 --2- 172.21.15.148:0/1459513408 >> v2:172.21.15.157:3300/0 conn(0x7f92bc0c9e80 0x7f92bc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 -- 172.21.15.148:0/1459513408 >> v2:172.21.15.157:3300/0 conn(0x7f92bc0c9e80 msgr2=0x7f92bc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 --2- 172.21.15.148:0/1459513408 >> v2:172.21.15.157:3300/0 conn(0x7f92bc0c9e80 0x7f92bc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 -- 172.21.15.148:0/1459513408 >> v1:172.21.15.148:6789/0 conn(0x7f92bc157250 legacy=0x7f92bc06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:51.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92ba000640 1 -- 172.21.15.148:0/1459513408 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0c6450 con 0x7f92bc0c44a0 2024-04-26T23:04:51.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.648+0000 7f92b9600640 1 -- 172.21.15.148:0/1459513408 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750100445 0 0) 0x7f92bc0c49e0 con 0x7f92bc157250 2024-04-26T23:04:51.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92ba000640 1 --2- 172.21.15.148:0/1459513408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc15d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0c4bb0 tx=0x7f92a801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda26b14edc182c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:51.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92b9600640 1 -- 172.21.15.148:0/1459513408 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80b1070 con 0x7f92bc0c44a0 2024-04-26T23:04:51.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92b9600640 1 -- 172.21.15.148:0/1459513408 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a80ac600 con 0x7f92bc0c44a0 2024-04-26T23:04:51.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92b9600640 1 -- 172.21.15.148:0/1459513408 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80ac9d0 con 0x7f92bc0c44a0 2024-04-26T23:04:51.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 -- 172.21.15.148:0/1459513408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 msgr2=0x7f92bc15d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 --2- 172.21.15.148:0/1459513408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc15d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0c4bb0 tx=0x7f92a801c490 comp rx=0 tx=0).stop 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 -- 172.21.15.148:0/1459513408 shutdown_connections 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 --2- 172.21.15.148:0/1459513408 >> v2:172.21.15.157:3300/0 conn(0x7f92bc0c9e80 0x7f92bc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 --2- 172.21.15.148:0/1459513408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc15d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 -- 172.21.15.148:0/1459513408 >> 172.21.15.148:0/1459513408 conn(0x7f92bc068140 msgr2=0x7f92bc068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 -- 172.21.15.148:0/1459513408 shutdown_connections 2024-04-26T23:04:51.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.652+0000 7f92c1c00640 1 -- 172.21.15.148:0/1459513408 wait complete. 2024-04-26T23:04:51.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 Processor -- start 2024-04-26T23:04:51.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- start start 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92bc0c9e80 0x7f92bc146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92bc157250 0x7f92bc156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0b26c0 con 0x7f92bc0c44a0 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc157630 con 0x7f92bc0c9e80 2024-04-26T23:04:51.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc0b2840 con 0x7f92bc157250 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34862/0 (socket says 172.21.15.148:34862) 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 -- 172.21.15.148:0/3753540484 learned_addr learned my addr 172.21.15.148:0/3753540484 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92ba000640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92bc0c9e80 0x7f92bc146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92bb400640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92bc157250 0x7f92bc156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 -- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92bc157250 msgr2=0x7f92bc156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92bc157250 0x7f92bc156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 -- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92bc0c9e80 msgr2=0x7f92bc146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92bc0c9e80 0x7f92bc146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 -- 172.21.15.148:0/3753540484 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc14b070 con 0x7f92bc0c44a0 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92baa00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c7c0 tx=0x7f92ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:51.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92b2a00640 1 -- 172.21.15.148:0/3753540484 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac018070 con 0x7f92bc0c44a0 2024-04-26T23:04:51.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92b2a00640 1 -- 172.21.15.148:0/3753540484 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac00a640 con 0x7f92bc0c44a0 2024-04-26T23:04:51.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc1467b0 con 0x7f92bc0c44a0 2024-04-26T23:04:51.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92b2a00640 1 -- 172.21.15.148:0/3753540484 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00aa30 con 0x7f92bc0c44a0 2024-04-26T23:04:51.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.656+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc146d70 con 0x7f92bc0c44a0 2024-04-26T23:04:51.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92b2a00640 1 -- 172.21.15.148:0/3753540484 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92ac01b070 con 0x7f92bc0c44a0 2024-04-26T23:04:51.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92b2a00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 0x7f929c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92b2a00640 1 -- 172.21.15.148:0/3753540484 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92ac0863a0 con 0x7f92bc0c44a0 2024-04-26T23:04:51.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92ba000640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 0x7f929c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 Processor -- start 2024-04-26T23:04:51.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 -- start start 2024-04-26T23:04:51.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92ba000640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 0x7f929c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ae000 tx=0x7f92a8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:51.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e77e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56290e638140 con 0x56290e77d700 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56290e5cde00 con 0x56290e77e940 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.660+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56290e586a00 con 0x56290e77e020 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34866/0 (socket says 172.21.15.148:34866) 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 -- 172.21.15.148:0/1211108886 learned_addr learned my addr 172.21.15.148:0/1211108886 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92ba000640 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e77e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92bb400640 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 -- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 msgr2=0x56290e77e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e77e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 -- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 msgr2=0x56290e7cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 -- 172.21.15.148:0/1211108886 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e58b0e0 con 0x56290e77d700 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac084430 tx=0x7f92ac055d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09fb3ab871e188f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92a7400640 1 -- 172.21.15.148:0/1211108886 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac05ea60 con 0x56290e77d700 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92a7400640 1 -- 172.21.15.148:0/1211108886 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac07de50 con 0x56290e77d700 2024-04-26T23:04:51.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92a7400640 1 -- 172.21.15.148:0/1211108886 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0860c0 con 0x56290e77d700 2024-04-26T23:04:51.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- 172.21.15.148:0/1211108886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 msgr2=0x56290e77dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:51.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac084430 tx=0x7f92ac055d80 comp rx=0 tx=0).stop 2024-04-26T23:04:51.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- 172.21.15.148:0/1211108886 shutdown_connections 2024-04-26T23:04:51.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e77e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- 172.21.15.148:0/1211108886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e77dae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- 172.21.15.148:0/1211108886 >> 172.21.15.148:0/1211108886 conn(0x56290e7bf5f0 msgr2=0x56290e7c19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- 172.21.15.148:0/1211108886 shutdown_connections 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- 172.21.15.148:0/1211108886 wait complete. 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- start start 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 Processor -- start 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77d700 0x56290e7be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e7be910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56290e5db200 con 0x56290e77e940 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56290e571e80 con 0x56290e77e020 2024-04-26T23:04:51.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56290e5c8ae0 con 0x56290e77d700 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92c5095000 10 client.0 _ll_register_callbacks cb 0x56290e5dada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92bb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92bb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34874/0 (socket says 172.21.15.148:34874) 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92bb400640 1 -- 172.21.15.148:0/3121488030 learned_addr learned my addr 172.21.15.148:0/3121488030 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92baa00640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77d700 0x56290e7be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.664+0000 7f92ba000640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e7be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 -- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77d700 msgr2=0x56290e7be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77d700 0x56290e7be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 -- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 msgr2=0x56290e7be910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e7be910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:51.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 -- 172.21.15.148:0/3121488030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290e56d4e0 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92bb400640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92b400bf80 tx=0x7f92b40116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b6ac8ea31e97ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4019070 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ac07de50 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92b4015650 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f92b4024050 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 10 client.4401 fetch_fsmap learned FSMap version 7 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56290e553e80 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac07de50 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f92b4027020 con 0x56290e77e940 2024-04-26T23:04:51.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 10 client.4401 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 20 client.4401 populate_metadata read hostname 'smithi148' 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7ca910 0x56290e7cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 4 client.4401 mds_command: new command op to 4312 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 --> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56290e566bc0 con 0x56290e7ca910 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92baa00640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7ca910 0x56290e7cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f92baa00640 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7ca910 0x56290e7cacf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d99ca41e0f5f5bf server_cookie=2b94bd08b5baadf5 in_seq=0 out_seq=0 2024-04-26T23:04:51.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:51.668+0000 7f929be00640 10 client.4401 ms_handle_connect on v2:172.21.15.157:6838/1573676603 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f929be00640 1 -- 172.21.15.148:0/3121488030 <== mds.0 v2:172.21.15.157:6838/1573676603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56290e566bc0 con 0x56290e7ca910 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f929be00640 10 client.4401 handle_command_reply: tid=0 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 client.4401 shutdown 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 msgr2=0x56290e7c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92b400bf80 tx=0x7f92b40116f0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 shutdown_connections 2024-04-26T23:04:54.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7ca910 0x56290e7cacf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77e940 0x56290e7c9c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e7be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 --2- 172.21.15.148:0/3121488030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77d700 0x56290e7be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f929be00640 0 client.4401 ms_handle_reset on v2:172.21.15.157:6838/1573676603 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 >> 172.21.15.148:0/3121488030 conn(0x56290e7bf5f0 msgr2=0x56290e77ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 shutdown_connections 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 1 -- 172.21.15.148:0/3121488030 wait complete. 2024-04-26T23:04:54.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.200+0000 7f92c5095000 20 client.4401 trim_cache size 0 max 16384 2024-04-26T23:04:54.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.220+0000 7f92c5095000 1 Processor -- start 2024-04-26T23:04:54.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.220+0000 7f92c5095000 1 -- start start 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e77c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e940 0x56290e77cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc200c40 con 0x56290e77d700 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc201260 con 0x56290e77e020 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56290e5637b0 con 0x56290e77e940 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34886/0 (socket says 172.21.15.148:34886) 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 -- 172.21.15.148:0/744859625 learned_addr learned my addr 172.21.15.148:0/744859625 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92bb400640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e940 0x56290e77cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92ba000640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e77c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 -- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e940 msgr2=0x56290e77cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e940 0x56290e77cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 -- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 msgr2=0x56290e77c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e77c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 -- 172.21.15.148:0/744859625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e783990 con 0x56290e77d700 2024-04-26T23:04:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92ba000640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e77c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92baa00640 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0564e0 tx=0x7f92ac086050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3610a0ae232fb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92a6a00640 1 -- 172.21.15.148:0/744859625 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac055c50 con 0x56290e77d700 2024-04-26T23:04:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92a6a00640 1 -- 172.21.15.148:0/744859625 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac07de50 con 0x56290e77d700 2024-04-26T23:04:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.224+0000 7f92a6a00640 1 -- 172.21.15.148:0/744859625 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac053fa0 con 0x56290e77d700 2024-04-26T23:04:54.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- 172.21.15.148:0/744859625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 msgr2=0x56290e7be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0564e0 tx=0x7f92ac086050 comp rx=0 tx=0).stop 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- 172.21.15.148:0/744859625 shutdown_connections 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e940 0x56290e77cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e020 0x56290e77c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- 172.21.15.148:0/744859625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7be870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- 172.21.15.148:0/744859625 >> 172.21.15.148:0/744859625 conn(0x56290e7bf5f0 msgr2=0x56290e7dc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- 172.21.15.148:0/744859625 shutdown_connections 2024-04-26T23:04:54.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- 172.21.15.148:0/744859625 wait complete. 2024-04-26T23:04:54.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- start start 2024-04-26T23:04:54.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 Processor -- start 2024-04-26T23:04:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e7d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56290e5d2430 con 0x56290e77d700 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56290e5cd110 con 0x56290e77e940 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56290e5da0a0 con 0x56290e77e020 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92c5095000 10 client.0 _ll_register_callbacks cb 0x7f92b400b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92ba000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e7d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34890/0 (socket says 172.21.15.148:34890) 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 -- 172.21.15.148:0/3541113298 learned_addr learned my addr 172.21.15.148:0/3541113298 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92bb400640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 -- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 msgr2=0x56290e7d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e7d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 -- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 msgr2=0x56290e7cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.228+0000 7f92baa00640 1 -- 172.21.15.148:0/3541113298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290e586c50 con 0x56290e77d700 2024-04-26T23:04:54.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92baa00640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0522e0 tx=0x7f92ac001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd7d181c49bddbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:54.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac055c50 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92ac0860b0 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ac07de50 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f92ac053fa0 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 10 client.4407 fetch_fsmap learned FSMap version 7 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56290e650160 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac07de50 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f92ac0524f0 con 0x56290e77d700 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 10 client.4407 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 20 client.4407 populate_metadata read hostname 'smithi148' 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 4 client.4407 mds_command: new command op to 4312 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 --> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] -- command(tid 0: {"prefix": "status"}) -- 0x56290e5dba10 con 0x56290e7cc560 2024-04-26T23:04:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b806daf4b515b1 server_cookie=b2cf364f38b32616 in_seq=0 out_seq=0 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 10 client.4407 ms_handle_connect on v2:172.21.15.157:6838/1573676603 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 -- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 msgr2=0x56290e83cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 -- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 msgr2=0x56290e83cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:04:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92ba000640 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b806daf4b515b1 server_cookie=b2cf364f38b32616 in_seq=0 out_seq=1 2024-04-26T23:04:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 10 client.4407 ms_handle_connect on v2:172.21.15.157:6838/1573676603 2024-04-26T23:04:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 1 -- 172.21.15.148:0/3541113298 <== mds.0 v2:172.21.15.157:6838/1573676603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x56290e5dba10 con 0x56290e7cc560 2024-04-26T23:04:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f929be00640 10 client.4407 handle_command_reply: tid=0 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.232+0000 7f92c5095000 1 client.4407 shutdown 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 msgr2=0x56290e7d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0522e0 tx=0x7f92ac001260 comp rx=0 tx=0).stop 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 shutdown_connections 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x56290e7cc560 0x56290e83cc90 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56290e77e940 0x56290e7cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56290e77e020 0x56290e7d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 --2- 172.21.15.148:0/3541113298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56290e77d700 0x56290e7d0100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f929be00640 0 client.4407 ms_handle_reset on v2:172.21.15.157:6838/1573676603 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 >> 172.21.15.148:0/3541113298 conn(0x56290e7bf5f0 msgr2=0x56290e7db220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 shutdown_connections 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 1 -- 172.21.15.148:0/3541113298 wait complete. 2024-04-26T23:04:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c5095000 20 client.4407 trim_cache size 0 max 16384 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4312, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 14.076177936000001, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 6, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 24, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T23:04:54.240 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 20.867198081000002 2024-04-26T23:04:54.241 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:04:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 msgr2=0x7f929c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 0x7f929c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ae000 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2024-04-26T23:04:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 msgr2=0x7f92bc1f40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c7c0 tx=0x7f92ac00cc80 comp rx=0 tx=0).stop 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 shutdown_connections 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f929c068380 0x7f929c06a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92bc157250 0x7f92bc156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92bc0c9e80 0x7f92bc146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 --2- 172.21.15.148:0/3753540484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc0c44a0 0x7f92bc1f40c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 >> 172.21.15.148:0/3753540484 conn(0x7f92bc068140 msgr2=0x7f92bc15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 shutdown_connections 2024-04-26T23:04:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.236+0000 7f92c1c00640 1 -- 172.21.15.148:0/3753540484 wait complete. 2024-04-26T23:04:54.261 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:04:54.261 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:54.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:04:54.328 INFO:tasks.ceph.mds.b.smithi157.stderr:2024-04-26T23:04:54.328+0000 7f1edb803640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:04:54.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 Processor -- start 2024-04-26T23:04:54.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 -- start start 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7981570f0 0x7fa79815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa798071680 0x7fa7980c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7980ca650 con 0x7fa7980c6120 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fa7980c9d40 con 0x7fa798071680 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79de00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa798070bc0 con 0x7fa7981570f0 2024-04-26T23:04:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa78fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa798071680 0x7fa7980c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79d400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa7980c6120 0x7fa7980cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59288/0 (socket says 172.21.15.148:59288) 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79d400640 1 -- 172.21.15.148:0/3758683187 learned_addr learned my addr 172.21.15.148:0/3758683187 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa79ca00640 1 --2- 172.21.15.148:0/3758683187 >> v2:172.21.15.157:3300/0 conn(0x7fa7981570f0 0x7fa79815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa78fe00640 1 -- 172.21.15.148:0/3758683187 >> v2:172.21.15.157:3300/0 conn(0x7fa7981570f0 msgr2=0x7fa79815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa78fe00640 1 --2- 172.21.15.148:0/3758683187 >> v2:172.21.15.157:3300/0 conn(0x7fa7981570f0 0x7fa79815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa78fe00640 1 -- 172.21.15.148:0/3758683187 >> v1:172.21.15.148:6789/0 conn(0x7fa7980c6120 legacy=0x7fa7980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa797e00640 1 -- 172.21.15.148:0/3758683187 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385420770 0 0) 0x7fa7900014a0 con 0x7fa7980c6120 2024-04-26T23:04:54.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.400+0000 7fa78fe00640 1 -- 172.21.15.148:0/3758683187 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7980c9f90 con 0x7fa798071680 2024-04-26T23:04:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa78fe00640 1 --2- 172.21.15.148:0/3758683187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa798071680 0x7fa7980c4560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7980c6710 tx=0x7fa78001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3053c6b6d987aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa797e00640 1 -- 172.21.15.148:0/3758683187 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800b0070 con 0x7fa798071680 2024-04-26T23:04:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa797e00640 1 -- 172.21.15.148:0/3758683187 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7800ab600 con 0x7fa798071680 2024-04-26T23:04:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa797e00640 1 -- 172.21.15.148:0/3758683187 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800ab9d0 con 0x7fa798071680 2024-04-26T23:04:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 -- 172.21.15.148:0/3758683187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa798071680 msgr2=0x7fa7980c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 --2- 172.21.15.148:0/3758683187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa798071680 0x7fa7980c4560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7980c6710 tx=0x7fa78001c480 comp rx=0 tx=0).stop 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 -- 172.21.15.148:0/3758683187 shutdown_connections 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 --2- 172.21.15.148:0/3758683187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa798071680 0x7fa7980c4560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 --2- 172.21.15.148:0/3758683187 >> v2:172.21.15.157:3300/0 conn(0x7fa7981570f0 0x7fa79815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 -- 172.21.15.148:0/3758683187 >> 172.21.15.148:0/3758683187 conn(0x7fa79806c7b0 msgr2=0x7fa798068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 -- 172.21.15.148:0/3758683187 shutdown_connections 2024-04-26T23:04:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.404+0000 7fa79de00640 1 -- 172.21.15.148:0/3758683187 wait complete. 2024-04-26T23:04:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 Processor -- start 2024-04-26T23:04:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- start start 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa798071680 0x7fa7980ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7981570f0 0x7fa7980cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980c4c20 con 0x7fa7980c6120 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980c4aa0 con 0x7fa798071680 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa7980cb150 con 0x7fa7981570f0 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34914/0 (socket says 172.21.15.148:34914) 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 -- 172.21.15.148:0/1853541970 learned_addr learned my addr 172.21.15.148:0/1853541970 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79ca00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa798071680 0x7fa7980ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79d400640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7981570f0 0x7fa7980cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 -- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7981570f0 msgr2=0x7fa7980cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7981570f0 0x7fa7980cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 -- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa798071680 msgr2=0x7fa7980ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa798071680 0x7fa7980ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 -- 172.21.15.148:0/1853541970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79814ec50 con 0x7fa7980c6120 2024-04-26T23:04:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa78fe00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa780019090 tx=0x7fa780019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800b0040 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7800ba070 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7980ce7b0 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780006e20 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7980ced70 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.408+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7980506d0 con 0x7fa7980c6120 2024-04-26T23:04:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.412+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7800b4610 con 0x7fa7980c6120 2024-04-26T23:04:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.412+0000 7fa795600640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 0x7fa77406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.412+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa780120950 con 0x7fa7980c6120 2024-04-26T23:04:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.412+0000 7fa79ca00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 0x7fa77406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.412+0000 7fa79ca00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 0x7fa77406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa788009b60 tx=0x7fa788009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.416+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa780016070 con 0x7fa7980c6120 2024-04-26T23:04:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa7980b2810 con 0x7fa7980c6120 2024-04-26T23:04:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa795600640 1 -- 172.21.15.148:0/1853541970 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fa7800f0aa0 con 0x7fa7980c6120 2024-04-26T23:04:54.610 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 msgr2=0x7fa77406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 0x7fa77406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa788009b60 tx=0x7fa788009190 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 msgr2=0x7fa79815d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa780019090 tx=0x7fa780019220 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 shutdown_connections 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa7740683b0 0x7fa77406a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7981570f0 0x7fa7980cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7980c6120 0x7fa79815d760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 --2- 172.21.15.148:0/1853541970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa798071680 0x7fa7980ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:54.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 >> 172.21.15.148:0/1853541970 conn(0x7fa79806c7b0 msgr2=0x7fa7980b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:54.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 shutdown_connections 2024-04-26T23:04:54.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54.608+0000 7fa79de00640 1 -- 172.21.15.148:0/1853541970 wait complete. 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:04:54.631 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T23:04:54.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:54.632 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:04:54.640 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:04:54.641 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:f5:6a:5a:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:04:54.642 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:04:54.642 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:04:54.643 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:04:54.643 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:04:54.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:04:54.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:54.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:54.795 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:04:54.812 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-04-26T23:04:54.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:54.815 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-04-26T23:04:54.892 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-04-26T23:04:54.892 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:04:54.893 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:04:54.893 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:04:54.894 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:04:54.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:04:54.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:04:54.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:04:54.894 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:04:54.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:04:55.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:55.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:55.029 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-04-26T23:04:55.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:55.085 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-04-26T23:04:55.143 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:04:55.143 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:04:55.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:55.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T23:04:55.143 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:04:55.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:04:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:55.269 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T23:04:55.270 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:04:55.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:04:55.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:55.430 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:04:55.431 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:04:55.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-04-26T23:04:55.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:04:55.431 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:04:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:04:55.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:55.556 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T23:04:55.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:04:55.556 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:55.566 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T23:04:55.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:04:55.567 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:55.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-04-26T23:04:55.676 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:04:55.725 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-04-26T23:04:55.726 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/run/lock 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-04-26T23:04:55.727 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/fs/nfsd 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/run/rpc_pipefs 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-04-26T23:04:55.728 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:55.729 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:55.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:55.730 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-04-26T23:04:55.784 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:04:55.785 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T23:04:55.831 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-04-26T23:04:55.852 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-04-26T23:04:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/run/lock 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/fs/nfsd 2024-04-26T23:04:55.907 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/rpc_pipefs 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:55.909 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-04-26T23:04:55.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi148.stderr:2024-04-26T23:04:55.924+0000 7fdc1ba49580 -1 init, newargv = 0x558c2a90d730 newargc=15 2024-04-26T23:04:55.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi148.stderr:ceph-fuse[32247]: starting ceph client 2024-04-26T23:04:55.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi148.stderr:ceph-fuse[32247]: starting fuse 2024-04-26T23:04:57.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-04-26T23:04:57.060 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-04-26T23:04:57.111 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/run/lock 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/fs/nfsd 2024-04-26T23:04:57.112 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/rpc_pipefs 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:04:57.113 INFO:teuthology.orchestra.run.smithi148.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:57.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:57.114 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-04-26T23:04:57.165 INFO:teuthology.orchestra.run.smithi148.stdout:44 2024-04-26T23:04:57.166 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> import glob 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> import re 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> import os 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> import subprocess 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> 2024-04-26T23:04:57.166 DEBUG:teuthology.orchestra.run.smithi148:> def _find_admin_socket(client_name): 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> return files[0] 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> for f in files: 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> contents = proc_f.read() 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> if mountpoint in contents: 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> return f 2024-04-26T23:04:57.167 DEBUG:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:04:57.168 DEBUG:teuthology.orchestra.run.smithi148:> 2024-04-26T23:04:57.168 DEBUG:teuthology.orchestra.run.smithi148:> print(_find_admin_socket("client.admin")) 2024-04-26T23:04:57.168 DEBUG:teuthology.orchestra.run.smithi148:> ' 2024-04-26T23:04:57.297 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.admin.32247.asok 2024-04-26T23:04:57.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:57.309 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32247.asok 2024-04-26T23:04:57.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:57.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32247.asok status 2024-04-26T23:04:57.482 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:04:57.482 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2024-04-26T23:04:57.482 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:04:57.482 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:04:57.482 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "admin", 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "32247", 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/" 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4425, 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2024-04-26T23:04:57.483 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4425 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1397241116 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:04:57.484 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1397241116 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.4425 192.168.0.1:0/1397241116", 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "192.168.0.1:0/1397241116", 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 6, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 24, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "blocklisted": false, 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs" 2024-04-26T23:04:57.485 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:04:57.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:57.498 DEBUG:teuthology.orchestra.run.smithi148:> stat --file-system '--printf=%T 2024-04-26T23:04:57.498 DEBUG:teuthology.orchestra.run.smithi148:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:57.507 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2024-04-26T23:04:57.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:57.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:04:57.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:04:57.569 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T23:04:57.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:04:57.708 INFO:teuthology.orchestra.run.smithi148.stdout:# file: . 2024-04-26T23:04:57.708 INFO:teuthology.orchestra.run.smithi148.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T23:04:57.709 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:57.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:04:57.715 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:57.715 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:04:57.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:57.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.896+0000 7f1895e00640 1 Processor -- start 2024-04-26T23:04:57.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.896+0000 7f1895e00640 1 -- start start 2024-04-26T23:04:57.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1890156070 0x7f189015f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f18900c9d40 0x7f1890166660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189006d6e0 con 0x7f189006f270 2024-04-26T23:04:57.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f189006d490 con 0x7f1890156070 2024-04-26T23:04:57.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f18900cf710 con 0x7f18900c9d40 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1890156070 0x7f189015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f188fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f189006f270 0x7f18900cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58552/0 (socket says 172.21.15.148:58552) 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f188fe00640 1 -- 172.21.15.148:0/212706548 learned_addr learned my addr 172.21.15.148:0/212706548 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1895400640 1 --2- 172.21.15.148:0/212706548 >> v2:172.21.15.157:3300/0 conn(0x7f18900c9d40 0x7f1890166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 -- 172.21.15.148:0/212706548 >> v2:172.21.15.157:3300/0 conn(0x7f18900c9d40 msgr2=0x7f1890166660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:57.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 --2- 172.21.15.148:0/212706548 >> v2:172.21.15.157:3300/0 conn(0x7f18900c9d40 0x7f1890166660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 -- 172.21.15.148:0/212706548 >> v1:172.21.15.148:6789/0 conn(0x7f189006f270 legacy=0x7f18900cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:57.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 -- 172.21.15.148:0/212706548 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189006d9c0 con 0x7f1890156070 2024-04-26T23:04:57.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f188f400640 1 -- 172.21.15.148:0/212706548 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085220449 0 0) 0x7f189006d6e0 con 0x7f189006f270 2024-04-26T23:04:57.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.900+0000 7f1894a00640 1 --2- 172.21.15.148:0/212706548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1890156070 0x7f189015f330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f189006d610 tx=0x7f188401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862d651283da0406 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:57.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f188f400640 1 -- 172.21.15.148:0/212706548 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18840b2070 con 0x7f1890156070 2024-04-26T23:04:57.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f188f400640 1 -- 172.21.15.148:0/212706548 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18840a9070 con 0x7f1890156070 2024-04-26T23:04:57.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f188f400640 1 -- 172.21.15.148:0/212706548 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18840ad880 con 0x7f1890156070 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- 172.21.15.148:0/212706548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1890156070 msgr2=0x7f189015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- 172.21.15.148:0/212706548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1890156070 0x7f189015f330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f189006d610 tx=0x7f188401c3a0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- 172.21.15.148:0/212706548 shutdown_connections 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- 172.21.15.148:0/212706548 >> v2:172.21.15.157:3300/0 conn(0x7f18900c9d40 0x7f1890166660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- 172.21.15.148:0/212706548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1890156070 0x7f189015f330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- 172.21.15.148:0/212706548 >> 172.21.15.148:0/212706548 conn(0x7f189006c7b0 msgr2=0x7f1890068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- 172.21.15.148:0/212706548 shutdown_connections 2024-04-26T23:04:57.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- 172.21.15.148:0/212706548 wait complete. 2024-04-26T23:04:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 Processor -- start 2024-04-26T23:04:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- start start 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18900c9d40 0x7f18900c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1890156070 0x7f189015d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f18901565d0 con 0x7f189006f270 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1890156450 con 0x7f1890156070 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f18900cfba0 con 0x7f18900c9d40 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52174/0 (socket says 172.21.15.148:52174) 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 -- 172.21.15.148:0/479581757 learned_addr learned my addr 172.21.15.148:0/479581757 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f188fe00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18900c9d40 0x7f18900c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1895400640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1890156070 0x7f189015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 -- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18900c9d40 msgr2=0x7f18900c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18900c9d40 0x7f18900c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 -- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1890156070 msgr2=0x7f189015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.904+0000 7f1894a00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1890156070 0x7f189015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f1894a00640 1 -- 172.21.15.148:0/479581757 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1890077f00 con 0x7f189006f270 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f1894a00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1884019fd0 tx=0x7f1884019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18840b2040 con 0x7f189006f270 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18840add80 con 0x7f189006f270 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189015ea40 con 0x7f189006f270 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18840b6630 con 0x7f189006f270 2024-04-26T23:04:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189015f000 con 0x7f189006f270 2024-04-26T23:04:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18900506d0 con 0x7f189006f270 2024-04-26T23:04:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18840ab070 con 0x7f189006f270 2024-04-26T23:04:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f18841205c0 con 0x7f189006f270 2024-04-26T23:04:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.908+0000 7f188fe00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.912+0000 7f188fe00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 0x7f187006a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18900cee70 tx=0x7f187c007b60 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:57.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:57.916+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1884016050 con 0x7f189006f270 2024-04-26T23:04:58.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18900cb240 con 0x7f189006f270 2024-04-26T23:04:58.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f188cc00640 1 -- 172.21.15.148:0/479581757 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f18840f0830 con 0x7f189006f270 2024-04-26T23:04:58.074 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:04:58.075 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:04:58.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 msgr2=0x7f187006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 0x7f187006a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18900cee70 tx=0x7f187c007b60 comp rx=0 tx=0).stop 2024-04-26T23:04:58.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 msgr2=0x7f189015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1884019fd0 tx=0x7f1884019140 comp rx=0 tx=0).stop 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 shutdown_connections 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1890156070 0x7f189015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18900c9d40 0x7f18900c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 --2- 172.21.15.148:0/479581757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f189006f270 0x7f189015e3b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 >> 172.21.15.148:0/479581757 conn(0x7f189006c7b0 msgr2=0x7f18900b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 shutdown_connections 2024-04-26T23:04:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.072+0000 7f1895e00640 1 -- 172.21.15.148:0/479581757 wait complete. 2024-04-26T23:04:58.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:04:58.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:04:58.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 Processor -- start 2024-04-26T23:04:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 -- start start 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcb80155e80 0x7fcb8015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb801601b0 con 0x7fcb800b1f60 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb8006d610 con 0x7fcb800ccc10 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb88000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fcb8015f3f0 con 0x7fcb80155e80 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb85600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcb80155e80 0x7fcb8015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb86000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcb800b1f60 0x7fcb801665e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58562/0 (socket says 172.21.15.148:58562) 2024-04-26T23:04:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb86000640 1 -- 172.21.15.148:0/770037362 learned_addr learned my addr 172.21.15.148:0/770037362 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb85600640 1 -- 172.21.15.148:0/770037362 >> v1:172.21.15.157:6789/0 conn(0x7fcb800ccc10 legacy=0x7fcb8006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb85600640 1 -- 172.21.15.148:0/770037362 >> v1:172.21.15.148:6789/0 conn(0x7fcb800b1f60 legacy=0x7fcb801665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb85600640 1 -- 172.21.15.148:0/770037362 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8015f6d0 con 0x7fcb80155e80 2024-04-26T23:04:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.232+0000 7fcb7fe00640 1 -- 172.21.15.148:0/770037362 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963015648 0 0) 0x7fcb801601b0 con 0x7fcb800b1f60 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb85600640 1 --2- 172.21.15.148:0/770037362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb8015bc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009dc0 tx=0x7fcb7401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785792f6198620cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb7fe00640 1 -- 172.21.15.148:0/770037362 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740a6680 con 0x7fcb80155e80 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb7fe00640 1 -- 172.21.15.148:0/770037362 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb740a6820 con 0x7fcb80155e80 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb7fe00640 1 -- 172.21.15.148:0/770037362 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740a6bf0 con 0x7fcb80155e80 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 -- 172.21.15.148:0/770037362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 msgr2=0x7fcb8015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 --2- 172.21.15.148:0/770037362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb8015bc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009dc0 tx=0x7fcb7401c8c0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 -- 172.21.15.148:0/770037362 shutdown_connections 2024-04-26T23:04:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 --2- 172.21.15.148:0/770037362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb8015bc60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 -- 172.21.15.148:0/770037362 >> 172.21.15.148:0/770037362 conn(0x7fcb80068140 msgr2=0x7fcb80068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 -- 172.21.15.148:0/770037362 shutdown_connections 2024-04-26T23:04:58.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.236+0000 7fcb88000640 1 -- 172.21.15.148:0/770037362 wait complete. 2024-04-26T23:04:58.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 Processor -- start 2024-04-26T23:04:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- start start 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb800b1f60 0x7fcb800b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 0x7fcb80152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80070790 con 0x7fcb80155e80 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80070610 con 0x7fcb800b1f60 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8016a520 con 0x7fcb800ccc10 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52188/0 (socket says 172.21.15.148:52188) 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 -- 172.21.15.148:0/511523792 learned_addr learned my addr 172.21.15.148:0/511523792 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb85600640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb800b1f60 0x7fcb800b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb84c00640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 0x7fcb80152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 -- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 msgr2=0x7fcb80152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 0x7fcb80152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 -- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb800b1f60 msgr2=0x7fcb800b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb800b1f60 0x7fcb800b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 -- 172.21.15.148:0/511523792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb80152410 con 0x7fcb80155e80 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb84c00640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 0x7fcb80152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb86000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800c410 tx=0x7fcb7800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb780074e0 con 0x7fcb80155e80 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb780047f0 con 0x7fcb80155e80 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78007680 con 0x7fcb80155e80 2024-04-26T23:04:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb80152130 con 0x7fcb80155e80 2024-04-26T23:04:58.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.240+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb800cb3c0 con 0x7fcb80155e80 2024-04-26T23:04:58.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb80077c20 con 0x7fcb80155e80 2024-04-26T23:04:58.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb78011070 con 0x7fcb80155e80 2024-04-26T23:04:58.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb7d600640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 0x7fcb6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcb780867f0 con 0x7fcb80155e80 2024-04-26T23:04:58.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb85600640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 0x7fcb6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.244+0000 7fcb85600640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 0x7fcb6006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb740af000 tx=0x7fcb740a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.248+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb780569d0 con 0x7fcb80155e80 2024-04-26T23:04:58.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb80159680 con 0x7fcb80155e80 2024-04-26T23:04:58.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb7d600640 1 -- 172.21.15.148:0/511523792 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fcb780562d0 con 0x7fcb80155e80 2024-04-26T23:04:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:04:58.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 msgr2=0x7fcb6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 0x7fcb6006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb740af000 tx=0x7fcb740a7000 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 msgr2=0x7fcb80153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800c410 tx=0x7fcb7800c8d0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 shutdown_connections 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcb60068380 0x7fcb6006a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb80155e80 0x7fcb80153c80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb800ccc10 0x7fcb80152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 --2- 172.21.15.148:0/511523792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb800b1f60 0x7fcb800b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 >> 172.21.15.148:0/511523792 conn(0x7fcb80068140 msgr2=0x7fcb80151180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 shutdown_connections 2024-04-26T23:04:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.404+0000 7fcb88000640 1 -- 172.21.15.148:0/511523792 wait complete. 2024-04-26T23:04:58.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:04:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.560+0000 7f6a67800640 1 Processor -- start 2024-04-26T23:04:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.560+0000 7f6a67800640 1 -- start start 2024-04-26T23:04:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a67800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006f460 0x7f6a6015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a67800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a60153eb0 0x7f6a6006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a67800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a600c96a0 con 0x7f6a6006fd80 2024-04-26T23:04:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a67800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6015ac00 con 0x7f6a60153eb0 2024-04-26T23:04:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a67800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a60070210 con 0x7f6a6006f460 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a57e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a60153eb0 0x7f6a6006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a65800640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a6006fd80 0x7f6a600c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58576/0 (socket says 172.21.15.148:58576) 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a65800640 1 -- 172.21.15.148:0/694653652 learned_addr learned my addr 172.21.15.148:0/694653652 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a64e00640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006f460 0x7f6a6015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a57e00640 1 -- 172.21.15.148:0/694653652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006f460 msgr2=0x7f6a6015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a57e00640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006f460 0x7f6a6015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a57e00640 1 -- 172.21.15.148:0/694653652 >> v1:172.21.15.148:6789/0 conn(0x7f6a6006fd80 legacy=0x7f6a600c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.564+0000 7f6a57e00640 1 -- 172.21.15.148:0/694653652 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a600c9980 con 0x7f6a60153eb0 2024-04-26T23:04:58.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a57e00640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a60153eb0 0x7f6a6006f840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097f0 tx=0x7f6a4801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635780dbfe3d81bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a5fe00640 1 -- 172.21.15.148:0/694653652 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480b5070 con 0x7f6a60153eb0 2024-04-26T23:04:58.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a5fe00640 1 -- 172.21.15.148:0/694653652 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a480a8990 con 0x7f6a60153eb0 2024-04-26T23:04:58.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a5fe00640 1 -- 172.21.15.148:0/694653652 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a8d60 con 0x7f6a60153eb0 2024-04-26T23:04:58.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- 172.21.15.148:0/694653652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a60153eb0 msgr2=0x7f6a6006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a60153eb0 0x7f6a6006f840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097f0 tx=0x7f6a4801ec90 comp rx=0 tx=0).stop 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- 172.21.15.148:0/694653652 shutdown_connections 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a60153eb0 0x7f6a6006f840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 --2- 172.21.15.148:0/694653652 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006f460 0x7f6a6015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- 172.21.15.148:0/694653652 >> 172.21.15.148:0/694653652 conn(0x7f6a600c9d10 msgr2=0x7f6a600ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- 172.21.15.148:0/694653652 shutdown_connections 2024-04-26T23:04:58.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- 172.21.15.148:0/694653652 wait complete. 2024-04-26T23:04:58.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 Processor -- start 2024-04-26T23:04:58.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.568+0000 7f6a67800640 1 -- start start 2024-04-26T23:04:58.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006fd80 0x7f6a60148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a601474c0 0x7f6a60147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600c5120 con 0x7f6a6006f460 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600708f0 con 0x7f6a601474c0 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a600c4d70 con 0x7f6a6006fd80 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52210/0 (socket says 172.21.15.148:52210) 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 -- 172.21.15.148:0/4246355289 learned_addr learned my addr 172.21.15.148:0/4246355289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a57e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006fd80 0x7f6a60148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a65800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a601474c0 0x7f6a60147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 -- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006fd80 msgr2=0x7f6a60148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006fd80 0x7f6a60148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 -- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a601474c0 msgr2=0x7f6a60147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a601474c0 0x7f6a60147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 -- 172.21.15.148:0/4246355289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a60149430 con 0x7f6a6006f460 2024-04-26T23:04:58.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a64e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000e930 tx=0x7f6a5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50017070 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5000c9a0 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000cd50 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a60149730 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a601499f0 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60077c20 con 0x7f6a6006f460 2024-04-26T23:04:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.572+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a5001a070 con 0x7f6a6006f460 2024-04-26T23:04:58.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.576+0000 7f6a5d600640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.576+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6a50086cf0 con 0x7f6a6006f460 2024-04-26T23:04:58.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.576+0000 7f6a57e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.576+0000 7f6a57e00640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 0x7f6a3c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a480b2000 tx=0x7f6a48008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.580+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a60149430 con 0x7f6a6006f460 2024-04-26T23:04:58.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a6006dda0 con 0x7f6a6006f460 2024-04-26T23:04:58.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a5d600640 1 -- 172.21.15.148:0/4246355289 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f6a50057020 con 0x7f6a6006f460 2024-04-26T23:04:58.739 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 msgr2=0x7f6a3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 0x7f6a3c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a480b2000 tx=0x7f6a48008040 comp rx=0 tx=0).stop 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 msgr2=0x7f6a601e4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000e930 tx=0x7f6a5000edf0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 shutdown_connections 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a601474c0 0x7f6a60147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a6006fd80 0x7f6a60148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 --2- 172.21.15.148:0/4246355289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a6006f460 0x7f6a601e4160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 >> 172.21.15.148:0/4246355289 conn(0x7f6a600c9d10 msgr2=0x7f6a600c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 shutdown_connections 2024-04-26T23:04:58.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.736+0000 7f6a67800640 1 -- 172.21.15.148:0/4246355289 wait complete. 2024-04-26T23:04:58.760 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:04:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 Processor -- start 2024-04-26T23:04:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 -- start start 2024-04-26T23:04:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea0155f80 0x7f7ea00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ea015bf20 0x7f7ea015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea015f410 con 0x7f7ea00cabe0 2024-04-26T23:04:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea015f6f0 con 0x7f7ea015bf20 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea7c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea015f9d0 con 0x7f7ea0155f80 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ea015bf20 0x7f7ea015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7e9fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7ea00cabe0 0x7f7ea00ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58590/0 (socket says 172.21.15.148:58590) 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7e9fe00640 1 -- 172.21.15.148:0/4025621951 learned_addr learned my addr 172.21.15.148:0/4025621951 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5200640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea0155f80 0x7f7ea00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5c00640 1 -- 172.21.15.148:0/4025621951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea0155f80 msgr2=0x7f7ea00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5c00640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea0155f80 0x7f7ea00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5c00640 1 -- 172.21.15.148:0/4025621951 >> v1:172.21.15.148:6789/0 conn(0x7f7ea00cabe0 legacy=0x7f7ea00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.896+0000 7f7ea5c00640 1 -- 172.21.15.148:0/4025621951 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea015fcb0 con 0x7f7ea015bf20 2024-04-26T23:04:58.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea5c00640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea015bf20 0x7f7ea015c340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e9801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6faf31b8ef4c574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7e9f400640 1 -- 172.21.15.148:0/4025621951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980b4070 con 0x7f7ea015bf20 2024-04-26T23:04:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7e9f400640 1 -- 172.21.15.148:0/4025621951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e980af600 con 0x7f7ea015bf20 2024-04-26T23:04:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7e9f400640 1 -- 172.21.15.148:0/4025621951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980af9d0 con 0x7f7ea015bf20 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 -- 172.21.15.148:0/4025621951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea015bf20 msgr2=0x7f7ea015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea015bf20 0x7f7ea015c340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e9801f150 comp rx=0 tx=0).stop 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 -- 172.21.15.148:0/4025621951 shutdown_connections 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea015bf20 0x7f7ea015c340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/4025621951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea0155f80 0x7f7ea00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 -- 172.21.15.148:0/4025621951 >> 172.21.15.148:0/4025621951 conn(0x7f7ea006c380 msgr2=0x7f7ea006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 -- 172.21.15.148:0/4025621951 shutdown_connections 2024-04-26T23:04:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 -- 172.21.15.148:0/4025621951 wait complete. 2024-04-26T23:04:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.900+0000 7f7ea7c00640 1 Processor -- start 2024-04-26T23:04:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- start start 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 0x7f7ea0153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 0x7f7ea00c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea00cbd10 con 0x7f7ea0155f80 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea015c880 con 0x7f7ea00cabe0 2024-04-26T23:04:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea00cc7a0 con 0x7f7ea015bf20 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52220/0 (socket says 172.21.15.148:52220) 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 -- 172.21.15.148:0/67680115 learned_addr learned my addr 172.21.15.148:0/67680115 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea5c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 0x7f7ea00c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea5200640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 0x7f7ea0153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 -- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 msgr2=0x7f7ea00c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 0x7f7ea00c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 -- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 msgr2=0x7f7ea0153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 0x7f7ea0153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 -- 172.21.15.148:0/67680115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00c9750 con 0x7f7ea0155f80 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea5c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 0x7f7ea00c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea5200640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 0x7f7ea0153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9fe00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c450 tx=0x7f7e8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c017070 con 0x7f7ea0155f80 2024-04-26T23:04:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c005cf0 con 0x7f7ea0155f80 2024-04-26T23:04:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c007290 con 0x7f7ea0155f80 2024-04-26T23:04:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea01f19f0 con 0x7f7ea0155f80 2024-04-26T23:04:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea01f1f50 con 0x7f7ea0155f80 2024-04-26T23:04:58.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.904+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea01f28f0 con 0x7f7ea0155f80 2024-04-26T23:04:58.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.908+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e8c01a070 con 0x7f7ea0155f80 2024-04-26T23:04:58.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.908+0000 7f7e9cc00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 0x7f7e8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:58.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.908+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e8c085ff0 con 0x7f7ea0155f80 2024-04-26T23:04:58.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.908+0000 7f7ea5200640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 0x7f7e8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:58.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.908+0000 7f7ea5200640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 0x7f7e8006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009bb0 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:58.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:58.912+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ea01f28f0 con 0x7f7ea0155f80 2024-04-26T23:04:59.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.068+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7ea0077c20 con 0x7f7ea0155f80 2024-04-26T23:04:59.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.068+0000 7f7e9cc00640 1 -- 172.21.15.148:0/67680115 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f7ea01f19f0 con 0x7f7ea0155f80 2024-04-26T23:04:59.071 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:04:59.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 msgr2=0x7f7e8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 0x7f7e8006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009bb0 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 msgr2=0x7f7ea00c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c450 tx=0x7f7e8c00c910 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 shutdown_connections 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7e80068380 0x7f7e8006a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ea015bf20 0x7f7ea00c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea0155f80 0x7f7ea00c5c00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 --2- 172.21.15.148:0/67680115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ea00cabe0 0x7f7ea0153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 >> 172.21.15.148:0/67680115 conn(0x7f7ea006c380 msgr2=0x7f7ea014e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 shutdown_connections 2024-04-26T23:04:59.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.072+0000 7f7ea7c00640 1 -- 172.21.15.148:0/67680115 wait complete. 2024-04-26T23:04:59.093 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:04:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 Processor -- start 2024-04-26T23:04:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 -- start start 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f440806ff50 0x7f44080c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44080708a0 0x7f4408072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44080c96b0 con 0x7f4408070330 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f44080c84e0 con 0x7f44080708a0 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f440d400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f44080c93d0 con 0x7f440806ff50 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44080708a0 0x7f4408072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44080708a0 0x7f4408072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52226/0 (socket says 172.21.15.148:52226) 2024-04-26T23:04:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 -- 172.21.15.148:0/1980518664 learned_addr learned my addr 172.21.15.148:0/1980518664 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4406800640 1 --2- 172.21.15.148:0/1980518664 >> v2:172.21.15.157:3300/0 conn(0x7f440806ff50 0x7f44080c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 -- 172.21.15.148:0/1980518664 >> v2:172.21.15.157:3300/0 conn(0x7f440806ff50 msgr2=0x7f44080c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 --2- 172.21.15.148:0/1980518664 >> v2:172.21.15.157:3300/0 conn(0x7f440806ff50 0x7f44080c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 -- 172.21.15.148:0/1980518664 >> v1:172.21.15.157:6789/0 conn(0x7f4408070330 legacy=0x7f4408158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:59.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.232+0000 7f4407200640 1 -- 172.21.15.148:0/1980518664 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44080c7bb0 con 0x7f44080708a0 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f4407200640 1 --2- 172.21.15.148:0/1980518664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44080708a0 0x7f4408072d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f44080cad50 tx=0x7f440001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64acc5c40326262b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f4405400640 1 -- 172.21.15.148:0/1980518664 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44000b4070 con 0x7f44080708a0 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f4405400640 1 -- 172.21.15.148:0/1980518664 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44000af400 con 0x7f44080708a0 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f4405400640 1 -- 172.21.15.148:0/1980518664 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44000af7d0 con 0x7f44080708a0 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- 172.21.15.148:0/1980518664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44080708a0 msgr2=0x7f4408072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 --2- 172.21.15.148:0/1980518664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44080708a0 0x7f4408072d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f44080cad50 tx=0x7f440001f1a0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- 172.21.15.148:0/1980518664 shutdown_connections 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 --2- 172.21.15.148:0/1980518664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44080708a0 0x7f4408072d20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 --2- 172.21.15.148:0/1980518664 >> v2:172.21.15.157:3300/0 conn(0x7f440806ff50 0x7f44080c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- 172.21.15.148:0/1980518664 >> 172.21.15.148:0/1980518664 conn(0x7f44080c9d10 msgr2=0x7f44080ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- 172.21.15.148:0/1980518664 shutdown_connections 2024-04-26T23:04:59.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- 172.21.15.148:0/1980518664 wait complete. 2024-04-26T23:04:59.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 Processor -- start 2024-04-26T23:04:59.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.236+0000 7f440d400640 1 -- start start 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 0x7f4408149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 0x7f4408073d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44080c8fd0 con 0x7f440806ff50 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f44080c8170 con 0x7f44080708a0 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f44080c9150 con 0x7f4408070330 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52242/0 (socket says 172.21.15.148:52242) 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 -- 172.21.15.148:0/3680327657 learned_addr learned my addr 172.21.15.148:0/3680327657 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4407200640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 0x7f4408073d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4405e00640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 0x7f4408149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 -- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 msgr2=0x7f4408149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 0x7f4408149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 -- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 msgr2=0x7f4408073d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 0x7f4408073d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 -- 172.21.15.148:0/3680327657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440814fe40 con 0x7f440806ff50 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4405e00640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 0x7f4408149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4407200640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 0x7f4408073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:04:59.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f4406800640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43f800d620 tx=0x7f43f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f800b620 con 0x7f440806ff50 2024-04-26T23:04:59.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8019070 con 0x7f440806ff50 2024-04-26T23:04:59.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f800b9e0 con 0x7f440806ff50 2024-04-26T23:04:59.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4408155270 con 0x7f440806ff50 2024-04-26T23:04:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4408155830 con 0x7f440806ff50 2024-04-26T23:04:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4408077c20 con 0x7f440806ff50 2024-04-26T23:04:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.240+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43f800bb80 con 0x7f440806ff50 2024-04-26T23:04:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.244+0000 7f43fea00640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 0x7f43e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.244+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f43f80871a0 con 0x7f440806ff50 2024-04-26T23:04:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.244+0000 7f4405e00640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 0x7f43e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.244+0000 7f4405e00640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 0x7f43e806a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44081ef090 tx=0x7f43f4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.248+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f440814fe40 con 0x7f440806ff50 2024-04-26T23:04:59.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.404+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4408073ae0 con 0x7f440806ff50 2024-04-26T23:04:59.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f43fea00640 1 -- 172.21.15.148:0/3680327657 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f43f8057380 con 0x7f440806ff50 2024-04-26T23:04:59.409 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:04:59.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 msgr2=0x7f43e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 0x7f43e806a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44081ef090 tx=0x7f43f4009040 comp rx=0 tx=0).stop 2024-04-26T23:04:59.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 msgr2=0x7f44081e5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43f800d620 tx=0x7f43f800dae0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 shutdown_connections 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f43e80683b0 0x7f43e806a870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44080708a0 0x7f4408073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4408070330 0x7f4408149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 --2- 172.21.15.148:0/3680327657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440806ff50 0x7f44081e5e10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 >> 172.21.15.148:0/3680327657 conn(0x7f44080c9d10 msgr2=0x7f44080c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 shutdown_connections 2024-04-26T23:04:59.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.408+0000 7f440d400640 1 -- 172.21.15.148:0/3680327657 wait complete. 2024-04-26T23:04:59.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:04:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.564+0000 7fb223e00640 1 Processor -- start 2024-04-26T23:04:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.564+0000 7fb223e00640 1 -- start start 2024-04-26T23:04:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb223e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb2240715f0 0x7fb2240ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb223e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb224157560 con 0x7fb224157180 2024-04-26T23:04:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb223e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2240cbb00 con 0x7fb2240c60d0 2024-04-26T23:04:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb223e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb2240cfcc0 con 0x7fb2240715f0 2024-04-26T23:04:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb2240715f0 0x7fb2240ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb2240715f0 0x7fb2240ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52258/0 (socket says 172.21.15.148:52258) 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 -- 172.21.15.148:0/3516829244 learned_addr learned my addr 172.21.15.148:0/3516829244 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb224157180 0x7fb2240708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58592/0 (socket says 172.21.15.148:58592) 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 -- 172.21.15.148:0/3516829244 >> v1:172.21.15.157:6789/0 conn(0x7fb2240c60d0 legacy=0x7fb224164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 -- 172.21.15.148:0/3516829244 >> v1:172.21.15.148:6789/0 conn(0x7fb224157180 legacy=0x7fb2240708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 -- 172.21.15.148:0/3516829244 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2240cb540 con 0x7fb2240715f0 2024-04-26T23:04:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.568+0000 7fb222000640 1 --2- 172.21.15.148:0/3516829244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240715f0 0x7fb2240ca4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb210009870 tx=0x7fb21001c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23dd1b848331eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb221600640 1 -- 172.21.15.148:0/3516829244 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100b0070 con 0x7fb2240715f0 2024-04-26T23:04:59.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb221600640 1 -- 172.21.15.148:0/3516829244 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2100a4e50 con 0x7fb2240715f0 2024-04-26T23:04:59.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb221600640 1 -- 172.21.15.148:0/3516829244 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100ab820 con 0x7fb2240715f0 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- 172.21.15.148:0/3516829244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240715f0 msgr2=0x7fb2240ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 --2- 172.21.15.148:0/3516829244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240715f0 0x7fb2240ca4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb210009870 tx=0x7fb21001c2b0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- 172.21.15.148:0/3516829244 shutdown_connections 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 --2- 172.21.15.148:0/3516829244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240715f0 0x7fb2240ca4d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- 172.21.15.148:0/3516829244 >> 172.21.15.148:0/3516829244 conn(0x7fb22406c980 msgr2=0x7fb224068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- 172.21.15.148:0/3516829244 shutdown_connections 2024-04-26T23:04:59.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- 172.21.15.148:0/3516829244 wait complete. 2024-04-26T23:04:59.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 Processor -- start 2024-04-26T23:04:59.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- start start 2024-04-26T23:04:59.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2240715f0 0x7fb2241420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb224157180 0x7fb22406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241682c0 con 0x7fb2240c60d0 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240cae20 con 0x7fb224157180 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb224168440 con 0x7fb2240715f0 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb222000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb222000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52266/0 (socket says 172.21.15.148:52266) 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb222000640 1 -- 172.21.15.148:0/3346575402 learned_addr learned my addr 172.21.15.148:0/3346575402 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb222a00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2240715f0 0x7fb2241420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.572+0000 7fb223400640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb224157180 0x7fb22406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 -- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2240715f0 msgr2=0x7fb2241420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2240715f0 0x7fb2241420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 -- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb224157180 msgr2=0x7fb22406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb224157180 0x7fb22406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 -- 172.21.15.148:0/3346575402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224156540 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb222000640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb210018ec0 tx=0x7fb210019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100b0070 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2100b1040 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb224156820 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100aaad0 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb224149b10 con 0x7fb2240c60d0 2024-04-26T23:04:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2240506d0 con 0x7fb2240c60d0 2024-04-26T23:04:59.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2100aac70 con 0x7fb2240c60d0 2024-04-26T23:04:59.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 0x7fb20406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.576+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb210120ce0 con 0x7fb2240c60d0 2024-04-26T23:04:59.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.580+0000 7fb222a00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 0x7fb20406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.580+0000 7fb222a00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 0x7fb20406a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb214000f70 tx=0x7fb214007cd0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.580+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb2100c3020 con 0x7fb2240c60d0 2024-04-26T23:04:59.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.748+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2240713d0 con 0x7fb2240c60d0 2024-04-26T23:04:59.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.748+0000 7fb21aa00640 1 -- 172.21.15.148:0/3346575402 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fb2240cbb00 con 0x7fb2240c60d0 2024-04-26T23:04:59.752 INFO:teuthology.orchestra.run.smithi148.stderr:listed 0 entries 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 msgr2=0x7fb20406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 0x7fb20406a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb214000f70 tx=0x7fb214007cd0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 msgr2=0x7fb2240ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb210018ec0 tx=0x7fb210019050 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 shutdown_connections 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb204068380 0x7fb20406a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb224157180 0x7fb22406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2240c60d0 0x7fb2240ce100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 --2- 172.21.15.148:0/3346575402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2240715f0 0x7fb2241420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 >> 172.21.15.148:0/3346575402 conn(0x7fb22406c980 msgr2=0x7fb2240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 shutdown_connections 2024-04-26T23:04:59.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.752+0000 7fb223e00640 1 -- 172.21.15.148:0/3346575402 wait complete. 2024-04-26T23:04:59.773 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:04:59.773 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:04:59.782 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:04:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.956+0000 7fc546200640 1 Processor -- start 2024-04-26T23:04:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.956+0000 7fc546200640 1 -- start start 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc546200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc5400c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc546200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5400c9340 0x7fc540072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc546200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc540152fa0 con 0x7fc5400732b0 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc546200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc540073700 con 0x7fc5400c9340 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc546200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc540159790 con 0x7fc540152bc0 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc53fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc5400732b0 0x7fc5400c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58594/0 (socket says 172.21.15.148:58594) 2024-04-26T23:04:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc53fe00640 1 -- 172.21.15.148:0/537227171 learned_addr learned my addr 172.21.15.148:0/537227171 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc536a00640 1 --2- 172.21.15.148:0/537227171 >> v2:172.21.15.157:3300/0 conn(0x7fc5400c9340 0x7fc540072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc53f400640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc5400c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc53ea00640 1 -- 172.21.15.148:0/537227171 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684880274 0 0) 0x7fc540152fa0 con 0x7fc5400732b0 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc53ea00640 1 -- 172.21.15.148:0/537227171 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524003530 con 0x7fc5400732b0 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc536a00640 1 -- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 msgr2=0x7fc5400c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc536a00640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc5400c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc536a00640 1 -- 172.21.15.148:0/537227171 >> v1:172.21.15.148:6789/0 conn(0x7fc5400732b0 legacy=0x7fc5400c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.960+0000 7fc536a00640 1 -- 172.21.15.148:0/537227171 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540158930 con 0x7fc5400c9340 2024-04-26T23:04:59.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc536a00640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc540072d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc528009d90 tx=0x7fc52801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e0d9a898607b46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53ea00640 1 -- 172.21.15.148:0/537227171 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5280b4070 con 0x7fc5400c9340 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53ea00640 1 -- 172.21.15.148:0/537227171 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5280af600 con 0x7fc5400c9340 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53ea00640 1 -- 172.21.15.148:0/537227171 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5280af9b0 con 0x7fc5400c9340 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 msgr2=0x7fc540072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc540072d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc528009d90 tx=0x7fc52801f150 comp rx=0 tx=0).stop 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- 172.21.15.148:0/537227171 shutdown_connections 2024-04-26T23:04:59.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc540072d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- 172.21.15.148:0/537227171 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc5400c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- 172.21.15.148:0/537227171 >> 172.21.15.148:0/537227171 conn(0x7fc54006c380 msgr2=0x7fc54006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- 172.21.15.148:0/537227171 shutdown_connections 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- 172.21.15.148:0/537227171 wait complete. 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 Processor -- start 2024-04-26T23:04:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- start start 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc5401f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc540144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc5401591d0 con 0x7fc5400732b0 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc540158ef0 con 0x7fc5400c9340 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc546200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc5401594b0 con 0x7fc540152bc0 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52274/0 (socket says 172.21.15.148:52274) 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.964+0000 7fc53f400640 1 -- 172.21.15.148:0/1841154990 learned_addr learned my addr 172.21.15.148:0/1841154990 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:04:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc536a00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc5401f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53fe00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc540144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 -- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 msgr2=0x7fc540144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc540144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 -- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 msgr2=0x7fc5401f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc5401f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 -- 172.21.15.148:0/1841154990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400c88c0 con 0x7fc5400732b0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53fe00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc540144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc53f400640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc53000e930 tx=0x7fc53000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530017070 con 0x7fc5400732b0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53000ca00 con 0x7fc5400732b0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5401470e0 con 0x7fc5400732b0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53000cdb0 con 0x7fc5400732b0 2024-04-26T23:04:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401f16a0 con 0x7fc5400732b0 2024-04-26T23:04:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc540077c20 con 0x7fc5400732b0 2024-04-26T23:04:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc53001a070 con 0x7fc5400732b0 2024-04-26T23:04:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 0x7fc51c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:04:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc530086d10 con 0x7fc5400732b0 2024-04-26T23:04:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.968+0000 7fc536a00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 0x7fc51c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:04:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.972+0000 7fc536a00640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 0x7fc51c06a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5280b1000 tx=0x7fc5280aa000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:04:59.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:04:59.972+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc530057050 con 0x7fc5400732b0 2024-04-26T23:05:00.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.132+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5400c4b50 con 0x7fc5400732b0 2024-04-26T23:05:00.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.132+0000 7fc537e00640 1 -- 172.21.15.148:0/1841154990 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fc530056950 con 0x7fc5400732b0 2024-04-26T23:05:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:00.137 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:00.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 msgr2=0x7fc51c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 0x7fc51c06a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5280b1000 tx=0x7fc5280aa000 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 msgr2=0x7fc540147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc53000e930 tx=0x7fc53000edf0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 shutdown_connections 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc51c0683b0 0x7fc51c06a870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc540152bc0 0x7fc540144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5400c9340 0x7fc5401f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 --2- 172.21.15.148:0/1841154990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5400732b0 0x7fc540147b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 >> 172.21.15.148:0/1841154990 conn(0x7fc54006c380 msgr2=0x7fc5400c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 shutdown_connections 2024-04-26T23:05:00.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.136+0000 7fc546200640 1 -- 172.21.15.148:0/1841154990 wait complete. 2024-04-26T23:05:00.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:05:00.160 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:05:00.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 Processor -- start 2024-04-26T23:05:00.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 -- start start 2024-04-26T23:05:00.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45e80c97d0 0x7f45e815c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e80c4b30 con 0x7f45e8152d00 2024-04-26T23:05:00.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e80c6f60 con 0x7f45e8073940 2024-04-26T23:05:00.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45ede00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f45e80c7240 con 0x7f45e80c97d0 2024-04-26T23:05:00.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e6a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f45e8152d00 0x7f45e8073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58598/0 (socket says 172.21.15.148:58598) 2024-04-26T23:05:00.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e6a00640 1 -- 172.21.15.148:0/1622076479 learned_addr learned my addr 172.21.15.148:0/1622076479 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:00.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 --2- 172.21.15.148:0/1622076479 >> v2:172.21.15.157:3300/0 conn(0x7f45e80c97d0 0x7f45e815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413513337 0 0) 0x7f45e80c4b30 con 0x7f45e8152d00 2024-04-26T23:05:00.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45cc005740 con 0x7f45e8152d00 2024-04-26T23:05:00.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 160880495 0 0) 0x7f45cc005740 con 0x7f45e8152d00 2024-04-26T23:05:00.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 >> v2:172.21.15.157:3300/0 conn(0x7f45e80c97d0 msgr2=0x7f45e815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 --2- 172.21.15.148:0/1622076479 >> v2:172.21.15.157:3300/0 conn(0x7f45e80c97d0 0x7f45e815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 >> v1:172.21.15.157:6789/0 conn(0x7f45e8073940 legacy=0x7f45e815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e80c7520 con 0x7f45e8152d00 2024-04-26T23:05:00.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f45d8001680 con 0x7f45e8152d00 2024-04-26T23:05:00.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 >> v1:172.21.15.148:6789/0 conn(0x7f45e8152d00 legacy=0x7f45e8073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc005bd0 0x7f45cc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc006a20 0x7f45cc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 0x7f45cc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80c7240 con 0x7f45cc0073e0 2024-04-26T23:05:00.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc00e280 con 0x7f45cc005bd0 2024-04-26T23:05:00.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45cc00e480 con 0x7f45cc006a20 2024-04-26T23:05:00.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 0x7f45cc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e6a00640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc005bd0 0x7f45cc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e6000640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc006a20 0x7f45cc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 -- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc006a20 msgr2=0x7f45cc006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc006a20 0x7f45cc006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 -- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc005bd0 msgr2=0x7f45cc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc005bd0 0x7f45cc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e7400640 1 -- 172.21.15.148:0/1622076479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc005740 con 0x7f45cc0073e0 2024-04-26T23:05:00.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.300+0000 7f45e6a00640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45cc005bd0 0x7f45cc005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:00.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45e7400640 1 -- 172.21.15.148:0/1622076479 reap_dead start 2024-04-26T23:05:00.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45e7400640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 0x7f45cc00dbe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009ae0 tx=0x7f45e001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccb728fce72302f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00096b0 con 0x7f45cc0073e0 2024-04-26T23:05:00.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e0004020 con 0x7f45cc0073e0 2024-04-26T23:05:00.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45e5600640 1 -- 172.21.15.148:0/1622076479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004410 con 0x7f45cc0073e0 2024-04-26T23:05:00.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 -- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 msgr2=0x7f45cc00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 0x7f45cc00dbe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009ae0 tx=0x7f45e001cab0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 -- 172.21.15.148:0/1622076479 shutdown_connections 2024-04-26T23:05:00.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 --2- 172.21.15.148:0/1622076479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45cc0073e0 0x7f45cc00dbe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 -- 172.21.15.148:0/1622076479 >> 172.21.15.148:0/1622076479 conn(0x7f45e80c9d10 msgr2=0x7f45e80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 -- 172.21.15.148:0/1622076479 shutdown_connections 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.304+0000 7f45ede00640 1 -- 172.21.15.148:0/1622076479 wait complete. 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 Processor -- start 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- start start 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc0073e0 0x7f45e8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e814d990 0x7f45e81e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80c4890 con 0x7f45e8156860 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80c4710 con 0x7f45e814d990 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45e80c4d00 con 0x7f45cc0073e0 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52306/0 (socket says 172.21.15.148:52306) 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 -- 172.21.15.148:0/2112537275 learned_addr learned my addr 172.21.15.148:0/2112537275 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e6000640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e814d990 0x7f45e81e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e6a00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc0073e0 0x7f45e8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 -- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc0073e0 msgr2=0x7f45e8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc0073e0 0x7f45e8158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 -- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e814d990 msgr2=0x7f45e81e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e814d990 0x7f45e81e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 -- 172.21.15.148:0/2112537275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e81592d0 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45e7400640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45e001c8e0 tx=0x7f45cc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00b2070 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00bb070 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00096b0 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e81595b0 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.308+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e814ceb0 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e8077c20 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45e00a5cf0 con 0x7f45e8156860 2024-04-26T23:05:00.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45df400640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 0x7f45c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f45e0120fd0 con 0x7f45e8156860 2024-04-26T23:05:00.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45e6a00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 0x7f45c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.312+0000 7f45e6a00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 0x7f45c806a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f45d8000f70 tx=0x7f45d8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.316+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45e00167c0 con 0x7f45e8156860 2024-04-26T23:05:00.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45e80cce20 con 0x7f45e8156860 2024-04-26T23:05:00.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45df400640 1 -- 172.21.15.148:0/2112537275 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f45e00f0bf0 con 0x7f45e8156860 2024-04-26T23:05:00.479 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 msgr2=0x7f45c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 0x7f45c806a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f45d8000f70 tx=0x7f45d8009040 comp rx=0 tx=0).stop 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 msgr2=0x7f45e80ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45e001c8e0 tx=0x7f45cc007a50 comp rx=0 tx=0).stop 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 shutdown_connections 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45c8068380 0x7f45c806a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45e8156860 0x7f45e80ca350 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45e814d990 0x7f45e81e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 --2- 172.21.15.148:0/2112537275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45cc0073e0 0x7f45e8158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 >> 172.21.15.148:0/2112537275 conn(0x7f45e80c9d10 msgr2=0x7f45e8155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 shutdown_connections 2024-04-26T23:05:00.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.476+0000 7f45ede00640 1 -- 172.21.15.148:0/2112537275 wait complete. 2024-04-26T23:05:00.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:05:00.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 Processor -- start 2024-04-26T23:05:00.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 -- start start 2024-04-26T23:05:00.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 0x7f28940c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f2894073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2894158a80 0x7f2894158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2894073bb0 con 0x7f2894158a80 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f28940c4b30 con 0x7f2894152d00 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f289b400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f28940c6f60 con 0x7f2894073230 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2894158a80 0x7f2894158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2894158a80 0x7f2894158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52320/0 (socket says 172.21.15.148:52320) 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 -- 172.21.15.148:0/3207128816 learned_addr learned my addr 172.21.15.148:0/3207128816 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f288be00640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f2894073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2898a00640 1 --2- 172.21.15.148:0/3207128816 >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 0x7f28940c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 -- 172.21.15.148:0/3207128816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 msgr2=0x7f2894073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f2894073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 -- 172.21.15.148:0/3207128816 >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 msgr2=0x7f28940c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 --2- 172.21.15.148:0/3207128816 >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 0x7f28940c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2899400640 1 -- 172.21.15.148:0/3207128816 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28940c7240 con 0x7f2894158a80 2024-04-26T23:05:00.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.636+0000 7f2898a00640 1 --2- 172.21.15.148:0/3207128816 >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 0x7f28940c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:00.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f2899400640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894158a80 0x7f2894158eb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2894068e40 tx=0x7f288c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c914bf4dbde753a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f2893e00640 1 -- 172.21.15.148:0/3207128816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a56e0 con 0x7f2894158a80 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f2893e00640 1 -- 172.21.15.148:0/3207128816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0a5880 con 0x7f2894158a80 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f2893e00640 1 -- 172.21.15.148:0/3207128816 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a5c50 con 0x7f2894158a80 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 -- 172.21.15.148:0/3207128816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894158a80 msgr2=0x7f2894158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894158a80 0x7f2894158eb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2894068e40 tx=0x7f288c01c9c0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 -- 172.21.15.148:0/3207128816 shutdown_connections 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894158a80 0x7f2894158eb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 --2- 172.21.15.148:0/3207128816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f2894073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 --2- 172.21.15.148:0/3207128816 >> v2:172.21.15.157:3300/0 conn(0x7f2894152d00 0x7f28940c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 -- 172.21.15.148:0/3207128816 >> 172.21.15.148:0/3207128816 conn(0x7f28940c9d10 msgr2=0x7f28940ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 -- 172.21.15.148:0/3207128816 shutdown_connections 2024-04-26T23:05:00.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.640+0000 7f289b400640 1 -- 172.21.15.148:0/3207128816 wait complete. 2024-04-26T23:05:00.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 Processor -- start 2024-04-26T23:05:00.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- start start 2024-04-26T23:05:00.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f28941f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2894158a80 0x7f2894156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28940c4f90 con 0x7f2894152d00 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f28940c4e10 con 0x7f2894158a80 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f28940c4710 con 0x7f2894073230 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f2898a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f28941f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52324/0 (socket says 172.21.15.148:52324) 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 -- 172.21.15.148:0/2705285457 learned_addr learned my addr 172.21.15.148:0/2705285457 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f2899400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2894158a80 0x7f2894156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 -- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 msgr2=0x7f28941f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f28941f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 -- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2894158a80 msgr2=0x7f2894156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2894158a80 0x7f2894156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 -- 172.21.15.148:0/2705285457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2894151b80 con 0x7f2894152d00 2024-04-26T23:05:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f288be00640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d830 tx=0x7f287c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287c018030 con 0x7f2894152d00 2024-04-26T23:05:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f287c00be10 con 0x7f2894152d00 2024-04-26T23:05:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287c0098b0 con 0x7f2894152d00 2024-04-26T23:05:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2894150be0 con 0x7f2894152d00 2024-04-26T23:05:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28941f7ef0 con 0x7f2894152d00 2024-04-26T23:05:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.644+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2894077c20 con 0x7f2894152d00 2024-04-26T23:05:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.648+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f287c01b070 con 0x7f2894152d00 2024-04-26T23:05:00.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.648+0000 7f2891600640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 0x7f287006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.648+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f287c086d80 con 0x7f2894152d00 2024-04-26T23:05:00.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.648+0000 7f2898a00640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 0x7f287006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.648+0000 7f2898a00640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 0x7f287006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28840045f0 tx=0x7f2884008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.652+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f287c056910 con 0x7f2894152d00 2024-04-26T23:05:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.804+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f289414d050 con 0x7f2894152d00 2024-04-26T23:05:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f2891600640 1 -- 172.21.15.148:0/2705285457 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f287c05ac10 con 0x7f2894152d00 2024-04-26T23:05:00.809 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 msgr2=0x7f287006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 0x7f287006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28840045f0 tx=0x7f2884008040 comp rx=0 tx=0).stop 2024-04-26T23:05:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 msgr2=0x7f28941f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d830 tx=0x7f287c00dcf0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 shutdown_connections 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2870068380 0x7f287006a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2894158a80 0x7f2894156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2894152d00 0x7f28941f4980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 --2- 172.21.15.148:0/2705285457 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2894073230 0x7f28941f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 >> 172.21.15.148:0/2705285457 conn(0x7f28940c9d10 msgr2=0x7f289414d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 shutdown_connections 2024-04-26T23:05:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.808+0000 7f289b400640 1 -- 172.21.15.148:0/2705285457 wait complete. 2024-04-26T23:05:00.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 Processor -- start 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 -- start start 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a780c44a0 0x7f5a7815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 0x7f5a7815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780c49e0 con 0x7f5a78157250 2024-04-26T23:05:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780cbb50 con 0x7f5a780c44a0 2024-04-26T23:05:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a7dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5a780caf80 con 0x7f5a780c9e80 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a780c44a0 0x7f5a7815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a780c44a0 0x7f5a7815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52334/0 (socket says 172.21.15.148:52334) 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 -- 172.21.15.148:0/93750377 learned_addr learned my addr 172.21.15.148:0/93750377 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a77400640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 0x7f5a7815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 -- 172.21.15.148:0/93750377 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 msgr2=0x7f5a7815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 0x7f5a7815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 -- 172.21.15.148:0/93750377 >> v1:172.21.15.157:6789/0 conn(0x7f5a78157250 legacy=0x7f5a7806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a76000640 1 -- 172.21.15.148:0/93750377 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780c6450 con 0x7f5a780c44a0 2024-04-26T23:05:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.968+0000 7f5a77400640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 0x7f5a7815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a76000640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c44a0 0x7f5a7815d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c933c83f28737e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a75600640 1 -- 172.21.15.148:0/93750377 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b1070 con 0x7f5a780c44a0 2024-04-26T23:05:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a75600640 1 -- 172.21.15.148:0/93750377 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640a8050 con 0x7f5a780c44a0 2024-04-26T23:05:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a75600640 1 -- 172.21.15.148:0/93750377 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ac860 con 0x7f5a780c44a0 2024-04-26T23:05:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 -- 172.21.15.148:0/93750377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c44a0 msgr2=0x7f5a7815d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c44a0 0x7f5a7815d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6401c4d0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 -- 172.21.15.148:0/93750377 shutdown_connections 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c9e80 0x7f5a7815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/93750377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c44a0 0x7f5a7815d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 -- 172.21.15.148:0/93750377 >> 172.21.15.148:0/93750377 conn(0x7f5a78068140 msgr2=0x7f5a78068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 -- 172.21.15.148:0/93750377 shutdown_connections 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.972+0000 7f5a7dc00640 1 -- 172.21.15.148:0/93750377 wait complete. 2024-04-26T23:05:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 Processor -- start 2024-04-26T23:05:00.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- start start 2024-04-26T23:05:00.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c44a0 0x7f5a780afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 0x7f5a7815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780b26c0 con 0x7f5a780c9e80 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78157670 con 0x7f5a78157250 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5a780b2840 con 0x7f5a780c44a0 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52344/0 (socket says 172.21.15.148:52344) 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 -- 172.21.15.148:0/2139154944 learned_addr learned my addr 172.21.15.148:0/2139154944 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76a00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c44a0 0x7f5a780afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a77400640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 0x7f5a7815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 -- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c44a0 msgr2=0x7f5a780afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c44a0 0x7f5a780afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 -- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 msgr2=0x7f5a7815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 0x7f5a7815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 -- 172.21.15.148:0/2139154944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7815d320 con 0x7f5a780c9e80 2024-04-26T23:05:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a77400640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 0x7f5a7815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a76000640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a640af040 tx=0x7f5a64019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b1040 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640ba070 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b5680 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7815d600 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.976+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7815bb90 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a78077c20 con 0x7f5a780c9e80 2024-04-26T23:05:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a640b5820 con 0x7f5a780c9e80 2024-04-26T23:05:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a6ea00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 0x7f5a5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a641209f0 con 0x7f5a780c9e80 2024-04-26T23:05:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a76a00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 0x7f5a5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.980+0000 7f5a76a00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 0x7f5a5806a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007fd0 tx=0x7f5a68009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:00.984+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5a64016150 con 0x7f5a780c9e80 2024-04-26T23:05:01.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a78156850 con 0x7f5a780c9e80 2024-04-26T23:05:01.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a6ea00640 1 -- 172.21.15.148:0/2139154944 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f5a640ace20 con 0x7f5a780c9e80 2024-04-26T23:05:01.142 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 msgr2=0x7f5a5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 0x7f5a5806a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007fd0 tx=0x7f5a68009040 comp rx=0 tx=0).stop 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 msgr2=0x7f5a7815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a640af040 tx=0x7f5a64019270 comp rx=0 tx=0).stop 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 shutdown_connections 2024-04-26T23:05:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5a58068380 0x7f5a5806a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78157250 0x7f5a7815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a780c9e80 0x7f5a7815c390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 --2- 172.21.15.148:0/2139154944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c44a0 0x7f5a780afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 >> 172.21.15.148:0/2139154944 conn(0x7f5a78068140 msgr2=0x7f5a78150490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 shutdown_connections 2024-04-26T23:05:01.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.140+0000 7f5a7dc00640 1 -- 172.21.15.148:0/2139154944 wait complete. 2024-04-26T23:05:01.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:05:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.296+0000 7f3382400640 1 Processor -- start 2024-04-26T23:05:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.296+0000 7f3382400640 1 -- start start 2024-04-26T23:05:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3382400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c0c8ed0 0x7f337c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3382400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f337c0c9310 0x7f337c0c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3382400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c0744e0 con 0x7f337c1562b0 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3382400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f337c070210 con 0x7f337c0c9310 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3382400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f337c0c97f0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f337c0c9310 0x7f337c0c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337b400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f337c1562b0 0x7f337c15c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58608/0 (socket says 172.21.15.148:58608) 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337b400640 1 -- 172.21.15.148:0/3583949960 learned_addr learned my addr 172.21.15.148:0/3583949960 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f3373e00640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c0c8ed0 0x7f337c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337be00640 1 -- 172.21.15.148:0/3583949960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c0c8ed0 msgr2=0x7f337c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337be00640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c0c8ed0 0x7f337c0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337be00640 1 -- 172.21.15.148:0/3583949960 >> v1:172.21.15.148:6789/0 conn(0x7f337c1562b0 legacy=0x7f337c15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337be00640 1 -- 172.21.15.148:0/3583949960 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c070460 con 0x7f337c0c9310 2024-04-26T23:05:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.300+0000 7f337aa00640 1 -- 172.21.15.148:0/3583949960 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017011218 0 0) 0x7f336c001120 con 0x7f337c1562b0 2024-04-26T23:05:01.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f337be00640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c9310 0x7f337c0c3d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3374009d90 tx=0x7f337401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c830cc74d6e3441 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f337aa00640 1 -- 172.21.15.148:0/3583949960 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740b2070 con 0x7f337c0c9310 2024-04-26T23:05:01.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f337aa00640 1 -- 172.21.15.148:0/3583949960 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33740a5920 con 0x7f337c0c9310 2024-04-26T23:05:01.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f337aa00640 1 -- 172.21.15.148:0/3583949960 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740a5cf0 con 0x7f337c0c9310 2024-04-26T23:05:01.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- 172.21.15.148:0/3583949960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c9310 msgr2=0x7f337c0c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c9310 0x7f337c0c3d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3374009d90 tx=0x7f337401c970 comp rx=0 tx=0).stop 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- 172.21.15.148:0/3583949960 shutdown_connections 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c9310 0x7f337c0c3d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 --2- 172.21.15.148:0/3583949960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c0c8ed0 0x7f337c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- 172.21.15.148:0/3583949960 >> 172.21.15.148:0/3583949960 conn(0x7f337c06f3d0 msgr2=0x7f337c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- 172.21.15.148:0/3583949960 shutdown_connections 2024-04-26T23:05:01.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- 172.21.15.148:0/3583949960 wait complete. 2024-04-26T23:05:01.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 Processor -- start 2024-04-26T23:05:01.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.304+0000 7f3382400640 1 -- start start 2024-04-26T23:05:01.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f337c0c9310 0x7f337c0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c1562b0 0x7f337c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f337c1687a0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f337c168620 con 0x7f337c0c9310 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f337c168920 con 0x7f337c1562b0 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52368/0 (socket says 172.21.15.148:52368) 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 -- 172.21.15.148:0/4225043497 learned_addr learned my addr 172.21.15.148:0/4225043497 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337be00640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c1562b0 0x7f337c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3373e00640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f337c0c9310 0x7f337c0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 -- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c1562b0 msgr2=0x7f337c14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c1562b0 0x7f337c14c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 -- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f337c0c9310 msgr2=0x7f337c0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f337c0c9310 0x7f337c0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 -- 172.21.15.148:0/4225043497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c1f4cf0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f337b400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7b0 tx=0x7f336c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c018070 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0072f0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c1f4f90 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0047f0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c1f5510 con 0x7f337c0c8ed0 2024-04-26T23:05:01.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c0696e0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.308+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f336c01b070 con 0x7f337c0c8ed0 2024-04-26T23:05:01.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.312+0000 7f3373400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 0x7f335806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.312+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f336c0860c0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.312+0000 7f3373e00640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 0x7f335806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.312+0000 7f3373e00640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 0x7f335806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f337c0c6630 tx=0x7f3364008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.316+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f337c0744e0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.472+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f337c14c2b0 con 0x7f337c0c8ed0 2024-04-26T23:05:01.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.472+0000 7f3373400640 1 -- 172.21.15.148:0/4225043497 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f336c055c50 con 0x7f337c0c8ed0 2024-04-26T23:05:01.476 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 msgr2=0x7f335806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 0x7f335806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f337c0c6630 tx=0x7f3364008040 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 msgr2=0x7f337c0b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7b0 tx=0x7f336c00cc70 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 shutdown_connections 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3358068380 0x7f335806a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f337c1562b0 0x7f337c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f337c0c9310 0x7f337c0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 --2- 172.21.15.148:0/4225043497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f337c0c8ed0 0x7f337c0b1460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 >> 172.21.15.148:0/4225043497 conn(0x7f337c06f3d0 msgr2=0x7f337c0cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 shutdown_connections 2024-04-26T23:05:01.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.476+0000 7f3382400640 1 -- 172.21.15.148:0/4225043497 wait complete. 2024-04-26T23:05:01.498 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:05:01.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 Processor -- start 2024-04-26T23:05:01.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 -- start start 2024-04-26T23:05:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f367c0c97d0 0x7f367c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367c0c4b30 con 0x7f367c152d00 2024-04-26T23:05:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367c0c6f60 con 0x7f367c073940 2024-04-26T23:05:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f3681800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f367c0c7240 con 0x7f367c0c97d0 2024-04-26T23:05:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f367aa00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f367c152d00 0x7f367c073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58624/0 (socket says 172.21.15.148:58624) 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f367aa00640 1 -- 172.21.15.148:0/2315149964 learned_addr learned my addr 172.21.15.148:0/2315149964 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.632+0000 7f367b400640 1 --2- 172.21.15.148:0/2315149964 >> v2:172.21.15.157:3300/0 conn(0x7f367c0c97d0 0x7f367c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367a000640 1 -- 172.21.15.148:0/2315149964 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046380212 0 0) 0x7f367c0c4b30 con 0x7f367c152d00 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367a000640 1 -- 172.21.15.148:0/2315149964 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3660003530 con 0x7f367c152d00 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367b400640 1 -- 172.21.15.148:0/2315149964 >> v1:172.21.15.157:6789/0 conn(0x7f367c073940 legacy=0x7f367c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367b400640 1 -- 172.21.15.148:0/2315149964 >> v1:172.21.15.148:6789/0 conn(0x7f367c152d00 legacy=0x7f367c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367b400640 1 -- 172.21.15.148:0/2315149964 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c0c7520 con 0x7f367c0c97d0 2024-04-26T23:05:01.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367b400640 1 --2- 172.21.15.148:0/2315149964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c0c97d0 0x7f367c15c780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f367401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442fdcd733d927b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367a000640 1 -- 172.21.15.148:0/2315149964 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740b2070 con 0x7f367c0c97d0 2024-04-26T23:05:01.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367a000640 1 -- 172.21.15.148:0/2315149964 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36740a5940 con 0x7f367c0c97d0 2024-04-26T23:05:01.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.636+0000 7f367a000640 1 -- 172.21.15.148:0/2315149964 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740a5cf0 con 0x7f367c0c97d0 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- 172.21.15.148:0/2315149964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c0c97d0 msgr2=0x7f367c15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 --2- 172.21.15.148:0/2315149964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c0c97d0 0x7f367c15c780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f367401c970 comp rx=0 tx=0).stop 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- 172.21.15.148:0/2315149964 shutdown_connections 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 --2- 172.21.15.148:0/2315149964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c0c97d0 0x7f367c15c780 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- 172.21.15.148:0/2315149964 >> 172.21.15.148:0/2315149964 conn(0x7f367c0c9d10 msgr2=0x7f367c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- 172.21.15.148:0/2315149964 shutdown_connections 2024-04-26T23:05:01.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- 172.21.15.148:0/2315149964 wait complete. 2024-04-26T23:05:01.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 Processor -- start 2024-04-26T23:05:01.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- start start 2024-04-26T23:05:01.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c073940 0x7f367c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 0x7f367c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f367c166db0 con 0x7f367c152d00 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f367c166c30 con 0x7f367c073940 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3681800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f367c166f30 con 0x7f367c0c97d0 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52378/0 (socket says 172.21.15.148:52378) 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 -- 172.21.15.148:0/2552933551 learned_addr learned my addr 172.21.15.148:0/2552933551 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367aa00640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c073940 0x7f367c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3672000640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 0x7f367c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 -- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 msgr2=0x7f367c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 0x7f367c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 -- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c073940 msgr2=0x7f367c153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c073940 0x7f367c153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f367b400640 1 -- 172.21.15.148:0/2552933551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c14fe10 con 0x7f367c152d00 2024-04-26T23:05:01.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.640+0000 7f3672000640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 0x7f367c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:01.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f367b400640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f3674019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740b2050 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36740be070 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674004040 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c1f5450 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c152370 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c1502f0 con 0x7f367c152d00 2024-04-26T23:05:01.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36740041e0 con 0x7f367c152d00 2024-04-26T23:05:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 0x7f365806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3674121d80 con 0x7f367c152d00 2024-04-26T23:05:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.644+0000 7f367aa00640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 0x7f365806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.648+0000 7f367aa00640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 0x7f365806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f366c0011f0 tx=0x7f366c007d40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.648+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3674125030 con 0x7f367c152d00 2024-04-26T23:05:01.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.816+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f367c077c20 con 0x7f367c152d00 2024-04-26T23:05:01.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3673400640 1 -- 172.21.15.148:0/2552933551 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3674016560 con 0x7f367c152d00 2024-04-26T23:05:01.821 INFO:teuthology.orchestra.run.smithi148.stderr:listed 0 entries 2024-04-26T23:05:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 msgr2=0x7f365806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 0x7f365806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f366c0011f0 tx=0x7f366c007d40 comp rx=0 tx=0).stop 2024-04-26T23:05:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 msgr2=0x7f367c15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f3674019710 comp rx=0 tx=0).stop 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 shutdown_connections 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3658068380 0x7f365806a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f367c152d00 0x7f367c15b260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f367c0c97d0 0x7f367c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 --2- 172.21.15.148:0/2552933551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f367c073940 0x7f367c153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 >> 172.21.15.148:0/2552933551 conn(0x7f367c0c9d10 msgr2=0x7f367c1638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 shutdown_connections 2024-04-26T23:05:01.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:01.820+0000 7f3681800640 1 -- 172.21.15.148:0/2552933551 wait complete. 2024-04-26T23:05:01.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi148.front.sepia.ceph.com... 2024-04-26T23:05:01.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:01.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T23:05:01.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi148.stderr:ceph-fuse[32247]: fuse finished with error 0 and tester_r 0 2024-04-26T23:05:01.869 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:05:01.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:05:01.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:01.914 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T23:05:01.973 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:02.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 Processor -- start 2024-04-26T23:05:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 -- start start 2024-04-26T23:05:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c153af0 0x7ff89c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff89c0c7b80 0x7ff89c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89c0c9d90 con 0x7ff89c0c9010 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff89c0ca630 con 0x7ff89c0c7b80 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a3200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c0ca070 con 0x7ff89c153af0 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a1200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff89c0c9010 0x7ff89c0c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58638/0 (socket says 172.21.15.148:58638) 2024-04-26T23:05:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff8a1200640 1 -- 172.21.15.148:0/1378913926 learned_addr learned my addr 172.21.15.148:0/1378913926 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff89be00640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c153af0 0x7ff89c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff893400640 1 --2- 172.21.15.148:0/1378913926 >> v2:172.21.15.157:3300/0 conn(0x7ff89c0c7b80 0x7ff89c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440442099 0 0) 0x7ff89c0c9d90 con 0x7ff89c0c9010 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff880003530 con 0x7ff89c0c9010 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff893400640 1 -- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c153af0 msgr2=0x7ff89c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff893400640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c153af0 0x7ff89c15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2892336786 0 0) 0x7ff880003530 con 0x7ff89c0c9010 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff893400640 1 -- 172.21.15.148:0/1378913926 >> v1:172.21.15.148:6789/0 conn(0x7ff89c0c9010 legacy=0x7ff89c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.148+0000 7ff893400640 1 -- 172.21.15.148:0/1378913926 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c0ca350 con 0x7ff89c0c7b80 2024-04-26T23:05:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff893400640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c0c7b80 0x7ff89c0c7f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8840097c0 tx=0x7ff88401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a094f234230150f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840b5070 con 0x7ff89c0c7b80 2024-04-26T23:05:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8840a85f0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff89b400640 1 -- 172.21.15.148:0/1378913926 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894001a00 con 0x7ff89c0c7b80 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 -- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c0c7b80 msgr2=0x7ff89c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c0c7b80 0x7ff89c0c7f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8840097c0 tx=0x7ff88401ebb0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 -- 172.21.15.148:0/1378913926 shutdown_connections 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c0c7b80 0x7ff89c0c7f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 --2- 172.21.15.148:0/1378913926 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c153af0 0x7ff89c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 -- 172.21.15.148:0/1378913926 >> 172.21.15.148:0/1378913926 conn(0x7ff89c06c380 msgr2=0x7ff89c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 -- 172.21.15.148:0/1378913926 shutdown_connections 2024-04-26T23:05:02.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.152+0000 7ff8a3200640 1 -- 172.21.15.148:0/1378913926 wait complete. 2024-04-26T23:05:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 Processor -- start 2024-04-26T23:05:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- start start 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c0c9010 0x7ff89c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c153af0 0x7ff89c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c153ed0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c15d290 con 0x7ff89c153af0 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c154050 con 0x7ff89c0c9010 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52388/0 (socket says 172.21.15.148:52388) 2024-04-26T23:05:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 -- 172.21.15.148:0/3867223505 learned_addr learned my addr 172.21.15.148:0/3867223505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a1200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c153af0 0x7ff89c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff893400640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c0c9010 0x7ff89c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 -- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c0c9010 msgr2=0x7ff89c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c0c9010 0x7ff89c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 -- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c153af0 msgr2=0x7ff89c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c153af0 0x7ff89c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 -- 172.21.15.148:0/3867223505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c0738c0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff89be00640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00e870 tx=0x7ff88c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c017070 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c0742a0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c00ee60 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00cae0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.156+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c1f1f50 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.160+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c077c20 con 0x7ff89c0c7b80 2024-04-26T23:05:02.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.160+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff88c01a070 con 0x7ff89c0c7b80 2024-04-26T23:05:02.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.160+0000 7ff898c00640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 0x7ff87806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.160+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff88c086ff0 con 0x7ff89c0c7b80 2024-04-26T23:05:02.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.160+0000 7ff893400640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 0x7ff87806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.164+0000 7ff893400640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 0x7ff87806a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b2000 tx=0x7ff884008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.164+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff88c057170 con 0x7ff89c0c7b80 2024-04-26T23:05:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.324+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff89c0c8670 con 0x7ff89c0c7b80 2024-04-26T23:05:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.324+0000 7ff898c00640 1 -- 172.21.15.148:0/3867223505 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7ff88c056a70 con 0x7ff89c0c7b80 2024-04-26T23:05:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:02.328 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 msgr2=0x7ff87806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 0x7ff87806a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b2000 tx=0x7ff884008040 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 msgr2=0x7ff89c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00e870 tx=0x7ff88c00ec70 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 shutdown_connections 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff8780683b0 0x7ff87806a870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff89c153af0 0x7ff89c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff89c0c9010 0x7ff89c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 --2- 172.21.15.148:0/3867223505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff89c0c7b80 0x7ff89c156ec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 >> 172.21.15.148:0/3867223505 conn(0x7ff89c06c380 msgr2=0x7ff89c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 shutdown_connections 2024-04-26T23:05:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.328+0000 7ff8a3200640 1 -- 172.21.15.148:0/3867223505 wait complete. 2024-04-26T23:05:02.350 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:02.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.480+0000 7f3d5b600640 1 Processor -- start 2024-04-26T23:05:02.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.480+0000 7f3d5b600640 1 -- start start 2024-04-26T23:05:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d5b600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 0x7f3d54073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d5b600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3d540c9b60 0x7f3d540c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d5b600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d54152fa0 con 0x7f3d54152bc0 2024-04-26T23:05:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d5b600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3d54159790 con 0x7f3d540c9b60 2024-04-26T23:05:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d5b600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3d54158930 con 0x7f3d54072d70 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d58c00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3d54152bc0 0x7f3d540c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52736/0 (socket says 172.21.15.148:52736) 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 0x7f3d54073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d58c00640 1 -- 172.21.15.148:0/4150113284 learned_addr learned my addr 172.21.15.148:0/4150113284 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d59600640 1 --2- 172.21.15.148:0/4150113284 >> v2:172.21.15.157:3300/0 conn(0x7f3d540c9b60 0x7f3d540c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d53400640 1 -- 172.21.15.148:0/4150113284 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449857176 0 0) 0x7f3d54152fa0 con 0x7f3d54152bc0 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d53400640 1 -- 172.21.15.148:0/4150113284 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d3c003530 con 0x7f3d54152bc0 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d59600640 1 -- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 msgr2=0x7f3d54073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d59600640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 0x7f3d54073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d59600640 1 -- 172.21.15.148:0/4150113284 >> v1:172.21.15.157:6789/0 conn(0x7f3d54152bc0 legacy=0x7f3d540c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d59600640 1 -- 172.21.15.148:0/4150113284 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d54158c10 con 0x7f3d540c9b60 2024-04-26T23:05:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.484+0000 7f3d53e00640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 0x7f3d54073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:02.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d59600640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d540c9b60 0x7f3d540c9fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009d90 tx=0x7f3d4c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3b2d1f51337e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d53400640 1 -- 172.21.15.148:0/4150113284 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0b4070 con 0x7f3d540c9b60 2024-04-26T23:05:02.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d53400640 1 -- 172.21.15.148:0/4150113284 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0af600 con 0x7f3d540c9b60 2024-04-26T23:05:02.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d53400640 1 -- 172.21.15.148:0/4150113284 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0af9d0 con 0x7f3d540c9b60 2024-04-26T23:05:02.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 -- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d540c9b60 msgr2=0x7f3d540c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d540c9b60 0x7f3d540c9fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009d90 tx=0x7f3d4c01f150 comp rx=0 tx=0).stop 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 -- 172.21.15.148:0/4150113284 shutdown_connections 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d540c9b60 0x7f3d540c9fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 --2- 172.21.15.148:0/4150113284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d54072d70 0x7f3d54073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 -- 172.21.15.148:0/4150113284 >> 172.21.15.148:0/4150113284 conn(0x7f3d5406c380 msgr2=0x7f3d5406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 -- 172.21.15.148:0/4150113284 shutdown_connections 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 -- 172.21.15.148:0/4150113284 wait complete. 2024-04-26T23:05:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.488+0000 7f3d5b600640 1 Processor -- start 2024-04-26T23:05:02.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- start start 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d540c9b60 0x7f3d54163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 0x7f3d5414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541594b0 con 0x7f3d54072d70 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541591d0 con 0x7f3d54152bc0 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3d540736d0 con 0x7f3d540c9b60 2024-04-26T23:05:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52400/0 (socket says 172.21.15.148:52400) 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 -- 172.21.15.148:0/2271747493 learned_addr learned my addr 172.21.15.148:0/2271747493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d53e00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d540c9b60 0x7f3d54163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d59600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 0x7f3d5414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 -- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d540c9b60 msgr2=0x7f3d54163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d540c9b60 0x7f3d54163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 -- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 msgr2=0x7f3d5414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 0x7f3d5414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 -- 172.21.15.148:0/2271747493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d541f1440 con 0x7f3d54072d70 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d59600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 0x7f3d5414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d58c00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800c450 tx=0x7f3d4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48017070 con 0x7f3d54072d70 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48005cf0 con 0x7f3d54072d70 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d480072f0 con 0x7f3d54072d70 2024-04-26T23:05:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d54163740 con 0x7f3d54072d70 2024-04-26T23:05:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541f1700 con 0x7f3d54072d70 2024-04-26T23:05:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.492+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54077c20 con 0x7f3d54072d70 2024-04-26T23:05:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.496+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d4801a070 con 0x7f3d54072d70 2024-04-26T23:05:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.496+0000 7f3d50c00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 0x7f3d3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.496+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d480861c0 con 0x7f3d54072d70 2024-04-26T23:05:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.496+0000 7f3d53e00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 0x7f3d3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.496+0000 7f3d53e00640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 0x7f3d3406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d541416a0 tx=0x7f3d40009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.500+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3d48055cc0 con 0x7f3d54072d70 2024-04-26T23:05:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.656+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d540c9940 con 0x7f3d54072d70 2024-04-26T23:05:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.656+0000 7f3d50c00640 1 -- 172.21.15.148:0/2271747493 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f3d48059fc0 con 0x7f3d54072d70 2024-04-26T23:05:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:02.660 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 msgr2=0x7f3d3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 0x7f3d3406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d541416a0 tx=0x7f3d40009190 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 msgr2=0x7f3d541f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800c450 tx=0x7f3d4800c910 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 shutdown_connections 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3d34068380 0x7f3d3406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d54152bc0 0x7f3d5414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d540c9b60 0x7f3d54163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 --2- 172.21.15.148:0/2271747493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d54072d70 0x7f3d541f53c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 >> 172.21.15.148:0/2271747493 conn(0x7f3d5406c380 msgr2=0x7f3d540c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 shutdown_connections 2024-04-26T23:05:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.660+0000 7f3d5b600640 1 -- 172.21.15.148:0/2271747493 wait complete. 2024-04-26T23:05:02.680 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:05:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 Processor -- start 2024-04-26T23:05:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 -- start start 2024-04-26T23:05:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc071000 0x7fd8cc0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd8cc0713e0 0x7fd8cc0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc0c9100 con 0x7fd8cc0c9c40 2024-04-26T23:05:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd8cc0742a0 con 0x7fd8cc0713e0 2024-04-26T23:05:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d3600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc073720 con 0x7fd8cc071000 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8cbe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd8cc0713e0 0x7fd8cc0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d0c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc071000 0x7fd8cc0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d1600640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd8cc0c9c40 0x7fd8cc152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52748/0 (socket says 172.21.15.148:52748) 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.816+0000 7fd8d1600640 1 -- 172.21.15.148:0/3482112353 learned_addr learned my addr 172.21.15.148:0/3482112353 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cbe00640 1 -- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc071000 msgr2=0x7fd8cc0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cbe00640 1 --2- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc071000 0x7fd8cc0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cbe00640 1 -- 172.21.15.148:0/3482112353 >> v1:172.21.15.157:6789/0 conn(0x7fd8cc0c9c40 legacy=0x7fd8cc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cbe00640 1 -- 172.21.15.148:0/3482112353 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc0c5e50 con 0x7fd8cc0713e0 2024-04-26T23:05:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cbe00640 1 --2- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc0c8bc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80097c0 tx=0x7fd8b8020ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ff68a802648f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cb400640 1 -- 172.21.15.148:0/3482112353 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b7070 con 0x7fd8cc0713e0 2024-04-26T23:05:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cb400640 1 -- 172.21.15.148:0/3482112353 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b80aaba0 con 0x7fd8cc0713e0 2024-04-26T23:05:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.820+0000 7fd8cb400640 1 -- 172.21.15.148:0/3482112353 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b2440 con 0x7fd8cc0713e0 2024-04-26T23:05:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc0713e0 msgr2=0x7fd8cc0c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc0c8bc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80097c0 tx=0x7fd8b8020ea0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- 172.21.15.148:0/3482112353 shutdown_connections 2024-04-26T23:05:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc0c8bc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- 172.21.15.148:0/3482112353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc071000 0x7fd8cc0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- 172.21.15.148:0/3482112353 >> 172.21.15.148:0/3482112353 conn(0x7fd8cc0ce2c0 msgr2=0x7fd8cc0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:02.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- 172.21.15.148:0/3482112353 shutdown_connections 2024-04-26T23:05:02.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- 172.21.15.148:0/3482112353 wait complete. 2024-04-26T23:05:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 Processor -- start 2024-04-26T23:05:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- start start 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc071000 0x7fd8cc1e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 0x7fd8cc1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc073f30 con 0x7fd8cc0713e0 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc073c50 con 0x7fd8cc071000 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d3600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc0c96e0 con 0x7fd8cc0c9c40 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52408/0 (socket says 172.21.15.148:52408) 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 -- 172.21.15.148:0/683297346 learned_addr learned my addr 172.21.15.148:0/683297346 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d0c00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc071000 0x7fd8cc1e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d1600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 0x7fd8cc1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 -- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 msgr2=0x7fd8cc1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 0x7fd8cc1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 -- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc071000 msgr2=0x7fd8cc1e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc071000 0x7fd8cc1e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8cbe00640 1 -- 172.21.15.148:0/683297346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc1f5070 con 0x7fd8cc0713e0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.824+0000 7fd8d1600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 0x7fd8cc1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8cbe00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80b5040 tx=0x7fd8b801dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80c0070 con 0x7fd8cc0713e0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc1f5350 con 0x7fd8cc0713e0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b80b0550 con 0x7fd8cc0713e0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b7070 con 0x7fd8cc0713e0 2024-04-26T23:05:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc1f5910 con 0x7fd8cc0713e0 2024-04-26T23:05:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8cc077c20 con 0x7fd8cc0713e0 2024-04-26T23:05:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8b80b0920 con 0x7fd8cc0713e0 2024-04-26T23:05:02.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 0x7fd8ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:02.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8b8124340 con 0x7fd8cc0713e0 2024-04-26T23:05:02.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.828+0000 7fd8d0c00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 0x7fd8ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:02.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.832+0000 7fd8d0c00640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 0x7fd8ac06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0113e0 tx=0x7fd8bc00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:02.832+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd8b801aa00 con 0x7fd8cc0713e0 2024-04-26T23:05:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.024+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd8cc152890 con 0x7fd8cc0713e0 2024-04-26T23:05:03.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.920+0000 7fd8c8c00640 1 -- 172.21.15.148:0/683297346 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fd8b8124100 con 0x7fd8cc0713e0 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 msgr2=0x7fd8ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 0x7fd8ac06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0113e0 tx=0x7fd8bc00b040 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 msgr2=0x7fd8cc1e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80b5040 tx=0x7fd8b801dc40 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 shutdown_connections 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8ac068380 0x7fd8ac06a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8cc0c9c40 0x7fd8cc1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8cc0713e0 0x7fd8cc1e4390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 --2- 172.21.15.148:0/683297346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8cc071000 0x7fd8cc1e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 >> 172.21.15.148:0/683297346 conn(0x7fd8cc0ce2c0 msgr2=0x7fd8cc0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 shutdown_connections 2024-04-26T23:05:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:03.924+0000 7fd8d3600640 1 -- 172.21.15.148:0/683297346 wait complete. 2024-04-26T23:05:03.948 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-26T23:05:03.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-26T23:05:04.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 Processor -- start 2024-04-26T23:05:04.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 -- start start 2024-04-26T23:05:04.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff48073940 0x7eff480c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff480c4b30 con 0x7eff48152d00 2024-04-26T23:05:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff480c6f60 con 0x7eff4815c070 2024-04-26T23:05:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4f600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff480c7240 con 0x7eff48073940 2024-04-26T23:05:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7eff48152d00 0x7eff48073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58654/0 (socket says 172.21.15.148:58654) 2024-04-26T23:05:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 -- 172.21.15.148:0/3336041756 learned_addr learned my addr 172.21.15.148:0/3336041756 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47e00640 1 --2- 172.21.15.148:0/3336041756 >> v2:172.21.15.157:3300/0 conn(0x7eff48073940 0x7eff480c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510550693 0 0) 0x7eff480c4b30 con 0x7eff48152d00 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff30003530 con 0x7eff48152d00 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2252193978 0 0) 0x7eff30003530 con 0x7eff48152d00 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 >> v2:172.21.15.157:3300/0 conn(0x7eff48073940 msgr2=0x7eff480c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 --2- 172.21.15.148:0/3336041756 >> v2:172.21.15.157:3300/0 conn(0x7eff48073940 0x7eff480c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 >> v1:172.21.15.157:6789/0 conn(0x7eff4815c070 legacy=0x7eff4815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff480c7520 con 0x7eff48152d00 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7eff3c001680 con 0x7eff48152d00 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 >> v1:172.21.15.148:6789/0 conn(0x7eff48152d00 legacy=0x7eff48073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 0x7eff30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff300051d0 0x7eff3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff480c7240 con 0x7eff300039c0 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff3000c070 con 0x7eff300051d0 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff3000c270 con 0x7eff30004810 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 0x7eff30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4d600640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff300051d0 0x7eff3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff47e00640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 -- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff30004810 msgr2=0x7eff30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 -- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff300051d0 msgr2=0x7eff3000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff300051d0 0x7eff3000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4d600640 1 -- 172.21.15.148:0/3336041756 reap_dead start 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.088+0000 7eff4cc00640 1 -- 172.21.15.148:0/3336041756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff30003530 con 0x7eff300039c0 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 0x7eff30003de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c240 tx=0x7eff3c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98aa837962cd8a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c007d20 con 0x7eff300039c0 2024-04-26T23:05:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c0a9070 con 0x7eff300039c0 2024-04-26T23:05:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff47400640 1 -- 172.21.15.148:0/3336041756 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c005d80 con 0x7eff300039c0 2024-04-26T23:05:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 -- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 msgr2=0x7eff30003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 0x7eff30003de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c240 tx=0x7eff3c01cc80 comp rx=0 tx=0).stop 2024-04-26T23:05:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 -- 172.21.15.148:0/3336041756 shutdown_connections 2024-04-26T23:05:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 --2- 172.21.15.148:0/3336041756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300039c0 0x7eff30003de0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 -- 172.21.15.148:0/3336041756 >> 172.21.15.148:0/3336041756 conn(0x7eff480c9d10 msgr2=0x7eff480ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 -- 172.21.15.148:0/3336041756 shutdown_connections 2024-04-26T23:05:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.092+0000 7eff4f600640 1 -- 172.21.15.148:0/3336041756 wait complete. 2024-04-26T23:05:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 Processor -- start 2024-04-26T23:05:04.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- start start 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff300039c0 0x7eff481502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff48159c40 0x7eff4814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff480c4890 con 0x7eff4814a390 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff480c4710 con 0x7eff48159c40 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff4815cc90 con 0x7eff300039c0 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52418/0 (socket says 172.21.15.148:52418) 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 -- 172.21.15.148:0/3407639676 learned_addr learned my addr 172.21.15.148:0/3407639676 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff300039c0 0x7eff481502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff47e00640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff48159c40 0x7eff4814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 -- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff300039c0 msgr2=0x7eff481502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff300039c0 0x7eff481502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 -- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff48159c40 msgr2=0x7eff4814c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff48159c40 0x7eff4814c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 -- 172.21.15.148:0/3407639676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4814d0e0 con 0x7eff4814a390 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4d600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff48156650 tx=0x7eff4000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40019070 con 0x7eff4814a390 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff40006d70 con 0x7eff4814a390 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40003ba0 con 0x7eff4814a390 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4814bea0 con 0x7eff4814a390 2024-04-26T23:05:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.096+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff481f89f0 con 0x7eff4814a390 2024-04-26T23:05:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff48077c20 con 0x7eff4814a390 2024-04-26T23:05:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff4001c070 con 0x7eff4814a390 2024-04-26T23:05:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff44c00640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff400861e0 con 0x7eff4814a390 2024-04-26T23:05:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.100+0000 7eff4cc00640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 0x7eff2806a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ab000 tx=0x7eff3c0a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:04.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.104+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7eff40055e10 con 0x7eff4814a390 2024-04-26T23:05:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.300+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7eff48070160 con 0x7eff4814a390 2024-04-26T23:05:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.928+0000 7eff44c00640 1 -- 172.21.15.148:0/3407639676 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7eff4005a110 con 0x7eff4814a390 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 msgr2=0x7eff2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 0x7eff2806a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ab000 tx=0x7eff3c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 msgr2=0x7eff4814a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff48156650 tx=0x7eff4000e9e0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 shutdown_connections 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff4814a390 0x7eff4814a810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff48159c40 0x7eff4814c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 --2- 172.21.15.148:0/3407639676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff300039c0 0x7eff481502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:04.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 >> 172.21.15.148:0/3407639676 conn(0x7eff480c9d10 msgr2=0x7eff48074000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:04.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 shutdown_connections 2024-04-26T23:05:04.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:04.932+0000 7eff4f600640 1 -- 172.21.15.148:0/3407639676 wait complete. 2024-04-26T23:05:04.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:05:05.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 Processor -- start 2024-04-26T23:05:05.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 -- start start 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f89400c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f894015c070 0x7f894015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89400c4b30 con 0x7f8940073230 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f89400c6f60 con 0x7f894015c070 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8947a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f89400c7240 con 0x7f8940152d00 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8937e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8940073230 0x7f8940073670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58658/0 (socket says 172.21.15.148:58658) 2024-04-26T23:05:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8937e00640 1 -- 172.21.15.148:0/2084260064 learned_addr learned my addr 172.21.15.148:0/2084260064 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 --2- 172.21.15.148:0/2084260064 >> v2:172.21.15.157:3300/0 conn(0x7f894015c070 0x7f894015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945000640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f89400c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234700875 0 0) 0x7f89400c4b30 con 0x7f8940073230 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8924005740 con 0x7f8940073230 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386593190 0 0) 0x7f8924005740 con 0x7f8940073230 2024-04-26T23:05:05.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 msgr2=0x7f89400c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f89400c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 >> v2:172.21.15.157:3300/0 conn(0x7f894015c070 msgr2=0x7f894015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 --2- 172.21.15.148:0/2084260064 >> v2:172.21.15.157:3300/0 conn(0x7f894015c070 0x7f894015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89400c7520 con 0x7f8940073230 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f8928001680 con 0x7f8940073230 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 >> v1:172.21.15.148:6789/0 conn(0x7f8940073230 legacy=0x7f8940073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8924005bd0 0x7f8924005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f8924006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8924006f60 0x7f89240073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f89400c6f60 con 0x7f8924006f60 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f89400c7240 con 0x7f8924005bd0 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f892400dbe0 con 0x7f8940152d00 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8924006f60 0x7f89240073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945000640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8924005bd0 0x7f8924005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8937e00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f8924006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 -- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 msgr2=0x7f8924006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8940152d00 0x7f8924006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 -- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8924005bd0 msgr2=0x7f8924005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8924005bd0 0x7f8924005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.092+0000 7f8945a00640 1 -- 172.21.15.148:0/2084260064 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8924005740 con 0x7f8924006f60 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8945a00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8924006f60 0x7f89240073e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fc0 tx=0x7f893801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ec0eefc3e48a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380b2070 con 0x7f8924006f60 2024-04-26T23:05:05.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89380a5cd0 con 0x7f8924006f60 2024-04-26T23:05:05.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f893fe00640 1 -- 172.21.15.148:0/2084260064 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938009c10 con 0x7f8924006f60 2024-04-26T23:05:05.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 -- 172.21.15.148:0/2084260064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8924006f60 msgr2=0x7f89240073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 --2- 172.21.15.148:0/2084260064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8924006f60 0x7f89240073e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fc0 tx=0x7f893801ccc0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8945a00640 1 -- 172.21.15.148:0/2084260064 reap_dead start 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 -- 172.21.15.148:0/2084260064 shutdown_connections 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 -- 172.21.15.148:0/2084260064 >> 172.21.15.148:0/2084260064 conn(0x7f89400c9d10 msgr2=0x7f89400ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 -- 172.21.15.148:0/2084260064 shutdown_connections 2024-04-26T23:05:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.096+0000 7f8947a00640 1 -- 172.21.15.148:0/2084260064 wait complete. 2024-04-26T23:05:05.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 Processor -- start 2024-04-26T23:05:05.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- start start 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8924006f60 0x7f89401efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89400ca630 0x7f89401eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f89400c4f90 con 0x7f89401ef0f0 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f89400c4e10 con 0x7f89400ca630 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f89400c4710 con 0x7f8924006f60 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52434/0 (socket says 172.21.15.148:52434) 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 -- 172.21.15.148:0/4052408358 learned_addr learned my addr 172.21.15.148:0/4052408358 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8937e00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89400ca630 0x7f89401eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945000640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8924006f60 0x7f89401efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 -- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8924006f60 msgr2=0x7f89401efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8924006f60 0x7f89401efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 -- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89400ca630 msgr2=0x7f89401eebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89400ca630 0x7f89401eebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 -- 172.21.15.148:0/4052408358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89401598a0 con 0x7f89401ef0f0 2024-04-26T23:05:05.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8945a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f893801c730 tx=0x7f8938009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380bd070 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89380a5ad0 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894014d6c0 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380b2040 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.100+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89401f03e0 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8940070cc0 con 0x7f89401ef0f0 2024-04-26T23:05:05.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89380039a0 con 0x7f89401ef0f0 2024-04-26T23:05:05.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f893d600640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 0x7f891c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:05.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8938120d80 con 0x7f89401ef0f0 2024-04-26T23:05:05.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f8945000640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 0x7f891c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:05.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.104+0000 7f8945000640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 0x7f891c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8930009a80 tx=0x7f8930008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:05.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.108+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f894014d6c0 con 0x7f89401ef0f0 2024-04-26T23:05:05.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.296+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f894014ce20 con 0x7f89401ef0f0 2024-04-26T23:05:05.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.940+0000 7f893d600640 1 -- 172.21.15.148:0/4052408358 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f89380169d0 con 0x7f89401ef0f0 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 msgr2=0x7f891c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 0x7f891c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8930009a80 tx=0x7f8930008040 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 msgr2=0x7f89401ed0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f893801c730 tx=0x7f8938009750 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 shutdown_connections 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f891c068380 0x7f891c06a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89401ef0f0 0x7f89401ed0f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89400ca630 0x7f89401eebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 --2- 172.21.15.148:0/4052408358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8924006f60 0x7f89401efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 >> 172.21.15.148:0/4052408358 conn(0x7f89400c9d10 msgr2=0x7f8940150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:05.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 shutdown_connections 2024-04-26T23:05:05.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:05.944+0000 7f8947a00640 1 -- 172.21.15.148:0/4052408358 wait complete. 2024-04-26T23:05:05.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T23:05:06.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 Processor -- start 2024-04-26T23:05:06.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 -- start start 2024-04-26T23:05:06.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 0x7f79940c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 0x7f799415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79940c4b30 con 0x7f7994152d00 2024-04-26T23:05:06.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f79940c6f60 con 0x7f7994073940 2024-04-26T23:05:06.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f799b800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f79940c7240 con 0x7f799415c070 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f7998e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7994152d00 0x7f7994073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52762/0 (socket says 172.21.15.148:52762) 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f7998e00640 1 -- 172.21.15.148:0/783815084 learned_addr learned my addr 172.21.15.148:0/783815084 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f7999800640 1 --2- 172.21.15.148:0/783815084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 0x7f799415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.104+0000 7f7993e00640 1 --2- 172.21.15.148:0/783815084 >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 0x7f79940c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993400640 1 -- 172.21.15.148:0/783815084 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213417375 0 0) 0x7f79940c4b30 con 0x7f7994152d00 2024-04-26T23:05:06.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993400640 1 -- 172.21.15.148:0/783815084 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7978003530 con 0x7f7994152d00 2024-04-26T23:05:06.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7999800640 1 -- 172.21.15.148:0/783815084 >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 msgr2=0x7f79940c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:06.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7999800640 1 --2- 172.21.15.148:0/783815084 >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 0x7f79940c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7999800640 1 -- 172.21.15.148:0/783815084 >> v1:172.21.15.157:6789/0 conn(0x7f7994152d00 legacy=0x7f7994073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7999800640 1 -- 172.21.15.148:0/783815084 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79940c7520 con 0x7f799415c070 2024-04-26T23:05:06.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993e00640 1 --2- 172.21.15.148:0/783815084 >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 0x7f79940c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:06.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7999800640 1 --2- 172.21.15.148:0/783815084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 0x7f799415c4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f798c009d90 tx=0x7f798c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26a692b36938ed55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:06.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993400640 1 -- 172.21.15.148:0/783815084 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0b2070 con 0x7f799415c070 2024-04-26T23:05:06.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993400640 1 -- 172.21.15.148:0/783815084 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0a59d0 con 0x7f799415c070 2024-04-26T23:05:06.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.108+0000 7f7993400640 1 -- 172.21.15.148:0/783815084 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a5d80 con 0x7f799415c070 2024-04-26T23:05:06.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- 172.21.15.148:0/783815084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 msgr2=0x7f799415c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- 172.21.15.148:0/783815084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 0x7f799415c4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f798c009d90 tx=0x7f798c01c970 comp rx=0 tx=0).stop 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- 172.21.15.148:0/783815084 shutdown_connections 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- 172.21.15.148:0/783815084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f799415c070 0x7f799415c4e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- 172.21.15.148:0/783815084 >> v2:172.21.15.157:3300/0 conn(0x7f7994073940 0x7f79940c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- 172.21.15.148:0/783815084 >> 172.21.15.148:0/783815084 conn(0x7f79940c9d10 msgr2=0x7f79940ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- 172.21.15.148:0/783815084 shutdown_connections 2024-04-26T23:05:06.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- 172.21.15.148:0/783815084 wait complete. 2024-04-26T23:05:06.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 Processor -- start 2024-04-26T23:05:06.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- start start 2024-04-26T23:05:06.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7994073940 0x7f79940c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 0x7f7994147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f799415cfb0 con 0x7f799415c070 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f799415ce30 con 0x7f7994152d00 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f799b800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7994165c20 con 0x7f7994073940 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52438/0 (socket says 172.21.15.148:52438) 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 -- 172.21.15.148:0/2811314706 learned_addr learned my addr 172.21.15.148:0/2811314706 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7998e00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7994073940 0x7f79940c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7993e00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 0x7f7994147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 -- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7994073940 msgr2=0x7f79940c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7994073940 0x7f79940c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 -- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 msgr2=0x7f7994147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 0x7f7994147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7999800640 1 -- 172.21.15.148:0/2811314706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994146e00 con 0x7f799415c070 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.112+0000 7f7993e00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 0x7f7994147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7999800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f798c0b0040 tx=0x7f798c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0b2050 con 0x7f799415c070 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0be070 con 0x7f799415c070 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c004040 con 0x7f799415c070 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941f3d80 con 0x7f799415c070 2024-04-26T23:05:06.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941f2fc0 con 0x7f799415c070 2024-04-26T23:05:06.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799414cf90 con 0x7f799415c070 2024-04-26T23:05:06.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f798c0041e0 con 0x7f799415c070 2024-04-26T23:05:06.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 0x7f797406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:06.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f798c121e40 con 0x7f799415c070 2024-04-26T23:05:06.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.116+0000 7f7998e00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 0x7f797406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:06.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.120+0000 7f7998e00640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 0x7f797406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7984007fd0 tx=0x7f7984009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:06.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.120+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f798c016560 con 0x7f799415c070 2024-04-26T23:05:06.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.312+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f799406ff30 con 0x7f799415c070 2024-04-26T23:05:06.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f7990c00640 1 -- 172.21.15.148:0/2811314706 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f798c0f2020 con 0x7f799415c070 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 msgr2=0x7f797406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 0x7f797406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7984007fd0 tx=0x7f7984009040 comp rx=0 tx=0).stop 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 msgr2=0x7f799413e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f798c0b0040 tx=0x7f798c019710 comp rx=0 tx=0).stop 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 shutdown_connections 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7974068380 0x7f797406a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799415c070 0x7f799413e860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7994152d00 0x7f7994147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 --2- 172.21.15.148:0/2811314706 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7994073940 0x7f79940c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:06.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.944+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 >> 172.21.15.148:0/2811314706 conn(0x7f79940c9d10 msgr2=0x7f79941461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:06.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.948+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 shutdown_connections 2024-04-26T23:05:06.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:06.948+0000 7f799b800640 1 -- 172.21.15.148:0/2811314706 wait complete. 2024-04-26T23:05:06.971 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:05:06.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:05:07.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.104+0000 7f219b000640 1 Processor -- start 2024-04-26T23:05:07.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.104+0000 7f219b000640 1 -- start start 2024-04-26T23:05:07.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2194153af0 0x7f219415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21940c7b80 0x7f21940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21940c9010 0x7f21940c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f21940ca630 con 0x7f21940c7b80 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f21940c99e0 con 0x7f21940c9010 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f219b000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f21940c9d90 con 0x7f2194153af0 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21940c7b80 0x7f21940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21940c7b80 0x7f21940c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44860/0 (socket says 172.21.15.148:44860) 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 -- 172.21.15.148:0/3979403534 learned_addr learned my addr 172.21.15.148:0/3979403534 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f2193e00640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2194153af0 0x7f219415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f2199000640 1 --2- 172.21.15.148:0/3979403534 >> v2:172.21.15.157:3300/0 conn(0x7f21940c9010 0x7f21940c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 -- 172.21.15.148:0/3979403534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2194153af0 msgr2=0x7f219415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:07.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2194153af0 0x7f219415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 -- 172.21.15.148:0/3979403534 >> v2:172.21.15.157:3300/0 conn(0x7f21940c9010 msgr2=0x7f21940c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:07.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 --2- 172.21.15.148:0/3979403534 >> v2:172.21.15.157:3300/0 conn(0x7f21940c9010 0x7f21940c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 -- 172.21.15.148:0/3979403534 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21940ca070 con 0x7f21940c7b80 2024-04-26T23:05:07.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.108+0000 7f218b400640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21940c7b80 0x7f21940c7f80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21940c3af0 tx=0x7f217c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9309e4dd90fbe2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2193400640 1 -- 172.21.15.148:0/3979403534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0b5070 con 0x7f21940c7b80 2024-04-26T23:05:07.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2193400640 1 -- 172.21.15.148:0/3979403534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217c0a89d0 con 0x7f21940c7b80 2024-04-26T23:05:07.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2193400640 1 -- 172.21.15.148:0/3979403534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0a8da0 con 0x7f21940c7b80 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- 172.21.15.148:0/3979403534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21940c7b80 msgr2=0x7f21940c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21940c7b80 0x7f21940c7f80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21940c3af0 tx=0x7f217c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- 172.21.15.148:0/3979403534 shutdown_connections 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21940c7b80 0x7f21940c7f80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- 172.21.15.148:0/3979403534 >> v2:172.21.15.157:3300/0 conn(0x7f21940c9010 0x7f21940c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- 172.21.15.148:0/3979403534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2194153af0 0x7f219415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- 172.21.15.148:0/3979403534 >> 172.21.15.148:0/3979403534 conn(0x7f219406c380 msgr2=0x7f219406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:07.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- 172.21.15.148:0/3979403534 shutdown_connections 2024-04-26T23:05:07.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- 172.21.15.148:0/3979403534 wait complete. 2024-04-26T23:05:07.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 Processor -- start 2024-04-26T23:05:07.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- start start 2024-04-26T23:05:07.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 0x7f21940c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 0x7f21940722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f219415d290 con 0x7f2194153af0 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f219415cfb0 con 0x7f21940c7b80 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f219b000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2194153ed0 con 0x7f21940c9010 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2199000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2199000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44876/0 (socket says 172.21.15.148:44876) 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2199000640 1 -- 172.21.15.148:0/874629903 learned_addr learned my addr 172.21.15.148:0/874629903 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f2193e00640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 0x7f21940c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.112+0000 7f218b400640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 0x7f21940722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 -- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 msgr2=0x7f21940722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 0x7f21940722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 -- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 msgr2=0x7f21940c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 0x7f21940c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 -- 172.21.15.148:0/874629903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2194074290 con 0x7f2194153af0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f218b400640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 0x7f21940722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2193e00640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 0x7f21940c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2199000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f218c007e40 tx=0x7f218c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c014620 con 0x7f2194153af0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c019070 con 0x7f2194153af0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21940c3500 con 0x7f2194153af0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c014a20 con 0x7f2194153af0 2024-04-26T23:05:07.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21940b9fd0 con 0x7f2194153af0 2024-04-26T23:05:07.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2194077c20 con 0x7f2194153af0 2024-04-26T23:05:07.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f218c014bc0 con 0x7f2194153af0 2024-04-26T23:05:07.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 0x7f217006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f218c087630 con 0x7f2194153af0 2024-04-26T23:05:07.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.116+0000 7f2193e00640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 0x7f217006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.120+0000 7f2193e00640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 0x7f217006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f218400b970 tx=0x7f2184008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.120+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f218c057810 con 0x7f2194153af0 2024-04-26T23:05:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21940c8670 con 0x7f2194153af0 2024-04-26T23:05:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f2190c00640 1 -- 172.21.15.148:0/874629903 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6863 (secure 0 0 0) 0x7f218c057110 con 0x7f2194153af0 2024-04-26T23:05:07.314 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:07.314 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:06.317389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4312,"mds_1":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4312]},"id":1}]} 2024-04-26T23:05:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 msgr2=0x7f217006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 0x7f217006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f218400b970 tx=0x7f2184008040 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 msgr2=0x7f219415bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f218c007e40 tx=0x7f218c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 shutdown_connections 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2170068380 0x7f217006a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2194153af0 0x7f219415bfa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21940c9010 0x7f21940722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 --2- 172.21.15.148:0/874629903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21940c7b80 0x7f21940c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 >> 172.21.15.148:0/874629903 conn(0x7f219406c380 msgr2=0x7f21940c39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 shutdown_connections 2024-04-26T23:05:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.312+0000 7f219b000640 1 -- 172.21.15.148:0/874629903 wait complete. 2024-04-26T23:05:07.335 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:07.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 Processor -- start 2024-04-26T23:05:07.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 -- start start 2024-04-26T23:05:07.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4500722a0 0x7ff450073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff45006fb60 0x7ff45006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4500c7e40 con 0x7ff450155f20 2024-04-26T23:05:07.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7ff450156300 con 0x7ff4500722a0 2024-04-26T23:05:07.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff456200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff4500c8120 con 0x7ff45006fb60 2024-04-26T23:05:07.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44ea00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4500722a0 0x7ff450073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44f400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff450155f20 0x7ff45015c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43198/0 (socket says 172.21.15.148:43198) 2024-04-26T23:05:07.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44f400640 1 -- 172.21.15.148:0/1868997894 learned_addr learned my addr 172.21.15.148:0/1868997894 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44fe00640 1 --2- 172.21.15.148:0/1868997894 >> v2:172.21.15.157:3300/0 conn(0x7ff45006fb60 0x7ff45006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44ea00640 1 -- 172.21.15.148:0/1868997894 >> v2:172.21.15.157:3300/0 conn(0x7ff45006fb60 msgr2=0x7ff45006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44ea00640 1 --2- 172.21.15.148:0/1868997894 >> v2:172.21.15.157:3300/0 conn(0x7ff45006fb60 0x7ff45006ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44ea00640 1 -- 172.21.15.148:0/1868997894 >> v1:172.21.15.148:6789/0 conn(0x7ff450155f20 legacy=0x7ff45015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44e000640 1 -- 172.21.15.148:0/1868997894 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682452408 0 0) 0x7ff4500c7e40 con 0x7ff450155f20 2024-04-26T23:05:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.468+0000 7ff44ea00640 1 -- 172.21.15.148:0/1868997894 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff450072d50 con 0x7ff4500722a0 2024-04-26T23:05:07.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff44ea00640 1 --2- 172.21.15.148:0/1868997894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500722a0 0x7ff450073550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff45006d2e0 tx=0x7ff43c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8112aadadcd58299 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff44e000640 1 -- 172.21.15.148:0/1868997894 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0b5070 con 0x7ff4500722a0 2024-04-26T23:05:07.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff44e000640 1 -- 172.21.15.148:0/1868997894 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c0a8970 con 0x7ff4500722a0 2024-04-26T23:05:07.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff44e000640 1 -- 172.21.15.148:0/1868997894 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0a8d40 con 0x7ff4500722a0 2024-04-26T23:05:07.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 -- 172.21.15.148:0/1868997894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500722a0 msgr2=0x7ff450073550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 --2- 172.21.15.148:0/1868997894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500722a0 0x7ff450073550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff45006d2e0 tx=0x7ff43c01ec70 comp rx=0 tx=0).stop 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 -- 172.21.15.148:0/1868997894 shutdown_connections 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 --2- 172.21.15.148:0/1868997894 >> v2:172.21.15.157:3300/0 conn(0x7ff45006fb60 0x7ff45006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 --2- 172.21.15.148:0/1868997894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500722a0 0x7ff450073550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 -- 172.21.15.148:0/1868997894 >> 172.21.15.148:0/1868997894 conn(0x7ff45006c380 msgr2=0x7ff45006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 -- 172.21.15.148:0/1868997894 shutdown_connections 2024-04-26T23:05:07.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.472+0000 7ff456200640 1 -- 172.21.15.148:0/1868997894 wait complete. 2024-04-26T23:05:07.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 Processor -- start 2024-04-26T23:05:07.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- start start 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4500722a0 0x7ff4501f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff450155f20 0x7ff4501f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff450073c10 con 0x7ff45006fb60 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff450073a90 con 0x7ff450155f20 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff4500c51e0 con 0x7ff4500722a0 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44894/0 (socket says 172.21.15.148:44894) 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 -- 172.21.15.148:0/1167433801 learned_addr learned my addr 172.21.15.148:0/1167433801 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44ea00640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4500722a0 0x7ff4501f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44fe00640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff450155f20 0x7ff4501f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 -- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4500722a0 msgr2=0x7ff4501f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4500722a0 0x7ff4501f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 -- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff450155f20 msgr2=0x7ff4501f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff450155f20 0x7ff4501f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 -- 172.21.15.148:0/1167433801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4501554d0 con 0x7ff45006fb60 2024-04-26T23:05:07.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff44f400640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c480 tx=0x7ff44000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440018070 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440007500 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45015f110 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440004a30 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.476+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45015f6d0 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff450077c20 con 0x7ff45006fb60 2024-04-26T23:05:07.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff440004bd0 con 0x7ff45006fb60 2024-04-26T23:05:07.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff447400640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 0x7ff43006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff440085ff0 con 0x7ff45006fb60 2024-04-26T23:05:07.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff44ea00640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 0x7ff43006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.480+0000 7ff44ea00640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 0x7ff43006a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0b2000 tx=0x7ff43c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.484+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff4400561e0 con 0x7ff45006fb60 2024-04-26T23:05:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.644+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff45006c860 con 0x7ff45006fb60 2024-04-26T23:05:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff447400640 1 -- 172.21.15.148:0/1167433801 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7ff440055ae0 con 0x7ff45006fb60 2024-04-26T23:05:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:07.650 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 msgr2=0x7ff43006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 0x7ff43006a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0b2000 tx=0x7ff43c008040 comp rx=0 tx=0).stop 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 msgr2=0x7ff4501e67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c480 tx=0x7ff44000c940 comp rx=0 tx=0).stop 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 shutdown_connections 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff430068380 0x7ff43006a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff450155f20 0x7ff4501f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4500722a0 0x7ff4501f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 --2- 172.21.15.148:0/1167433801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff45006fb60 0x7ff4501e67e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 >> 172.21.15.148:0/1167433801 conn(0x7ff45006c380 msgr2=0x7ff450154180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 shutdown_connections 2024-04-26T23:05:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.648+0000 7ff456200640 1 -- 172.21.15.148:0/1167433801 wait complete. 2024-04-26T23:05:07.671 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:05:07.671 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:07.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.804+0000 7fec9fe00640 1 Processor -- start 2024-04-26T23:05:07.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.804+0000 7fec9fe00640 1 -- start start 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9fe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec98153af0 0x7fec9815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec980c7b80 0x7fec980c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9fe00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980c9d90 con 0x7fec980c9010 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9fe00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fec980ca630 con 0x7fec980c7b80 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9fe00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fec980ca070 con 0x7fec98153af0 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec980c7b80 0x7fec980c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec980c7b80 0x7fec980c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44906/0 (socket says 172.21.15.148:44906) 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9de00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fec980c9010 0x7fec980c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43204/0 (socket says 172.21.15.148:43204) 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 -- 172.21.15.148:0/303660595 learned_addr learned my addr 172.21.15.148:0/303660595 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9d400640 1 --2- 172.21.15.148:0/303660595 >> v2:172.21.15.157:3300/0 conn(0x7fec98153af0 0x7fec9815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 -- 172.21.15.148:0/303660595 >> v2:172.21.15.157:3300/0 conn(0x7fec98153af0 msgr2=0x7fec9815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:07.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 --2- 172.21.15.148:0/303660595 >> v2:172.21.15.157:3300/0 conn(0x7fec98153af0 0x7fec9815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 -- 172.21.15.148:0/303660595 >> v1:172.21.15.148:6789/0 conn(0x7fec980c9010 legacy=0x7fec980c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.808+0000 7fec9ca00640 1 -- 172.21.15.148:0/303660595 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980ca350 con 0x7fec980c7b80 2024-04-26T23:05:07.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9ca00640 1 --2- 172.21.15.148:0/303660595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec980c7f80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec980745d0 tx=0x7fec8401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbc17edeca12ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec97e00640 1 -- 172.21.15.148:0/303660595 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840b5070 con 0x7fec980c7b80 2024-04-26T23:05:07.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec97e00640 1 -- 172.21.15.148:0/303660595 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec840a8a10 con 0x7fec980c7b80 2024-04-26T23:05:07.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec97e00640 1 -- 172.21.15.148:0/303660595 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840a8de0 con 0x7fec980c7b80 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- 172.21.15.148:0/303660595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 msgr2=0x7fec980c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- 172.21.15.148:0/303660595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec980c7f80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec980745d0 tx=0x7fec8401ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- 172.21.15.148:0/303660595 shutdown_connections 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- 172.21.15.148:0/303660595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec980c7f80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- 172.21.15.148:0/303660595 >> v2:172.21.15.157:3300/0 conn(0x7fec98153af0 0x7fec9815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- 172.21.15.148:0/303660595 >> 172.21.15.148:0/303660595 conn(0x7fec9806c380 msgr2=0x7fec9806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- 172.21.15.148:0/303660595 shutdown_connections 2024-04-26T23:05:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- 172.21.15.148:0/303660595 wait complete. 2024-04-26T23:05:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 Processor -- start 2024-04-26T23:05:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- start start 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec980c9010 0x7fec981ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec98153af0 0x7fec98159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec98153ed0 con 0x7fec980c7b80 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fec9815d290 con 0x7fec98153af0 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9fe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fec98154050 con 0x7fec980c9010 2024-04-26T23:05:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44916/0 (socket says 172.21.15.148:44916) 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9d400640 1 -- 172.21.15.148:0/3126939204 learned_addr learned my addr 172.21.15.148:0/3126939204 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9de00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec98153af0 0x7fec98159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.812+0000 7fec9ca00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec980c9010 0x7fec981ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 -- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec980c9010 msgr2=0x7fec981ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec980c9010 0x7fec981ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 -- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec98153af0 msgr2=0x7fec98159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec98153af0 0x7fec98159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 -- 172.21.15.148:0/3126939204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec98149590 con 0x7fec980c7b80 2024-04-26T23:05:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9d400640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007e40 tx=0x7fec8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c014620 con 0x7fec980c7b80 2024-04-26T23:05:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c019070 con 0x7fec980c7b80 2024-04-26T23:05:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c014a00 con 0x7fec980c7b80 2024-04-26T23:05:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec981f2ee0 con 0x7fec980c7b80 2024-04-26T23:05:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec981f34a0 con 0x7fec980c7b80 2024-04-26T23:05:07.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec98077c20 con 0x7fec980c7b80 2024-04-26T23:05:07.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec8c014ba0 con 0x7fec980c7b80 2024-04-26T23:05:07.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 0x7fec7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:07.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fec8c087660 con 0x7fec980c7b80 2024-04-26T23:05:07.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.816+0000 7fec9ca00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 0x7fec7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:07.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.820+0000 7fec9ca00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 0x7fec7806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec840b2000 tx=0x7fec84008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:07.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.820+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fec8c057840 con 0x7fec980c7b80 2024-04-26T23:05:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:07.980+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec981e2e30 con 0x7fec78068380 2024-04-26T23:05:08.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.020+0000 7fec95600640 1 -- 172.21.15.148:0/3126939204 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332639 (secure 0 0 0) 0x7fec981e2e30 con 0x7fec78068380 2024-04-26T23:05:08.023 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 msgr2=0x7fec7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 0x7fec7806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec840b2000 tx=0x7fec84008040 comp rx=0 tx=0).stop 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 msgr2=0x7fec981e3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007e40 tx=0x7fec8c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 shutdown_connections 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fec78068380 0x7fec7806a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec98153af0 0x7fec98159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec980c9010 0x7fec981ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 --2- 172.21.15.148:0/3126939204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec980c7b80 0x7fec981e3a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 >> 172.21.15.148:0/3126939204 conn(0x7fec9806c380 msgr2=0x7fec9815ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:08.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 shutdown_connections 2024-04-26T23:05:08.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.024+0000 7fec9fe00640 1 -- 172.21.15.148:0/3126939204 wait complete. 2024-04-26T23:05:08.045 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T23:05:07.849483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234976,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739744,"statfs":{"total":773094113280,"available":772853497856,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005226"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659974+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:04:45.659974+0000","last_peered":"2024-04-26T23:04:45.659974+0000","last_clean":"2024-04-26T23:04:45.659974+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:04:45.659974+0000","last_undegraded":"2024-04-26T23:04:45.659974+0000","last_fullsized":"2024-04-26T23:04:45.659974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301542+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301542+0000","last_peered":"2024-04-26T23:04:47.301542+0000","last_clean":"2024-04-26T23:04:47.301542+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301542+0000","last_undegraded":"2024-04-26T23:04:47.301542+0000","last_fullsized":"2024-04-26T23:04:47.301542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802152+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:04:46.802152+0000","last_peered":"2024-04-26T23:04:46.802152+0000","last_clean":"2024-04-26T23:04:46.802152+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:04:46.802152+0000","last_undegraded":"2024-04-26T23:04:46.802152+0000","last_fullsized":"2024-04-26T23:04:46.802152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802590+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:04:46.802590+0000","last_peered":"2024-04-26T23:04:46.802590+0000","last_clean":"2024-04-26T23:04:46.802590+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:04:46.802590+0000","last_undegraded":"2024-04-26T23:04:46.802590+0000","last_fullsized":"2024-04-26T23:04:46.802590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303146+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303146+0000","last_peered":"2024-04-26T23:04:47.303146+0000","last_clean":"2024-04-26T23:04:47.303146+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303146+0000","last_undegraded":"2024-04-26T23:04:47.303146+0000","last_fullsized":"2024-04-26T23:04:47.303146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301492+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:04:47.301492+0000","last_peered":"2024-04-26T23:04:47.301492+0000","last_clean":"2024-04-26T23:04:47.301492+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:04:47.301492+0000","last_undegraded":"2024-04-26T23:04:47.301492+0000","last_fullsized":"2024-04-26T23:04:47.301492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801013+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:04:46.801013+0000","last_peered":"2024-04-26T23:04:46.801013+0000","last_clean":"2024-04-26T23:04:46.801013+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:04:46.801013+0000","last_undegraded":"2024-04-26T23:04:46.801013+0000","last_fullsized":"2024-04-26T23:04:46.801013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187993+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:04:45.187993+0000","last_peered":"2024-04-26T23:04:45.187993+0000","last_clean":"2024-04-26T23:04:45.187993+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:04:45.187993+0000","last_undegraded":"2024-04-26T23:04:45.187993+0000","last_fullsized":"2024-04-26T23:04:45.187993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301616+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:04:47.301616+0000","last_peered":"2024-04-26T23:04:47.301616+0000","last_clean":"2024-04-26T23:04:47.301616+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:04:47.301616+0000","last_undegraded":"2024-04-26T23:04:47.301616+0000","last_fullsized":"2024-04-26T23:04:47.301616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802429+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802429+0000","last_peered":"2024-04-26T23:04:46.802429+0000","last_clean":"2024-04-26T23:04:46.802429+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802429+0000","last_undegraded":"2024-04-26T23:04:46.802429+0000","last_fullsized":"2024-04-26T23:04:46.802429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303484+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303484+0000","last_peered":"2024-04-26T23:04:47.303484+0000","last_clean":"2024-04-26T23:04:47.303484+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303484+0000","last_undegraded":"2024-04-26T23:04:47.303484+0000","last_fullsized":"2024-04-26T23:04:47.303484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187960+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:04:45.187960+0000","last_peered":"2024-04-26T23:04:45.187960+0000","last_clean":"2024-04-26T23:04:45.187960+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:04:45.187960+0000","last_undegraded":"2024-04-26T23:04:45.187960+0000","last_fullsized":"2024-04-26T23:04:45.187960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801113+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:04:46.801113+0000","last_peered":"2024-04-26T23:04:46.801113+0000","last_clean":"2024-04-26T23:04:46.801113+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:04:46.801113+0000","last_undegraded":"2024-04-26T23:04:46.801113+0000","last_fullsized":"2024-04-26T23:04:46.801113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301513+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:04:47.301513+0000","last_peered":"2024-04-26T23:04:47.301513+0000","last_clean":"2024-04-26T23:04:47.301513+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:04:47.301513+0000","last_undegraded":"2024-04-26T23:04:47.301513+0000","last_fullsized":"2024-04-26T23:04:47.301513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188260+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:04:45.188260+0000","last_peered":"2024-04-26T23:04:45.188260+0000","last_clean":"2024-04-26T23:04:45.188260+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:04:45.188260+0000","last_undegraded":"2024-04-26T23:04:45.188260+0000","last_fullsized":"2024-04-26T23:04:45.188260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190245+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190245+0000","last_peered":"2024-04-26T23:04:45.190245+0000","last_clean":"2024-04-26T23:04:45.190245+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190245+0000","last_undegraded":"2024-04-26T23:04:45.190245+0000","last_fullsized":"2024-04-26T23:04:45.190245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187862+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:04:45.187862+0000","last_peered":"2024-04-26T23:04:45.187862+0000","last_clean":"2024-04-26T23:04:45.187862+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:04:45.187862+0000","last_undegraded":"2024-04-26T23:04:45.187862+0000","last_fullsized":"2024-04-26T23:04:45.187862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186872+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:04:45.186872+0000","last_peered":"2024-04-26T23:04:45.186872+0000","last_clean":"2024-04-26T23:04:45.186872+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:04:45.186872+0000","last_undegraded":"2024-04-26T23:04:45.186872+0000","last_fullsized":"2024-04-26T23:04:45.186872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303298+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:04:47.303298+0000","last_peered":"2024-04-26T23:04:47.303298+0000","last_clean":"2024-04-26T23:04:47.303298+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:04:47.303298+0000","last_undegraded":"2024-04-26T23:04:47.303298+0000","last_fullsized":"2024-04-26T23:04:47.303298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659800+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:04:45.659800+0000","last_peered":"2024-04-26T23:04:45.659800+0000","last_clean":"2024-04-26T23:04:45.659800+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:04:45.659800+0000","last_undegraded":"2024-04-26T23:04:45.659800+0000","last_fullsized":"2024-04-26T23:04:45.659800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:01.872929+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:01.872929+0000","last_peered":"2024-04-26T23:05:01.872929+0000","last_clean":"2024-04-26T23:05:01.872929+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:01.872929+0000","last_undegraded":"2024-04-26T23:05:01.872929+0000","last_fullsized":"2024-04-26T23:05:01.872929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303300+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303300+0000","last_peered":"2024-04-26T23:04:47.303300+0000","last_clean":"2024-04-26T23:04:47.303300+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303300+0000","last_undegraded":"2024-04-26T23:04:47.303300+0000","last_fullsized":"2024-04-26T23:04:47.303300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301984+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:04:47.301984+0000","last_peered":"2024-04-26T23:04:47.301984+0000","last_clean":"2024-04-26T23:04:47.301984+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:04:47.301984+0000","last_undegraded":"2024-04-26T23:04:47.301984+0000","last_fullsized":"2024-04-26T23:04:47.301984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187871+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:04:45.187871+0000","last_peered":"2024-04-26T23:04:45.187871+0000","last_clean":"2024-04-26T23:04:45.187871+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:04:45.187871+0000","last_undegraded":"2024-04-26T23:04:45.187871+0000","last_fullsized":"2024-04-26T23:04:45.187871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301467+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301467+0000","last_peered":"2024-04-26T23:04:47.301467+0000","last_clean":"2024-04-26T23:04:47.301467+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301467+0000","last_undegraded":"2024-04-26T23:04:47.301467+0000","last_fullsized":"2024-04-26T23:04:47.301467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187270+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:04:45.187270+0000","last_peered":"2024-04-26T23:04:45.187270+0000","last_clean":"2024-04-26T23:04:45.187270+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:04:45.187270+0000","last_undegraded":"2024-04-26T23:04:45.187270+0000","last_fullsized":"2024-04-26T23:04:45.187270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:08.051 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:08.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.224+0000 7f0827000640 1 Processor -- start 2024-04-26T23:05:08.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.224+0000 7f0827000640 1 -- start start 2024-04-26T23:05:08.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0827000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f082006fea0 0x7f08200702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0827000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0827000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f082006f9f0 con 0x7f0820155c00 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0827000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0820070820 con 0x7f082006fea0 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0827000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08200c8fd0 con 0x7f082006c7f0 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0825200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f082006fea0 0x7f08200702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58102/0 (socket says 172.21.15.148:58102) 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 -- 172.21.15.148:0/1731903900 learned_addr learned my addr 172.21.15.148:0/1731903900 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:08.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 -- 172.21.15.148:0/1731903900 >> v2:172.21.15.157:3300/0 conn(0x7f082006fea0 msgr2=0x7f08200702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:08.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 --2- 172.21.15.148:0/1731903900 >> v2:172.21.15.157:3300/0 conn(0x7f082006fea0 0x7f08200702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 -- 172.21.15.148:0/1731903900 >> v1:172.21.15.157:6789/0 conn(0x7f0820155c00 legacy=0x7f08200ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.228+0000 7f0826600640 1 -- 172.21.15.148:0/1731903900 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082015bd70 con 0x7f082006c7f0 2024-04-26T23:05:08.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0826600640 1 --2- 172.21.15.148:0/1731903900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e50 tx=0x7f081801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27737546fc63e74a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f081fe00640 1 -- 172.21.15.148:0/1731903900 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08180b4070 con 0x7f082006c7f0 2024-04-26T23:05:08.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f081fe00640 1 -- 172.21.15.148:0/1731903900 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08180af400 con 0x7f082006c7f0 2024-04-26T23:05:08.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f081fe00640 1 -- 172.21.15.148:0/1731903900 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08180af7d0 con 0x7f082006c7f0 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- 172.21.15.148:0/1731903900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 msgr2=0x7f082006cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- 172.21.15.148:0/1731903900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e50 tx=0x7f081801f210 comp rx=0 tx=0).stop 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- 172.21.15.148:0/1731903900 shutdown_connections 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- 172.21.15.148:0/1731903900 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f082006c7f0 0x7f082006cc60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- 172.21.15.148:0/1731903900 >> v2:172.21.15.157:3300/0 conn(0x7f082006fea0 0x7f08200702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- 172.21.15.148:0/1731903900 >> 172.21.15.148:0/1731903900 conn(0x7f0820070d40 msgr2=0x7f0820071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:08.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- 172.21.15.148:0/1731903900 shutdown_connections 2024-04-26T23:05:08.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- 172.21.15.148:0/1731903900 wait complete. 2024-04-26T23:05:08.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 Processor -- start 2024-04-26T23:05:08.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- start start 2024-04-26T23:05:08.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 0x7f08201f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0820155c00 0x7f08201f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f082015c610 con 0x7f082006c7f0 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f082015c330 con 0x7f082006fea0 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.232+0000 7f0827000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f082006d1a0 con 0x7f0820155c00 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44918/0 (socket says 172.21.15.148:44918) 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 -- 172.21.15.148:0/2369788244 learned_addr learned my addr 172.21.15.148:0/2369788244 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825200640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 0x7f08201f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0826600640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0820155c00 0x7f08201f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 -- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0820155c00 msgr2=0x7f08201f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0820155c00 0x7f08201f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 -- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 msgr2=0x7f08201f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 0x7f08201f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 -- 172.21.15.148:0/2369788244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08201523b0 con 0x7f082006c7f0 2024-04-26T23:05:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825200640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 0x7f08201f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0825c00640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f081400c420 tx=0x7f081400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140052d0 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0814005470 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0820152690 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814007260 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201503e0 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08200506d0 con 0x7f082006c7f0 2024-04-26T23:05:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0814007400 con 0x7f082006c7f0 2024-04-26T23:05:08.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.236+0000 7f081d600640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 0x7f080006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.240+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0814086200 con 0x7f082006c7f0 2024-04-26T23:05:08.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.240+0000 7f0825200640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 0x7f080006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.240+0000 7f0825200640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 0x7f080006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08201f5e20 tx=0x7f080c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.244+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0814056480 con 0x7f082006c7f0 2024-04-26T23:05:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.399+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0820155310 con 0x7f0800068380 2024-04-26T23:05:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.419+0000 7f081d600640 1 -- 172.21.15.148:0/2369788244 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332639 (secure 0 0 0) 0x7f0820155310 con 0x7f0800068380 2024-04-26T23:05:08.428 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:08.430 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 msgr2=0x7f080006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 0x7f080006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08201f5e20 tx=0x7f080c008040 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 msgr2=0x7f08200cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f081400c420 tx=0x7f081400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 shutdown_connections 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0800068380 0x7f080006a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0820155c00 0x7f08201f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f082006fea0 0x7f08201f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 --2- 172.21.15.148:0/2369788244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f082006c7f0 0x7f08200cda20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 >> 172.21.15.148:0/2369788244 conn(0x7f0820070d40 msgr2=0x7f08200ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 shutdown_connections 2024-04-26T23:05:08.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.427+0000 7f0827000640 1 -- 172.21.15.148:0/2369788244 wait complete. 2024-04-26T23:05:08.448 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T23:05:07.849483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234976,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739744,"statfs":{"total":773094113280,"available":772853497856,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005226"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659974+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:04:45.659974+0000","last_peered":"2024-04-26T23:04:45.659974+0000","last_clean":"2024-04-26T23:04:45.659974+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:04:45.659974+0000","last_undegraded":"2024-04-26T23:04:45.659974+0000","last_fullsized":"2024-04-26T23:04:45.659974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301542+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301542+0000","last_peered":"2024-04-26T23:04:47.301542+0000","last_clean":"2024-04-26T23:04:47.301542+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301542+0000","last_undegraded":"2024-04-26T23:04:47.301542+0000","last_fullsized":"2024-04-26T23:04:47.301542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802152+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:04:46.802152+0000","last_peered":"2024-04-26T23:04:46.802152+0000","last_clean":"2024-04-26T23:04:46.802152+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:04:46.802152+0000","last_undegraded":"2024-04-26T23:04:46.802152+0000","last_fullsized":"2024-04-26T23:04:46.802152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802590+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:04:46.802590+0000","last_peered":"2024-04-26T23:04:46.802590+0000","last_clean":"2024-04-26T23:04:46.802590+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:04:46.802590+0000","last_undegraded":"2024-04-26T23:04:46.802590+0000","last_fullsized":"2024-04-26T23:04:46.802590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303146+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303146+0000","last_peered":"2024-04-26T23:04:47.303146+0000","last_clean":"2024-04-26T23:04:47.303146+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303146+0000","last_undegraded":"2024-04-26T23:04:47.303146+0000","last_fullsized":"2024-04-26T23:04:47.303146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301492+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:04:47.301492+0000","last_peered":"2024-04-26T23:04:47.301492+0000","last_clean":"2024-04-26T23:04:47.301492+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:04:47.301492+0000","last_undegraded":"2024-04-26T23:04:47.301492+0000","last_fullsized":"2024-04-26T23:04:47.301492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801013+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:04:46.801013+0000","last_peered":"2024-04-26T23:04:46.801013+0000","last_clean":"2024-04-26T23:04:46.801013+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:04:46.801013+0000","last_undegraded":"2024-04-26T23:04:46.801013+0000","last_fullsized":"2024-04-26T23:04:46.801013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187993+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:04:45.187993+0000","last_peered":"2024-04-26T23:04:45.187993+0000","last_clean":"2024-04-26T23:04:45.187993+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:04:45.187993+0000","last_undegraded":"2024-04-26T23:04:45.187993+0000","last_fullsized":"2024-04-26T23:04:45.187993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301616+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:04:47.301616+0000","last_peered":"2024-04-26T23:04:47.301616+0000","last_clean":"2024-04-26T23:04:47.301616+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:04:47.301616+0000","last_undegraded":"2024-04-26T23:04:47.301616+0000","last_fullsized":"2024-04-26T23:04:47.301616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802429+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802429+0000","last_peered":"2024-04-26T23:04:46.802429+0000","last_clean":"2024-04-26T23:04:46.802429+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802429+0000","last_undegraded":"2024-04-26T23:04:46.802429+0000","last_fullsized":"2024-04-26T23:04:46.802429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303484+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303484+0000","last_peered":"2024-04-26T23:04:47.303484+0000","last_clean":"2024-04-26T23:04:47.303484+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303484+0000","last_undegraded":"2024-04-26T23:04:47.303484+0000","last_fullsized":"2024-04-26T23:04:47.303484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187960+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:04:45.187960+0000","last_peered":"2024-04-26T23:04:45.187960+0000","last_clean":"2024-04-26T23:04:45.187960+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:04:45.187960+0000","last_undegraded":"2024-04-26T23:04:45.187960+0000","last_fullsized":"2024-04-26T23:04:45.187960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801113+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:04:46.801113+0000","last_peered":"2024-04-26T23:04:46.801113+0000","last_clean":"2024-04-26T23:04:46.801113+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:04:46.801113+0000","last_undegraded":"2024-04-26T23:04:46.801113+0000","last_fullsized":"2024-04-26T23:04:46.801113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301513+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:04:47.301513+0000","last_peered":"2024-04-26T23:04:47.301513+0000","last_clean":"2024-04-26T23:04:47.301513+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:04:47.301513+0000","last_undegraded":"2024-04-26T23:04:47.301513+0000","last_fullsized":"2024-04-26T23:04:47.301513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188260+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:04:45.188260+0000","last_peered":"2024-04-26T23:04:45.188260+0000","last_clean":"2024-04-26T23:04:45.188260+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:04:45.188260+0000","last_undegraded":"2024-04-26T23:04:45.188260+0000","last_fullsized":"2024-04-26T23:04:45.188260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190245+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190245+0000","last_peered":"2024-04-26T23:04:45.190245+0000","last_clean":"2024-04-26T23:04:45.190245+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190245+0000","last_undegraded":"2024-04-26T23:04:45.190245+0000","last_fullsized":"2024-04-26T23:04:45.190245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187862+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:04:45.187862+0000","last_peered":"2024-04-26T23:04:45.187862+0000","last_clean":"2024-04-26T23:04:45.187862+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:04:45.187862+0000","last_undegraded":"2024-04-26T23:04:45.187862+0000","last_fullsized":"2024-04-26T23:04:45.187862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186872+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:04:45.186872+0000","last_peered":"2024-04-26T23:04:45.186872+0000","last_clean":"2024-04-26T23:04:45.186872+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:04:45.186872+0000","last_undegraded":"2024-04-26T23:04:45.186872+0000","last_fullsized":"2024-04-26T23:04:45.186872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303298+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:04:47.303298+0000","last_peered":"2024-04-26T23:04:47.303298+0000","last_clean":"2024-04-26T23:04:47.303298+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:04:47.303298+0000","last_undegraded":"2024-04-26T23:04:47.303298+0000","last_fullsized":"2024-04-26T23:04:47.303298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659800+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:04:45.659800+0000","last_peered":"2024-04-26T23:04:45.659800+0000","last_clean":"2024-04-26T23:04:45.659800+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:04:45.659800+0000","last_undegraded":"2024-04-26T23:04:45.659800+0000","last_fullsized":"2024-04-26T23:04:45.659800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:01.872929+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:01.872929+0000","last_peered":"2024-04-26T23:05:01.872929+0000","last_clean":"2024-04-26T23:05:01.872929+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:01.872929+0000","last_undegraded":"2024-04-26T23:05:01.872929+0000","last_fullsized":"2024-04-26T23:05:01.872929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303300+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303300+0000","last_peered":"2024-04-26T23:04:47.303300+0000","last_clean":"2024-04-26T23:04:47.303300+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303300+0000","last_undegraded":"2024-04-26T23:04:47.303300+0000","last_fullsized":"2024-04-26T23:04:47.303300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301984+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:04:47.301984+0000","last_peered":"2024-04-26T23:04:47.301984+0000","last_clean":"2024-04-26T23:04:47.301984+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:04:47.301984+0000","last_undegraded":"2024-04-26T23:04:47.301984+0000","last_fullsized":"2024-04-26T23:04:47.301984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187871+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:04:45.187871+0000","last_peered":"2024-04-26T23:04:45.187871+0000","last_clean":"2024-04-26T23:04:45.187871+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:04:45.187871+0000","last_undegraded":"2024-04-26T23:04:45.187871+0000","last_fullsized":"2024-04-26T23:04:45.187871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301467+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301467+0000","last_peered":"2024-04-26T23:04:47.301467+0000","last_clean":"2024-04-26T23:04:47.301467+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301467+0000","last_undegraded":"2024-04-26T23:04:47.301467+0000","last_fullsized":"2024-04-26T23:04:47.301467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187270+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:04:45.187270+0000","last_peered":"2024-04-26T23:04:45.187270+0000","last_clean":"2024-04-26T23:04:45.187270+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:04:45.187270+0000","last_undegraded":"2024-04-26T23:04:45.187270+0000","last_fullsized":"2024-04-26T23:04:45.187270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:08.453 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:05:08.454 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:05:08.454 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:05:08.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:05:08.454 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:05:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 Processor -- start 2024-04-26T23:05:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 -- start start 2024-04-26T23:05:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 0x7fdc4c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 0x7fdc4c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4c0ca650 con 0x7fdc4c071680 2024-04-26T23:05:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4c0c9d40 con 0x7fdc4c0c6120 2024-04-26T23:05:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc52600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c070bc0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc51c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 0x7fdc4c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc51200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 0x7fdc4c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc51c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 0x7fdc4c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55520/0 (socket says 172.21.15.148:55520) 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc51c00640 1 -- 172.21.15.148:0/962284595 learned_addr learned my addr 172.21.15.148:0/962284595 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.619+0000 7fdc4be00640 1 --1- 172.21.15.148:0/962284595 >> v1:172.21.15.157:6789/0 conn(0x7fdc4c071680 0x7fdc4c0c4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41074/0 (socket says 172.21.15.148:41074) 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc51200640 1 -- 172.21.15.148:0/962284595 >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 msgr2=0x7fdc4c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc51200640 1 --2- 172.21.15.148:0/962284595 >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 0x7fdc4c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc51200640 1 -- 172.21.15.148:0/962284595 >> v1:172.21.15.157:6789/0 conn(0x7fdc4c071680 legacy=0x7fdc4c0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc51200640 1 -- 172.21.15.148:0/962284595 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c0c9f90 con 0x7fdc4c1570f0 2024-04-26T23:05:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc51200640 1 --2- 172.21.15.148:0/962284595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 0x7fdc4c15a560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0097c0 tx=0x7fdc3c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edb921be73cc028c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc4b400640 1 -- 172.21.15.148:0/962284595 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0b0070 con 0x7fdc4c1570f0 2024-04-26T23:05:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc4b400640 1 -- 172.21.15.148:0/962284595 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0ab600 con 0x7fdc4c1570f0 2024-04-26T23:05:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.623+0000 7fdc4b400640 1 -- 172.21.15.148:0/962284595 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ab9d0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- 172.21.15.148:0/962284595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 msgr2=0x7fdc4c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- 172.21.15.148:0/962284595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 0x7fdc4c15a560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0097c0 tx=0x7fdc3c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- 172.21.15.148:0/962284595 shutdown_connections 2024-04-26T23:05:08.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- 172.21.15.148:0/962284595 >> v2:172.21.15.157:3300/0 conn(0x7fdc4c0c6120 0x7fdc4c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- 172.21.15.148:0/962284595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c1570f0 0x7fdc4c15a560 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- 172.21.15.148:0/962284595 >> 172.21.15.148:0/962284595 conn(0x7fdc4c06c7b0 msgr2=0x7fdc4c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:08.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- 172.21.15.148:0/962284595 shutdown_connections 2024-04-26T23:05:08.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- 172.21.15.148:0/962284595 wait complete. 2024-04-26T23:05:08.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 Processor -- start 2024-04-26T23:05:08.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- start start 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc4c071680 0x7fdc4c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c0c6120 0x7fdc4c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0cb2d0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0cb150 con 0x7fdc4c071680 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc52600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c166ba0 con 0x7fdc4c0c6120 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44920/0 (socket says 172.21.15.148:44920) 2024-04-26T23:05:08.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 -- 172.21.15.148:0/245268891 learned_addr learned my addr 172.21.15.148:0/245268891 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:08.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc4be00640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c0c6120 0x7fdc4c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51200640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc4c071680 0x7fdc4c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 -- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c0c6120 msgr2=0x7fdc4c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c0c6120 0x7fdc4c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 -- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc4c071680 msgr2=0x7fdc4c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc4c071680 0x7fdc4c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.627+0000 7fdc51c00640 1 -- 172.21.15.148:0/245268891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c154810 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc51c00640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009cf0 tx=0x7fdc4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400ccc0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4400ce60 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c14f4c0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44003be0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c1592f0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c0506d0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc44012050 con 0x7fdc4c1570f0 2024-04-26T23:05:08.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 0x7fdc2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:08.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc440870d0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.631+0000 7fdc51200640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 0x7fdc2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:08.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.635+0000 7fdc51200640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 0x7fdc2c06a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ad000 tx=0x7fdc3c0a6000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:08.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.635+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdc44010040 con 0x7fdc4c1570f0 2024-04-26T23:05:08.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.831+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdc4c0caa80 con 0x7fdc4c1570f0 2024-04-26T23:05:08.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.835+0000 7fdc48c00640 1 -- 172.21.15.148:0/245268891 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168088 (secure 0 0 0) 0x7fdc44056bd0 con 0x7fdc4c1570f0 2024-04-26T23:05:08.840 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 msgr2=0x7fdc2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 0x7fdc2c06a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ad000 tx=0x7fdc3c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:05:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 msgr2=0x7fdc4c14daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009cf0 tx=0x7fdc4400c490 comp rx=0 tx=0).stop 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 shutdown_connections 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdc2c0683b0 0x7fdc2c06a870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc4c1570f0 0x7fdc4c14daf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc4c0c6120 0x7fdc4c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 --2- 172.21.15.148:0/245268891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc4c071680 0x7fdc4c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 >> 172.21.15.148:0/245268891 conn(0x7fdc4c06c7b0 msgr2=0x7fdc4c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 shutdown_connections 2024-04-26T23:05:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.839+0000 7fdc52600640 1 -- 172.21.15.148:0/245268891 wait complete. 2024-04-26T23:05:08.861 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"flags":0,"active_gid":4115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":726741875},{"type":"v1","addr":"172.21.15.157:6833","nonce":726741875}]},"active_addr":"172.21.15.157:6833/726741875","active_change":"2024-04-26T23:04:27.828314+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":4104873048}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":901039206}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2322961980}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2909866393}]}]} 2024-04-26T23:05:08.866 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:05:08.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:05:08.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:09.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.999+0000 7feb8e800640 1 Processor -- start 2024-04-26T23:05:09.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:08.999+0000 7feb8e800640 1 -- start start 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb8e800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb88152120 0x7feb881589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb8e800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb880708f0 0x7feb88072a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb8e800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880c9190 con 0x7feb880c8700 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb8e800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7feb880c8f40 con 0x7feb880708f0 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb8e800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb880c7c20 con 0x7feb88152120 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb880708f0 0x7feb88072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb880708f0 0x7feb88072a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44930/0 (socket says 172.21.15.148:44930) 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 -- 172.21.15.148:0/3212360946 learned_addr learned my addr 172.21.15.148:0/3212360946 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb87400640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb88152120 0x7feb881589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 -- 172.21.15.148:0/3212360946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb88152120 msgr2=0x7feb881589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb88152120 0x7feb881589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 -- 172.21.15.148:0/3212360946 >> v1:172.21.15.157:6789/0 conn(0x7feb880c8700 legacy=0x7feb8806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 -- 172.21.15.148:0/3212360946 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880c7f00 con 0x7feb880708f0 2024-04-26T23:05:09.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.003+0000 7feb86a00640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb880708f0 0x7feb88072a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb88071c10 tx=0x7feb7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8a343db8af9552 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb86000640 1 -- 172.21.15.148:0/3212360946 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740b1070 con 0x7feb880708f0 2024-04-26T23:05:09.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb86000640 1 -- 172.21.15.148:0/3212360946 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb740ac410 con 0x7feb880708f0 2024-04-26T23:05:09.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb86000640 1 -- 172.21.15.148:0/3212360946 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740ac7e0 con 0x7feb880708f0 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- 172.21.15.148:0/3212360946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb880708f0 msgr2=0x7feb88072a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb880708f0 0x7feb88072a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb88071c10 tx=0x7feb7401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- 172.21.15.148:0/3212360946 shutdown_connections 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb880708f0 0x7feb88072a40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- 172.21.15.148:0/3212360946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb88152120 0x7feb881589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- 172.21.15.148:0/3212360946 >> 172.21.15.148:0/3212360946 conn(0x7feb8806c380 msgr2=0x7feb8806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- 172.21.15.148:0/3212360946 shutdown_connections 2024-04-26T23:05:09.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- 172.21.15.148:0/3212360946 wait complete. 2024-04-26T23:05:09.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 Processor -- start 2024-04-26T23:05:09.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- start start 2024-04-26T23:05:09.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb880708f0 0x7feb881f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 0x7feb88144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb880703f0 con 0x7feb88152120 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb88070270 con 0x7feb880c8700 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb8e800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb88152500 con 0x7feb880708f0 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44946/0 (socket says 172.21.15.148:44946) 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb87e00640 1 -- 172.21.15.148:0/1955762541 learned_addr learned my addr 172.21.15.148:0/1955762541 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb86a00640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 0x7feb88144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.007+0000 7feb87400640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb880708f0 0x7feb881f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 -- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb880708f0 msgr2=0x7feb881f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb880708f0 0x7feb881f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 -- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 msgr2=0x7feb88144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 0x7feb88144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 -- 172.21.15.148:0/1955762541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb88146d20 con 0x7feb88152120 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb86a00640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 0x7feb88144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87e00640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b970 tx=0x7feb8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80019070 con 0x7feb88152120 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8000cb40 con 0x7feb88152120 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80014440 con 0x7feb88152120 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb88150c70 con 0x7feb88152120 2024-04-26T23:05:09.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb880ccb60 con 0x7feb88152120 2024-04-26T23:05:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb88077c20 con 0x7feb88152120 2024-04-26T23:05:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb8001c070 con 0x7feb88152120 2024-04-26T23:05:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 0x7feb6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feb800869f0 con 0x7feb88152120 2024-04-26T23:05:09.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.011+0000 7feb87400640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 0x7feb6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.015+0000 7feb87400640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 0x7feb6806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb7800b9d0 tx=0x7feb78008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.015+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb88146d20 con 0x7feb88152120 2024-04-26T23:05:09.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.175+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb88155cd0 con 0x7feb88152120 2024-04-26T23:05:09.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.175+0000 7feb7f400640 1 -- 172.21.15.148:0/1955762541 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7feb80056bd0 con 0x7feb88152120 2024-04-26T23:05:09.179 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:09.180 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 msgr2=0x7feb6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 0x7feb6806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb7800b9d0 tx=0x7feb78008040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 msgr2=0x7feb88140960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b970 tx=0x7feb8000be30 comp rx=0 tx=0).stop 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 shutdown_connections 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb68068380 0x7feb6806a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb88152120 0x7feb88140960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb880c8700 0x7feb88144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 --2- 172.21.15.148:0/1955762541 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb880708f0 0x7feb881f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 >> 172.21.15.148:0/1955762541 conn(0x7feb8806c380 msgr2=0x7feb8806fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 shutdown_connections 2024-04-26T23:05:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.179+0000 7feb8e800640 1 -- 172.21.15.148:0/1955762541 wait complete. 2024-04-26T23:05:09.201 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:05:09.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:09.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 Processor -- start 2024-04-26T23:05:09.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 -- start start 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f46180b47e0 0x7f461806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180cb7f0 con 0x7f46181574b0 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180ca0d0 con 0x7f46180c63f0 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f4620800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f46180ccd80 con 0x7f46180b47e0 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461de00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f46181574b0 0x7f46180ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43214/0 (socket says 172.21.15.148:43214) 2024-04-26T23:05:09.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461de00640 1 -- 172.21.15.148:0/885182822 learned_addr learned my addr 172.21.15.148:0/885182822 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 --2- 172.21.15.148:0/885182822 >> v2:172.21.15.157:3300/0 conn(0x7f46180b47e0 0x7f461806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411418318 0 0) 0x7f46180cb7f0 con 0x7f46181574b0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4600003530 con 0x7f46181574b0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 636469033 0 0) 0x7f4600003530 con 0x7f46181574b0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 >> v2:172.21.15.157:3300/0 conn(0x7f46180b47e0 msgr2=0x7f461806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 --2- 172.21.15.148:0/885182822 >> v2:172.21.15.157:3300/0 conn(0x7f46180b47e0 0x7f461806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 >> v1:172.21.15.157:6789/0 conn(0x7f46180c63f0 legacy=0x7f4618164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46180cba90 con 0x7f46181574b0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f460c001680 con 0x7f46181574b0 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 >> v1:172.21.15.148:6789/0 conn(0x7f46181574b0 legacy=0x7f46180ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46000039c0 0x7f4600003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 0x7f4600004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46000051d0 0x7f460000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46180ccd80 con 0x7f4600004810 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f460000c070 con 0x7f46000051d0 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f460000c270 con 0x7f46000039c0 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 0x7f4600004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461e800640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46000051d0 0x7f460000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461de00640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46000039c0 0x7f4600003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 -- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46000039c0 msgr2=0x7f4600003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46000039c0 0x7f4600003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 -- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46000051d0 msgr2=0x7f460000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46000051d0 0x7f460000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461d400640 1 -- 172.21.15.148:0/885182822 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600003530 con 0x7f4600004810 2024-04-26T23:05:09.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.335+0000 7f461e800640 1 -- 172.21.15.148:0/885182822 reap_dead start 2024-04-26T23:05:09.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f461d400640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 0x7f4600004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4608009ab0 tx=0x7f460801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684ce5927fb60714 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46080b2070 con 0x7f4600004810 2024-04-26T23:05:09.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46080a5530 con 0x7f4600004810 2024-04-26T23:05:09.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f461ca00640 1 -- 172.21.15.148:0/885182822 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46080096b0 con 0x7f4600004810 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 -- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 msgr2=0x7f4600004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 0x7f4600004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4608009ab0 tx=0x7f460801ca50 comp rx=0 tx=0).stop 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 -- 172.21.15.148:0/885182822 shutdown_connections 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 --2- 172.21.15.148:0/885182822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4600004810 0x7f4600004c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 -- 172.21.15.148:0/885182822 >> 172.21.15.148:0/885182822 conn(0x7f4618071160 msgr2=0x7f4618068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 -- 172.21.15.148:0/885182822 shutdown_connections 2024-04-26T23:05:09.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.339+0000 7f4620800640 1 -- 172.21.15.148:0/885182822 wait complete. 2024-04-26T23:05:09.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 Processor -- start 2024-04-26T23:05:09.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- start start 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 0x7f46181f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 0x7f461806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46180ca3b0 con 0x7f46181f5180 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f46180c9e80 con 0x7f4600004810 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46180b1900 con 0x7f46180cdc90 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44958/0 (socket says 172.21.15.148:44958) 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 -- 172.21.15.148:0/1949073559 learned_addr learned my addr 172.21.15.148:0/1949073559 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461de00640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 0x7f46181f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461d400640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 0x7f461806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 -- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 msgr2=0x7f461806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 0x7f461806e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 -- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 msgr2=0x7f46181f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 0x7f46181f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 -- 172.21.15.148:0/1949073559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46181f1d20 con 0x7f46181f5180 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461de00640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 0x7f46181f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461d400640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 0x7f461806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f461e800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46180c6820 tx=0x7f461400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614019070 con 0x7f46181f5180 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4614006d70 con 0x7f46181f5180 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46181f5a30 con 0x7f46181f5180 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614003ba0 con 0x7f46181f5180 2024-04-26T23:05:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46181f1fc0 con 0x7f46181f5180 2024-04-26T23:05:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.343+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4618077c20 con 0x7f46181f5180 2024-04-26T23:05:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.347+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f461401c070 con 0x7f46181f5180 2024-04-26T23:05:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.347+0000 7f4612000640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 0x7f45fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.347+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46140862c0 con 0x7f46181f5180 2024-04-26T23:05:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.347+0000 7f461de00640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 0x7f45fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.347+0000 7f461de00640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 0x7f45fc06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f460c001cd0 tx=0x7f460c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.351+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46140564a0 con 0x7f46181f5180 2024-04-26T23:05:09.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.507+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46180d01a0 con 0x7f46181f5180 2024-04-26T23:05:09.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4612000640 1 -- 172.21.15.148:0/1949073559 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f4614055da0 con 0x7f46181f5180 2024-04-26T23:05:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:09.514 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:09.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 msgr2=0x7f45fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 0x7f45fc06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f460c001cd0 tx=0x7f460c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 msgr2=0x7f4618154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46180c6820 tx=0x7f461400e910 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 shutdown_connections 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45fc068380 0x7f45fc06a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46181f5180 0x7f4618154040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46180cdc90 0x7f461806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 --2- 172.21.15.148:0/1949073559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4600004810 0x7f46181f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 >> 172.21.15.148:0/1949073559 conn(0x7f4618071160 msgr2=0x7f4618068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 shutdown_connections 2024-04-26T23:05:09.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.511+0000 7f4620800640 1 -- 172.21.15.148:0/1949073559 wait complete. 2024-04-26T23:05:09.534 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:05:09.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:05:09.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:05:09.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:05:09.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:05:09.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:05:09.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:05:09.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:05:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.775+0000 7f878f000640 1 Processor -- start 2024-04-26T23:05:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.775+0000 7f878f000640 1 -- start start 2024-04-26T23:05:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7fb775600640 1 Processor -- start 2024-04-26T23:05:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f48a1e00640 1 Processor -- start 2024-04-26T23:05:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f878f000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8788070480 0x7f8788072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7fb775600640 1 -- start start 2024-04-26T23:05:09.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f878f000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8788070a10 con 0x7f878806f460 2024-04-26T23:05:09.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f878f000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87880c7c90 con 0x7f8788152000 2024-04-26T23:05:09.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f878f000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f87880c85c0 con 0x7f8788070480 2024-04-26T23:05:09.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f8787e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8788152000 0x7f87881587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41104/0 (socket says 172.21.15.148:41104) 2024-04-26T23:05:09.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f8787e00640 1 -- 172.21.15.148:0/1062289600 learned_addr learned my addr 172.21.15.148:0/1062289600 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:09.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8787400640 1 --2- 172.21.15.148:0/1062289600 >> v2:172.21.15.148:3300/0 conn(0x7f8788070480 0x7f8788072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.779+0000 7f48a1e00640 1 -- start start 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f489c0d17d0 0x7f489c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d1bb0 0x7f489c0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 0x7f489c152720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f489c0ce840 con 0x7f489c0cc460 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f489c15ce20 con 0x7f489c0d17d0 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f48a1e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f489c0cd950 con 0x7f489c0d1bb0 2024-04-26T23:05:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb775600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7700744f0 0x7fb7700ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 Processor -- start 2024-04-26T23:05:09.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76ea00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb7700ca3b0 0x7fb770073790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41108/0 (socket says 172.21.15.148:41108) 2024-04-26T23:05:09.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76ea00640 1 -- 172.21.15.148:0/2270874181 learned_addr learned my addr 172.21.15.148:0/2270874181 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:09.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 -- start start 2024-04-26T23:05:09.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76e000640 1 --2- 172.21.15.148:0/2270874181 >> v2:172.21.15.157:3300/0 conn(0x7fb7700744f0 0x7fb7700ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb775600640 1 --2- 172.21.15.148:0/2270874181 >> v2:172.21.15.148:3300/0 conn(0x7fb77015c0c0 0x7fb77015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382213772 0 0) 0x7f87880c7c90 con 0x7f8788152000 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f876c003530 con 0x7f8788152000 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109696453 0 0) 0x7f8788070a10 con 0x7f878806f460 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8787400640 1 -- 172.21.15.148:0/1062289600 >> v1:172.21.15.157:6789/0 conn(0x7f8788152000 legacy=0x7f87881587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8787400640 1 -- 172.21.15.148:0/1062289600 >> v1:172.21.15.148:6789/0 conn(0x7f878806f460 legacy=0x7f87881626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f8787400640 1 -- 172.21.15.148:0/1062289600 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87880c7f70 con 0x7f8788070480 2024-04-26T23:05:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76f400640 1 --2- 172.21.15.148:0/2270874181 >> v2:172.21.15.148:3300/0 conn(0x7fb77015c0c0 0x7fb77015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7700c75f0 con 0x7fb7700ca3b0 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb770074110 con 0x7fb77015c0c0 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb7700c5930 con 0x7fb7700744f0 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 0x7fcc700e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcc700062d0 0x7fcc70034560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc70036610 con 0x7fcc7004e070 2024-04-26T23:05:09.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7004b3c0 con 0x7fcc7004a950 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fcc7d800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcc700368f0 con 0x7fcc700062d0 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f489aa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f489c0d17d0 0x7f489c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f489aa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f489c0d17d0 0x7f489c15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55568/0 (socket says 172.21.15.148:55568) 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f489aa00640 1 -- 172.21.15.148:0/963439192 learned_addr learned my addr 172.21.15.148:0/963439192 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489b400640 1 --2- 172.21.15.148:0/963439192 >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 0x7f489c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7f489a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d1bb0 0x7f489c0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489aa00640 1 -- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d1bb0 msgr2=0x7f489c0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489aa00640 1 --2- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d1bb0 0x7f489c0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489aa00640 1 -- 172.21.15.148:0/963439192 >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 msgr2=0x7f489c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489aa00640 1 --2- 172.21.15.148:0/963439192 >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 0x7f489c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489aa00640 1 -- 172.21.15.148:0/963439192 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c0cdc30 con 0x7f489c0d17d0 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f489b400640 1 --2- 172.21.15.148:0/963439192 >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 0x7f489c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcc700062d0 0x7fcc70034560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcc700062d0 0x7fcc70034560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55580/0 (socket says 172.21.15.148:55580) 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 -- 172.21.15.148:0/2391499609 learned_addr learned my addr 172.21.15.148:0/2391499609 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76e000640 1 -- 172.21.15.148:0/2270874181 >> v2:172.21.15.148:3300/0 conn(0x7fb77015c0c0 msgr2=0x7fb77015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76e000640 1 --2- 172.21.15.148:0/2270874181 >> v2:172.21.15.148:3300/0 conn(0x7fb77015c0c0 0x7fb77015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76e000640 1 -- 172.21.15.148:0/2270874181 >> v1:172.21.15.157:6789/0 conn(0x7fb7700ca3b0 legacy=0x7fb770073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.783+0000 7fb76e000640 1 -- 172.21.15.148:0/2270874181 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7700c5bf0 con 0x7fb7700744f0 2024-04-26T23:05:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc77e00640 1 --2- 172.21.15.148:0/2391499609 >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 0x7fcc700e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 -- 172.21.15.148:0/2391499609 >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 msgr2=0x7fcc700e0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 --2- 172.21.15.148:0/2391499609 >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 0x7fcc700e0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 -- 172.21.15.148:0/2391499609 >> v1:172.21.15.148:6789/0 conn(0x7fcc7004e070 legacy=0x7fcc70007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc7ce00640 1 -- 172.21.15.148:0/2391499609 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc70007150 con 0x7fcc700062d0 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f7796a00640 1 Processor -- start 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7f7796a00640 1 -- start start 2024-04-26T23:05:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fcc77e00640 1 --2- 172.21.15.148:0/2391499609 >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 0x7fcc700e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:09.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fda1fe00640 1 Processor -- start 2024-04-26T23:05:09.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fda1fe00640 1 -- start start 2024-04-26T23:05:09.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.787+0000 7fa721000640 1 Processor -- start 2024-04-26T23:05:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb76e000640 1 --2- 172.21.15.148:0/2270874181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb7700ca790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb77006e530 tx=0x7fb75c0273a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89e57d3b4b6dbd0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa721000640 1 -- start start 2024-04-26T23:05:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f7796a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 0x7f779015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f7796a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77900c96a0 con 0x7f779006ff50 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f7796a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77900c9980 con 0x7f779006f460 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f7796a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f779015ac00 con 0x7f7790153eb0 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 0x7f779015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778fe00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f779006f460 0x7f779006f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41122/0 (socket says 172.21.15.148:41122) 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778fe00640 1 -- 172.21.15.148:0/3772350685 learned_addr learned my addr 172.21.15.148:0/3772350685 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda20163490 0x7fda200720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda2006c9c0 0x7fda20159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1fe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200728e0 con 0x7fda2006c5e0 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1fe00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fda2015ff20 con 0x7fda2006c9c0 2024-04-26T23:05:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1fe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fda20163910 con 0x7fda20163490 2024-04-26T23:05:09.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778ea00640 1 -- 172.21.15.148:0/3772350685 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189295447 0 0) 0x7f77900c9980 con 0x7f779006f460 2024-04-26T23:05:09.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778ea00640 1 -- 172.21.15.148:0/3772350685 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7774003530 con 0x7f779006f460 2024-04-26T23:05:09.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda2006c9c0 0x7fda20159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda2006c9c0 0x7fda20159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45004/0 (socket says 172.21.15.148:45004) 2024-04-26T23:05:09.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 -- 172.21.15.148:0/3211211421 learned_addr learned my addr 172.21.15.148:0/3211211421 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb76d600640 1 -- 172.21.15.148:0/2270874181 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0bc070 con 0x7fb7700744f0 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb76d600640 1 -- 172.21.15.148:0/2270874181 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c00b450 con 0x7fb7700744f0 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb76d600640 1 -- 172.21.15.148:0/2270874181 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00d2d0 con 0x7fb7700744f0 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa721000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa71c0c9020 0x7fa71c164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa721000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c15aa80 con 0x7fa71c0707b0 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa721000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c070c20 con 0x7fa71c15a6a0 2024-04-26T23:05:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa721000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fa71c0c9b10 con 0x7fa71c0c9020 2024-04-26T23:05:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1e000640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda20163490 0x7fda200720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa719e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa71c15a6a0 0x7fa71c06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41144/0 (socket says 172.21.15.148:41144) 2024-04-26T23:05:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa719e00640 1 -- 172.21.15.148:0/1464624082 learned_addr learned my addr 172.21.15.148:0/1464624082 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f489aa00640 1 --2- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0d17d0 0x7f489c15c8e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f489c0ccc60 tx=0x7f488801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68898c1d1a770adb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa719400640 1 --2- 172.21.15.148:0/1464624082 >> v2:172.21.15.148:3300/0 conn(0x7fa71c0c9020 0x7fa71c164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fcc7ce00640 1 --2- 172.21.15.148:0/2391499609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc70034560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97dcdaed69e13878 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 -- 172.21.15.148:0/3211211421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda20163490 msgr2=0x7fda200720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda20163490 0x7fda200720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 -- 172.21.15.148:0/3211211421 >> v1:172.21.15.157:6789/0 conn(0x7fda2006c5e0 legacy=0x7fda20160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fda1f400640 1 -- 172.21.15.148:0/3211211421 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda20163bf0 con 0x7fda2006c9c0 2024-04-26T23:05:09.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f8787400640 1 --2- 172.21.15.148:0/1062289600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8788070480 0x7f8788072260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8780009d90 tx=0x7f8780021330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df462678effa7f7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 msgr2=0x7fb7700ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 --2- 172.21.15.148:0/2270874181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb7700ca790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb77006e530 tx=0x7fb75c0273a0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85411313 0 0) 0x7fa71c070c20 con 0x7fa71c15a6a0 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778f400640 1 -- 172.21.15.148:0/3772350685 >> v1:172.21.15.157:6789/0 conn(0x7f779006f460 legacy=0x7f779006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778f400640 1 -- 172.21.15.148:0/3772350685 >> v1:172.21.15.148:6789/0 conn(0x7f779006ff50 legacy=0x7f77900c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7f778f400640 1 -- 172.21.15.148:0/3772350685 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7790070610 con 0x7f7790153eb0 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fcc76a00640 1 -- 172.21.15.148:0/2391499609 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0b5070 con 0x7fcc700062d0 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fcc76a00640 1 -- 172.21.15.148:0/2391499609 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6c0a88d0 con 0x7fcc700062d0 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fcc76a00640 1 -- 172.21.15.148:0/2391499609 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0a8ca0 con 0x7fcc700062d0 2024-04-26T23:05:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 shutdown_connections 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 --2- 172.21.15.148:0/2270874181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb7700ca790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 --2- 172.21.15.148:0/2270874181 >> v2:172.21.15.148:3300/0 conn(0x7fb77015c0c0 0x7fb77015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 >> 172.21.15.148:0/2270874181 conn(0x7fb77006d490 msgr2=0x7fb77006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa700003530 con 0x7fa71c15a6a0 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636798979 0 0) 0x7fa71c15aa80 con 0x7fa71c0707b0 2024-04-26T23:05:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.791+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa71c070c20 con 0x7fa71c0707b0 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f4899600640 1 -- 172.21.15.148:0/963439192 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48880b5070 con 0x7f489c0d17d0 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f4899600640 1 -- 172.21.15.148:0/963439192 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48880a89d0 con 0x7f489c0d17d0 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f4899600640 1 -- 172.21.15.148:0/963439192 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48880a8da0 con 0x7f489c0d17d0 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 shutdown_connections 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fb775600640 1 -- 172.21.15.148:0/2270874181 wait complete. 2024-04-26T23:05:09.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 Processor -- start 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fa719400640 1 -- 172.21.15.148:0/1464624082 >> v1:172.21.15.157:6789/0 conn(0x7fa71c15a6a0 legacy=0x7fa71c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fa719400640 1 -- 172.21.15.148:0/1464624082 >> v1:172.21.15.148:6789/0 conn(0x7fa71c0707b0 legacy=0x7fa71c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fa719400640 1 -- 172.21.15.148:0/1464624082 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c070010 con 0x7fa71c0c9020 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800b6070 con 0x7f8788070480 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87800b1600 con 0x7f8788070480 2024-04-26T23:05:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f8786a00640 1 -- 172.21.15.148:0/1062289600 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800b19d0 con 0x7f8788070480 2024-04-26T23:05:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 -- 172.21.15.148:0/2391499609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 msgr2=0x7fcc70034560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 --2- 172.21.15.148:0/2391499609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc70034560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c01ecd0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 -- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0d17d0 msgr2=0x7f489c15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 --2- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0d17d0 0x7f489c15c8e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f489c0ccc60 tx=0x7f488801ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 -- start start 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 -- 172.21.15.148:0/1062289600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8788070480 msgr2=0x7f8788072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 --2- 172.21.15.148:0/1062289600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8788070480 0x7f8788072260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8780009d90 tx=0x7f8780021330 comp rx=0 tx=0).stop 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 -- 172.21.15.148:0/2391499609 shutdown_connections 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 --2- 172.21.15.148:0/2391499609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc70034560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 --2- 172.21.15.148:0/2391499609 >> v2:172.21.15.148:3300/0 conn(0x7fcc7004a950 0x7fcc700e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 -- 172.21.15.148:0/2391499609 >> 172.21.15.148:0/2391499609 conn(0x7fcc7004d4c0 msgr2=0x7fcc7004d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 -- 172.21.15.148:0/1062289600 shutdown_connections 2024-04-26T23:05:09.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 --2- 172.21.15.148:0/1062289600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8788070480 0x7f8788072260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 -- 172.21.15.148:0/1062289600 >> 172.21.15.148:0/1062289600 conn(0x7f87880c9d10 msgr2=0x7f87880ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fb775600640 1 Processor -- start 2024-04-26T23:05:09.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 -- 172.21.15.148:0/963439192 shutdown_connections 2024-04-26T23:05:09.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 --2- 172.21.15.148:0/963439192 >> v2:172.21.15.148:3300/0 conn(0x7f489c0cc460 0x7f489c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 --2- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d1bb0 0x7f489c0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 --2- 172.21.15.148:0/963439192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0d17d0 0x7f489c15c8e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 -- 172.21.15.148:0/963439192 >> 172.21.15.148:0/963439192 conn(0x7f489c06dc10 msgr2=0x7f489c06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 -- 172.21.15.148:0/963439192 shutdown_connections 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f48a1e00640 1 -- 172.21.15.148:0/963439192 wait complete. 2024-04-26T23:05:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fb775600640 1 -- start start 2024-04-26T23:05:09.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 -- 172.21.15.148:0/2391499609 shutdown_connections 2024-04-26T23:05:09.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fcc7d800640 1 -- 172.21.15.148:0/2391499609 wait complete. 2024-04-26T23:05:09.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7fda1f400640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda2006c9c0 0x7fda20159da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fda18009870 tx=0x7fda1801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516b4e68f225bf77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f778f400640 1 --2- 172.21.15.148:0/3772350685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 0x7f779015a6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f777c0097f0 tx=0x7f777c01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d30e9f637dd86d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1d600640 1 -- 172.21.15.148:0/3211211421 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda180a95f0 con 0x7fda2006c9c0 2024-04-26T23:05:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1d600640 1 -- 172.21.15.148:0/3211211421 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda180a9790 con 0x7fda2006c9c0 2024-04-26T23:05:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1d600640 1 -- 172.21.15.148:0/3211211421 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda180a9b60 con 0x7fda2006c9c0 2024-04-26T23:05:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb770150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 -- 172.21.15.148:0/1062289600 shutdown_connections 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f878f000640 1 -- 172.21.15.148:0/1062289600 wait complete. 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7700ca3b0 0x7fb7701465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb77015c0c0 0x7fb7701edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700c7b70 con 0x7fb77015c0c0 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700c7890 con 0x7fb7700744f0 2024-04-26T23:05:09.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb775600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb77015ca10 con 0x7fb7700ca3b0 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ab40d1df0 0x7f7ab415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab40b5120 con 0x7f7ab40b40f0 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab415cd40 con 0x7f7ab40d1df0 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aba600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab40b5400 con 0x7f7ab40d1a10 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7ab9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7ab9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58190/0 (socket says 172.21.15.148:58190) 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7ab9200640 1 -- 172.21.15.148:0/2173745642 learned_addr learned my addr 172.21.15.148:0/2173745642 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.795+0000 7f7aabe00640 1 --2- 172.21.15.148:0/2173745642 >> v2:172.21.15.157:3300/0 conn(0x7f7ab40d1df0 0x7f7ab415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7ab9200640 1 -- 172.21.15.148:0/2173745642 >> v2:172.21.15.157:3300/0 conn(0x7f7ab40d1df0 msgr2=0x7f7ab415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7ab9200640 1 --2- 172.21.15.148:0/2173745642 >> v2:172.21.15.157:3300/0 conn(0x7f7ab40d1df0 0x7f7ab415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7ab3e00640 1 -- 172.21.15.148:0/2173745642 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769600817 0 0) 0x7f7ab40b5120 con 0x7f7ab40b40f0 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7ab9200640 1 -- 172.21.15.148:0/2173745642 >> v1:172.21.15.157:6789/0 conn(0x7f7ab40b40f0 legacy=0x7f7ab41559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7ab9200640 1 -- 172.21.15.148:0/2173745642 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab40b56e0 con 0x7f7ab40d1a10 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 -- 172.21.15.148:0/3211211421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda2006c9c0 msgr2=0x7fda20159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda2006c9c0 0x7fda20159da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fda18009870 tx=0x7fda1801c530 comp rx=0 tx=0).stop 2024-04-26T23:05:09.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb770150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb770150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55600/0 (socket says 172.21.15.148:55600) 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 -- 172.21.15.148:0/1557760836 learned_addr learned my addr 172.21.15.148:0/1557760836 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 -- 172.21.15.148:0/3211211421 shutdown_connections 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda20163490 0x7fda200720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 --2- 172.21.15.148:0/3211211421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda2006c9c0 0x7fda20159da0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 -- 172.21.15.148:0/3211211421 >> 172.21.15.148:0/3211211421 conn(0x7fda2006e0a0 msgr2=0x7fda2006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f878f000640 1 Processor -- start 2024-04-26T23:05:09.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 Processor -- start 2024-04-26T23:05:09.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 -- start start 2024-04-26T23:05:09.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76e000640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7700ca3b0 0x7fb7701465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76f400640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb77015c0c0 0x7fb7701edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa719400640 1 --2- 172.21.15.148:0/1464624082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c0c9020 0x7fa71c164230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7080097c0 tx=0x7fa70801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb95fc9ff9dd252 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f778ea00640 1 -- 172.21.15.148:0/3772350685 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b5070 con 0x7f7790153eb0 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f778ea00640 1 -- 172.21.15.148:0/3772350685 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c0a89d0 con 0x7f7790153eb0 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f778ea00640 1 -- 172.21.15.148:0/3772350685 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0a8da0 con 0x7f7790153eb0 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080b0070 con 0x7fa71c0c9020 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7080ab600 con 0x7fa71c0c9020 2024-04-26T23:05:09.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa718a00640 1 -- 172.21.15.148:0/1464624082 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080ab9d0 con 0x7fa71c0c9020 2024-04-26T23:05:09.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 -- 172.21.15.148:0/3211211421 shutdown_connections 2024-04-26T23:05:09.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7796a00640 1 -- 172.21.15.148:0/3772350685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 msgr2=0x7f779015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fda1fe00640 1 -- 172.21.15.148:0/3211211421 wait complete. 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 -- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7700ca3b0 msgr2=0x7fb7701465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7700ca3b0 0x7fb7701465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 -- 172.21.15.148:0/1557760836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb77015c0c0 msgr2=0x7fb7701edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb77015c0c0 0x7fb7701edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7701ed630 con 0x7fb7700744f0 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc700da870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc7004a950 0x7fcc700d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 0x7fcc70170e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fb76ea00640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb770150e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c4d0 tx=0x7fb76000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa721000640 1 -- 172.21.15.148:0/1464624082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c0c9020 msgr2=0x7fa71c164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa721000640 1 --2- 172.21.15.148:0/1464624082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c0c9020 0x7fa71c164230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7080097c0 tx=0x7fa70801c410 comp rx=0 tx=0).stop 2024-04-26T23:05:09.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7796a00640 1 --2- 172.21.15.148:0/3772350685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 0x7f779015a6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f777c0097f0 tx=0x7f777c01ecf0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7796a00640 1 -- 172.21.15.148:0/3772350685 shutdown_connections 2024-04-26T23:05:09.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7796a00640 1 --2- 172.21.15.148:0/3772350685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7790153eb0 0x7f779015a6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70008340 con 0x7fcc7004a950 2024-04-26T23:05:09.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70007710 con 0x7fcc700062d0 2024-04-26T23:05:09.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fcc7d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcc70034aa0 con 0x7fcc7004e070 2024-04-26T23:05:09.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f878f000640 1 -- start start 2024-04-26T23:05:09.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 Processor -- start 2024-04-26T23:05:09.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 -- start start 2024-04-26T23:05:09.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f878f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 0x7f8788145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878f000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8788152000 0x7f87880cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878f000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87881edcf0 0x7f87881ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87880c8a50 con 0x7f878806f460 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878f000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87880727a0 con 0x7f87881edcf0 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878f000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f87880c8bd0 con 0x7f8788152000 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f8787e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 0x7f8788145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f8787e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 0x7f8788145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45020/0 (socket says 172.21.15.148:45020) 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f8787e00640 1 -- 172.21.15.148:0/3638709952 learned_addr learned my addr 172.21.15.148:0/3638709952 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f8787400640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8788152000 0x7f87880cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87881edcf0 0x7f87881ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 -- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8788152000 msgr2=0x7f87880cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8788152000 0x7f87880cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 0x7fcc70170e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 0x7fcc70170e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58204/0 (socket says 172.21.15.148:58204) 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 -- 172.21.15.148:0/641031886 learned_addr learned my addr 172.21.15.148:0/641031886 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc77e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc700da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 -- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 msgr2=0x7fcc700da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc700da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 -- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc7004a950 msgr2=0x7fcc700d5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc7004a950 0x7fcc700d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc701706b0 con 0x7fcc7004e070 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc77e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc700062d0 0x7fcc700da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:09.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760005cf0 con 0x7fb7700744f0 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7701f0d40 con 0x7fb7700744f0 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7701f1300 con 0x7fb7700744f0 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb760007070 con 0x7fb7700744f0 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760007460 con 0x7fb7700744f0 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7fa721000640 1 -- 172.21.15.148:0/1464624082 shutdown_connections 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fa721000640 1 --2- 172.21.15.148:0/1464624082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c0c9020 0x7fa71c164230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fa721000640 1 -- 172.21.15.148:0/1464624082 >> 172.21.15.148:0/1464624082 conn(0x7fa71c0c9d10 msgr2=0x7fa71c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fa721000640 1 -- 172.21.15.148:0/1464624082 shutdown_connections 2024-04-26T23:05:09.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fa721000640 1 -- 172.21.15.148:0/1464624082 wait complete. 2024-04-26T23:05:09.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.799+0000 7f7796a00640 1 -- 172.21.15.148:0/3772350685 >> 172.21.15.148:0/3772350685 conn(0x7f77900c9d10 msgr2=0x7f77900ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7796a00640 1 -- 172.21.15.148:0/3772350685 shutdown_connections 2024-04-26T23:05:09.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 -- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 msgr2=0x7f8788145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 0x7f8788145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87880738b0 con 0x7f87881edcf0 2024-04-26T23:05:09.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f8787e00640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f878806f460 0x7f8788145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 0x7f489c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f878d000640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87881edcf0 0x7f87881ee160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3c0 tx=0x7f877400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7796a00640 1 -- 172.21.15.148:0/3772350685 wait complete. 2024-04-26T23:05:09.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d17d0 0x7f489c1f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fda1fe00640 1 Processor -- start 2024-04-26T23:05:09.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f489c0d1bb0 0x7f489c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 0x7f489c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 0x7f489c14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55634/0 (socket says 172.21.15.148:55634) 2024-04-26T23:05:09.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7ce00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 0x7fcc70170e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c01ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7ab9200640 1 --2- 172.21.15.148:0/2173745642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a76d10f6b537c3ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb748001040 con 0x7fb7700744f0 2024-04-26T23:05:09.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7796a00640 1 Processor -- start 2024-04-26T23:05:09.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fda1fe00640 1 -- start start 2024-04-26T23:05:09.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d17d0 0x7f489c1f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d17d0 0x7f489c1f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58234/0 (socket says 172.21.15.148:58234) 2024-04-26T23:05:09.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0be070 con 0x7fcc7004e070 2024-04-26T23:05:09.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6c0b0700 con 0x7fcc7004e070 2024-04-26T23:05:09.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0b5040 con 0x7fcc7004e070 2024-04-26T23:05:09.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7796a00640 1 -- start start 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc700dc490 con 0x7fcc7004e070 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 -- 172.21.15.148:0/437410744 learned_addr learned my addr 172.21.15.148:0/437410744 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f489c0ce4d0 con 0x7f489c0d1bb0 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f489c0ce1f0 con 0x7f489c0cc460 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f489c0c69e0 con 0x7f489c0d17d0 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7ab3e00640 1 -- 172.21.15.148:0/2173745642 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40b5070 con 0x7f7ab40d1a10 2024-04-26T23:05:09.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7ab3e00640 1 -- 172.21.15.148:0/2173745642 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa40a8a50 con 0x7f7ab40d1a10 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f7ab3e00640 1 -- 172.21.15.148:0/2173745642 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40a8e20 con 0x7f7ab40d1a10 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489b400640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f489c0d1bb0 0x7f489c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 -- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d17d0 msgr2=0x7f489c1f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f489c0d17d0 0x7f489c1f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 -- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f489c0d1bb0 msgr2=0x7f489c147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f489c0d1bb0 0x7f489c147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7f489aa00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c1600a0 con 0x7f489c0cc460 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 -- 172.21.15.148:0/2173745642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 msgr2=0x7f7ab40b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 --2- 172.21.15.148:0/2173745642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa401ed50 comp rx=0 tx=0).stop 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774017070 con 0x7f87881edcf0 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8774003620 con 0x7f87881edcf0 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740039d0 con 0x7f87881edcf0 2024-04-26T23:05:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f878f000640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87881f1af0 con 0x7f87881edcf0 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.803+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc700dca30 con 0x7fcc7004e070 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779006f460 0x7f7790149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f779006ff50 0x7f779014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7790073e60 0x7f7790157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77900c4d70 con 0x7f779006f460 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f77900c5120 con 0x7f7790073e60 2024-04-26T23:05:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7796a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f77900c4ef0 con 0x7f779006ff50 2024-04-26T23:05:09.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 -- 172.21.15.148:0/2173745642 shutdown_connections 2024-04-26T23:05:09.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 --2- 172.21.15.148:0/2173745642 >> v2:172.21.15.157:3300/0 conn(0x7f7ab40d1df0 0x7f7ab415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 --2- 172.21.15.148:0/2173745642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40d1a10 0x7f7ab40b4600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 -- 172.21.15.148:0/2173745642 >> 172.21.15.148:0/2173745642 conn(0x7f7ab406d090 msgr2=0x7f7ab406d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f878f000640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87881f1250 con 0x7f87881edcf0 2024-04-26T23:05:09.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fa721000640 1 Processor -- start 2024-04-26T23:05:09.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fa721000640 1 -- start start 2024-04-26T23:05:09.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 -- 172.21.15.148:0/2173745642 shutdown_connections 2024-04-26T23:05:09.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2006c5e0 0x7fda2014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda2006c9c0 0x7fda20155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7794a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7790073e60 0x7f7790157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7794a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7790073e60 0x7f7790157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55648/0 (socket says 172.21.15.148:55648) 2024-04-26T23:05:09.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7794a00640 1 -- 172.21.15.148:0/1609878319 learned_addr learned my addr 172.21.15.148:0/1609878319 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f779006ff50 0x7f779014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda20163490 0x7fda201fc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda20160e10 con 0x7fda20163490 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fda2015a6f0 con 0x7fda2006c5e0 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1fe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fda2016cfe0 con 0x7fda2006c9c0 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778fe00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779006f460 0x7f7790149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda20163490 0x7fda201fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb760007600 con 0x7fb7700744f0 2024-04-26T23:05:09.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda20163490 0x7fda201fc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45050/0 (socket says 172.21.15.148:45050) 2024-04-26T23:05:09.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1f400640 1 -- 172.21.15.148:0/143872085 learned_addr learned my addr 172.21.15.148:0/143872085 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1ea00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2006c5e0 0x7fda2014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc700057f0 con 0x7fcc7004e070 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 -- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7790073e60 msgr2=0x7f7790157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7790073e60 0x7f7790157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 -- 172.21.15.148:0/1609878319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779006f460 msgr2=0x7f7790149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779006f460 0x7f7790149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77901fe5f0 con 0x7f779006ff50 2024-04-26T23:05:09.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f489aa00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 0x7f489c14e450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f488801d3c0 tx=0x7f488801bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f878f000640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8788077c20 con 0x7f87881edcf0 2024-04-26T23:05:09.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f7aba600640 1 -- 172.21.15.148:0/2173745642 wait complete. 2024-04-26T23:05:09.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7f778f400640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f779006ff50 0x7f779014acc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f777c0af000 tx=0x7f777c01ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda2006c9c0 0x7fda20155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 -- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2006c5e0 msgr2=0x7fda2014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2006c5e0 0x7fda2014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 -- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda20163490 msgr2=0x7fda201fc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda20163490 0x7fda201fc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fda1e000640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda201497f0 con 0x7fda2006c9c0 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb750068380 0x7fb75006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb7600871a0 con 0x7fb7700744f0 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7fb750071a80 0x7fb750073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb760013e70 con 0x7fb750071a80 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.807+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb760087630 con 0x7fb7700744f0 2024-04-26T23:05:09.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0bf070 con 0x7f779006ff50 2024-04-26T23:05:09.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48880b5040 con 0x7f489c0cc460 2024-04-26T23:05:09.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48880be070 con 0x7f489c0cc460 2024-04-26T23:05:09.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48880b1990 con 0x7f489c0cc460 2024-04-26T23:05:09.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c15d020 con 0x7f489c0cc460 2024-04-26T23:05:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fb76e000640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb750068380 0x7fb75006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fb76f400640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7fb750071a80 0x7fb750073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda1e000640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda2006c9c0 0x7fda20155370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda1000efc0 tx=0x7fda1000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c15d5e0 con 0x7f489c0cc460 2024-04-26T23:05:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f877401a070 con 0x7f87881edcf0 2024-04-26T23:05:09.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7aba600640 1 Processor -- start 2024-04-26T23:05:09.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c0b0720 con 0x7f779006ff50 2024-04-26T23:05:09.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b5040 con 0x7f779006ff50 2024-04-26T23:05:09.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc6c0b0ad0 con 0x7fcc7004e070 2024-04-26T23:05:09.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77901ff410 con 0x7f779006ff50 2024-04-26T23:05:09.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fb76e000640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb750068380 0x7fb75006a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0b9000 tx=0x7fb75c004740 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fb76f400640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7fb750071a80 0x7fb750073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa71c0707b0 0x7fa71c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa71c0c9020 0x7fa71c201980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77901feb70 con 0x7f779006ff50 2024-04-26T23:05:09.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4874001040 con 0x7f489c0cc460 2024-04-26T23:05:09.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcc5c068380 0x7fcc5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc6c123700 con 0x7fcc7004e070 2024-04-26T23:05:09.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 0x7fa71c0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7fcc5c071a80 0x7fcc5c073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc77e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcc5c068380 0x7fcc5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc6c0b5e50 con 0x7fcc5c071a80 2024-04-26T23:05:09.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcc6c12a050 con 0x7fcc7004e070 2024-04-26T23:05:09.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c06fcf0 con 0x7fa71c15a6a0 2024-04-26T23:05:09.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c06fb70 con 0x7fa71c0c9020 2024-04-26T23:05:09.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa721000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c16e800 con 0x7fa71c0707b0 2024-04-26T23:05:09.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f87680683b0 0x7f876806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f8787e00640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f87680683b0 0x7f876806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10018020 con 0x7fda2006c9c0 2024-04-26T23:05:09.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda20149ad0 con 0x7fda2006c9c0 2024-04-26T23:05:09.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2014a090 con 0x7fda2006c9c0 2024-04-26T23:05:09.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda201495a0 con 0x7fda2006c9c0 2024-04-26T23:05:09.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc77400640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7fcc5c071a80 0x7fcc5c073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fcc77e00640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcc5c068380 0x7fcc5c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc78000b70 tx=0x7fcc78070040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda10014480 con 0x7fda2006c9c0 2024-04-26T23:05:09.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8774053b70 con 0x7f87881edcf0 2024-04-26T23:05:09.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa71a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 0x7fa71c0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10014850 con 0x7fda2006c9c0 2024-04-26T23:05:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f8768072700 0x7f8768074ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8768075270 con 0x7f8768072700 2024-04-26T23:05:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8774052500 con 0x7f87881edcf0 2024-04-26T23:05:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa71a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 0x7fa71c0c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45056/0 (socket says 172.21.15.148:45056) 2024-04-26T23:05:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa71a800640 1 -- 172.21.15.148:0/3952621549 learned_addr learned my addr 172.21.15.148:0/3952621549 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7fa719e00640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa71c0707b0 0x7fa71c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f8787e00640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f87680683b0 0x7f876806a870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8778000f70 tx=0x7f8778007d90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa719400640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa71c0c9020 0x7fa71c201980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f8787400640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f8768072700 0x7f8768074ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 -- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa71c0707b0 msgr2=0x7fa71c0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa71c0707b0 0x7fa71c0ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 -- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa71c0c9020 msgr2=0x7fa71c201980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa71c0c9020 0x7fa71c201980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c161860 con 0x7fa71c15a6a0 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa719400640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa71c0c9020 0x7fa71c201980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa71a800640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 0x7fa71c0c68f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa71400c770 tx=0x7fa71400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7790077c20 con 0x7f779006ff50 2024-04-26T23:05:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f8787400640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f8768072700 0x7f8768074ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714003b80 con 0x7fa71c15a6a0 2024-04-26T23:05:09.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.811+0000 7f7aba600640 1 -- start start 2024-04-26T23:05:09.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fcc77400640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7fcc5c071a80 0x7fcc5c073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40b40f0 0x7f7ab41f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 0x7f7ab415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab40d1df0 0x7f7ab40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40b4b40 con 0x7f7ab40d1df0 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40b5ca0 con 0x7f7ab40d1a10 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aba600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab40b4cc0 con 0x7f7ab40b40f0 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aabe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 0x7f7ab415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aabe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 0x7f7ab415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55680/0 (socket says 172.21.15.148:55680) 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aabe00640 1 -- 172.21.15.148:0/1427309107 learned_addr learned my addr 172.21.15.148:0/1427309107 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab40d1df0 0x7f7ab40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa714003d20 con 0x7fa71c15a6a0 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c161b40 con 0x7fa71c15a6a0 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c205370 con 0x7fa71c15a6a0 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71400aa90 con 0x7fa71c15a6a0 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 -- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40b40f0 msgr2=0x7f7ab41f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ab40b40f0 0x7f7ab41f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 -- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 msgr2=0x7f7ab415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 0x7f7ab415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab40c8f80 con 0x7f7ab40d1df0 2024-04-26T23:05:09.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7aabe00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ab40d1a10 0x7f7ab415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:09.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== osd.4 v2:172.21.15.157:6810/734957518 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb760013e70 con 0x7fb750071a80 2024-04-26T23:05:09.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab9c00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab40d1df0 0x7f7ab40c79f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c750 tx=0x7f7aac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48880b1b30 con 0x7f489c0cc460 2024-04-26T23:05:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== osd.3 v2:172.21.15.148:6816/3094791832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc6c0b5e50 con 0x7fcc5c071a80 2024-04-26T23:05:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda1001b020 con 0x7fda2006c9c0 2024-04-26T23:05:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa71c077c20 con 0x7fa71c15a6a0 2024-04-26T23:05:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== osd.2 v2:172.21.15.148:6817/2623535582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8768075270 con 0x7f8768072700 2024-04-26T23:05:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f777c0b0b10 con 0x7f779006ff50 2024-04-26T23:05:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda16a00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda00068380 0x7fda0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003bb0 con 0x7f7ab40d1df0 2024-04-26T23:05:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac003d70 con 0x7f7ab40d1df0 2024-04-26T23:05:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.815+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0052b0 con 0x7f7ab40d1df0 2024-04-26T23:05:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda10088550 con 0x7fda2006c9c0 2024-04-26T23:05:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa71400ac30 con 0x7fa71c15a6a0 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda1ea00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda00068380 0x7fda0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda16a00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7fda00071a00 0x7fda00073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda10004800 con 0x7fda00071a00 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fda100889e0 con 0x7fda2006c9c0 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fa712000640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6fc068380 0x7fa6fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f7787e00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7770068380 0x7f777006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fa719e00640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6fc068380 0x7fa6fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fda1f400640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7fda00071a00 0x7fda00073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f777c123490 con 0x7f779006ff50 2024-04-26T23:05:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f778fe00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7770068380 0x7f777006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa714087790 con 0x7fa71c15a6a0 2024-04-26T23:05:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fda1ea00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda00068380 0x7fda0006a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda0c007fd0 tx=0x7fda0c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa712000640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7fa6fc071a70 0x7fa6fc073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa714004ec0 con 0x7fa6fc071a70 2024-04-26T23:05:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa7140532b0 con 0x7fa71c15a6a0 2024-04-26T23:05:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7787e00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f7770071b00 0x7f7770073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f777c0044a0 con 0x7f7770071b00 2024-04-26T23:05:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa719400640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7fa6fc071a70 0x7fa6fc073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa719e00640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6fc068380 0x7fa6fc06a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa70c007fd0 tx=0x7fa70c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f777c12a050 con 0x7f779006ff50 2024-04-26T23:05:09.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7794a00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f7770071b00 0x7f7770073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fda1f400640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7fda00071a00 0x7fda00073e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f778fe00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7770068380 0x7f777006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7780001570 tx=0x7f7780006f00 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f4893400640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f487c068480 0x7f487c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4888124890 con 0x7f489c0cc460 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f489a000640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f487c068480 0x7f487c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f4893400640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7f487c071c00 0x7f487c074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48880aaea0 con 0x7f487c071c00 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4888124c80 con 0x7f489c0cc460 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f489b400640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7f487c071c00 0x7f487c074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f489a000640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f487c068480 0x7f487c06a940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f489c0cbbe0 tx=0x7f488c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f489b400640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7f487c071c00 0x7f487c074040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f7aba600640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab40c9260 con 0x7f7ab40d1df0 2024-04-26T23:05:09.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.819+0000 7f7aba600640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab40ca270 con 0x7f7ab40d1df0 2024-04-26T23:05:09.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ab40506d0 con 0x7f7ab40d1df0 2024-04-26T23:05:09.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fa719400640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7fa6fc071a70 0x7fa6fc073eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== osd.1 v2:172.21.15.148:6800/2370517083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48880aaea0 con 0x7f487c071c00 2024-04-26T23:05:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7f7794a00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f7770071b00 0x7f7770073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.823+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== osd.0 v2:172.21.15.148:6808/2413441377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda10004800 con 0x7fda00071a00 2024-04-26T23:05:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7aac005450 con 0x7f7ab40d1df0 2024-04-26T23:05:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== osd.5 v2:172.21.15.157:6800/549691601 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa714004ec0 con 0x7fa6fc071a70 2024-04-26T23:05:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7a900683d0 0x7f7a9006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== osd.6 v2:172.21.15.157:6824/1080565004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f777c0044a0 con 0x7f7770071b00 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7aac0874e0 con 0x7f7ab40d1df0 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f7a90071b40 0x7f7a90073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a90074650 con 0x7f7a90071b40 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7aac087890 con 0x7f7ab40d1df0 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7aabe00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f7a90071b40 0x7f7a90073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.827+0000 7f7ab9200640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7a900683d0 0x7f7a9006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.831+0000 7f7aabe00640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f7a90071b40 0x7f7a90073f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.831+0000 7f7ab9200640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7a900683d0 0x7f7a9006a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b2000 tx=0x7f7aa4004740 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.831+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== osd.7 v2:172.21.15.157:6808/939880062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a90074650 con 0x7f7a90071b40 2024-04-26T23:05:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.831+0000 7f878f000640 1 -- 172.21.15.148:0/3638709952 --> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8788074100 con 0x7f8768072700 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877fe00640 1 -- 172.21.15.148:0/3638709952 <== osd.2 v2:172.21.15.148:6817/2623535582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8788074100 con 0x7f8768072700 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f8768072700 msgr2=0x7f8768074ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f8768072700 0x7f8768074ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f87680683b0 msgr2=0x7f876806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f87680683b0 0x7f876806a870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8778000f70 tx=0x7f8778007d90 comp rx=0 tx=0).stop 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87881edcf0 msgr2=0x7f87881ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 --2- 172.21.15.148:0/3638709952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87881edcf0 0x7f87881ee160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3c0 tx=0x7f877400c880 comp rx=0 tx=0).stop 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f878d000640 1 -- 172.21.15.148:0/3638709952 reap_dead start 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 shutdown_connections 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.835+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 >> 172.21.15.148:0/3638709952 conn(0x7f87880c9d10 msgr2=0x7f87880c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.839+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 shutdown_connections 2024-04-26T23:05:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.839+0000 7f877d600640 1 -- 172.21.15.148:0/3638709952 wait complete. 2024-04-26T23:05:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.847+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 --> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb748002de0 con 0x7fb750071a80 2024-04-26T23:05:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb766a00640 1 -- 172.21.15.148:0/1557760836 <== osd.4 v2:172.21.15.157:6810/734957518 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb748002de0 con 0x7fb750071a80 2024-04-26T23:05:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 --> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc70006d50 con 0x7fcc5c071a80 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7fb750071a80 msgr2=0x7fb750073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7fb750071a80 0x7fb750073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb750068380 msgr2=0x7fb75006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb750068380 0x7fb75006a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0b9000 tx=0x7fb75c004740 comp rx=0 tx=0).stop 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 msgr2=0x7fb770150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fcc67e00640 1 -- 172.21.15.148:0/641031886 <== osd.3 v2:172.21.15.148:6816/3094791832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc70006d50 con 0x7fcc5c071a80 2024-04-26T23:05:09.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 --2- 172.21.15.148:0/1557760836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7700744f0 0x7fb770150e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c4d0 tx=0x7fb76000c990 comp rx=0 tx=0).stop 2024-04-26T23:05:09.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb76f400640 1 -- 172.21.15.148:0/1557760836 reap_dead start 2024-04-26T23:05:09.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 shutdown_connections 2024-04-26T23:05:09.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.851+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 >> 172.21.15.148:0/1557760836 conn(0x7fb77006d490 msgr2=0x7fb7700c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 --> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4874002de0 con 0x7f487c071c00 2024-04-26T23:05:09.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 --> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda200506d0 con 0x7fda00071a00 2024-04-26T23:05:09.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7fcc5c071a80 msgr2=0x7fcc5c073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7fcc5c071a80 0x7fcc5c073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 shutdown_connections 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcc5c068380 msgr2=0x7fcc5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcc5c068380 0x7fcc5c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc78000b70 tx=0x7fcc78070040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 msgr2=0x7fcc70170e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 --2- 172.21.15.148:0/641031886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc7004e070 0x7fcc70170e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c01ba70 comp rx=0 tx=0).stop 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7ce00640 1 -- 172.21.15.148:0/641031886 reap_dead start 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 shutdown_connections 2024-04-26T23:05:09.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 >> 172.21.15.148:0/641031886 conn(0x7fcc7004d4c0 msgr2=0x7fcc70005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda16a00640 1 -- 172.21.15.148:0/143872085 <== osd.0 v2:172.21.15.148:6808/2413441377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda200506d0 con 0x7fda00071a00 2024-04-26T23:05:09.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fb775600640 1 -- 172.21.15.148:0/1557760836 wait complete. 2024-04-26T23:05:09.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 --> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa71c148fb0 con 0x7fa6fc071a70 2024-04-26T23:05:09.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 shutdown_connections 2024-04-26T23:05:09.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fcc7d800640 1 -- 172.21.15.148:0/641031886 wait complete. 2024-04-26T23:05:09.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7fda00071a00 msgr2=0x7fda00073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7fda00071a00 0x7fda00073e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f4893400640 1 -- 172.21.15.148:0/437410744 <== osd.1 v2:172.21.15.148:6800/2370517083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4874002de0 con 0x7f487c071c00 2024-04-26T23:05:09.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa712000640 1 -- 172.21.15.148:0/3952621549 <== osd.5 v2:172.21.15.157:6800/549691601 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa71c148fb0 con 0x7fa6fc071a70 2024-04-26T23:05:09.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda00068380 msgr2=0x7fda0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda00068380 0x7fda0006a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda0c007fd0 tx=0x7fda0c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda2006c9c0 msgr2=0x7fda20155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 --2- 172.21.15.148:0/143872085 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda2006c9c0 0x7fda20155370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda1000efc0 tx=0x7fda1000c490 comp rx=0 tx=0).stop 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1f400640 1 -- 172.21.15.148:0/143872085 reap_dead start 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 shutdown_connections 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 >> 172.21.15.148:0/143872085 conn(0x7fda2006e0a0 msgr2=0x7fda200c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7fa6fc071a70 msgr2=0x7fa6fc073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7fa6fc071a70 0x7fa6fc073eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6fc068380 msgr2=0x7fa6fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6fc068380 0x7fa6fc06a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa70c007fd0 tx=0x7fa70c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 msgr2=0x7fa71c0c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa721000640 1 --2- 172.21.15.148:0/3952621549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa71c15a6a0 0x7fa71c0c68f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa71400c770 tx=0x7fa71400cc30 comp rx=0 tx=0).stop 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7fa71a800640 1 -- 172.21.15.148:0/3952621549 reap_dead start 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7f487c071c00 msgr2=0x7f487c074040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7f487c071c00 0x7f487c074040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 --> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7790073c40 con 0x7f7770071b00 2024-04-26T23:05:09.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f487c068480 msgr2=0x7f487c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f487c068480 0x7f487c06a940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f489c0cbbe0 tx=0x7f488c008040 comp rx=0 tx=0).stop 2024-04-26T23:05:09.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 msgr2=0x7f489c14e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 --2- 172.21.15.148:0/437410744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f489c0cc460 0x7f489c14e450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f488801d3c0 tx=0x7f488801bab0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f489b400640 1 -- 172.21.15.148:0/437410744 reap_dead start 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 shutdown_connections 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.855+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 >> 172.21.15.148:0/437410744 conn(0x7f489c06dc10 msgr2=0x7f489c1517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 shutdown_connections 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f48a1e00640 1 -- 172.21.15.148:0/437410744 wait complete. 2024-04-26T23:05:09.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7787e00640 1 -- 172.21.15.148:0/1609878319 <== osd.6 v2:172.21.15.157:6824/1080565004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7790073c40 con 0x7f7770071b00 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f7770071b00 msgr2=0x7f7770073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f7770071b00 0x7f7770073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7770068380 msgr2=0x7f777006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7770068380 0x7f777006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7780001570 tx=0x7f7780006f00 comp rx=0 tx=0).stop 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f779006ff50 msgr2=0x7f779014acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 --2- 172.21.15.148:0/1609878319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f779006ff50 0x7f779014acc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f777c0af000 tx=0x7f777c01ba90 comp rx=0 tx=0).stop 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7794a00640 1 -- 172.21.15.148:0/1609878319 reap_dead start 2024-04-26T23:05:09.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 shutdown_connections 2024-04-26T23:05:09.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 shutdown_connections 2024-04-26T23:05:09.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 >> 172.21.15.148:0/3952621549 conn(0x7fa71c0c9d10 msgr2=0x7fa71c0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 >> 172.21.15.148:0/1609878319 conn(0x7f77900c9d10 msgr2=0x7f77900c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 shutdown_connections 2024-04-26T23:05:09.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 shutdown_connections 2024-04-26T23:05:09.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7f7796a00640 1 -- 172.21.15.148:0/1609878319 wait complete. 2024-04-26T23:05:09.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.859+0000 7fda1fe00640 1 -- 172.21.15.148:0/143872085 wait complete. 2024-04-26T23:05:09.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.863+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 shutdown_connections 2024-04-26T23:05:09.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 --> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ab406d600 con 0x7f7a90071b40 2024-04-26T23:05:09.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7ab1600640 1 -- 172.21.15.148:0/1427309107 <== osd.7 v2:172.21.15.157:6808/939880062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ab406d600 con 0x7f7a90071b40 2024-04-26T23:05:09.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7fa721000640 1 -- 172.21.15.148:0/3952621549 wait complete. 2024-04-26T23:05:09.900 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:09.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:05:09.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f7a90071b40 msgr2=0x7f7a90073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f7a90071b40 0x7f7a90073f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7a900683d0 msgr2=0x7f7a9006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7a900683d0 0x7f7a9006a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b2000 tx=0x7f7aa4004740 comp rx=0 tx=0).stop 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab40d1df0 msgr2=0x7f7ab40c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 --2- 172.21.15.148:0/1427309107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab40d1df0 0x7f7ab40c79f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c750 tx=0x7f7aac00cc10 comp rx=0 tx=0).stop 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7ab9c00640 1 -- 172.21.15.148:0/1427309107 reap_dead start 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 shutdown_connections 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 >> 172.21.15.148:0/1427309107 conn(0x7f7ab406d090 msgr2=0x7f7ab40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 shutdown_connections 2024-04-26T23:05:09.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:09.867+0000 7f7aaa000640 1 -- 172.21.15.148:0/1427309107 wait complete. 2024-04-26T23:05:09.903 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:09.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:05:09.904 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:09.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:05:09.905 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:09.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:05:09.907 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:09.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:05:09.909 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:09.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:05:09.917 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:09.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:05:09.919 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:09.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:05:10.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.111+0000 7ff270a00640 1 Processor -- start 2024-04-26T23:05:10.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 -- start start 2024-04-26T23:05:10.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 Processor -- start 2024-04-26T23:05:10.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 -- start start 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c1520f0 0x7ff26c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff26c0c47c0 0x7ff26c073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26c0c98d0 con 0x7ff26c158990 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff26c068850 con 0x7ff26c0c47c0 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff270a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c0c96a0 con 0x7ff26c1520f0 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff26b400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c1520f0 0x7ff26c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff26be00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff26c158990 0x7ff26c068140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41166/0 (socket says 172.21.15.148:41166) 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff26be00640 1 -- 172.21.15.148:0/2696335912 learned_addr learned my addr 172.21.15.148:0/2696335912 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2696335912 >> v2:172.21.15.157:3300/0 conn(0x7ff26c0c47c0 0x7ff26c073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518159531 0 0) 0x7ff26c0c98d0 con 0x7ff26c158990 2024-04-26T23:05:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff250003530 con 0x7ff26c158990 2024-04-26T23:05:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3890331350 0 0) 0x7ff250003530 con 0x7ff26c158990 2024-04-26T23:05:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c1520f0 msgr2=0x7ff26c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c1520f0 0x7ff26c0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 >> v2:172.21.15.157:3300/0 conn(0x7ff26c0c47c0 msgr2=0x7ff26c073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 --2- 172.21.15.148:0/2696335912 >> v2:172.21.15.157:3300/0 conn(0x7ff26c0c47c0 0x7ff26c073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c0c9b70 con 0x7ff26c158990 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7ff264001a00 con 0x7ff26c158990 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 >> v1:172.21.15.157:6789/0 conn(0x7ff26c158990 legacy=0x7ff26c068140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2500039c0 0x7ff250003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2500043d0 0x7ff2500048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff250004f20 0x7ff25000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c068850 con 0x7ff2500043d0 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000bf10 con 0x7ff250004f20 2024-04-26T23:05:10.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff25000c090 con 0x7ff2500039c0 2024-04-26T23:05:10.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26be00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff250004f20 0x7ff25000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26b400640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2500039c0 0x7ff250003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7fe152c00640 1 Processor -- start 2024-04-26T23:05:10.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7fe152c00640 1 -- start start 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f928c0746d0 0x7f928c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f928c072e50 con 0x7f928c154010 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f928c0730f0 con 0x7f928c0746d0 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.115+0000 7f9294200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f928c0c8e40 con 0x7f928c0c8510 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58284/0 (socket says 172.21.15.148:58284) 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 -- 172.21.15.148:0/683519732 learned_addr learned my addr 172.21.15.148:0/683519732 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 -- 172.21.15.148:0/683519732 >> v2:172.21.15.148:3300/0 conn(0x7f928c0746d0 msgr2=0x7f928c15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 --2- 172.21.15.148:0/683519732 >> v2:172.21.15.148:3300/0 conn(0x7f928c0746d0 0x7f928c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 -- 172.21.15.148:0/683519732 >> v1:172.21.15.148:6789/0 conn(0x7f928c154010 legacy=0x7f928c0c7320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:10.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7f9290e00640 1 -- 172.21.15.148:0/683519732 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c0c9120 con 0x7f928c0c8510 2024-04-26T23:05:10.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2500043d0 0x7ff2500048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26aa00640 1 -- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2500039c0 msgr2=0x7ff250003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2500039c0 0x7ff250003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26aa00640 1 -- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff250004f20 msgr2=0x7ff25000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.119+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff250004f20 0x7ff25000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7ff26aa00640 1 -- 172.21.15.148:0/2696335912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c0c9b70 con 0x7ff2500043d0 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe152c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe14c152000 0x7fe14c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7f9290e00640 1 --2- 172.21.15.148:0/683519732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9280009870 tx=0x7f928002fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d1d1ce91037a094 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe14c152000 0x7fe14c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe14c152000 0x7fe14c1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55706/0 (socket says 172.21.15.148:55706) 2024-04-26T23:05:10.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14b400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe14c070480 0x7fe14c072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41172/0 (socket says 172.21.15.148:41172) 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14be00640 1 -- 172.21.15.148:0/3176799109 learned_addr learned my addr 172.21.15.148:0/3176799109 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c158d00 con 0x7fe14c06f460 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c070a10 con 0x7fe14c070480 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe14c0c85c0 con 0x7fe14c152000 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14aa00640 1 -- 172.21.15.148:0/3176799109 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768818486 0 0) 0x7fe14c070a10 con 0x7fe14c070480 2024-04-26T23:05:10.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7fe14aa00640 1 -- 172.21.15.148:0/3176799109 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe130003530 con 0x7fe14c070480 2024-04-26T23:05:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.123+0000 7f928be00640 1 -- 172.21.15.148:0/683519732 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800c6070 con 0x7f928c0c8510 2024-04-26T23:05:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f928be00640 1 -- 172.21.15.148:0/683519732 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92800b99e0 con 0x7f928c0c8510 2024-04-26T23:05:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f928be00640 1 -- 172.21.15.148:0/683519732 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800b9db0 con 0x7f928c0c8510 2024-04-26T23:05:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7fe14be00640 1 -- 172.21.15.148:0/3176799109 >> v1:172.21.15.157:6789/0 conn(0x7fe14c070480 legacy=0x7fe14c072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7fe14be00640 1 -- 172.21.15.148:0/3176799109 >> v1:172.21.15.148:6789/0 conn(0x7fe14c06f460 legacy=0x7fe14c1626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2500043d0 0x7ff2500048b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009ac0 tx=0x7ff25c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79db286c5f48027 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 -- 172.21.15.148:0/683519732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 msgr2=0x7f928c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 --2- 172.21.15.148:0/683519732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9280009870 tx=0x7f928002fd40 comp rx=0 tx=0).stop 2024-04-26T23:05:10.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b2070 con 0x7ff2500043d0 2024-04-26T23:05:10.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f321be00640 1 Processor -- start 2024-04-26T23:05:10.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a5680 con 0x7ff2500043d0 2024-04-26T23:05:10.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7fe14be00640 1 -- 172.21.15.148:0/3176799109 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c0c7c90 con 0x7fe14c152000 2024-04-26T23:05:10.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f321be00640 1 -- start start 2024-04-26T23:05:10.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 -- 172.21.15.148:0/683519732 shutdown_connections 2024-04-26T23:05:10.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 --2- 172.21.15.148:0/683519732 >> v2:172.21.15.148:3300/0 conn(0x7f928c0746d0 0x7f928c15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 --2- 172.21.15.148:0/683519732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0c8510 0x7f928c15d3a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 -- 172.21.15.148:0/683519732 >> 172.21.15.148:0/683519732 conn(0x7f928c06e620 msgr2=0x7f928c06ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff26a000640 1 -- 172.21.15.148:0/2696335912 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c009690 con 0x7ff2500043d0 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff270a00640 1 -- 172.21.15.148:0/2696335912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2500043d0 msgr2=0x7ff2500048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff270a00640 1 --2- 172.21.15.148:0/2696335912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2500043d0 0x7ff2500048b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009ac0 tx=0x7ff25c01ca30 comp rx=0 tx=0).stop 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7ff26be00640 1 -- 172.21.15.148:0/2696335912 reap_dead start 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 -- 172.21.15.148:0/683519732 shutdown_connections 2024-04-26T23:05:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.127+0000 7f9294200640 1 -- 172.21.15.148:0/683519732 wait complete. 2024-04-26T23:05:10.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f321c155ff0 0x7f321c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7ff270a00640 1 -- 172.21.15.148:0/2696335912 shutdown_connections 2024-04-26T23:05:10.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7ff270a00640 1 -- 172.21.15.148:0/2696335912 >> 172.21.15.148:0/2696335912 conn(0x7ff26c06e420 msgr2=0x7ff26c06e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9294200640 1 Processor -- start 2024-04-26T23:05:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f321c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9294200640 1 -- start start 2024-04-26T23:05:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321be00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c15ff20 con 0x7f321c071650 2024-04-26T23:05:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7ff270a00640 1 -- 172.21.15.148:0/2696335912 shutdown_connections 2024-04-26T23:05:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7ff270a00640 1 -- 172.21.15.148:0/2696335912 wait complete. 2024-04-26T23:05:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321be00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f321c160200 con 0x7f321c155ff0 2024-04-26T23:05:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f321c0ca6a0 con 0x7f321c0cac70 2024-04-26T23:05:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f3212000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f321c071650 0x7f321c06d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41178/0 (socket says 172.21.15.148:41178) 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f3212000640 1 -- 172.21.15.148:0/284299200 learned_addr learned my addr 172.21.15.148:0/284299200 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546905693 0 0) 0x7f321c15ff20 con 0x7f321c071650 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3200003530 con 0x7f321c071650 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321aa00640 1 --2- 172.21.15.148:0/284299200 >> v2:172.21.15.157:3300/0 conn(0x7f321c155ff0 0x7f321c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7fe14be00640 1 --2- 172.21.15.148:0/3176799109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c152000 0x7fe14c1587c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007360 tx=0x7fe13c01f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a40fc5bf81a9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9294200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7fe14aa00640 1 -- 172.21.15.148:0/3176799109 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138001680 con 0x7fe14c152000 2024-04-26T23:05:10.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7fe14aa00640 1 -- 172.21.15.148:0/3176799109 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c0089e0 con 0x7fe14c152000 2024-04-26T23:05:10.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7fe14aa00640 1 -- 172.21.15.148:0/3176799109 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c008db0 con 0x7fe14c152000 2024-04-26T23:05:10.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9294200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c152000 msgr2=0x7fe14c1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 --2- 172.21.15.148:0/3176799109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c152000 0x7fe14c1587c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007360 tx=0x7fe13c01f9e0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9294200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9291800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9291800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58296/0 (socket says 172.21.15.148:58296) 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9290e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9290e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55730/0 (socket says 172.21.15.148:55730) 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9292200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f9292200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45106/0 (socket says 172.21.15.148:45106) 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 -- 172.21.15.148:0/3845908774 learned_addr learned my addr 172.21.15.148:0/3845908774 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f928c0cb550 con 0x7f928c154010 2024-04-26T23:05:10.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 Processor -- start 2024-04-26T23:05:10.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f928c0c96e0 con 0x7f928c0c8510 2024-04-26T23:05:10.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 -- start start 2024-04-26T23:05:10.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f928c072a30 con 0x7f928c0746d0 2024-04-26T23:05:10.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321b400640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f321c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 546549062 0 0) 0x7f3200003530 con 0x7f321c071650 2024-04-26T23:05:10.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 msgr2=0x7f321c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f321c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 >> v2:172.21.15.157:3300/0 conn(0x7f321c155ff0 msgr2=0x7f321c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 --2- 172.21.15.148:0/284299200 >> v2:172.21.15.157:3300/0 conn(0x7f321c155ff0 0x7f321c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c0ca980 con 0x7f321c071650 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f3204001680 con 0x7f321c071650 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 >> v1:172.21.15.157:6789/0 conn(0x7f321c071650 legacy=0x7f321c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32000039c0 0x7f3200003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f32000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f321c160200 con 0x7f32000039c0 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0ca6a0 con 0x7f3200004810 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f320000bab0 con 0x7f321c0cac70 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321aa00640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32000039c0 0x7f3200003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f3212000640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.131+0000 7f321b400640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f32000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f321aa00640 1 -- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 msgr2=0x7f32000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f321aa00640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0cac70 0x7f32000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f321aa00640 1 -- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3200004810 msgr2=0x7f3200004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f321aa00640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f321aa00640 1 -- 172.21.15.148:0/284299200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3200003530 con 0x7f32000039c0 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 -- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 msgr2=0x7f928c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 -- 172.21.15.148:0/3845908774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 msgr2=0x7f928c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9291800640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c0c5d80 con 0x7f928c0746d0 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9292200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7f9290e00640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 shutdown_connections 2024-04-26T23:05:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 --2- 172.21.15.148:0/3176799109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c152000 0x7fe14c1587c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 >> 172.21.15.148:0/3176799109 conn(0x7fe14c0c9d10 msgr2=0x7fe14c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 0x7ff26c13ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff26b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff26c15b420 0x7ff26c15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0c83f0 con 0x7ff26c152df0 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff26b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45118/0 (socket says 172.21.15.148:45118) 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff26b400640 1 -- 172.21.15.148:0/2718677358 learned_addr learned my addr 172.21.15.148:0/2718677358 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0c9e10 con 0x7ff26c15b420 2024-04-26T23:05:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 shutdown_connections 2024-04-26T23:05:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7fe152c00640 1 -- 172.21.15.148:0/3176799109 wait complete. 2024-04-26T23:05:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.135+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c0c86d0 con 0x7ff26c13ead0 2024-04-26T23:05:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26be00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff26c15b420 0x7ff26c15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 0x7ff26c13ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f9291800640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f927800b420 tx=0x7f927800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 -- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 msgr2=0x7ff26c13ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 0x7ff26c13ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 -- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff26c15b420 msgr2=0x7ff26c15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff26c15b420 0x7ff26c15b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c156910 con 0x7ff26c152df0 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 0x7ff26c13ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff26b400640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff258011850 tx=0x7ff258011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258019070 con 0x7ff26c152df0 2024-04-26T23:05:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f321aa00640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32000039c0 0x7f3200003de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f320c009ba0 tx=0x7f320c03ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f6d6250af2a10d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258004240 con 0x7ff26c152df0 2024-04-26T23:05:10.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258019070 con 0x7ff26c152df0 2024-04-26T23:05:10.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c153960 con 0x7ff26c152df0 2024-04-26T23:05:10.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c0cc200 con 0x7ff26c152df0 2024-04-26T23:05:10.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0d4070 con 0x7f32000039c0 2024-04-26T23:05:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7fe152c00640 1 Processor -- start 2024-04-26T23:05:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7fe152c00640 1 -- start start 2024-04-26T23:05:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c15bde0 con 0x7ff26c152df0 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c0c7c40 con 0x7f32000039c0 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f321be00640 1 -- 172.21.15.148:0/284299200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32000039c0 msgr2=0x7f3200003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f321a000640 1 -- 172.21.15.148:0/284299200 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0d4070 con 0x7f32000039c0 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321be00640 1 --2- 172.21.15.148:0/284299200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32000039c0 0x7f3200003de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f320c009ba0 tx=0x7f320c03ee90 comp rx=0 tx=0).stop 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321b400640 1 -- 172.21.15.148:0/284299200 reap_dead start 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321be00640 1 -- 172.21.15.148:0/284299200 shutdown_connections 2024-04-26T23:05:10.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278011830 con 0x7f928c0746d0 2024-04-26T23:05:10.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9278016070 con 0x7f928c0746d0 2024-04-26T23:05:10.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.139+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278011c30 con 0x7f928c0746d0 2024-04-26T23:05:10.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c15c5f0 con 0x7f928c0746d0 2024-04-26T23:05:10.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c14a8e0 con 0x7f928c0746d0 2024-04-26T23:05:10.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321be00640 1 -- 172.21.15.148:0/284299200 >> 172.21.15.148:0/284299200 conn(0x7f321c06c980 msgr2=0x7f321c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c06f460 0x7fe14c142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 0x7fe14c1ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 0x7fe14c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0c8a50 con 0x7fe14c06f460 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0c8250 con 0x7fe14c070480 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe152c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c0c8bd0 con 0x7fe14c152000 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe14b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 0x7fe14c1ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 0x7fe14c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe14b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 0x7fe14c1ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55736/0 (socket says 172.21.15.148:55736) 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe14b400640 1 -- 172.21.15.148:0/2657673399 learned_addr learned my addr 172.21.15.148:0/2657673399 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321be00640 1 -- 172.21.15.148:0/284299200 shutdown_connections 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7f321be00640 1 -- 172.21.15.148:0/284299200 wait complete. 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f321be00640 1 Processor -- start 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe14be00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c06f460 0x7fe14c142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 -- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 msgr2=0x7fe14c1ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 0x7fe14c1ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 -- 172.21.15.148:0/2657673399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c06f460 msgr2=0x7fe14c142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c06f460 0x7fe14c142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 -- 172.21.15.148:0/2657673399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c153430 con 0x7fe14c152000 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7fe150c00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 0x7fe14c150ec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c7b0 tx=0x7fe14400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.143+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff25801c070 con 0x7ff26c152df0 2024-04-26T23:05:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f321be00640 1 -- start start 2024-04-26T23:05:10.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7ff263400640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 0x7ff24c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff258086c00 con 0x7ff26c152df0 2024-04-26T23:05:10.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 0x7ff24c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144016020 con 0x7fe14c152000 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14400aa70 con 0x7fe14c152000 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ce60 con 0x7fe14c152000 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7fe152c00640 1 -- 172.21.15.148:0/2657673399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c1f1c70 con 0x7fe14c152000 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7fe152c00640 1 -- 172.21.15.148:0/2657673399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1f0eb0 con 0x7fe14c152000 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f927801b460 con 0x7f928c0746d0 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f9289600640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 0x7f926c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92680052a0 con 0x7f928c0746d0 2024-04-26T23:05:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7f9290e00640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 0x7f926c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.147+0000 7ff26aa00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 0x7ff24c06aa40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0af000 tx=0x7ff25c0046d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9278054590 con 0x7f928c0746d0 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0c9a40 0x7f321c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f321c0cf4c0 0x7f321c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f321c156550 con 0x7f321c0cf4c0 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1563d0 con 0x7f321c1494b0 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f321c166650 con 0x7f321c0c9a40 2024-04-26T23:05:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f9290e00640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 0x7f926c06a890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92800c3000 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55740/0 (socket says 172.21.15.148:55740) 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 -- 172.21.15.148:0/2323917164 learned_addr learned my addr 172.21.15.148:0/2323917164 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f3212000640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f321c0cf4c0 0x7f321c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 -- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0c9a40 msgr2=0x7f321c149f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0c9a40 0x7f321c149f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 -- 172.21.15.148:0/2323917164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f321c0cf4c0 msgr2=0x7f321c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f321c0cf4c0 0x7f321c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 -- 172.21.15.148:0/2323917164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c0cfa90 con 0x7f321c1494b0 2024-04-26T23:05:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1200052a0 con 0x7fe14c152000 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321b400640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f321c0c66a0 tx=0x7f321400f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214004440 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3214019070 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214003860 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c0cfd70 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.151+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c14c3a0 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.155+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c0506d0 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.155+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3214012070 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.155+0000 7f3213400640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 0x7f31f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.155+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3214086650 con 0x7f321c1494b0 2024-04-26T23:05:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.155+0000 7f321aa00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 0x7f31f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.159+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff258056790 con 0x7ff26c152df0 2024-04-26T23:05:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.163+0000 7f321aa00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 0x7f31f806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f320c0d1000 tx=0x7f320c00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.163+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9278056bf0 con 0x7f928c0746d0 2024-04-26T23:05:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.167+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe144019020 con 0x7fe14c152000 2024-04-26T23:05:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.167+0000 7fe143e00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 0x7fe12c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.171+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe144087540 con 0x7fe14c152000 2024-04-26T23:05:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.171+0000 7fe14be00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 0x7fe12c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.171+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f32140567a0 con 0x7f321c1494b0 2024-04-26T23:05:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.175+0000 7fe14be00640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 0x7fe12c06a940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0b2000 tx=0x7fe13c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.179+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe144020020 con 0x7fe14c152000 2024-04-26T23:05:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 Processor -- start 2024-04-26T23:05:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 -- start start 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d5006c5e0 0x7f8d500ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 0x7f8d500c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d500c81c0 con 0x7f8d50155920 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f8d50072db0 con 0x7f8d5006c5e0 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d55000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5015ba80 con 0x7f8d5006c9c0 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d4fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8d50155920 0x7f8d5015bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43276/0 (socket says 172.21.15.148:43276) 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d4fe00640 1 -- 172.21.15.148:0/4005152542 learned_addr learned my addr 172.21.15.148:0/4005152542 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.195+0000 7f8d4ea00640 1 --2- 172.21.15.148:0/4005152542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 0x7f8d500c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.199+0000 7f8d4e000640 1 -- 172.21.15.148:0/4005152542 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068881194 0 0) 0x7f8d500c81c0 con 0x7f8d50155920 2024-04-26T23:05:10.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f8d4e000640 1 -- 172.21.15.148:0/4005152542 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d34003530 con 0x7f8d50155920 2024-04-26T23:05:10.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f8d4ea00640 1 -- 172.21.15.148:0/4005152542 >> v2:172.21.15.148:3300/0 conn(0x7f8d5006c5e0 msgr2=0x7f8d500ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f8d4ea00640 1 --2- 172.21.15.148:0/4005152542 >> v2:172.21.15.148:3300/0 conn(0x7f8d5006c5e0 0x7f8d500ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f8d4ea00640 1 -- 172.21.15.148:0/4005152542 >> v1:172.21.15.148:6789/0 conn(0x7f8d50155920 legacy=0x7f8d5015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f8d4ea00640 1 -- 172.21.15.148:0/4005152542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d50073050 con 0x7f8d5006c9c0 2024-04-26T23:05:10.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f6510800640 1 Processor -- start 2024-04-26T23:05:10.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.203+0000 7f6510800640 1 -- start start 2024-04-26T23:05:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f8d4ea00640 1 --2- 172.21.15.148:0/4005152542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 0x7f8d500c7c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d400097c0 tx=0x7f8d4001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4961532c83b3223b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f6510800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f65040dace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f6510800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f65040d4c80 0x7f6504006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f6510800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6504006900 con 0x7f650404b5f0 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f6510800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f65040077f0 con 0x7f65040d4c80 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f6510800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6504006be0 con 0x7f6504050e80 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f8d4e000640 1 -- 172.21.15.148:0/4005152542 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400b5070 con 0x7f8d5006c9c0 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f8d4e000640 1 -- 172.21.15.148:0/4005152542 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d400a8990 con 0x7f8d5006c9c0 2024-04-26T23:05:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f8d4e000640 1 -- 172.21.15.148:0/4005152542 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400a8d60 con 0x7f8d5006c9c0 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f65040dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650de00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f650404b5f0 0x7f65040348f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41194/0 (socket says 172.21.15.148:41194) 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650de00640 1 -- 172.21.15.148:0/1356427395 learned_addr learned my addr 172.21.15.148:0/1356427395 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650ca00640 1 --2- 172.21.15.148:0/1356427395 >> v2:172.21.15.157:3300/0 conn(0x7f65040d4c80 0x7f6504006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650ca00640 1 -- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 msgr2=0x7f65040dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650ca00640 1 --2- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f65040dace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650ca00640 1 -- 172.21.15.148:0/1356427395 >> v1:172.21.15.157:6789/0 conn(0x7f650404b5f0 legacy=0x7f65040348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.207+0000 7f650ca00640 1 -- 172.21.15.148:0/1356427395 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6504006ec0 con 0x7f65040d4c80 2024-04-26T23:05:10.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 -- 172.21.15.148:0/4005152542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 msgr2=0x7f8d500c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 --2- 172.21.15.148:0/4005152542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 0x7f8d500c7c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d400097c0 tx=0x7f8d4001ec90 comp rx=0 tx=0).stop 2024-04-26T23:05:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 -- 172.21.15.148:0/4005152542 shutdown_connections 2024-04-26T23:05:10.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 --2- 172.21.15.148:0/4005152542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d5006c9c0 0x7f8d500c7c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 --2- 172.21.15.148:0/4005152542 >> v2:172.21.15.148:3300/0 conn(0x7f8d5006c5e0 0x7f8d500ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 -- 172.21.15.148:0/4005152542 >> 172.21.15.148:0/4005152542 conn(0x7f8d5006e0a0 msgr2=0x7f8d5006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f650ca00640 1 --2- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65040d4c80 0x7f6504006070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0097c0 tx=0x7f64fc01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f533c2ee5dd3d6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 -- 172.21.15.148:0/4005152542 shutdown_connections 2024-04-26T23:05:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f8d55000640 1 -- 172.21.15.148:0/4005152542 wait complete. 2024-04-26T23:05:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f650f200640 1 -- 172.21.15.148:0/1356427395 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0b0070 con 0x7f65040d4c80 2024-04-26T23:05:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f650f200640 1 -- 172.21.15.148:0/1356427395 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc0ab600 con 0x7f65040d4c80 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f650f200640 1 -- 172.21.15.148:0/1356427395 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0ab9d0 con 0x7f65040d4c80 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f6510800640 1 -- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65040d4c80 msgr2=0x7f6504006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.211+0000 7f6510800640 1 --2- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65040d4c80 0x7f6504006070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0097c0 tx=0x7f64fc01c440 comp rx=0 tx=0).stop 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 -- 172.21.15.148:0/1356427395 shutdown_connections 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 --2- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65040d4c80 0x7f6504006070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 --2- 172.21.15.148:0/1356427395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f65040dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 -- 172.21.15.148:0/1356427395 >> 172.21.15.148:0/1356427395 conn(0x7f6504050360 msgr2=0x7f6504050770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 -- 172.21.15.148:0/1356427395 shutdown_connections 2024-04-26T23:05:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 -- 172.21.15.148:0/1356427395 wait complete. 2024-04-26T23:05:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 Processor -- start 2024-04-26T23:05:10.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 -- start start 2024-04-26T23:05:10.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d5006c9c0 0x7f8d500c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 0x7f8d501e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d500738d0 con 0x7f8d5006c5e0 2024-04-26T23:05:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8d500735f0 con 0x7f8d5006c9c0 2024-04-26T23:05:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d55000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8d500722d0 con 0x7f8d50155920 2024-04-26T23:05:10.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 Processor -- start 2024-04-26T23:05:10.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f6510800640 1 -- start start 2024-04-26T23:05:10.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 0x7f8d501e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45160/0 (socket says 172.21.15.148:45160) 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.215+0000 7f8d4f400640 1 -- 172.21.15.148:0/3632235069 learned_addr learned my addr 172.21.15.148:0/3632235069 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4ea00640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d5006c9c0 0x7f8d500c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 -- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d5006c9c0 msgr2=0x7f8d500c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d5006c9c0 0x7f8d500c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 -- 172.21.15.148:0/3632235069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 msgr2=0x7f8d501505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 -- 172.21.15.148:0/3632235069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5015dab0 con 0x7f8d50155920 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4f400640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d4fe00640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 0x7f8d501e4e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c3c0 tx=0x7f8d3800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f650404b5f0 0x7f6504049a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f6504182230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f650de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f650de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45166/0 (socket says 172.21.15.148:45166) 2024-04-26T23:05:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f650ca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f6504182230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f650de00640 1 -- 172.21.15.148:0/2790682209 learned_addr learned my addr 172.21.15.148:0/2790682209 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f65040065b0 con 0x7f65040d4c80 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f650d400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f650404b5f0 0x7f6504049a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6504007480 con 0x7f650404b5f0 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f6510800640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f65040d50a0 con 0x7f6504050e80 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38017070 con 0x7f8d50155920 2024-04-26T23:05:10.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d38005cf0 con 0x7f8d50155920 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38017070 con 0x7f8d50155920 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.219+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5015dd90 con 0x7f8d50155920 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5015e350 con 0x7f8d50155920 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 -- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 msgr2=0x7f6504182230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f6504182230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 -- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f650404b5f0 msgr2=0x7f6504049a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f650404b5f0 0x7f6504049a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6504035000 con 0x7f65040d4c80 2024-04-26T23:05:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f650de00640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65080519e0 tx=0x7f6508076890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d500506d0 con 0x7f8d50155920 2024-04-26T23:05:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508074040 con 0x7f65040d4c80 2024-04-26T23:05:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6508074200 con 0x7f65040d4c80 2024-04-26T23:05:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508074470 con 0x7f65040d4c80 2024-04-26T23:05:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f6510800640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65040e2d10 con 0x7f65040d4c80 2024-04-26T23:05:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f6510800640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65040e3660 con 0x7f65040d4c80 2024-04-26T23:05:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.223+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d3801a070 con 0x7f8d50155920 2024-04-26T23:05:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.227+0000 7f8d47400640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 0x7f8d2c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.227+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d38085b90 con 0x7f8d50155920 2024-04-26T23:05:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.227+0000 7f8d4f400640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 0x7f8d2c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.227+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6508074610 con 0x7f65040d4c80 2024-04-26T23:05:10.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.227+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6504005570 con 0x7f65040d4c80 2024-04-26T23:05:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.231+0000 7f8d4f400640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 0x7f8d2c06aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007560 tx=0x7f8d48009790 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.231+0000 7f6502000640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 0x7f64ec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.231+0000 7f650d400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 0x7f64ec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.231+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f650810b060 con 0x7f65040d4c80 2024-04-26T23:05:10.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.231+0000 7f650d400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 0x7f64ec06a8c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64f8007a60 tx=0x7f64f8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.235+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f65080d6120 con 0x7f65040d4c80 2024-04-26T23:05:10.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.239+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8d38055690 con 0x7f8d50155920 2024-04-26T23:05:10.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 Processor -- start 2024-04-26T23:05:10.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 -- start start 2024-04-26T23:05:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 0x7fee640c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee640c4b30 con 0x7fee64073230 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fee640c6f60 con 0x7fee6415c070 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.243+0000 7fee6aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fee640c7240 con 0x7fee64152d00 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee68a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee68a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55782/0 (socket says 172.21.15.148:55782) 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee68a00640 1 -- 172.21.15.148:0/1426662777 learned_addr learned my addr 172.21.15.148:0/1426662777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee63e00640 1 --2- 172.21.15.148:0/1426662777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 0x7fee640c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee62a00640 1 -- 172.21.15.148:0/1426662777 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891570277 0 0) 0x7fee640c4b30 con 0x7fee64073230 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee62a00640 1 -- 172.21.15.148:0/1426662777 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee48014540 con 0x7fee64073230 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee63e00640 1 -- 172.21.15.148:0/1426662777 >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 msgr2=0x7fee6415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee63e00640 1 --2- 172.21.15.148:0/1426662777 >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee63e00640 1 -- 172.21.15.148:0/1426662777 >> v1:172.21.15.148:6789/0 conn(0x7fee64073230 legacy=0x7fee64073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee63e00640 1 -- 172.21.15.148:0/1426662777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee640c7520 con 0x7fee64152d00 2024-04-26T23:05:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.247+0000 7fee68a00640 1 --2- 172.21.15.148:0/1426662777 >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:10.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fdb9f800640 1 Processor -- start 2024-04-26T23:05:10.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fdb9f800640 1 -- start start 2024-04-26T23:05:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fee63e00640 1 --2- 172.21.15.148:0/1426662777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 0x7fee640c97d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91b3991b057c964 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fee62a00640 1 -- 172.21.15.148:0/1426662777 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee500b0070 con 0x7fee64152d00 2024-04-26T23:05:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fee62a00640 1 -- 172.21.15.148:0/1426662777 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee500ab600 con 0x7fee64152d00 2024-04-26T23:05:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.251+0000 7fee62a00640 1 -- 172.21.15.148:0/1426662777 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab9d0 con 0x7fee64152d00 2024-04-26T23:05:10.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 -- 172.21.15.148:0/1426662777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 msgr2=0x7fee640c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 --2- 172.21.15.148:0/1426662777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 0x7fee640c97d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c4e0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb9f800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb98070da0 0x7fdb98071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 -- 172.21.15.148:0/1426662777 shutdown_connections 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 --2- 172.21.15.148:0/1426662777 >> v2:172.21.15.157:3300/0 conn(0x7fee6415c070 0x7fee6415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 --2- 172.21.15.148:0/1426662777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64152d00 0x7fee640c97d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 -- 172.21.15.148:0/1426662777 >> 172.21.15.148:0/1426662777 conn(0x7fee640c9d10 msgr2=0x7fee640ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 -- 172.21.15.148:0/1426662777 shutdown_connections 2024-04-26T23:05:10.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fee6aa00640 1 -- 172.21.15.148:0/1426662777 wait complete. 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdb980c9520 0x7fdb9815c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41208/0 (socket says 172.21.15.148:41208) 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97e00640 1 -- 172.21.15.148:0/1343020877 learned_addr learned my addr 172.21.15.148:0/1343020877 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb980c8e50 con 0x7fdb9815c770 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb98160290 con 0x7fdb980c9520 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb980c9110 con 0x7fdb98070da0 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367883964 0 0) 0x7fdb98160290 con 0x7fdb980c9520 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb78003530 con 0x7fdb980c9520 2024-04-26T23:05:10.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002170389 0 0) 0x7fdb78003530 con 0x7fdb980c9520 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb98070da0 msgr2=0x7fdb98071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb98070da0 0x7fdb98071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 >> v1:172.21.15.148:6789/0 conn(0x7fdb9815c770 legacy=0x7fdb98166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980c9d70 con 0x7fdb980c9520 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fdb88001680 con 0x7fdb980c9520 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 >> v1:172.21.15.157:6789/0 conn(0x7fdb980c9520 legacy=0x7fdb9815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780039c0 0x7fdb78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb78004810 0x7fdb78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb780052f0 0x7fdb7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980c9110 con 0x7fdb780039c0 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7800c150 con 0x7fdb78004810 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 Processor -- start 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7800c350 con 0x7fdb780052f0 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb9d800640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb780052f0 0x7fdb7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.255+0000 7fdb97e00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb78004810 0x7fdb78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 -- start start 2024-04-26T23:05:10.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb97e00640 1 -- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb780052f0 msgr2=0x7fdb7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb97e00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb780052f0 0x7fdb7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb97e00640 1 -- 172.21.15.148:0/1343020877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780039c0 msgr2=0x7fdb78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:10.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb9ce00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780039c0 0x7fdb78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64073230 0x7fee64142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 0x7fee6413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 0x7fee6413f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee68a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 0x7fee6413f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee68a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 0x7fee6413f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45192/0 (socket says 172.21.15.148:45192) 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 0x7fee6413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee68a00640 1 -- 172.21.15.148:0/4176138463 learned_addr learned my addr 172.21.15.148:0/4176138463 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee6415cf70 con 0x7fee6415c070 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fee6415cdf0 con 0x7fee64152d00 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee6aa00640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fee64070500 con 0x7fee64073230 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb97e00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780039c0 0x7fdb78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb97e00640 1 -- 172.21.15.148:0/1343020877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980c9d70 con 0x7fdb78004810 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb9d800640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb780052f0 0x7fdb7800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fdb9ce00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780039c0 0x7fdb78003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 -- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64073230 msgr2=0x7fee64142550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64073230 0x7fee64142550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 -- 172.21.15.148:0/4176138463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 msgr2=0x7fee6413f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 0x7fee6413f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.259+0000 7fee63400640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee640cc670 con 0x7fee64152d00 2024-04-26T23:05:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee63400640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 0x7fee6413ec90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c460 tx=0x7fee5400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54017070 con 0x7fee64152d00 2024-04-26T23:05:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee540052d0 con 0x7fee64152d00 2024-04-26T23:05:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54003840 con 0x7fee64152d00 2024-04-26T23:05:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee6aa00640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee64143250 con 0x7fee64152d00 2024-04-26T23:05:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fee6aa00640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee64143810 con 0x7fee64152d00 2024-04-26T23:05:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fdb97e00640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb78004810 0x7fdb78004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c210 tx=0x7fdb8801ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff5cd538522cc80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88007d10 con 0x7fdb78004810 2024-04-26T23:05:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.263+0000 7fdb97400640 1 -- 172.21.15.148:0/1343020877 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb880a9070 con 0x7fdb78004810 2024-04-26T23:05:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee64077c20 con 0x7fee64152d00 2024-04-26T23:05:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb78004810 msgr2=0x7fdb78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 --2- 172.21.15.148:0/1343020877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb78004810 0x7fdb78004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c210 tx=0x7fdb8801ccc0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9d800640 1 -- 172.21.15.148:0/1343020877 reap_dead start 2024-04-26T23:05:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee5401a070 con 0x7fee64152d00 2024-04-26T23:05:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 shutdown_connections 2024-04-26T23:05:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 >> 172.21.15.148:0/1343020877 conn(0x7fdb980ce2c0 msgr2=0x7fdb980ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fee5be00640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 0x7fee4406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 shutdown_connections 2024-04-26T23:05:10.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fee54085fe0 con 0x7fee64152d00 2024-04-26T23:05:10.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fee63e00640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 0x7fee4406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.267+0000 7fdb9f800640 1 -- 172.21.15.148:0/1343020877 wait complete. 2024-04-26T23:05:10.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fee63e00640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 0x7fee4406a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee64068e70 tx=0x7fee500ad040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 Processor -- start 2024-04-26T23:05:10.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 -- start start 2024-04-26T23:05:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 0x7fdb9806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 0x7fdb9814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb980cd290 0x7fdb9814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdb98168910 con 0x7fdb980cd290 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdb98168790 con 0x7fdb9814d090 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.271+0000 7fdb9f800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdb98168a90 con 0x7fdb78004810 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 0x7fdb9806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 0x7fdb9814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 0x7fdb9814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55818/0 (socket says 172.21.15.148:55818) 2024-04-26T23:05:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb97e00640 1 -- 172.21.15.148:0/4228460690 learned_addr learned my addr 172.21.15.148:0/4228460690 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9d800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb980cd290 0x7fdb9814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 -- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 msgr2=0x7fdb9814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 0x7fdb9814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 -- 172.21.15.148:0/4228460690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb980cd290 msgr2=0x7fdb9814a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb980cd290 0x7fdb9814a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 -- 172.21.15.148:0/4228460690 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980cdc00 con 0x7fdb78004810 2024-04-26T23:05:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9ce00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 0x7fdb9806cff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000c540 tx=0x7fdb8000ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80015070 con 0x7fdb78004810 2024-04-26T23:05:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb80011820 con 0x7fdb78004810 2024-04-26T23:05:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80011c10 con 0x7fdb78004810 2024-04-26T23:05:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb980c1520 con 0x7fdb78004810 2024-04-26T23:05:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.275+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb980cc400 con 0x7fdb78004810 2024-04-26T23:05:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.279+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb980cc220 con 0x7fdb78004810 2024-04-26T23:05:10.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.283+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee54005480 con 0x7fee64152d00 2024-04-26T23:05:10.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.283+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb80018070 con 0x7fdb78004810 2024-04-26T23:05:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.287+0000 7fdb94c00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 0x7fdb7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.287+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdb80054700 con 0x7fdb78004810 2024-04-26T23:05:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.287+0000 7fdb97e00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 0x7fdb7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.287+0000 7fdb97e00640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 0x7fdb7406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb8801cd00 tx=0x7fdb880a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:10.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.299+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb980cc220 con 0x7fdb78004810 2024-04-26T23:05:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.479+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff26c0506d0 con 0x7ff26c152df0 2024-04-26T23:05:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.483+0000 7ff263400640 1 -- 172.21.15.148:0/2718677358 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff25805aa90 con 0x7ff26c152df0 2024-04-26T23:05:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.483+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 msgr2=0x7ff24c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.483+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 0x7ff24c06aa40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0af000 tx=0x7ff25c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.483+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 msgr2=0x7ff26c1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.483+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff258011850 tx=0x7ff258011d10 comp rx=0 tx=0).stop 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 shutdown_connections 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff24c068580 0x7ff24c06aa40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff26c15b420 0x7ff26c15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff26c13ead0 0x7ff26c13ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 --2- 172.21.15.148:0/2718677358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff26c152df0 0x7ff26c1531d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 >> 172.21.15.148:0/2718677358 conn(0x7ff26c06e420 msgr2=0x7ff26c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 shutdown_connections 2024-04-26T23:05:10.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.487+0000 7ff270a00640 1 -- 172.21.15.148:0/2718677358 wait complete. 2024-04-26T23:05:10.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.515+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9268005860 con 0x7f928c0746d0 2024-04-26T23:05:10.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.515+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe120005860 con 0x7fe14c152000 2024-04-26T23:05:10.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.515+0000 7f9289600640 1 -- 172.21.15.148:0/3845908774 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92780564f0 con 0x7f928c0746d0 2024-04-26T23:05:10.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-26T23:05:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:10.521 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:10.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe143e00640 1 -- 172.21.15.148:0/2657673399 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe144057710 con 0x7fe14c152000 2024-04-26T23:05:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:55834574856 2024-04-26T23:05:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f321c06ed10 con 0x7f321c1494b0 2024-04-26T23:05:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 msgr2=0x7f926c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 0x7f926c06a890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92800c3000 tx=0x7f9280008040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 msgr2=0x7f928c0c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f927800b420 tx=0x7f927800b8e0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 shutdown_connections 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f926c0683d0 0x7f926c06a890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f928c154010 0x7f928c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c0c8510 0x7f928c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 --2- 172.21.15.148:0/3845908774 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0746d0 0x7f928c0c5840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 >> 172.21.15.148:0/3845908774 conn(0x7f928c06e620 msgr2=0x7f928c1523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f3213400640 1 -- 172.21.15.148:0/2323917164 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32140560a0 con 0x7f321c1494b0 2024-04-26T23:05:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 shutdown_connections 2024-04-26T23:05:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:10.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7f9294200640 1 -- 172.21.15.148:0/3845908774 wait complete. 2024-04-26T23:05:10.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 msgr2=0x7fe12c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 0x7fe12c06a940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0b2000 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 msgr2=0x7fe14c150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 0x7fe14c150ec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c7b0 tx=0x7fe14400cc70 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 shutdown_connections 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe12c068480 0x7fe12c06a940 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0b2000 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe14c152000 0x7fe14c150ec0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe14c070480 0x7fe14c1ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 --2- 172.21.15.148:0/2657673399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c06f460 0x7fe14c142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.519+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 >> 172.21.15.148:0/2657673399 conn(0x7fe14c0c9d10 msgr2=0x7fe14c0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 shutdown_connections 2024-04-26T23:05:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7fe141600640 1 -- 172.21.15.148:0/2657673399 wait complete. 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 msgr2=0x7f31f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 0x7f31f806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f320c0d1000 tx=0x7f320c00b040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 msgr2=0x7f321c08d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f321c0c66a0 tx=0x7f321400f8a0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 shutdown_connections 2024-04-26T23:05:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f31f80683b0 0x7f31f806a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f321c1494b0 0x7f321c08d2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f321c0cf4c0 0x7f321c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 --2- 172.21.15.148:0/2323917164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f321c0c9a40 0x7f321c149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 >> 172.21.15.148:0/2323917164 conn(0x7f321c06c980 msgr2=0x7f321c0c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 shutdown_connections 2024-04-26T23:05:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.523+0000 7f321be00640 1 -- 172.21.15.148:0/2323917164 wait complete. 2024-04-26T23:05:10.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.551+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8d500cab20 con 0x7f8d50155920 2024-04-26T23:05:10.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.551+0000 7f8d47400640 1 -- 172.21.15.148:0/3632235069 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d38059990 con 0x7f8d50155920 2024-04-26T23:05:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:10.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.555+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 msgr2=0x7f8d2c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.555+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 0x7f8d2c06aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007560 tx=0x7f8d48009790 comp rx=0 tx=0).stop 2024-04-26T23:05:10.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.555+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 msgr2=0x7f8d501e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.555+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 0x7f8d501e4e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c3c0 tx=0x7f8d3800c880 comp rx=0 tx=0).stop 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 shutdown_connections 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8d2c068580 0x7f8d2c06aa40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8d50155920 0x7f8d501e4e70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d5006c9c0 0x7f8d500c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 --2- 172.21.15.148:0/3632235069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5006c5e0 0x7f8d501505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 >> 172.21.15.148:0/3632235069 conn(0x7f8d5006e0a0 msgr2=0x7f8d5015a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 shutdown_connections 2024-04-26T23:05:10.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.559+0000 7f8d55000640 1 -- 172.21.15.148:0/3632235069 wait complete. 2024-04-26T23:05:10.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-26T23:05:10.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-26T23:05:10.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-26T23:05:10.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.563+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f65040473b0 con 0x7f65040d4c80 2024-04-26T23:05:10.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f6502000640 1 -- 172.21.15.148:0/2790682209 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65080da420 con 0x7f65040d4c80 2024-04-26T23:05:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 msgr2=0x7f64ec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 0x7f64ec06a8c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64f8007a60 tx=0x7f64f8008040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 msgr2=0x7f6504182770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65080519e0 tx=0x7f6508076890 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 shutdown_connections 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f64ec068400 0x7f64ec06a8c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65040d4c80 0x7f6504182770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6504050e80 0x7f6504182230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 --2- 172.21.15.148:0/2790682209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f650404b5f0 0x7f6504049a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 >> 172.21.15.148:0/2790682209 conn(0x7f6504050360 msgr2=0x7f65040348f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 shutdown_connections 2024-04-26T23:05:10.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.567+0000 7f64f7400640 1 -- 172.21.15.148:0/2790682209 wait complete. 2024-04-26T23:05:10.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-26T23:05:10.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-04-26T23:05:10.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fee64159a20 con 0x7fee64152d00 2024-04-26T23:05:10.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee5be00640 1 -- 172.21.15.148:0/4176138463 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee54055ca0 con 0x7fee64152d00 2024-04-26T23:05:10.595 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 msgr2=0x7fee4406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 0x7fee4406a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee64068e70 tx=0x7fee500ad040 comp rx=0 tx=0).stop 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 msgr2=0x7fee6413ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.591+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 0x7fee6413ec90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c460 tx=0x7fee5400c920 comp rx=0 tx=0).stop 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 shutdown_connections 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fee44068400 0x7fee4406a8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6415c070 0x7fee6413f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee64152d00 0x7fee6413ec90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 --2- 172.21.15.148:0/4176138463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee64073230 0x7fee64142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 >> 172.21.15.148:0/4176138463 conn(0x7fee640c9d10 msgr2=0x7fee6414a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 shutdown_connections 2024-04-26T23:05:10.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.595+0000 7fee59600640 1 -- 172.21.15.148:0/4176138463 wait complete. 2024-04-26T23:05:10.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdb98077c20 con 0x7fdb78004810 2024-04-26T23:05:10.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb94c00640 1 -- 172.21.15.148:0/4228460690 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdb80056660 con 0x7fdb78004810 2024-04-26T23:05:10.602 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 msgr2=0x7fdb7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 0x7fdb7406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb8801cd00 tx=0x7fdb880a7070 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 msgr2=0x7fdb9806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 0x7fdb9806cff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000c540 tx=0x7fdb8000ca00 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 shutdown_connections 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdb74068380 0x7fdb7406a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb980cd290 0x7fdb9814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb9814d090 0x7fdb9814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 --2- 172.21.15.148:0/4228460690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdb78004810 0x7fdb9806cff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 >> 172.21.15.148:0/4228460690 conn(0x7fdb980ce2c0 msgr2=0x7fdb98150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:10.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 shutdown_connections 2024-04-26T23:05:10.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:10.599+0000 7fdb9f800640 1 -- 172.21.15.148:0/4228460690 wait complete. 2024-04-26T23:05:10.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-04-26T23:05:10.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-04-26T23:05:11.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:05:11.564 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:05:11.567 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:05:11.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:05:11.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:05:11.620 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:05:11.626 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:05:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.719+0000 7fed60a00640 1 Processor -- start 2024-04-26T23:05:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 -- start start 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fed5c0ccc10 0x7fed5c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed5c164350 0x7fed5c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c06e3e0 con 0x7fed5c15a530 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c163ec0 con 0x7fed5c164350 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed60a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c06e6c0 con 0x7fed5c0ccc10 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed59e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fed5c15a530 0x7fed5c160070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43294/0 (socket says 172.21.15.148:43294) 2024-04-26T23:05:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed59e00640 1 -- 172.21.15.148:0/528764464 learned_addr learned my addr 172.21.15.148:0/528764464 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed5a800640 1 --2- 172.21.15.148:0/528764464 >> v2:172.21.15.148:3300/0 conn(0x7fed5c164350 0x7fed5c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed5a800640 1 -- 172.21.15.148:0/528764464 >> v2:172.21.15.157:3300/0 conn(0x7fed5c0ccc10 msgr2=0x7fed5c06d490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed5a800640 1 --2- 172.21.15.148:0/528764464 >> v2:172.21.15.157:3300/0 conn(0x7fed5c0ccc10 0x7fed5c06d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed5a800640 1 -- 172.21.15.148:0/528764464 >> v1:172.21.15.148:6789/0 conn(0x7fed5c15a530 legacy=0x7fed5c160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.723+0000 7fed5a800640 1 -- 172.21.15.148:0/528764464 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c163870 con 0x7fed5c164350 2024-04-26T23:05:11.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed5a800640 1 --2- 172.21.15.148:0/528764464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c164350 0x7fed5c06ff00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06f500 tx=0x7fed5401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e10ed943a79c60c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed58a00640 1 -- 172.21.15.148:0/528764464 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed540b4070 con 0x7fed5c164350 2024-04-26T23:05:11.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed58a00640 1 -- 172.21.15.148:0/528764464 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed540af600 con 0x7fed5c164350 2024-04-26T23:05:11.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed58a00640 1 -- 172.21.15.148:0/528764464 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed540af9d0 con 0x7fed5c164350 2024-04-26T23:05:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed60a00640 1 -- 172.21.15.148:0/528764464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c164350 msgr2=0x7fed5c06ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.727+0000 7fed60a00640 1 --2- 172.21.15.148:0/528764464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c164350 0x7fed5c06ff00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06f500 tx=0x7fed5401f130 comp rx=0 tx=0).stop 2024-04-26T23:05:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 -- 172.21.15.148:0/528764464 shutdown_connections 2024-04-26T23:05:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 --2- 172.21.15.148:0/528764464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c164350 0x7fed5c06ff00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 --2- 172.21.15.148:0/528764464 >> v2:172.21.15.157:3300/0 conn(0x7fed5c0ccc10 0x7fed5c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 -- 172.21.15.148:0/528764464 >> 172.21.15.148:0/528764464 conn(0x7fed5c068140 msgr2=0x7fed5c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 -- 172.21.15.148:0/528764464 shutdown_connections 2024-04-26T23:05:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 -- 172.21.15.148:0/528764464 wait complete. 2024-04-26T23:05:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 Processor -- start 2024-04-26T23:05:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 -- start start 2024-04-26T23:05:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 0x7fed5c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c15a530 0x7fed5c1f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.731+0000 7fed60a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 0x7fed5c070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed59e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 0x7fed5c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed59e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 0x7fed5c15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55832/0 (socket says 172.21.15.148:55832) 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed60a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c06dea0 con 0x7fed5c15a530 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed59e00640 1 -- 172.21.15.148:0/2135609719 learned_addr learned my addr 172.21.15.148:0/2135609719 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0c9f10 con 0x7fed5c0ccc10 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c06e020 con 0x7fed5c164350 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed59400640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c15a530 0x7fed5c1f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 0x7fed5c070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 -- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 msgr2=0x7fed5c15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 0x7fed5c15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 -- 172.21.15.148:0/2135609719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c15a530 msgr2=0x7fed5c1f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c15a530 0x7fed5c1f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c1f71a0 con 0x7fed5c164350 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed5a800640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 0x7fed5c070110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed540af000 tx=0x7fed5401bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed540b4040 con 0x7fed5c164350 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c0cd320 con 0x7fed5c164350 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed540af400 con 0x7fed5c164350 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed540ba680 con 0x7fed5c164350 2024-04-26T23:05:11.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.735+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c0cd5c0 con 0x7fed5c164350 2024-04-26T23:05:11.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.739+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c077c20 con 0x7fed5c164350 2024-04-26T23:05:11.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.743+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed540c4020 con 0x7fed5c164350 2024-04-26T23:05:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.743+0000 7fed52000640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 0x7fed3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.743+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fed54124b50 con 0x7fed5c164350 2024-04-26T23:05:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.743+0000 7fed59e00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 0x7fed3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.743+0000 7fed59e00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 0x7fed3c06a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007fd0 tx=0x7fed4c007f20 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.751+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed540cb020 con 0x7fed5c164350 2024-04-26T23:05:11.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 Processor -- start 2024-04-26T23:05:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 -- start start 2024-04-26T23:05:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f54380b71d0 0x7f54380cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c8d60 0x7f54380cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f543815ce20 con 0x7f54380cd6d0 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f543815bfc0 con 0x7f54380c8d60 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f543dc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f543815c2a0 con 0x7f54380b71d0 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c8d60 0x7f54380cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c8d60 0x7f54380cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45220/0 (socket says 172.21.15.148:45220) 2024-04-26T23:05:11.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 -- 172.21.15.148:0/1765897918 learned_addr learned my addr 172.21.15.148:0/1765897918 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 -- 172.21.15.148:0/1765897918 >> v2:172.21.15.157:3300/0 conn(0x7f54380b71d0 msgr2=0x7f54380cd190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:05:11.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 --2- 172.21.15.148:0/1765897918 >> v2:172.21.15.157:3300/0 conn(0x7f54380b71d0 0x7f54380cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 -- 172.21.15.148:0/1765897918 >> v1:172.21.15.148:6789/0 conn(0x7f54380cd6d0 legacy=0x7f54380d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5435600640 1 -- 172.21.15.148:0/1765897918 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257697417 0 0) 0x7f543815ce20 con 0x7f54380cd6d0 2024-04-26T23:05:11.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.759+0000 7f5437400640 1 -- 172.21.15.148:0/1765897918 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543815c580 con 0x7f54380c8d60 2024-04-26T23:05:11.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.763+0000 7f2461400640 1 Processor -- start 2024-04-26T23:05:11.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.763+0000 7f2461400640 1 -- start start 2024-04-26T23:05:11.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f5437400640 1 --2- 172.21.15.148:0/1765897918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380cdfb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54380cbbb0 tx=0x7f543001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd35558f1c364b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f5435600640 1 -- 172.21.15.148:0/1765897918 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300b5070 con 0x7f54380c8d60 2024-04-26T23:05:11.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f5435600640 1 -- 172.21.15.148:0/1765897918 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54300a8a30 con 0x7f54380c8d60 2024-04-26T23:05:11.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f5435600640 1 -- 172.21.15.148:0/1765897918 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300a8e00 con 0x7f54380c8d60 2024-04-26T23:05:11.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2461400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f245c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2461400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f245c164350 0x7f245c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2461400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c06e3e0 con 0x7f245c15a530 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2461400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f245c163ec0 con 0x7f245c164350 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2461400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f245c06e6c0 con 0x7f245c0ccc10 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f245c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 -- 172.21.15.148:0/1765897918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 msgr2=0x7f54380cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 --2- 172.21.15.148:0/1765897918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380cdfb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54380cbbb0 tx=0x7f543001ed30 comp rx=0 tx=0).stop 2024-04-26T23:05:11.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f245c06d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:58436/0 (socket says 172.21.15.148:58436) 2024-04-26T23:05:11.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459e00640 1 -- 172.21.15.148:0/10456175 learned_addr learned my addr 172.21.15.148:0/10456175 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f245b200640 1 --2- 172.21.15.148:0/10456175 >> v2:172.21.15.148:3300/0 conn(0x7f245c164350 0x7f245c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 -- 172.21.15.148:0/1765897918 shutdown_connections 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 --2- 172.21.15.148:0/1765897918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380cdfb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 --2- 172.21.15.148:0/1765897918 >> v2:172.21.15.157:3300/0 conn(0x7f54380b71d0 0x7f54380cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 -- 172.21.15.148:0/1765897918 >> 172.21.15.148:0/1765897918 conn(0x7f543806d0d0 msgr2=0x7f543806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 -- 172.21.15.148:0/1765897918 shutdown_connections 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f543dc00640 1 -- 172.21.15.148:0/1765897918 wait complete. 2024-04-26T23:05:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60458280 0 0) 0x7f245c06e3e0 con 0x7f245c15a530 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2440003530 con 0x7f245c15a530 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2358646581 0 0) 0x7f2440003530 con 0x7f245c15a530 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 msgr2=0x7f245c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f245c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 >> v2:172.21.15.148:3300/0 conn(0x7f245c164350 msgr2=0x7f245c06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.767+0000 7f2459400640 1 --2- 172.21.15.148:0/10456175 >> v2:172.21.15.148:3300/0 conn(0x7f245c164350 0x7f245c06ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c163870 con 0x7f245c15a530 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f244c001680 con 0x7f245c15a530 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 >> v1:172.21.15.148:6789/0 conn(0x7f245c15a530 legacy=0x7f245c160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f24400039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f2440004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f245a800640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f24400039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2440004d50 0x7f24400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 Processor -- start 2024-04-26T23:05:11.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f245c163ec0 con 0x7f2440003f40 2024-04-26T23:05:11.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f245c06e6c0 con 0x7f2440004d50 2024-04-26T23:05:11.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 -- start start 2024-04-26T23:05:11.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 0x7f543815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54380b4350 con 0x7f54380c8d60 2024-04-26T23:05:11.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f543815cb40 con 0x7f54380cd6d0 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f244000ba00 con 0x7f245c0ccc10 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f245b200640 1 --2- 172.21.15.148:0/10456175 >> v2:172.21.15.148:3300/0 conn(0x7f245c164350 0x7f245c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f2440004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f245b200640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2440004d50 0x7f24400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 -- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 msgr2=0x7f24400039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c0ccc10 0x7f24400039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 -- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2440004d50 msgr2=0x7f24400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2440004d50 0x7f24400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f2459e00640 1 -- 172.21.15.148:0/10456175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c163870 con 0x7f2440003f40 2024-04-26T23:05:11.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.771+0000 7f543dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f54380d1ce0 con 0x7f543814f3a0 2024-04-26T23:05:11.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5436a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5436000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5436000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55860/0 (socket says 172.21.15.148:55860) 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5436000640 1 -- 172.21.15.148:0/2157557745 learned_addr learned my addr 172.21.15.148:0/2157557745 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 0x7f543815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 -- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 msgr2=0x7f543814db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 -- 172.21.15.148:0/2157557745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 msgr2=0x7f54380c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 -- 172.21.15.148:0/2157557745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438153660 con 0x7f543814f3a0 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5436000640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f5437400640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 0x7f543815b160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54300af000 tx=0x7f543001bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300b5050 con 0x7f543814f3a0 2024-04-26T23:05:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54380c6e80 con 0x7f543814f3a0 2024-04-26T23:05:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54300bf070 con 0x7f543814f3a0 2024-04-26T23:05:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300b0d80 con 0x7f543814f3a0 2024-04-26T23:05:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54380c7440 con 0x7f543814f3a0 2024-04-26T23:05:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f2459e00640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f2440004810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2448009b60 tx=0x7f244801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339c8c67071a0303 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.775+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5438077c20 con 0x7f543814f3a0 2024-04-26T23:05:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480b2070 con 0x7f2440003f40 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24480a56f0 con 0x7f2440003f40 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2459400640 1 -- 172.21.15.148:0/10456175 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448009760 con 0x7f2440003f40 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 -- 172.21.15.148:0/10456175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 msgr2=0x7f2440004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 --2- 172.21.15.148:0/10456175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f2440004810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2448009b60 tx=0x7f244801cb50 comp rx=0 tx=0).stop 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f245b200640 1 -- 172.21.15.148:0/10456175 reap_dead start 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 -- 172.21.15.148:0/10456175 shutdown_connections 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 -- 172.21.15.148:0/10456175 >> 172.21.15.148:0/10456175 conn(0x7f245c068140 msgr2=0x7f245c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 -- 172.21.15.148:0/10456175 shutdown_connections 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f2461400640 1 -- 172.21.15.148:0/10456175 wait complete. 2024-04-26T23:05:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f54300ba440 con 0x7f543814f3a0 2024-04-26T23:05:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.779+0000 7f542ea00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5430123b20 con 0x7f543814f3a0 2024-04-26T23:05:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 Processor -- start 2024-04-26T23:05:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 -- start start 2024-04-26T23:05:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f5436a00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f5436a00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 0x7f541806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5428009fd0 tx=0x7f542800d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f245c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 0x7f245c070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 0x7f245c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f245c06dea0 con 0x7f2440003f40 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0c9f10 con 0x7f245c155a10 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2461400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f245c06e020 con 0x7f245c154570 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f245a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f245c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2459e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 0x7f245c070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2459e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 0x7f245c070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55874/0 (socket says 172.21.15.148:55874) 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f2459e00640 1 -- 172.21.15.148:0/4227519150 learned_addr learned my addr 172.21.15.148:0/4227519150 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f245b200640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 0x7f245c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.783+0000 7f245a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f245c15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45262/0 (socket says 172.21.15.148:45262) 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 -- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 msgr2=0x7f245c070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 0x7f245c070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 -- 172.21.15.148:0/4227519150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 msgr2=0x7f245c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f245c15ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 -- 172.21.15.148:0/4227519150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1e9ed0 con 0x7f245c154570 2024-04-26T23:05:11.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.787+0000 7f245b200640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 0x7f245c1496a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f245c164730 tx=0x7f245400f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245400fdf0 con 0x7f245c154570 2024-04-26T23:05:11.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24540039a0 con 0x7f245c154570 2024-04-26T23:05:11.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454003d90 con 0x7f245c154570 2024-04-26T23:05:11.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5430018890 con 0x7f543814f3a0 2024-04-26T23:05:11.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1ea170 con 0x7f245c154570 2024-04-26T23:05:11.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1f60d0 con 0x7f245c154570 2024-04-26T23:05:11.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.795+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c077c20 con 0x7f245c154570 2024-04-26T23:05:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.799+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f245401f020 con 0x7f245c154570 2024-04-26T23:05:11.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.799+0000 7f2452a00640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 0x7f243c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.799+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2454087c00 con 0x7f245c154570 2024-04-26T23:05:11.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.803+0000 7f245a800640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 0x7f243c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.807+0000 7f245a800640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 0x7f243c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f244c001ec0 tx=0x7f244c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.811+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2454010040 con 0x7f245c154570 2024-04-26T23:05:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.839+0000 7f3370800640 1 Processor -- start 2024-04-26T23:05:11.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.839+0000 7f3370800640 1 -- start start 2024-04-26T23:05:11.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 Processor -- start 2024-04-26T23:05:11.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 -- start start 2024-04-26T23:05:11.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f3370800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 0x7f3368165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f3370800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33680c49e0 con 0x7f3368157250 2024-04-26T23:05:11.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f3370800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33680caf80 con 0x7f33680c44a0 2024-04-26T23:05:11.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f3370800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f33680cbb50 con 0x7f336815d8a0 2024-04-26T23:05:11.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336de00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3368157250 0x7f336806ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43328/0 (socket says 172.21.15.148:43328) 2024-04-26T23:05:11.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336de00640 1 -- 172.21.15.148:0/3326857658 learned_addr learned my addr 172.21.15.148:0/3326857658 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:11.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336e800640 1 --2- 172.21.15.148:0/3326857658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 0x7f3368165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cb806cd50 0x7f1cb80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1cb80c9f90 0x7f1cb815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb8071540 con 0x7f1cb815ca10 2024-04-26T23:05:11.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb80c8bc0 con 0x7f1cb806cd50 2024-04-26T23:05:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbf400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb8071820 con 0x7f1cb80c9f90 2024-04-26T23:05:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cb806cd50 0x7f1cb80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cb806cd50 0x7f1cb80c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45278/0 (socket says 172.21.15.148:45278) 2024-04-26T23:05:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 -- 172.21.15.148:0/2477262039 learned_addr learned my addr 172.21.15.148:0/2477262039 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336ca00640 1 -- 172.21.15.148:0/3326857658 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410517162 0 0) 0x7f33680c49e0 con 0x7f3368157250 2024-04-26T23:05:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336ca00640 1 -- 172.21.15.148:0/3326857658 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3350003530 con 0x7f3368157250 2024-04-26T23:05:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336e800640 1 -- 172.21.15.148:0/3326857658 >> v1:172.21.15.157:6789/0 conn(0x7f33680c44a0 legacy=0x7f336815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336e800640 1 -- 172.21.15.148:0/3326857658 >> v1:172.21.15.148:6789/0 conn(0x7f3368157250 legacy=0x7f336806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f336e800640 1 -- 172.21.15.148:0/3326857658 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680c6450 con 0x7f336815d8a0 2024-04-26T23:05:11.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cb7e00640 1 --2- 172.21.15.148:0/2477262039 >> v2:172.21.15.157:3300/0 conn(0x7f1cb80c9f90 0x7f1cb815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 -- 172.21.15.148:0/2477262039 >> v2:172.21.15.157:3300/0 conn(0x7f1cb80c9f90 msgr2=0x7f1cb815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 --2- 172.21.15.148:0/2477262039 >> v2:172.21.15.157:3300/0 conn(0x7f1cb80c9f90 0x7f1cb815c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 -- 172.21.15.148:0/2477262039 >> v1:172.21.15.148:6789/0 conn(0x7f1cb815ca10 legacy=0x7f1cb8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.843+0000 7f1cbca00640 1 -- 172.21.15.148:0/2477262039 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb8071b00 con 0x7f1cb806cd50 2024-04-26T23:05:11.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.847+0000 7f1cbca00640 1 --2- 172.21.15.148:0/2477262039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb806cd50 0x7f1cb80c8360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8074880 tx=0x7f1cac01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2761c5c86c4f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.847+0000 7f1cb7400640 1 -- 172.21.15.148:0/2477262039 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0b5070 con 0x7f1cb806cd50 2024-04-26T23:05:11.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.847+0000 7f1cb7400640 1 -- 172.21.15.148:0/2477262039 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac0a89d0 con 0x7f1cb806cd50 2024-04-26T23:05:11.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.847+0000 7f1cb7400640 1 -- 172.21.15.148:0/2477262039 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0a8da0 con 0x7f1cb806cd50 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 -- 172.21.15.148:0/2477262039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb806cd50 msgr2=0x7f1cb80c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 --2- 172.21.15.148:0/2477262039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb806cd50 0x7f1cb80c8360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8074880 tx=0x7f1cac01ecf0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 -- 172.21.15.148:0/2477262039 shutdown_connections 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 --2- 172.21.15.148:0/2477262039 >> v2:172.21.15.157:3300/0 conn(0x7f1cb80c9f90 0x7f1cb815c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 --2- 172.21.15.148:0/2477262039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb806cd50 0x7f1cb80c8360 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8074880 tx=0x7f1cac01ecf0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 -- 172.21.15.148:0/2477262039 >> 172.21.15.148:0/2477262039 conn(0x7f1cb80ce220 msgr2=0x7f1cb80ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 -- 172.21.15.148:0/2477262039 shutdown_connections 2024-04-26T23:05:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f1cbf400640 1 -- 172.21.15.148:0/2477262039 wait complete. 2024-04-26T23:05:11.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f336e800640 1 --2- 172.21.15.148:0/3326857658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 0x7f3368165440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3364009dc0 tx=0x7f336401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e01fd67114151fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f336ca00640 1 -- 172.21.15.148:0/3326857658 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640b2070 con 0x7f336815d8a0 2024-04-26T23:05:11.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f336ca00640 1 -- 172.21.15.148:0/3326857658 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33640a58b0 con 0x7f336815d8a0 2024-04-26T23:05:11.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f336ca00640 1 -- 172.21.15.148:0/3326857658 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640a5c80 con 0x7f336815d8a0 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f3370800640 1 -- 172.21.15.148:0/3326857658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 msgr2=0x7f3368165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.851+0000 7f3370800640 1 --2- 172.21.15.148:0/3326857658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 0x7f3368165440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3364009dc0 tx=0x7f336401c900 comp rx=0 tx=0).stop 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 -- 172.21.15.148:0/3326857658 shutdown_connections 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 --2- 172.21.15.148:0/3326857658 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f336815d8a0 0x7f3368165440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 -- 172.21.15.148:0/3326857658 >> 172.21.15.148:0/3326857658 conn(0x7f3368068140 msgr2=0x7f3368068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 -- 172.21.15.148:0/3326857658 shutdown_connections 2024-04-26T23:05:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 -- 172.21.15.148:0/3326857658 wait complete. 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 Processor -- start 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 -- start start 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb815ca10 0x7f1cb81e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb81e2430 0x7f1cb8073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb80c1c10 con 0x7f1cb80c9f90 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb80c8e10 con 0x7f1cb81e2430 2024-04-26T23:05:11.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbf400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb80c1d90 con 0x7f1cb815ca10 2024-04-26T23:05:11.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 Processor -- start 2024-04-26T23:05:11.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45294/0 (socket says 172.21.15.148:45294) 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 -- 172.21.15.148:0/1433368002 learned_addr learned my addr 172.21.15.148:0/1433368002 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbd400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb81e2430 0x7f1cb8073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 -- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb815ca10 msgr2=0x7f1cb81e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb815ca10 0x7f1cb81e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 -- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb81e2430 msgr2=0x7f1cb8073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb81e2430 0x7f1cb8073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f1cbca00640 1 -- 172.21.15.148:0/1433368002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb80c16a0 con 0x7f1cb80c9f90 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.855+0000 7f3370800640 1 -- start start 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 0x7f33680cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 0x7f33680cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33680b26c0 con 0x7f3368157250 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3368157670 con 0x7f336815d8a0 2024-04-26T23:05:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3370800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f33680b2840 con 0x7f33680c44a0 2024-04-26T23:05:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 Processor -- start 2024-04-26T23:05:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 -- start start 2024-04-26T23:05:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cbca00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0b3040 tx=0x7f1cac01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336e800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 0x7f33680cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0c0070 con 0x7f1cb80c9f90 2024-04-26T23:05:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac0b0a70 con 0x7f1cb80c9f90 2024-04-26T23:05:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0b5070 con 0x7f1cb80c9f90 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45310/0 (socket says 172.21.15.148:45310) 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 -- 172.21.15.148:0/4266639011 learned_addr learned my addr 172.21.15.148:0/4266639011 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336de00640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 0x7f33680cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 -- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 msgr2=0x7f33680cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 0x7f33680cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 -- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 msgr2=0x7f33680cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 0x7f33680cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 -- 172.21.15.148:0/4266639011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680c93d0 con 0x7f3368157250 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336e800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 0x7f33680cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336de00640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 0x7f33680cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f336d400640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f335c00c450 tx=0x7f335c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb81f6fc0 con 0x7f1cb80c9f90 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb80c1940 con 0x7f1cb80c9f90 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8fd806c5e0 0x7f8fd80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8fd8155920 0x7f8fd8155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd8072db0 con 0x7f8fd806c9c0 2024-04-26T23:05:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd815ba80 con 0x7f8fd806c5e0 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdec00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd8073050 con 0x7f8fd8155920 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdce00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8fd806c9c0 0x7f8fd80c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41222/0 (socket says 172.21.15.148:41222) 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdce00640 1 -- 172.21.15.148:0/3796071955 learned_addr learned my addr 172.21.15.148:0/3796071955 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fde200640 1 --2- 172.21.15.148:0/3796071955 >> v2:172.21.15.157:3300/0 conn(0x7f8fd8155920 0x7f8fd8155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3796071955 >> v2:172.21.15.148:3300/0 conn(0x7f8fd806c5e0 0x7f8fd80ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb81558b0 con 0x7f1cb80c9f90 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.859+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c0050d0 con 0x7f3368157250 2024-04-26T23:05:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c005290 con 0x7f3368157250 2024-04-26T23:05:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c003620 con 0x7f3368157250 2024-04-26T23:05:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fd7e00640 1 -- 172.21.15.148:0/3796071955 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655526810 0 0) 0x7f8fd8072db0 con 0x7f8fd806c9c0 2024-04-26T23:05:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fd7e00640 1 -- 172.21.15.148:0/3796071955 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc0003530 con 0x7f8fd806c9c0 2024-04-26T23:05:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fdd800640 1 -- 172.21.15.148:0/3796071955 >> v2:172.21.15.157:3300/0 conn(0x7f8fd8155920 msgr2=0x7f8fd8155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3796071955 >> v2:172.21.15.157:3300/0 conn(0x7f8fd8155920 0x7f8fd8155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fdd800640 1 -- 172.21.15.148:0/3796071955 >> v1:172.21.15.157:6789/0 conn(0x7f8fd806c9c0 legacy=0x7f8fd80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f8fdd800640 1 -- 172.21.15.148:0/3796071955 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd8073310 con 0x7f8fd806c5e0 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33680c96b0 con 0x7f3368157250 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33680c8710 con 0x7f3368157250 2024-04-26T23:05:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.863+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368077c20 con 0x7f3368157250 2024-04-26T23:05:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 Processor -- start 2024-04-26T23:05:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cac0c3070 con 0x7f1cb80c9f90 2024-04-26T23:05:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 -- start start 2024-04-26T23:05:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3796071955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80ca510 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8fd806fbe0 tx=0x7f8fc801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a4dd0e5cecd1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1cb4c00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 0x7f1c9c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f335c0037c0 con 0x7f3368157250 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1cac124370 con 0x7f1cb80c9f90 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1cb7e00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 0x7f1c9c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 0x7f135c0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c0ce960 con 0x7f135c0b71d0 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c0cd8a0 con 0x7f135c0c8d60 2024-04-26T23:05:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1360e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f135c15ce20 con 0x7f135c0cdfb0 2024-04-26T23:05:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f135a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 0x7f135c0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1cb7e00640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 0x7f1c9c06a910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1cb806a0b0 tx=0x7f1ca8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1359400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f135c0c8d60 0x7f135c0d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41226/0 (socket says 172.21.15.148:41226) 2024-04-26T23:05:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f1359400640 1 -- 172.21.15.148:0/1605650880 learned_addr learned my addr 172.21.15.148:0/1605650880 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.867+0000 7f3362000640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 0x7f334c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f336de00640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 0x7f334c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f1358a00640 1 -- 172.21.15.148:0/1605650880 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176335998 0 0) 0x7f135c0cd8a0 con 0x7f135c0c8d60 2024-04-26T23:05:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f1358a00640 1 -- 172.21.15.148:0/1605650880 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1340003530 con 0x7f135c0c8d60 2024-04-26T23:05:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f135a800640 1 -- 172.21.15.148:0/1605650880 >> v1:172.21.15.157:6789/0 conn(0x7f135c0c8d60 legacy=0x7f135c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f135a800640 1 -- 172.21.15.148:0/1605650880 >> v1:172.21.15.148:6789/0 conn(0x7f135c0b71d0 legacy=0x7f135c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f135a800640 1 -- 172.21.15.148:0/1605650880 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c15bfc0 con 0x7f135c0cdfb0 2024-04-26T23:05:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.871+0000 7f336de00640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 0x7f334c06a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3358005890 tx=0x7f3358009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f335c05cc90 con 0x7f3368157250 2024-04-26T23:05:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f8fd7e00640 1 -- 172.21.15.148:0/3796071955 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80b5070 con 0x7f8fd806c5e0 2024-04-26T23:05:11.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1cac0ca020 con 0x7f1cb80c9f90 2024-04-26T23:05:11.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f135a800640 1 --2- 172.21.15.148:0/1605650880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 0x7f135c0ce420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1354009dc0 tx=0x7f135401f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6fa430654e0a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1358a00640 1 -- 172.21.15.148:0/1605650880 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13540b4070 con 0x7f135c0cdfb0 2024-04-26T23:05:11.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1358a00640 1 -- 172.21.15.148:0/1605650880 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13540af600 con 0x7f135c0cdfb0 2024-04-26T23:05:11.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1358a00640 1 -- 172.21.15.148:0/1605650880 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13540af9d0 con 0x7f135c0cdfb0 2024-04-26T23:05:11.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 -- 172.21.15.148:0/1605650880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 msgr2=0x7f135c0ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 --2- 172.21.15.148:0/1605650880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 0x7f135c0ce420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1354009dc0 tx=0x7f135401f190 comp rx=0 tx=0).stop 2024-04-26T23:05:11.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 -- 172.21.15.148:0/1605650880 shutdown_connections 2024-04-26T23:05:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 --2- 172.21.15.148:0/1605650880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c0cdfb0 0x7f135c0ce420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 -- 172.21.15.148:0/1605650880 >> 172.21.15.148:0/1605650880 conn(0x7f135c06d0d0 msgr2=0x7f135c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 -- 172.21.15.148:0/1605650880 shutdown_connections 2024-04-26T23:05:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.875+0000 7f1360e00640 1 -- 172.21.15.148:0/1605650880 wait complete. 2024-04-26T23:05:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 Processor -- start 2024-04-26T23:05:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 -- start start 2024-04-26T23:05:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 0x7f135c0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c158700 0x7f135c1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f135c15c860 con 0x7f135c0cdfb0 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f135c15c580 con 0x7f135c0c8d60 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1360e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f135c15cb40 con 0x7f135c158700 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 0x7f135c0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 0x7f135c0b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:55918/0 (socket says 172.21.15.148:55918) 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45330/0 (socket says 172.21.15.148:45330) 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359e00640 1 -- 172.21.15.148:0/2536304474 learned_addr learned my addr 172.21.15.148:0/2536304474 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f135a800640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c158700 0x7f135c1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 -- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c158700 msgr2=0x7f135c1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c158700 0x7f135c1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 -- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 msgr2=0x7f135c0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 0x7f135c0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 -- 172.21.15.148:0/2536304474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c1e1f70 con 0x7f135c0cdfb0 2024-04-26T23:05:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.879+0000 7f1359400640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c400 tx=0x7f134c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f8fd7e00640 1 -- 172.21.15.148:0/3796071955 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc80a8970 con 0x7f8fd806c5e0 2024-04-26T23:05:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f8fd7e00640 1 -- 172.21.15.148:0/3796071955 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80a8d20 con 0x7f8fd806c5e0 2024-04-26T23:05:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c017070 con 0x7f135c0cdfb0 2024-04-26T23:05:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134c005cf0 con 0x7f135c0cdfb0 2024-04-26T23:05:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c0072d0 con 0x7f135c0cdfb0 2024-04-26T23:05:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c1e2250 con 0x7f135c0cdfb0 2024-04-26T23:05:11.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c1f4e90 con 0x7f135c0cdfb0 2024-04-26T23:05:11.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f335c05f2f0 con 0x7f3368157250 2024-04-26T23:05:11.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f8fdec00640 1 -- 172.21.15.148:0/3796071955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 msgr2=0x7f8fd80ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.883+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3796071955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80ca510 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8fd806fbe0 tx=0x7f8fc801ec70 comp rx=0 tx=0).stop 2024-04-26T23:05:11.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 -- 172.21.15.148:0/3796071955 shutdown_connections 2024-04-26T23:05:11.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3796071955 >> v2:172.21.15.157:3300/0 conn(0x7f8fd8155920 0x7f8fd8155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3796071955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80ca510 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 -- 172.21.15.148:0/3796071955 >> 172.21.15.148:0/3796071955 conn(0x7f8fd806e0a0 msgr2=0x7f8fd806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:11.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c0cc370 con 0x7f135c0cdfb0 2024-04-26T23:05:11.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 -- 172.21.15.148:0/3796071955 shutdown_connections 2024-04-26T23:05:11.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 -- 172.21.15.148:0/3796071955 wait complete. 2024-04-26T23:05:11.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f134c01a070 con 0x7f135c0cdfb0 2024-04-26T23:05:11.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f1352000640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 0x7f133c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f134c086000 con 0x7f135c0cdfb0 2024-04-26T23:05:11.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f1359e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 0x7f133c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 Processor -- start 2024-04-26T23:05:11.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.887+0000 7f8fdec00640 1 -- start start 2024-04-26T23:05:11.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f1359e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 0x7f133c06a940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f13480018b0 tx=0x7f1348009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45332/0 (socket says 172.21.15.148:45332) 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 -- 172.21.15.148:0/3363047040 learned_addr learned my addr 172.21.15.148:0/3363047040 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd806c9c0 0x7f8fd814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd8155920 0x7f8fd814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80722d0 con 0x7f8fd806c5e0 2024-04-26T23:05:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80738d0 con 0x7f8fd8155920 2024-04-26T23:05:11.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdce00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd806c9c0 0x7f8fd814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd815bf80 con 0x7f8fd806c9c0 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fde200640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd8155920 0x7f8fd814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 -- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd806c9c0 msgr2=0x7f8fd814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd806c9c0 0x7f8fd814ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 -- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd8155920 msgr2=0x7f8fd814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd8155920 0x7f8fd814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.891+0000 7f8fdd800640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd81f1200 con 0x7f8fd806c5e0 2024-04-26T23:05:11.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fdd800640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8fc801c8a0 tx=0x7f8fc801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80bf070 con 0x7f8fd806c5e0 2024-04-26T23:05:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd81f14a0 con 0x7f8fd806c5e0 2024-04-26T23:05:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd81f1a60 con 0x7f8fd806c5e0 2024-04-26T23:05:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f134c055c10 con 0x7f135c0cdfb0 2024-04-26T23:05:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc8004240 con 0x7f8fd806c5e0 2024-04-26T23:05:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.895+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80bf070 con 0x7f8fd806c5e0 2024-04-26T23:05:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.899+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb40052a0 con 0x7f8fd806c5e0 2024-04-26T23:05:11.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.899+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fc8003620 con 0x7f8fd806c5e0 2024-04-26T23:05:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.903+0000 7f8fd5600640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 0x7f8fbc06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.903+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8fc8123160 con 0x7f8fd806c5e0 2024-04-26T23:05:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.903+0000 7f8fdce00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 0x7f8fbc06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.903+0000 7f8fdce00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 0x7f8fbc06aa40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80ce140 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:11.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:11.911+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8fc80187f0 con 0x7f8fd806c5e0 2024-04-26T23:05:12.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1cb80696e0 con 0x7f1cb80c9f90 2024-04-26T23:05:12.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cb4c00640 1 -- 172.21.15.148:0/1433368002 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cac018850 con 0x7f1cb80c9f90 2024-04-26T23:05:12.064 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 msgr2=0x7f1c9c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 0x7f1c9c06a910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1cb806a0b0 tx=0x7f1ca8008040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 msgr2=0x7f1cb81e1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0b3040 tx=0x7f1cac01ba90 comp rx=0 tx=0).stop 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 shutdown_connections 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c9c068450 0x7f1c9c06a910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1cb81e2430 0x7f1cb8073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1cb815ca10 0x7f1cb81e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 --2- 172.21.15.148:0/1433368002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb80c9f90 0x7f1cb81e1e40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 >> 172.21.15.148:0/1433368002 conn(0x7f1cb80ce220 msgr2=0x7f1cb80c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.059+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fed5c06eb10 con 0x7fed5c164350 2024-04-26T23:05:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.063+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 shutdown_connections 2024-04-26T23:05:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.063+0000 7f1cbf400640 1 -- 172.21.15.148:0/1433368002 wait complete. 2024-04-26T23:05:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.063+0000 7fed52000640 1 -- 172.21.15.148:0/2135609719 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed5c1f71a0 con 0x7fed5c164350 2024-04-26T23:05:12.066 INFO:teuthology.orchestra.run.smithi148.stdout:55834574857 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 msgr2=0x7fed3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 0x7fed3c06a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007fd0 tx=0x7fed4c007f20 comp rx=0 tx=0).stop 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 msgr2=0x7fed5c070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 0x7fed5c070110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed540af000 tx=0x7fed5401bed0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 shutdown_connections 2024-04-26T23:05:12.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fed3c068380 0x7fed3c06a840 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007fd0 tx=0x7fed4c007f20 comp rx=0 tx=0).stop 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed5c164350 0x7fed5c070110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed5c15a530 0x7fed5c1f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 --2- 172.21.15.148:0/2135609719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed5c0ccc10 0x7fed5c15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 >> 172.21.15.148:0/2135609719 conn(0x7fed5c068140 msgr2=0x7fed5c158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 shutdown_connections 2024-04-26T23:05:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.071+0000 7fed60a00640 1 -- 172.21.15.148:0/2135609719 wait complete. 2024-04-26T23:05:12.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-04-26T23:05:12.088 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-26T23:05:12.106 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.135+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f54380cee80 con 0x7f543814f3a0 2024-04-26T23:05:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.135+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f245c0ca540 con 0x7f245c154570 2024-04-26T23:05:12.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.135+0000 7f542ea00640 1 -- 172.21.15.148:0/2157557745 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54300a8a00 con 0x7f543814f3a0 2024-04-26T23:05:12.138 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:12.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.135+0000 7f2452a00640 1 -- 172.21.15.148:0/4227519150 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2454057810 con 0x7f245c154570 2024-04-26T23:05:12.139 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:12.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 msgr2=0x7f541806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 0x7f541806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5428009fd0 tx=0x7f542800d040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 msgr2=0x7f543815b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 0x7f543815b160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54300af000 tx=0x7f543001bad0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 msgr2=0x7f243c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 0x7f243c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f244c001ec0 tx=0x7f244c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 shutdown_connections 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 msgr2=0x7f245c1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 0x7f245c1496a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f245c164730 tx=0x7f245400f580 comp rx=0 tx=0).stop 2024-04-26T23:05:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f543814f3a0 0x7f543815b160 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54380cd6d0 0x7f543814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 --2- 172.21.15.148:0/2157557745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c8d60 0x7f54380c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 >> 172.21.15.148:0/2157557745 conn(0x7f543806d0d0 msgr2=0x7f5438155910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 shutdown_connections 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f243c068380 0x7f243c06a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f245c154570 0x7f245c1496a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c155a10 0x7f245c070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 --2- 172.21.15.148:0/4227519150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2440003f40 0x7f245c15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 >> 172.21.15.148:0/4227519150 conn(0x7f245c068140 msgr2=0x7f245c162e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 shutdown_connections 2024-04-26T23:05:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f543dc00640 1 -- 172.21.15.148:0/2157557745 wait complete. 2024-04-26T23:05:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 shutdown_connections 2024-04-26T23:05:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.139+0000 7f2461400640 1 -- 172.21.15.148:0/4227519150 wait complete. 2024-04-26T23:05:12.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.147+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f33680c9880 con 0x7f3368157250 2024-04-26T23:05:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.147+0000 7f3362000640 1 -- 172.21.15.148:0/4266639011 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f335c05ebf0 con 0x7f3368157250 2024-04-26T23:05:12.153 INFO:teuthology.orchestra.run.smithi148.stdout:55834574859 2024-04-26T23:05:12.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.151+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 msgr2=0x7f334c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.151+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 0x7f334c06a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3358005890 tx=0x7f3358009040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.151+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 msgr2=0x7f33680cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.151+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f335c00c450 tx=0x7f335c00c910 comp rx=0 tx=0).stop 2024-04-26T23:05:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 shutdown_connections 2024-04-26T23:05:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f334c0683d0 0x7f334c06a890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f336815d8a0 0x7f33680cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3368157250 0x7f33680cd280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 --2- 172.21.15.148:0/4266639011 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33680c44a0 0x7f33680cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 >> 172.21.15.148:0/4266639011 conn(0x7f3368068140 msgr2=0x7f33680b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 shutdown_connections 2024-04-26T23:05:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.155+0000 7f3370800640 1 -- 172.21.15.148:0/4266639011 wait complete. 2024-04-26T23:05:12.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-26T23:05:12.178 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-26T23:05:12.181 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-26T23:05:12.182 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.183+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8fb4005590 con 0x7f8fd806c5e0 2024-04-26T23:05:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.183+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f135c077c20 con 0x7f135c0cdfb0 2024-04-26T23:05:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.183+0000 7f8fd5600640 1 -- 172.21.15.148:0/3363047040 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fc80f2cf0 con 0x7f8fd806c5e0 2024-04-26T23:05:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.183+0000 7f1352000640 1 -- 172.21.15.148:0/2536304474 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f134c059f10 con 0x7f135c0cdfb0 2024-04-26T23:05:12.188 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:12.188 INFO:teuthology.orchestra.run.smithi148.stdout:55834574858 2024-04-26T23:05:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 msgr2=0x7f8fbc06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 0x7f8fbc06aa40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80ce140 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 msgr2=0x7f8fd80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8fc801c8a0 tx=0x7f8fc801ba10 comp rx=0 tx=0).stop 2024-04-26T23:05:12.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 shutdown_connections 2024-04-26T23:05:12.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 msgr2=0x7f133c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 0x7f133c06a940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f13480018b0 tx=0x7f1348009040 comp rx=0 tx=0).stop 2024-04-26T23:05:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8fbc068580 0x7f8fbc06aa40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fd8155920 0x7f8fd814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8fd806c9c0 0x7f8fd814ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 --2- 172.21.15.148:0/3363047040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd806c5e0 0x7f8fd80cccd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 >> 172.21.15.148:0/3363047040 conn(0x7f8fd806e0a0 msgr2=0x7f8fd815a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 msgr2=0x7f135c1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c400 tx=0x7f134c00c8c0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 shutdown_connections 2024-04-26T23:05:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f133c068480 0x7f133c06a940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f135c158700 0x7f135c1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135c0cdfb0 0x7f135c1f16d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 --2- 172.21.15.148:0/2536304474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f135c0c8d60 0x7f135c0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 >> 172.21.15.148:0/2536304474 conn(0x7f135c06d0d0 msgr2=0x7f135c159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 shutdown_connections 2024-04-26T23:05:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f8fdec00640 1 -- 172.21.15.148:0/3363047040 wait complete. 2024-04-26T23:05:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 shutdown_connections 2024-04-26T23:05:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.187+0000 7f1360e00640 1 -- 172.21.15.148:0/2536304474 wait complete. 2024-04-26T23:05:12.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-26T23:05:12.212 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-26T23:05:12.213 DEBUG:teuthology.parallel:result is None 2024-04-26T23:05:12.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:05:12.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.387+0000 7f4bb2800640 1 Processor -- start 2024-04-26T23:05:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.387+0000 7f4bb2800640 1 -- start start 2024-04-26T23:05:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bb2800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac153af0 0x7f4bac15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bb2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bac0c7b80 0x7f4bac0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bb2800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac0c9d90 con 0x7f4bac0c9010 2024-04-26T23:05:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bb2800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac0ca630 con 0x7f4bac0c7b80 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bb2800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac0ca070 con 0x7f4bac153af0 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bac0c7b80 0x7f4bac0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4bab400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac153af0 0x7f4bac15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bac0c7b80 0x7f4bac0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45348/0 (socket says 172.21.15.148:45348) 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 -- 172.21.15.148:0/1813976947 learned_addr learned my addr 172.21.15.148:0/1813976947 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 -- 172.21.15.148:0/1813976947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac153af0 msgr2=0x7f4bac15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 --2- 172.21.15.148:0/1813976947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac153af0 0x7f4bac15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 -- 172.21.15.148:0/1813976947 >> v1:172.21.15.157:6789/0 conn(0x7f4bac0c9010 legacy=0x7f4bac0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.391+0000 7f4ba2a00640 1 -- 172.21.15.148:0/1813976947 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac0ca350 con 0x7f4bac0c7b80 2024-04-26T23:05:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4ba2a00640 1 --2- 172.21.15.148:0/1813976947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac0c7b80 0x7f4bac0c7f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009e50 tx=0x7f4b9401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4969e1e06767939 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4baaa00640 1 -- 172.21.15.148:0/1813976947 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940b4070 con 0x7f4bac0c7b80 2024-04-26T23:05:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4baaa00640 1 -- 172.21.15.148:0/1813976947 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b940af400 con 0x7f4bac0c7b80 2024-04-26T23:05:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4baaa00640 1 -- 172.21.15.148:0/1813976947 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940af7d0 con 0x7f4bac0c7b80 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- 172.21.15.148:0/1813976947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac0c7b80 msgr2=0x7f4bac0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 --2- 172.21.15.148:0/1813976947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac0c7b80 0x7f4bac0c7f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009e50 tx=0x7f4b9401f210 comp rx=0 tx=0).stop 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- 172.21.15.148:0/1813976947 shutdown_connections 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 --2- 172.21.15.148:0/1813976947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac0c7b80 0x7f4bac0c7f80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 --2- 172.21.15.148:0/1813976947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac153af0 0x7f4bac15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- 172.21.15.148:0/1813976947 >> 172.21.15.148:0/1813976947 conn(0x7f4bac06c380 msgr2=0x7f4bac06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- 172.21.15.148:0/1813976947 shutdown_connections 2024-04-26T23:05:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- 172.21.15.148:0/1813976947 wait complete. 2024-04-26T23:05:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 Processor -- start 2024-04-26T23:05:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.395+0000 7f4bb2800640 1 -- start start 2024-04-26T23:05:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bac0c7b80 0x7f4bac1f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac0c9010 0x7f4bac150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac153ed0 con 0x7f4bac153af0 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac15d290 con 0x7f4bac0c7b80 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac154050 con 0x7f4bac0c9010 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45362/0 (socket says 172.21.15.148:45362) 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 -- 172.21.15.148:0/387919672 learned_addr learned my addr 172.21.15.148:0/387919672 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bab400640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bac0c7b80 0x7f4bac1f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4ba2a00640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac0c9010 0x7f4bac150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 -- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac0c9010 msgr2=0x7f4bac150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac0c9010 0x7f4bac150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 -- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bac0c7b80 msgr2=0x7f4bac1f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bac0c7b80 0x7f4bac1f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 -- 172.21.15.148:0/387919672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac154530 con 0x7f4bac153af0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4babe00640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c460 tx=0x7f4ba400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005220 con 0x7f4bac153af0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba40053c0 con 0x7f4bac153af0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac154810 con 0x7f4bac153af0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4007270 con 0x7f4bac153af0 2024-04-26T23:05:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac156560 con 0x7f4bac153af0 2024-04-26T23:05:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac156a50 con 0x7f4bac153af0 2024-04-26T23:05:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.399+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ba4019020 con 0x7f4bac153af0 2024-04-26T23:05:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.403+0000 7f4ba3e00640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 0x7f4b8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.403+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4ba4085fc0 con 0x7f4bac153af0 2024-04-26T23:05:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.403+0000 7f4bab400640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 0x7f4b8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.403+0000 7f4bab400640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 0x7f4b8806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009ac0 tx=0x7f4b9c009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.407+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ba4055b50 con 0x7f4bac153af0 2024-04-26T23:05:12.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.559+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4bac077c20 con 0x7f4b88068380 2024-04-26T23:05:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.583+0000 7f4ba3e00640 1 -- 172.21.15.148:0/387919672 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7f4bac077c20 con 0x7f4b88068380 2024-04-26T23:05:12.589 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 msgr2=0x7f4b8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 0x7f4b8806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009ac0 tx=0x7f4b9c009190 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 msgr2=0x7f4bac155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c460 tx=0x7f4ba400c920 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 shutdown_connections 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b88068380 0x7f4b8806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bac153af0 0x7f4bac155490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4bac0c9010 0x7f4bac150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 --2- 172.21.15.148:0/387919672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bac0c7b80 0x7f4bac1f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 >> 172.21.15.148:0/387919672 conn(0x7f4bac06c380 msgr2=0x7f4bac0c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 shutdown_connections 2024-04-26T23:05:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.587+0000 7f4bb2800640 1 -- 172.21.15.148:0/387919672 wait complete. 2024-04-26T23:05:12.609 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T23:05:11.851117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234976,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739744,"statfs":{"total":773094113280,"available":772853497856,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005069"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659974+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:04:45.659974+0000","last_peered":"2024-04-26T23:04:45.659974+0000","last_clean":"2024-04-26T23:04:45.659974+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:04:45.659974+0000","last_undegraded":"2024-04-26T23:04:45.659974+0000","last_fullsized":"2024-04-26T23:04:45.659974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301542+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301542+0000","last_peered":"2024-04-26T23:04:47.301542+0000","last_clean":"2024-04-26T23:04:47.301542+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301542+0000","last_undegraded":"2024-04-26T23:04:47.301542+0000","last_fullsized":"2024-04-26T23:04:47.301542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802152+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:04:46.802152+0000","last_peered":"2024-04-26T23:04:46.802152+0000","last_clean":"2024-04-26T23:04:46.802152+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:04:46.802152+0000","last_undegraded":"2024-04-26T23:04:46.802152+0000","last_fullsized":"2024-04-26T23:04:46.802152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802590+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:04:46.802590+0000","last_peered":"2024-04-26T23:04:46.802590+0000","last_clean":"2024-04-26T23:04:46.802590+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:04:46.802590+0000","last_undegraded":"2024-04-26T23:04:46.802590+0000","last_fullsized":"2024-04-26T23:04:46.802590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303146+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303146+0000","last_peered":"2024-04-26T23:04:47.303146+0000","last_clean":"2024-04-26T23:04:47.303146+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303146+0000","last_undegraded":"2024-04-26T23:04:47.303146+0000","last_fullsized":"2024-04-26T23:04:47.303146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301492+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:04:47.301492+0000","last_peered":"2024-04-26T23:04:47.301492+0000","last_clean":"2024-04-26T23:04:47.301492+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:04:47.301492+0000","last_undegraded":"2024-04-26T23:04:47.301492+0000","last_fullsized":"2024-04-26T23:04:47.301492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801013+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:04:46.801013+0000","last_peered":"2024-04-26T23:04:46.801013+0000","last_clean":"2024-04-26T23:04:46.801013+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:04:46.801013+0000","last_undegraded":"2024-04-26T23:04:46.801013+0000","last_fullsized":"2024-04-26T23:04:46.801013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187993+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:04:45.187993+0000","last_peered":"2024-04-26T23:04:45.187993+0000","last_clean":"2024-04-26T23:04:45.187993+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:04:45.187993+0000","last_undegraded":"2024-04-26T23:04:45.187993+0000","last_fullsized":"2024-04-26T23:04:45.187993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301616+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:04:47.301616+0000","last_peered":"2024-04-26T23:04:47.301616+0000","last_clean":"2024-04-26T23:04:47.301616+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:04:47.301616+0000","last_undegraded":"2024-04-26T23:04:47.301616+0000","last_fullsized":"2024-04-26T23:04:47.301616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802429+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802429+0000","last_peered":"2024-04-26T23:04:46.802429+0000","last_clean":"2024-04-26T23:04:46.802429+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802429+0000","last_undegraded":"2024-04-26T23:04:46.802429+0000","last_fullsized":"2024-04-26T23:04:46.802429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303484+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303484+0000","last_peered":"2024-04-26T23:04:47.303484+0000","last_clean":"2024-04-26T23:04:47.303484+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303484+0000","last_undegraded":"2024-04-26T23:04:47.303484+0000","last_fullsized":"2024-04-26T23:04:47.303484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187960+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:04:45.187960+0000","last_peered":"2024-04-26T23:04:45.187960+0000","last_clean":"2024-04-26T23:04:45.187960+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:04:45.187960+0000","last_undegraded":"2024-04-26T23:04:45.187960+0000","last_fullsized":"2024-04-26T23:04:45.187960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801113+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:04:46.801113+0000","last_peered":"2024-04-26T23:04:46.801113+0000","last_clean":"2024-04-26T23:04:46.801113+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:04:46.801113+0000","last_undegraded":"2024-04-26T23:04:46.801113+0000","last_fullsized":"2024-04-26T23:04:46.801113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301513+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:04:47.301513+0000","last_peered":"2024-04-26T23:04:47.301513+0000","last_clean":"2024-04-26T23:04:47.301513+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:04:47.301513+0000","last_undegraded":"2024-04-26T23:04:47.301513+0000","last_fullsized":"2024-04-26T23:04:47.301513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188260+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:04:45.188260+0000","last_peered":"2024-04-26T23:04:45.188260+0000","last_clean":"2024-04-26T23:04:45.188260+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:04:45.188260+0000","last_undegraded":"2024-04-26T23:04:45.188260+0000","last_fullsized":"2024-04-26T23:04:45.188260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190245+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190245+0000","last_peered":"2024-04-26T23:04:45.190245+0000","last_clean":"2024-04-26T23:04:45.190245+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190245+0000","last_undegraded":"2024-04-26T23:04:45.190245+0000","last_fullsized":"2024-04-26T23:04:45.190245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187862+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:04:45.187862+0000","last_peered":"2024-04-26T23:04:45.187862+0000","last_clean":"2024-04-26T23:04:45.187862+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:04:45.187862+0000","last_undegraded":"2024-04-26T23:04:45.187862+0000","last_fullsized":"2024-04-26T23:04:45.187862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186872+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:04:45.186872+0000","last_peered":"2024-04-26T23:04:45.186872+0000","last_clean":"2024-04-26T23:04:45.186872+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:04:45.186872+0000","last_undegraded":"2024-04-26T23:04:45.186872+0000","last_fullsized":"2024-04-26T23:04:45.186872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303298+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:04:47.303298+0000","last_peered":"2024-04-26T23:04:47.303298+0000","last_clean":"2024-04-26T23:04:47.303298+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:04:47.303298+0000","last_undegraded":"2024-04-26T23:04:47.303298+0000","last_fullsized":"2024-04-26T23:04:47.303298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659800+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:04:45.659800+0000","last_peered":"2024-04-26T23:04:45.659800+0000","last_clean":"2024-04-26T23:04:45.659800+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:04:45.659800+0000","last_undegraded":"2024-04-26T23:04:45.659800+0000","last_fullsized":"2024-04-26T23:04:45.659800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:01.872929+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:01.872929+0000","last_peered":"2024-04-26T23:05:01.872929+0000","last_clean":"2024-04-26T23:05:01.872929+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:01.872929+0000","last_undegraded":"2024-04-26T23:05:01.872929+0000","last_fullsized":"2024-04-26T23:05:01.872929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303300+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303300+0000","last_peered":"2024-04-26T23:04:47.303300+0000","last_clean":"2024-04-26T23:04:47.303300+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303300+0000","last_undegraded":"2024-04-26T23:04:47.303300+0000","last_fullsized":"2024-04-26T23:04:47.303300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301984+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:04:47.301984+0000","last_peered":"2024-04-26T23:04:47.301984+0000","last_clean":"2024-04-26T23:04:47.301984+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:04:47.301984+0000","last_undegraded":"2024-04-26T23:04:47.301984+0000","last_fullsized":"2024-04-26T23:04:47.301984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187871+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:04:45.187871+0000","last_peered":"2024-04-26T23:04:45.187871+0000","last_clean":"2024-04-26T23:04:45.187871+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:04:45.187871+0000","last_undegraded":"2024-04-26T23:04:45.187871+0000","last_fullsized":"2024-04-26T23:04:45.187871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301467+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301467+0000","last_peered":"2024-04-26T23:04:47.301467+0000","last_clean":"2024-04-26T23:04:47.301467+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301467+0000","last_undegraded":"2024-04-26T23:04:47.301467+0000","last_fullsized":"2024-04-26T23:04:47.301467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187270+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:04:45.187270+0000","last_peered":"2024-04-26T23:04:45.187270+0000","last_clean":"2024-04-26T23:04:45.187270+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:04:45.187270+0000","last_undegraded":"2024-04-26T23:04:45.187270+0000","last_fullsized":"2024-04-26T23:04:45.187270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:12.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.787+0000 7f72f6800640 1 Processor -- start 2024-04-26T23:05:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.787+0000 7f72f6800640 1 -- start start 2024-04-26T23:05:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72f6800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00c6340 0x7f72f015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72f6800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72f00c9e80 0x7f72f015c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72f6800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f00cfb50 con 0x7f72f00b1d80 2024-04-26T23:05:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72f6800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f72f00cce10 con 0x7f72f00c9e80 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72f6800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f72f00cfe10 con 0x7f72f00c6340 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72efe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72f00c9e80 0x7f72f015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72ef400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f72f00b1d80 0x7f72f006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43354/0 (socket says 172.21.15.148:43354) 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72ef400640 1 -- 172.21.15.148:0/2018176111 learned_addr learned my addr 172.21.15.148:0/2018176111 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72e6a00640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00c6340 0x7f72f015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72efe00640 1 -- 172.21.15.148:0/2018176111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00c6340 msgr2=0x7f72f015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72efe00640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00c6340 0x7f72f015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72efe00640 1 -- 172.21.15.148:0/2018176111 >> v1:172.21.15.148:6789/0 conn(0x7f72f00b1d80 legacy=0x7f72f006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.791+0000 7f72efe00640 1 -- 172.21.15.148:0/2018176111 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f006d650 con 0x7f72f00c9e80 2024-04-26T23:05:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72efe00640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c9e80 0x7f72f015c610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009d90 tx=0x7f72e801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ebcb4ed734930f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72eea00640 1 -- 172.21.15.148:0/2018176111 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80b4070 con 0x7f72f00c9e80 2024-04-26T23:05:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72eea00640 1 -- 172.21.15.148:0/2018176111 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80af600 con 0x7f72f00c9e80 2024-04-26T23:05:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72eea00640 1 -- 172.21.15.148:0/2018176111 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80af9d0 con 0x7f72f00c9e80 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- 172.21.15.148:0/2018176111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c9e80 msgr2=0x7f72f015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c9e80 0x7f72f015c610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009d90 tx=0x7f72e801f150 comp rx=0 tx=0).stop 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- 172.21.15.148:0/2018176111 shutdown_connections 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c9e80 0x7f72f015c610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 --2- 172.21.15.148:0/2018176111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00c6340 0x7f72f015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- 172.21.15.148:0/2018176111 >> 172.21.15.148:0/2018176111 conn(0x7f72f0071160 msgr2=0x7f72f0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- 172.21.15.148:0/2018176111 shutdown_connections 2024-04-26T23:05:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- 172.21.15.148:0/2018176111 wait complete. 2024-04-26T23:05:12.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 Processor -- start 2024-04-26T23:05:12.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.795+0000 7f72f6800640 1 -- start start 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00b1d80 0x7f72f014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f00c9e80 0x7f72f00b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00b2160 con 0x7f72f00c6340 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f72f006dc10 con 0x7f72f00c9e80 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f72f0071970 con 0x7f72f00b1d80 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72ef400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00b1d80 0x7f72f014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45368/0 (socket says 172.21.15.148:45368) 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 -- 172.21.15.148:0/712230515 learned_addr learned my addr 172.21.15.148:0/712230515 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72efe00640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f00c9e80 0x7f72f00b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 -- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00b1d80 msgr2=0x7f72f014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00b1d80 0x7f72f014ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 -- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f00c9e80 msgr2=0x7f72f00b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f00c9e80 0x7f72f00b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 -- 172.21.15.148:0/712230515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0151160 con 0x7f72f00c6340 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e6a00640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e960 tx=0x7f72d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8017070 con 0x7f72f00c6340 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d800ca00 con 0x7f72f00c6340 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f0151880 con 0x7f72f00c6340 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d800cdb0 con 0x7f72f00c6340 2024-04-26T23:05:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f0151b40 con 0x7f72f00c6340 2024-04-26T23:05:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f01f16b0 con 0x7f72f00c6340 2024-04-26T23:05:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.799+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72d801a070 con 0x7f72f00c6340 2024-04-26T23:05:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.803+0000 7f72e7e00640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.803+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f72d8086cb0 con 0x7f72f00c6340 2024-04-26T23:05:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.803+0000 7f72ef400640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.803+0000 7f72ef400640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 0x7f72cc06a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000f70 tx=0x7f72e0007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.807+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f72f0151160 con 0x7f72f00c6340 2024-04-26T23:05:12.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:05:12.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:05:12.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.959+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72f0077c20 con 0x7f72cc0683b0 2024-04-26T23:05:12.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.971+0000 7f72e7e00640 1 -- 172.21.15.148:0/712230515 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7f72f0077c20 con 0x7f72cc0683b0 2024-04-26T23:05:12.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:12.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.975+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 msgr2=0x7f72cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.975+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 0x7f72cc06a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000f70 tx=0x7f72e0007e90 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.975+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 msgr2=0x7f72f0150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e960 tx=0x7f72d800ee20 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 shutdown_connections 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f72cc0683b0 0x7f72cc06a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f00c9e80 0x7f72f00b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72f00c6340 0x7f72f0150c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 --2- 172.21.15.148:0/712230515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72f00b1d80 0x7f72f014ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 >> 172.21.15.148:0/712230515 conn(0x7f72f0071160 msgr2=0x7f72f015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 shutdown_connections 2024-04-26T23:05:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:12.979+0000 7f72f6800640 1 -- 172.21.15.148:0/712230515 wait complete. 2024-04-26T23:05:13.002 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T23:05:11.851117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234976,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739744,"statfs":{"total":773094113280,"available":772853497856,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005069"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659974+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:04:45.659974+0000","last_peered":"2024-04-26T23:04:45.659974+0000","last_clean":"2024-04-26T23:04:45.659974+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:04:45.659974+0000","last_undegraded":"2024-04-26T23:04:45.659974+0000","last_fullsized":"2024-04-26T23:04:45.659974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301542+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301542+0000","last_peered":"2024-04-26T23:04:47.301542+0000","last_clean":"2024-04-26T23:04:47.301542+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301542+0000","last_undegraded":"2024-04-26T23:04:47.301542+0000","last_fullsized":"2024-04-26T23:04:47.301542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802152+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:04:46.802152+0000","last_peered":"2024-04-26T23:04:46.802152+0000","last_clean":"2024-04-26T23:04:46.802152+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:04:46.802152+0000","last_undegraded":"2024-04-26T23:04:46.802152+0000","last_fullsized":"2024-04-26T23:04:46.802152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802590+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:04:46.802590+0000","last_peered":"2024-04-26T23:04:46.802590+0000","last_clean":"2024-04-26T23:04:46.802590+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:04:46.802590+0000","last_undegraded":"2024-04-26T23:04:46.802590+0000","last_fullsized":"2024-04-26T23:04:46.802590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303146+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303146+0000","last_peered":"2024-04-26T23:04:47.303146+0000","last_clean":"2024-04-26T23:04:47.303146+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303146+0000","last_undegraded":"2024-04-26T23:04:47.303146+0000","last_fullsized":"2024-04-26T23:04:47.303146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301492+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:04:47.301492+0000","last_peered":"2024-04-26T23:04:47.301492+0000","last_clean":"2024-04-26T23:04:47.301492+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:04:47.301492+0000","last_undegraded":"2024-04-26T23:04:47.301492+0000","last_fullsized":"2024-04-26T23:04:47.301492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801013+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:04:46.801013+0000","last_peered":"2024-04-26T23:04:46.801013+0000","last_clean":"2024-04-26T23:04:46.801013+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:04:46.801013+0000","last_undegraded":"2024-04-26T23:04:46.801013+0000","last_fullsized":"2024-04-26T23:04:46.801013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187993+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:04:45.187993+0000","last_peered":"2024-04-26T23:04:45.187993+0000","last_clean":"2024-04-26T23:04:45.187993+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:04:45.187993+0000","last_undegraded":"2024-04-26T23:04:45.187993+0000","last_fullsized":"2024-04-26T23:04:45.187993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301616+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:04:47.301616+0000","last_peered":"2024-04-26T23:04:47.301616+0000","last_clean":"2024-04-26T23:04:47.301616+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:04:47.301616+0000","last_undegraded":"2024-04-26T23:04:47.301616+0000","last_fullsized":"2024-04-26T23:04:47.301616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802429+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802429+0000","last_peered":"2024-04-26T23:04:46.802429+0000","last_clean":"2024-04-26T23:04:46.802429+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802429+0000","last_undegraded":"2024-04-26T23:04:46.802429+0000","last_fullsized":"2024-04-26T23:04:46.802429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303484+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303484+0000","last_peered":"2024-04-26T23:04:47.303484+0000","last_clean":"2024-04-26T23:04:47.303484+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303484+0000","last_undegraded":"2024-04-26T23:04:47.303484+0000","last_fullsized":"2024-04-26T23:04:47.303484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187960+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:04:45.187960+0000","last_peered":"2024-04-26T23:04:45.187960+0000","last_clean":"2024-04-26T23:04:45.187960+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:04:45.187960+0000","last_undegraded":"2024-04-26T23:04:45.187960+0000","last_fullsized":"2024-04-26T23:04:45.187960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801113+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:04:46.801113+0000","last_peered":"2024-04-26T23:04:46.801113+0000","last_clean":"2024-04-26T23:04:46.801113+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:04:46.801113+0000","last_undegraded":"2024-04-26T23:04:46.801113+0000","last_fullsized":"2024-04-26T23:04:46.801113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301513+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:04:47.301513+0000","last_peered":"2024-04-26T23:04:47.301513+0000","last_clean":"2024-04-26T23:04:47.301513+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:04:47.301513+0000","last_undegraded":"2024-04-26T23:04:47.301513+0000","last_fullsized":"2024-04-26T23:04:47.301513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188260+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:04:45.188260+0000","last_peered":"2024-04-26T23:04:45.188260+0000","last_clean":"2024-04-26T23:04:45.188260+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:04:45.188260+0000","last_undegraded":"2024-04-26T23:04:45.188260+0000","last_fullsized":"2024-04-26T23:04:45.188260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190245+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190245+0000","last_peered":"2024-04-26T23:04:45.190245+0000","last_clean":"2024-04-26T23:04:45.190245+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190245+0000","last_undegraded":"2024-04-26T23:04:45.190245+0000","last_fullsized":"2024-04-26T23:04:45.190245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187862+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:04:45.187862+0000","last_peered":"2024-04-26T23:04:45.187862+0000","last_clean":"2024-04-26T23:04:45.187862+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:04:45.187862+0000","last_undegraded":"2024-04-26T23:04:45.187862+0000","last_fullsized":"2024-04-26T23:04:45.187862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186872+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:04:45.186872+0000","last_peered":"2024-04-26T23:04:45.186872+0000","last_clean":"2024-04-26T23:04:45.186872+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:04:45.186872+0000","last_undegraded":"2024-04-26T23:04:45.186872+0000","last_fullsized":"2024-04-26T23:04:45.186872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303298+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:04:47.303298+0000","last_peered":"2024-04-26T23:04:47.303298+0000","last_clean":"2024-04-26T23:04:47.303298+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:04:47.303298+0000","last_undegraded":"2024-04-26T23:04:47.303298+0000","last_fullsized":"2024-04-26T23:04:47.303298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659800+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:04:45.659800+0000","last_peered":"2024-04-26T23:04:45.659800+0000","last_clean":"2024-04-26T23:04:45.659800+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:04:45.659800+0000","last_undegraded":"2024-04-26T23:04:45.659800+0000","last_fullsized":"2024-04-26T23:04:45.659800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:01.872929+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:01.872929+0000","last_peered":"2024-04-26T23:05:01.872929+0000","last_clean":"2024-04-26T23:05:01.872929+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:01.872929+0000","last_undegraded":"2024-04-26T23:05:01.872929+0000","last_fullsized":"2024-04-26T23:05:01.872929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303300+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303300+0000","last_peered":"2024-04-26T23:04:47.303300+0000","last_clean":"2024-04-26T23:04:47.303300+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303300+0000","last_undegraded":"2024-04-26T23:04:47.303300+0000","last_fullsized":"2024-04-26T23:04:47.303300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301984+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:04:47.301984+0000","last_peered":"2024-04-26T23:04:47.301984+0000","last_clean":"2024-04-26T23:04:47.301984+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:04:47.301984+0000","last_undegraded":"2024-04-26T23:04:47.301984+0000","last_fullsized":"2024-04-26T23:04:47.301984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187871+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:04:45.187871+0000","last_peered":"2024-04-26T23:04:45.187871+0000","last_clean":"2024-04-26T23:04:45.187871+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:04:45.187871+0000","last_undegraded":"2024-04-26T23:04:45.187871+0000","last_fullsized":"2024-04-26T23:04:45.187871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301467+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301467+0000","last_peered":"2024-04-26T23:04:47.301467+0000","last_clean":"2024-04-26T23:04:47.301467+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301467+0000","last_undegraded":"2024-04-26T23:04:47.301467+0000","last_fullsized":"2024-04-26T23:04:47.301467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187270+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:04:45.187270+0000","last_peered":"2024-04-26T23:04:45.187270+0000","last_clean":"2024-04-26T23:04:45.187270+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:04:45.187270+0000","last_undegraded":"2024-04-26T23:04:45.187270+0000","last_fullsized":"2024-04-26T23:04:45.187270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301323+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:04:47.301323+0000","last_peered":"2024-04-26T23:04:47.301323+0000","last_clean":"2024-04-26T23:04:47.301323+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:04:47.301323+0000","last_undegraded":"2024-04-26T23:04:47.301323+0000","last_fullsized":"2024-04-26T23:04:47.301323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:13.007 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:05:13.007 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:05:13.007 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:05:13.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:05:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 Processor -- start 2024-04-26T23:05:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 -- start start 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6be4153af0 0x7f6be415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6be40c9720 0x7f6be40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be40c9d90 con 0x7f6be40c7b80 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6be40ca630 con 0x7f6be40c9720 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be9e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6be40ca070 con 0x7f6be4153af0 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6be40c9720 0x7f6be40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6be40c9720 0x7f6be40c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45384/0 (socket says 172.21.15.148:45384) 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be2000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6be40c7b80 0x7f6be40c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43358/0 (socket says 172.21.15.148:43358) 2024-04-26T23:05:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 -- 172.21.15.148:0/3163991193 learned_addr learned my addr 172.21.15.148:0/3163991193 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be2a00640 1 --2- 172.21.15.148:0/3163991193 >> v2:172.21.15.157:3300/0 conn(0x7f6be4153af0 0x7f6be415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 -- 172.21.15.148:0/3163991193 >> v2:172.21.15.157:3300/0 conn(0x7f6be4153af0 msgr2=0x7f6be415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 --2- 172.21.15.148:0/3163991193 >> v2:172.21.15.157:3300/0 conn(0x7f6be4153af0 0x7f6be415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 -- 172.21.15.148:0/3163991193 >> v1:172.21.15.148:6789/0 conn(0x7f6be40c7b80 legacy=0x7f6be40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.179+0000 7f6be3400640 1 -- 172.21.15.148:0/3163991193 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be40ca350 con 0x7f6be40c9720 2024-04-26T23:05:13.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be3400640 1 --2- 172.21.15.148:0/3163991193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be40c7f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6be40745d0 tx=0x7f6bdc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533b66c974c62eb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be1600640 1 -- 172.21.15.148:0/3163991193 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0b4070 con 0x7f6be40c9720 2024-04-26T23:05:13.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be1600640 1 -- 172.21.15.148:0/3163991193 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0af400 con 0x7f6be40c9720 2024-04-26T23:05:13.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be1600640 1 -- 172.21.15.148:0/3163991193 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0af7d0 con 0x7f6be40c9720 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 -- 172.21.15.148:0/3163991193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 msgr2=0x7f6be40c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3163991193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be40c7f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6be40745d0 tx=0x7f6bdc01f1e0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 -- 172.21.15.148:0/3163991193 shutdown_connections 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3163991193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be40c7f80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3163991193 >> v2:172.21.15.157:3300/0 conn(0x7f6be4153af0 0x7f6be415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 -- 172.21.15.148:0/3163991193 >> 172.21.15.148:0/3163991193 conn(0x7f6be406c380 msgr2=0x7f6be406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 -- 172.21.15.148:0/3163991193 shutdown_connections 2024-04-26T23:05:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.183+0000 7f6be9e00640 1 -- 172.21.15.148:0/3163991193 wait complete. 2024-04-26T23:05:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 Processor -- start 2024-04-26T23:05:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- start start 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40c7b80 0x7f6be4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 0x7f6be4159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4153ed0 con 0x7f6be40c9720 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6be415d290 con 0x7f6be40c7b80 2024-04-26T23:05:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6be4154050 con 0x7f6be4153af0 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45390/0 (socket says 172.21.15.148:45390) 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 -- 172.21.15.148:0/3215543263 learned_addr learned my addr 172.21.15.148:0/3215543263 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be3400640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 0x7f6be4159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2a00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40c7b80 0x7f6be4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 -- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 msgr2=0x7f6be4159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 0x7f6be4159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 -- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40c7b80 msgr2=0x7f6be4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40c7b80 0x7f6be4151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 -- 172.21.15.148:0/3215543263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be40ce0a0 con 0x7f6be40c9720 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be3400640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 0x7f6be4159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be2000640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c450 tx=0x7f6bd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0018070 con 0x7f6be40c9720 2024-04-26T23:05:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd0007480 con 0x7f6be40c9720 2024-04-26T23:05:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00047f0 con 0x7f6be40c9720 2024-04-26T23:05:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be40cdae0 con 0x7f6be40c9720 2024-04-26T23:05:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be40cb500 con 0x7f6be40c9720 2024-04-26T23:05:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.187+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be4077c20 con 0x7f6be40c9720 2024-04-26T23:05:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.191+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6bd0004990 con 0x7f6be40c9720 2024-04-26T23:05:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.191+0000 7f6bdb400640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 0x7f6bc406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.191+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6bd0085ee0 con 0x7f6be40c9720 2024-04-26T23:05:13.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.191+0000 7f6be2a00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 0x7f6bc406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.191+0000 7f6be2a00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 0x7f6bc406a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009a50 tx=0x7f6bd4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.195+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6bd00560c0 con 0x7f6be40c9720 2024-04-26T23:05:13.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6be415cab0 con 0x7f6be40c9720 2024-04-26T23:05:13.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6bdb400640 1 -- 172.21.15.148:0/3215543263 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6bd00559c0 con 0x7f6be40c9720 2024-04-26T23:05:13.390 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:13.390 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 msgr2=0x7f6bc406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 0x7f6bc406a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009a50 tx=0x7f6bd4008040 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 msgr2=0x7f6be41f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c450 tx=0x7f6bd000c910 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 shutdown_connections 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6bc40683b0 0x7f6bc406a870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be4153af0 0x7f6be4159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6be40c9720 0x7f6be41f19f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 --2- 172.21.15.148:0/3215543263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be40c7b80 0x7f6be4151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 >> 172.21.15.148:0/3215543263 conn(0x7f6be406c380 msgr2=0x7f6be4073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:13.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 shutdown_connections 2024-04-26T23:05:13.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.387+0000 7f6be9e00640 1 -- 172.21.15.148:0/3215543263 wait complete. 2024-04-26T23:05:13.410 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:05:13.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:13.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 Processor -- start 2024-04-26T23:05:13.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 -- start start 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414c0cb7f0 con 0x7f414c0c63f0 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414c0ca0d0 con 0x7f414c1574b0 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f4152600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f414c0ccd80 con 0x7f414c0b47e0 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414be00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f414c0c63f0 0x7f414c164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43372/0 (socket says 172.21.15.148:43372) 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414be00640 1 -- 172.21.15.148:0/2582119236 learned_addr learned my addr 172.21.15.148:0/2582119236 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:13.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414aa00640 1 --2- 172.21.15.148:0/2582119236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985640072 0 0) 0x7f414c0cb7f0 con 0x7f414c0c63f0 2024-04-26T23:05:13.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4130003530 con 0x7f414c0c63f0 2024-04-26T23:05:13.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639020304 0 0) 0x7f414c0ca0d0 con 0x7f414c1574b0 2024-04-26T23:05:13.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f414c0cb7f0 con 0x7f414c1574b0 2024-04-26T23:05:13.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414aa00640 1 -- 172.21.15.148:0/2582119236 >> v1:172.21.15.157:6789/0 conn(0x7f414c1574b0 legacy=0x7f414c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414aa00640 1 -- 172.21.15.148:0/2582119236 >> v1:172.21.15.148:6789/0 conn(0x7f414c0c63f0 legacy=0x7f414c164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.543+0000 7f414aa00640 1 -- 172.21.15.148:0/2582119236 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c0cba90 con 0x7f414c0b47e0 2024-04-26T23:05:13.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f414aa00640 1 --2- 172.21.15.148:0/2582119236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c06feb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41380097f0 tx=0x7f413801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64de59c0f0701e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380b0070 con 0x7f414c0b47e0 2024-04-26T23:05:13.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41380ab600 con 0x7f414c0b47e0 2024-04-26T23:05:13.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f414a000640 1 -- 172.21.15.148:0/2582119236 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380ab9b0 con 0x7f414c0b47e0 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 -- 172.21.15.148:0/2582119236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 msgr2=0x7f414c06feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 --2- 172.21.15.148:0/2582119236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c06feb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41380097f0 tx=0x7f413801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 -- 172.21.15.148:0/2582119236 shutdown_connections 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 --2- 172.21.15.148:0/2582119236 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c06feb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 -- 172.21.15.148:0/2582119236 >> 172.21.15.148:0/2582119236 conn(0x7f414c071160 msgr2=0x7f414c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 -- 172.21.15.148:0/2582119236 shutdown_connections 2024-04-26T23:05:13.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.547+0000 7f4152600640 1 -- 172.21.15.148:0/2582119236 wait complete. 2024-04-26T23:05:13.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 Processor -- start 2024-04-26T23:05:13.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- start start 2024-04-26T23:05:13.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 0x7f414c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f414c168460 con 0x7f414c0c63f0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f414c070680 con 0x7f414c1574b0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f414c1685e0 con 0x7f414c0b47e0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45394/0 (socket says 172.21.15.148:45394) 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 -- 172.21.15.148:0/4192133967 learned_addr learned my addr 172.21.15.148:0/4192133967 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414b400640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414be00640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 0x7f414c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 -- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 msgr2=0x7f414c1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 -- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 msgr2=0x7f414c0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 0x7f414c0ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 -- 172.21.15.148:0/4192133967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c1f8150 con 0x7f414c0c63f0 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414be00640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 0x7f414c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:13.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f414aa00640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4138000c10 tx=0x7f4138019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380b0040 con 0x7f414c0c63f0 2024-04-26T23:05:13.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41380ab400 con 0x7f414c0c63f0 2024-04-26T23:05:13.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c06d860 con 0x7f414c0c63f0 2024-04-26T23:05:13.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138006e20 con 0x7f414c0c63f0 2024-04-26T23:05:13.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1f86d0 con 0x7f414c0c63f0 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.551+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c077c20 con 0x7f414c0c63f0 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.555+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41380bb020 con 0x7f414c0c63f0 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.555+0000 7f4143400640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 0x7f412c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.555+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f41381202d0 con 0x7f414c0c63f0 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.555+0000 7f414b400640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 0x7f412c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.555+0000 7f414b400640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 0x7f412c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f413c0011f0 tx=0x7f413c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.559+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f41380abe20 con 0x7f414c0c63f0 2024-04-26T23:05:13.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.715+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f414c14b960 con 0x7f414c0c63f0 2024-04-26T23:05:13.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.715+0000 7f4143400640 1 -- 172.21.15.148:0/4192133967 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f41380160d0 con 0x7f414c0c63f0 2024-04-26T23:05:13.720 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:13.721 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:13.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 msgr2=0x7f412c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 0x7f412c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f413c0011f0 tx=0x7f413c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 msgr2=0x7f414c06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4138000c10 tx=0x7f4138019280 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 shutdown_connections 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f412c068380 0x7f412c06a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f414c1574b0 0x7f414c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f414c0c63f0 0x7f414c06ddc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 --2- 172.21.15.148:0/4192133967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f414c0b47e0 0x7f414c1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 >> 172.21.15.148:0/4192133967 conn(0x7f414c071160 msgr2=0x7f414c14ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 shutdown_connections 2024-04-26T23:05:13.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.719+0000 7f4152600640 1 -- 172.21.15.148:0/4192133967 wait complete. 2024-04-26T23:05:13.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:05:13.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:05:13.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 Processor -- start 2024-04-26T23:05:13.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 -- start start 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 0x7fa8cc15f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8cc15fcf0 con 0x7fa8cc06c3f0 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8cc0ca7b0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa8cc06d9a0 con 0x7fa8cc15f320 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8c3e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa8cc06c3f0 0x7fa8cc0c9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43380/0 (socket says 172.21.15.148:43380) 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8c3e00640 1 -- 172.21.15.148:0/3724285600 learned_addr learned my addr 172.21.15.148:0/3724285600 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:13.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1400640 1 --2- 172.21.15.148:0/3724285600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 0x7fa8cc15f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703139142 0 0) 0x7fa8cc15fcf0 con 0x7fa8cc06c3f0 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b0003530 con 0x7fa8cc06c3f0 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985003230 0 0) 0x7fa8cc0ca7b0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1400640 1 -- 172.21.15.148:0/3724285600 >> v1:172.21.15.157:6789/0 conn(0x7fa8cc155ef0 legacy=0x7fa8cc0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1400640 1 -- 172.21.15.148:0/3724285600 >> v1:172.21.15.148:6789/0 conn(0x7fa8cc06c3f0 legacy=0x7fa8cc0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.879+0000 7fa8d1400640 1 -- 172.21.15.148:0/3724285600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc06cd90 con 0x7fa8cc15f320 2024-04-26T23:05:13.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1400640 1 --2- 172.21.15.148:0/3724285600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 0x7fa8cc15f7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc06db20 tx=0x7fa8c401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484b738b01f0d7ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40b2070 con 0x7fa8cc15f320 2024-04-26T23:05:13.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c40a5a40 con 0x7fa8cc15f320 2024-04-26T23:05:13.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8cbe00640 1 -- 172.21.15.148:0/3724285600 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40a5df0 con 0x7fa8cc15f320 2024-04-26T23:05:13.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- 172.21.15.148:0/3724285600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 msgr2=0x7fa8cc15f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/3724285600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 0x7fa8cc15f7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc06db20 tx=0x7fa8c401c960 comp rx=0 tx=0).stop 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- 172.21.15.148:0/3724285600 shutdown_connections 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/3724285600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc15f320 0x7fa8cc15f7b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- 172.21.15.148:0/3724285600 >> 172.21.15.148:0/3724285600 conn(0x7fa8cc06f000 msgr2=0x7fa8cc06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- 172.21.15.148:0/3724285600 shutdown_connections 2024-04-26T23:05:13.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- 172.21.15.148:0/3724285600 wait complete. 2024-04-26T23:05:13.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 Processor -- start 2024-04-26T23:05:13.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- start start 2024-04-26T23:05:13.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc06c3f0 0x7fa8cc14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8cc15f320 0x7fa8cc1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc0c9130 con 0x7fa8cc155ef0 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc1562d0 con 0x7fa8cc15f320 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8d1e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa8cc0c92b0 con 0x7fa8cc06c3f0 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.883+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45406/0 (socket says 172.21.15.148:45406) 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 -- 172.21.15.148:0/1528796522 learned_addr learned my addr 172.21.15.148:0/1528796522 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8d0a00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc06c3f0 0x7fa8cc14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8d1400640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8cc15f320 0x7fa8cc1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 -- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc06c3f0 msgr2=0x7fa8cc14d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc06c3f0 0x7fa8cc14d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 -- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8cc15f320 msgr2=0x7fa8cc1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:13.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8cc15f320 0x7fa8cc1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:13.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 -- 172.21.15.148:0/1528796522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc154460 con 0x7fa8cc155ef0 2024-04-26T23:05:13.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c3e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c450 tx=0x7fa8b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4017070 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b4005cf0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8cc1530e0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4007290 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8cc1536a0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8cc0506d0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8b401a070 con 0x7fa8cc155ef0 2024-04-26T23:05:13.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.887+0000 7fa8c9600640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 0x7fa8a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:13.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.891+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa8b4085fe0 con 0x7fa8cc155ef0 2024-04-26T23:05:13.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.891+0000 7fa8d0a00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 0x7fa8a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:13.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.891+0000 7fa8d0a00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 0x7fa8a806a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc000f70 tx=0x7fa8bc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:13.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:13.891+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8b4055c00 con 0x7fa8cc155ef0 2024-04-26T23:05:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.055+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8cc06f760 con 0x7fa8cc155ef0 2024-04-26T23:05:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.055+0000 7fa8c9600640 1 -- 172.21.15.148:0/1528796522 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fa8b4059f00 con 0x7fa8cc155ef0 2024-04-26T23:05:14.055 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 msgr2=0x7fa8a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 0x7fa8a806a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc000f70 tx=0x7fa8bc009040 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 msgr2=0x7fa8cc0cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c450 tx=0x7fa8b400c910 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 shutdown_connections 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa8a80683b0 0x7fa8a806a870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8cc15f320 0x7fa8cc1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8cc155ef0 0x7fa8cc0cc2a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 --2- 172.21.15.148:0/1528796522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8cc06c3f0 0x7fa8cc14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 >> 172.21.15.148:0/1528796522 conn(0x7fa8cc06f000 msgr2=0x7fa8cc15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 shutdown_connections 2024-04-26T23:05:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.059+0000 7fa8d1e00640 1 -- 172.21.15.148:0/1528796522 wait complete. 2024-04-26T23:05:14.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:05:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 Processor -- start 2024-04-26T23:05:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 -- start start 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 0x7f76900cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f769015f340 0x7f7690071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76900cbb70 con 0x7f76901593d0 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f76900cbf50 con 0x7f769015f340 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f7696200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f76900ca630 con 0x7f76900c9e50 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768f400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f76901593d0 0x7f76900cc3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43384/0 (socket says 172.21.15.148:43384) 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768f400640 1 -- 172.21.15.148:0/2175105116 learned_addr learned my addr 172.21.15.148:0/2175105116 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768fe00640 1 --2- 172.21.15.148:0/2175105116 >> v2:172.21.15.148:3300/0 conn(0x7f769015f340 0x7f7690071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768ea00640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 0x7f76900cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768fe00640 1 -- 172.21.15.148:0/2175105116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 msgr2=0x7f76900cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768fe00640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 0x7f76900cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768fe00640 1 -- 172.21.15.148:0/2175105116 >> v1:172.21.15.148:6789/0 conn(0x7f76901593d0 legacy=0x7f76900cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768fe00640 1 -- 172.21.15.148:0/2175105116 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900ca910 con 0x7f769015f340 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768ea00640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 0x7f76900cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:14.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.215+0000 7f768e000640 1 -- 172.21.15.148:0/2175105116 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308605698 0 0) 0x7f76900cbb70 con 0x7f76901593d0 2024-04-26T23:05:14.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f768fe00640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f7690071f40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7688009d90 tx=0x7f768801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fffb0c1175e8c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f768e000640 1 -- 172.21.15.148:0/2175105116 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880b4070 con 0x7f769015f340 2024-04-26T23:05:14.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f768e000640 1 -- 172.21.15.148:0/2175105116 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76880af600 con 0x7f769015f340 2024-04-26T23:05:14.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f768e000640 1 -- 172.21.15.148:0/2175105116 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880af9d0 con 0x7f769015f340 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 -- 172.21.15.148:0/2175105116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 msgr2=0x7f7690071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f7690071f40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7688009d90 tx=0x7f768801f150 comp rx=0 tx=0).stop 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 -- 172.21.15.148:0/2175105116 shutdown_connections 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f7690071f40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 --2- 172.21.15.148:0/2175105116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76900c9e50 0x7f76900cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 -- 172.21.15.148:0/2175105116 >> 172.21.15.148:0/2175105116 conn(0x7f7690070570 msgr2=0x7f769006f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 -- 172.21.15.148:0/2175105116 shutdown_connections 2024-04-26T23:05:14.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 -- 172.21.15.148:0/2175105116 wait complete. 2024-04-26T23:05:14.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.219+0000 7f7696200640 1 Processor -- start 2024-04-26T23:05:14.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- start start 2024-04-26T23:05:14.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76900c9e50 0x7f76900cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76901593d0 0x7f76901f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76901597b0 con 0x7f769015f340 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f76900caed0 con 0x7f76900c9e50 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f76900c62c0 con 0x7f76901593d0 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45428/0 (socket says 172.21.15.148:45428) 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 -- 172.21.15.148:0/3064871278 learned_addr learned my addr 172.21.15.148:0/3064871278 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768ea00640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76901593d0 0x7f76901f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768f400640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76900c9e50 0x7f76900cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 -- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76901593d0 msgr2=0x7f76901f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76901593d0 0x7f76901f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 -- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76900c9e50 msgr2=0x7f76900cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76900c9e50 0x7f76900cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 -- 172.21.15.148:0/3064871278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900c8f80 con 0x7f769015f340 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f768fe00640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7688009d90 tx=0x7f768801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880b4040 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76880c1070 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688009450 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76900c9260 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76900c9820 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.223+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76901f1a20 con 0x7f769015f340 2024-04-26T23:05:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.227+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76880ba6b0 con 0x7f769015f340 2024-04-26T23:05:14.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.227+0000 7f7687400640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 0x7f767006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.227+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7688125690 con 0x7f769015f340 2024-04-26T23:05:14.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.227+0000 7f768f400640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 0x7f767006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.227+0000 7f768f400640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 0x7f767006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7680007fd0 tx=0x7f7680009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.231+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7688018cb0 con 0x7f769015f340 2024-04-26T23:05:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7690077c20 con 0x7f769015f340 2024-04-26T23:05:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7687400640 1 -- 172.21.15.148:0/3064871278 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f76880f5190 con 0x7f769015f340 2024-04-26T23:05:14.386 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 msgr2=0x7f767006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 0x7f767006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7680007fd0 tx=0x7f7680009040 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 msgr2=0x7f76901f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7688009d90 tx=0x7f768801bef0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 shutdown_connections 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7670068380 0x7f767006a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f769015f340 0x7f76901f1ef0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76901593d0 0x7f76901f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 --2- 172.21.15.148:0/3064871278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76900c9e50 0x7f76900cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 >> 172.21.15.148:0/3064871278 conn(0x7f7690070570 msgr2=0x7f7690071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 shutdown_connections 2024-04-26T23:05:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.387+0000 7f7696200640 1 -- 172.21.15.148:0/3064871278 wait complete. 2024-04-26T23:05:14.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:05:14.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 Processor -- start 2024-04-26T23:05:14.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 -- start start 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f02500c97d0 0x7f025015c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02500c4b30 con 0x7f0250073940 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02500c6f60 con 0x7f0250152d00 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f0255400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f02500c7240 con 0x7f02500c97d0 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024de00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0250073940 0x7f025015c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43392/0 (socket says 172.21.15.148:43392) 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024de00640 1 -- 172.21.15.148:0/3862842753 learned_addr learned my addr 172.21.15.148:0/3862842753 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:14.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024f200640 1 --2- 172.21.15.148:0/3862842753 >> v2:172.21.15.157:3300/0 conn(0x7f02500c97d0 0x7f025015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024d400640 1 -- 172.21.15.148:0/3862842753 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569494883 0 0) 0x7f02500c4b30 con 0x7f0250073940 2024-04-26T23:05:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024d400640 1 -- 172.21.15.148:0/3862842753 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0234003530 con 0x7f0250073940 2024-04-26T23:05:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024f200640 1 -- 172.21.15.148:0/3862842753 >> v1:172.21.15.157:6789/0 conn(0x7f0250152d00 legacy=0x7f0250073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024f200640 1 -- 172.21.15.148:0/3862842753 >> v1:172.21.15.148:6789/0 conn(0x7f0250073940 legacy=0x7f025015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.547+0000 7f024f200640 1 -- 172.21.15.148:0/3862842753 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02500c7520 con 0x7f02500c97d0 2024-04-26T23:05:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f024f200640 1 --2- 172.21.15.148:0/3862842753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f025015c780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0248009d90 tx=0x7f024801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a407283d153803 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f024d400640 1 -- 172.21.15.148:0/3862842753 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02480b2070 con 0x7f02500c97d0 2024-04-26T23:05:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f024d400640 1 -- 172.21.15.148:0/3862842753 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02480a5940 con 0x7f02500c97d0 2024-04-26T23:05:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f024d400640 1 -- 172.21.15.148:0/3862842753 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02480a5d10 con 0x7f02500c97d0 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 -- 172.21.15.148:0/3862842753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 msgr2=0x7f025015c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 --2- 172.21.15.148:0/3862842753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f025015c780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0248009d90 tx=0x7f024801c970 comp rx=0 tx=0).stop 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 -- 172.21.15.148:0/3862842753 shutdown_connections 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 --2- 172.21.15.148:0/3862842753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f025015c780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 -- 172.21.15.148:0/3862842753 >> 172.21.15.148:0/3862842753 conn(0x7f02500c9d10 msgr2=0x7f02500ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 -- 172.21.15.148:0/3862842753 shutdown_connections 2024-04-26T23:05:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 -- 172.21.15.148:0/3862842753 wait complete. 2024-04-26T23:05:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.551+0000 7f0255400640 1 Processor -- start 2024-04-26T23:05:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- start start 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f0250151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0250152d00 0x7f0250145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0250166db0 con 0x7f0250073940 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0250166c30 con 0x7f02500c97d0 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0250166f30 con 0x7f0250152d00 2024-04-26T23:05:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45438/0 (socket says 172.21.15.148:45438) 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 -- 172.21.15.148:0/3183605247 learned_addr learned my addr 172.21.15.148:0/3183605247 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024de00640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f0250151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024f200640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0250152d00 0x7f0250145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 -- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0250152d00 msgr2=0x7f0250145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0250152d00 0x7f0250145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 -- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 msgr2=0x7f0250151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f0250151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 -- 172.21.15.148:0/3183605247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0250150ae0 con 0x7f0250073940 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f024e800640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f024000c530 tx=0x7f024000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240016020 con 0x7f0250073940 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0240005220 con 0x7f0250073940 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240007030 con 0x7f0250073940 2024-04-26T23:05:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0250149df0 con 0x7f0250073940 2024-04-26T23:05:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025014a3b0 con 0x7f0250073940 2024-04-26T23:05:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.555+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0250077c20 con 0x7f0250073940 2024-04-26T23:05:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.559+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02400071d0 con 0x7f0250073940 2024-04-26T23:05:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.559+0000 7f0246a00640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 0x7f023006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.559+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0240086630 con 0x7f0250073940 2024-04-26T23:05:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.559+0000 7f024de00640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 0x7f023006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.559+0000 7f024de00640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 0x7f023006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0250070340 tx=0x7f023c007d40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.563+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0240020020 con 0x7f0250073940 2024-04-26T23:05:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.719+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0250070090 con 0x7f0250073940 2024-04-26T23:05:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.719+0000 7f0246a00640 1 -- 172.21.15.148:0/3183605247 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f02400568a0 con 0x7f0250073940 2024-04-26T23:05:14.721 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 msgr2=0x7f023006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 0x7f023006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0250070340 tx=0x7f023c007d40 comp rx=0 tx=0).stop 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 msgr2=0x7f0250151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f024000c530 tx=0x7f024000c9f0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 shutdown_connections 2024-04-26T23:05:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0230068380 0x7f023006a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0250152d00 0x7f0250145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02500c97d0 0x7f0250151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 --2- 172.21.15.148:0/3183605247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0250073940 0x7f0250151550 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 >> 172.21.15.148:0/3183605247 conn(0x7f02500c9d10 msgr2=0x7f02500759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 shutdown_connections 2024-04-26T23:05:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.723+0000 7f0255400640 1 -- 172.21.15.148:0/3183605247 wait complete. 2024-04-26T23:05:14.743 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:05:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 Processor -- start 2024-04-26T23:05:14.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 -- start start 2024-04-26T23:05:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 0x7f2cc00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0073230 0x7f2cc0073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cc0158a80 0x7f2cc0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc0073bb0 con 0x7f2cc0158a80 2024-04-26T23:05:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc00c4b30 con 0x7f2cc0152d00 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc7a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc00c6f60 con 0x7f2cc0073230 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cc0158a80 0x7f2cc0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cc0158a80 0x7f2cc0158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45452/0 (socket says 172.21.15.148:45452) 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 -- 172.21.15.148:0/3748635534 learned_addr learned my addr 172.21.15.148:0/3748635534 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cbfe00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0073230 0x7f2cc0073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5000640 1 --2- 172.21.15.148:0/3748635534 >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 0x7f2cc00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 -- 172.21.15.148:0/3748635534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0073230 msgr2=0x7f2cc0073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0073230 0x7f2cc0073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 -- 172.21.15.148:0/3748635534 >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 msgr2=0x7f2cc00c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 --2- 172.21.15.148:0/3748635534 >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 0x7f2cc00c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5a00640 1 -- 172.21.15.148:0/3748635534 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00c7240 con 0x7f2cc0158a80 2024-04-26T23:05:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.883+0000 7f2cc5000640 1 --2- 172.21.15.148:0/3748635534 >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 0x7f2cc00c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc5a00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0158a80 0x7f2cc0158eb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0068e40 tx=0x7f2cb801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8b49ed5d199db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cbf400640 1 -- 172.21.15.148:0/3748635534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a57e0 con 0x7f2cc0158a80 2024-04-26T23:05:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cbf400640 1 -- 172.21.15.148:0/3748635534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb80a5980 con 0x7f2cc0158a80 2024-04-26T23:05:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cbf400640 1 -- 172.21.15.148:0/3748635534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a5d50 con 0x7f2cc0158a80 2024-04-26T23:05:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- 172.21.15.148:0/3748635534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0158a80 msgr2=0x7f2cc0158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0158a80 0x7f2cc0158eb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0068e40 tx=0x7f2cb801c9c0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- 172.21.15.148:0/3748635534 shutdown_connections 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0158a80 0x7f2cc0158eb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/3748635534 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0073230 0x7f2cc0073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/3748635534 >> v2:172.21.15.157:3300/0 conn(0x7f2cc0152d00 0x7f2cc00c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- 172.21.15.148:0/3748635534 >> 172.21.15.148:0/3748635534 conn(0x7f2cc00c9d10 msgr2=0x7f2cc00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- 172.21.15.148:0/3748635534 shutdown_connections 2024-04-26T23:05:14.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- 172.21.15.148:0/3748635534 wait complete. 2024-04-26T23:05:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 Processor -- start 2024-04-26T23:05:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.887+0000 7f2cc7a00640 1 -- start start 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 0x7f2cc00c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0158a80 0x7f2cc00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00c4f90 con 0x7f2cc0073230 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00c4e10 con 0x7f2cc0152d00 2024-04-26T23:05:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc00c4710 con 0x7f2cc0158a80 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45456/0 (socket says 172.21.15.148:45456) 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 -- 172.21.15.148:0/891158173 learned_addr learned my addr 172.21.15.148:0/891158173 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0158a80 0x7f2cc00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbfe00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 0x7f2cc00c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 -- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0158a80 msgr2=0x7f2cc00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0158a80 0x7f2cc00c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 -- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 msgr2=0x7f2cc00c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 0x7f2cc00c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 -- 172.21.15.148:0/891158173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc014cc50 con 0x7f2cc0073230 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbfe00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 0x7f2cc00c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc5000640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e810 tx=0x7f2cb400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4017070 con 0x7f2cc0073230 2024-04-26T23:05:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb400c8d0 con 0x7f2cc0073230 2024-04-26T23:05:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc01f5700 con 0x7f2cc0073230 2024-04-26T23:05:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400f040 con 0x7f2cc0073230 2024-04-26T23:05:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc014d1f0 con 0x7f2cc0073230 2024-04-26T23:05:14.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc0077c20 con 0x7f2cc0073230 2024-04-26T23:05:14.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.891+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cb401a070 con 0x7f2cc0073230 2024-04-26T23:05:14.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.895+0000 7f2cbcc00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 0x7f2ca006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:14.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.895+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2cb40868b0 con 0x7f2cc0073230 2024-04-26T23:05:14.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.895+0000 7f2cbfe00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 0x7f2ca006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:14.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.895+0000 7f2cbfe00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 0x7f2ca006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2cc01485d0 tx=0x7f2cac008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:14.899+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2cb40564d0 con 0x7f2cc0073230 2024-04-26T23:05:15.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.063+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2cc0076010 con 0x7f2cc0073230 2024-04-26T23:05:15.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.063+0000 7f2cbcc00640 1 -- 172.21.15.148:0/891158173 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f2cb4084e20 con 0x7f2cc0073230 2024-04-26T23:05:15.064 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 msgr2=0x7f2ca006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 0x7f2ca006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2cc01485d0 tx=0x7f2cac008040 comp rx=0 tx=0).stop 2024-04-26T23:05:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 msgr2=0x7f2cc01411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e810 tx=0x7f2cb400ecd0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 shutdown_connections 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ca0068380 0x7f2ca006a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc0158a80 0x7f2cc00c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc0152d00 0x7f2cc00c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 --2- 172.21.15.148:0/891158173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cc0073230 0x7f2cc01411a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 >> 172.21.15.148:0/891158173 conn(0x7f2cc00c9d10 msgr2=0x7f2cc00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 shutdown_connections 2024-04-26T23:05:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.067+0000 7f2cc7a00640 1 -- 172.21.15.148:0/891158173 wait complete. 2024-04-26T23:05:15.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:05:15.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 Processor -- start 2024-04-26T23:05:15.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 -- start start 2024-04-26T23:05:15.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9a01594f0 0x7fe9a00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 0x7fe9a00ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a015f5e0 con 0x7fe9a00c9c40 2024-04-26T23:05:15.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a015f8c0 con 0x7fe9a01594f0 2024-04-26T23:05:15.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe9a6000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a015fba0 con 0x7fe9a00c1b70 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9a01594f0 0x7fe9a00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9a01594f0 0x7fe9a00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45460/0 (socket says 172.21.15.148:45460) 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 -- 172.21.15.148:0/2130274264 learned_addr learned my addr 172.21.15.148:0/2130274264 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe996a00640 1 --2- 172.21.15.148:0/2130274264 >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 0x7fe9a00ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 -- 172.21.15.148:0/2130274264 >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 msgr2=0x7fe9a00ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 --2- 172.21.15.148:0/2130274264 >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 0x7fe9a00ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 -- 172.21.15.148:0/2130274264 >> v1:172.21.15.157:6789/0 conn(0x7fe9a00c9c40 legacy=0x7fe9a015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe99f400640 1 -- 172.21.15.148:0/2130274264 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a015fe80 con 0x7fe9a01594f0 2024-04-26T23:05:15.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.223+0000 7fe996a00640 1 --2- 172.21.15.148:0/2130274264 >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 0x7fe9a00ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:15.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe99f400640 1 --2- 172.21.15.148:0/2130274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a00c8e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0074af0 tx=0x7fe99001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747ce4c39569766 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe99ea00640 1 -- 172.21.15.148:0/2130274264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900b5070 con 0x7fe9a01594f0 2024-04-26T23:05:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe99ea00640 1 -- 172.21.15.148:0/2130274264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9900a89d0 con 0x7fe9a01594f0 2024-04-26T23:05:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe99ea00640 1 -- 172.21.15.148:0/2130274264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900a8da0 con 0x7fe9a01594f0 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 -- 172.21.15.148:0/2130274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 msgr2=0x7fe9a00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 --2- 172.21.15.148:0/2130274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a00c8e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0074af0 tx=0x7fe99001ecd0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 -- 172.21.15.148:0/2130274264 shutdown_connections 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 --2- 172.21.15.148:0/2130274264 >> v2:172.21.15.157:3300/0 conn(0x7fe9a00c1b70 0x7fe9a00ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 --2- 172.21.15.148:0/2130274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a00c8e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 -- 172.21.15.148:0/2130274264 >> 172.21.15.148:0/2130274264 conn(0x7fe9a00ce2c0 msgr2=0x7fe9a00ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 -- 172.21.15.148:0/2130274264 shutdown_connections 2024-04-26T23:05:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.227+0000 7fe9a6000640 1 -- 172.21.15.148:0/2130274264 wait complete. 2024-04-26T23:05:15.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 Processor -- start 2024-04-26T23:05:15.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- start start 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9a00c1b70 0x7fe9a01f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9a00c9c40 0x7fe9a015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a015c800 con 0x7fe9a01594f0 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01598d0 con 0x7fe9a00c9c40 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a015c980 con 0x7fe9a00c1b70 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9a00c1b70 0x7fe9a01f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45462/0 (socket says 172.21.15.148:45462) 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 -- 172.21.15.148:0/648215213 learned_addr learned my addr 172.21.15.148:0/648215213 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe996a00640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9a00c9c40 0x7fe9a015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 -- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9a00c1b70 msgr2=0x7fe9a01f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9a00c1b70 0x7fe9a01f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 -- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9a00c9c40 msgr2=0x7fe9a015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9a00c9c40 0x7fe9a015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 -- 172.21.15.148:0/648215213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a00c1710 con 0x7fe9a01594f0 2024-04-26T23:05:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe99fe00640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe99800b9a0 tx=0x7fe99800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998019070 con 0x7fe9a01594f0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99800cba0 con 0x7fe9a01594f0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998014440 con 0x7fe9a01594f0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01e6590 con 0x7fe9a01594f0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.231+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01e6b50 con 0x7fe9a01594f0 2024-04-26T23:05:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0077c20 con 0x7fe9a01594f0 2024-04-26T23:05:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe99801c070 con 0x7fe9a01594f0 2024-04-26T23:05:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe997e00640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe998086950 con 0x7fe9a01594f0 2024-04-26T23:05:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe99f400640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.235+0000 7fe99f400640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 0x7fe97c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9900b2000 tx=0x7fe990009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.239+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe9980564e0 con 0x7fe9a01594f0 2024-04-26T23:05:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9a00c9a20 con 0x7fe9a01594f0 2024-04-26T23:05:15.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe997e00640 1 -- 172.21.15.148:0/648215213 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6884 (secure 0 0 0) 0x7fe99805a7e0 con 0x7fe9a01594f0 2024-04-26T23:05:15.431 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:15.431 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:09.976179+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4312,4309]},"id":1}]} 2024-04-26T23:05:15.431 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 msgr2=0x7fe97c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 0x7fe97c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9900b2000 tx=0x7fe990009040 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 msgr2=0x7fe9a014e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe99800b9a0 tx=0x7fe99800be60 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 shutdown_connections 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe97c068380 0x7fe97c06a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a01594f0 0x7fe9a014e080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9a00c9c40 0x7fe9a015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 --2- 172.21.15.148:0/648215213 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9a00c1b70 0x7fe9a01f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 >> 172.21.15.148:0/648215213 conn(0x7fe9a00ce2c0 msgr2=0x7fe9a01e5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 shutdown_connections 2024-04-26T23:05:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.431+0000 7fe9a6000640 1 -- 172.21.15.148:0/648215213 wait complete. 2024-04-26T23:05:15.452 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:15.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 Processor -- start 2024-04-26T23:05:15.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 -- start start 2024-04-26T23:05:15.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41640cd150 0x7f41640c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4164159b50 con 0x7f41640c70e0 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4164159e10 con 0x7f4164071180 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4169e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f416415a990 con 0x7f41640cd150 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f41640c70e0 0x7f41640c83d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43396/0 (socket says 172.21.15.148:43396) 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162a00640 1 -- 172.21.15.148:0/1118893194 learned_addr learned my addr 172.21.15.148:0/1118893194 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4163400640 1 --2- 172.21.15.148:0/1118893194 >> v2:172.21.15.157:3300/0 conn(0x7f41640cd150 0x7f41640c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294947670 0 0) 0x7f4164159b50 con 0x7f41640c70e0 2024-04-26T23:05:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4148003530 con 0x7f41640c70e0 2024-04-26T23:05:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2084267352 0 0) 0x7f4148003530 con 0x7f41640c70e0 2024-04-26T23:05:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 >> v2:172.21.15.157:3300/0 conn(0x7f41640cd150 msgr2=0x7f41640c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 --2- 172.21.15.148:0/1118893194 >> v2:172.21.15.157:3300/0 conn(0x7f41640cd150 0x7f41640c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 >> v1:172.21.15.157:6789/0 conn(0x7f4164071180 legacy=0x7f41640cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416415a0f0 con 0x7f41640c70e0 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f4154001680 con 0x7f41640c70e0 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 >> v1:172.21.15.148:6789/0 conn(0x7f41640c70e0 legacy=0x7f41640c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 0x7f4148003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4148004810 0x7f4148004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480051d0 0x7f414800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f416415a990 con 0x7f41480039c0 2024-04-26T23:05:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f414800c070 con 0x7f41480051d0 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f414800c270 con 0x7f4148004810 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4162a00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 0x7f4148003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f415a000640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4148004810 0x7f4148004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.587+0000 7f4163400640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480051d0 0x7f414800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 -- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4148004810 msgr2=0x7f4148004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4148004810 0x7f4148004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 -- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480051d0 msgr2=0x7f414800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480051d0 0x7f414800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 -- 172.21.15.148:0/1118893194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4148003530 con 0x7f41480039c0 2024-04-26T23:05:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4163400640 1 -- 172.21.15.148:0/1118893194 reap_dead start 2024-04-26T23:05:15.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162a00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 0x7f4148003de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f415400c210 tx=0x7f415401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba007783014d60d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154007d40 con 0x7f41480039c0 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41540a9070 con 0x7f41480039c0 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4162000640 1 -- 172.21.15.148:0/1118893194 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154005d80 con 0x7f41480039c0 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4169e00640 1 -- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 msgr2=0x7f4148003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4169e00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 0x7f4148003de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f415400c210 tx=0x7f415401cc20 comp rx=0 tx=0).stop 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4169e00640 1 -- 172.21.15.148:0/1118893194 shutdown_connections 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4169e00640 1 --2- 172.21.15.148:0/1118893194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41480039c0 0x7f4148003de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.591+0000 7f4169e00640 1 -- 172.21.15.148:0/1118893194 >> 172.21.15.148:0/1118893194 conn(0x7f416406c380 msgr2=0x7f416406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- 172.21.15.148:0/1118893194 shutdown_connections 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- 172.21.15.148:0/1118893194 wait complete. 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 Processor -- start 2024-04-26T23:05:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- start start 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480039c0 0x7f41641526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41641f60c0 0x7f416414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f41640cce50 con 0x7f41641f6500 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f41640c78d0 con 0x7f41480039c0 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4169e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f41640ccfd0 con 0x7f41641f60c0 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45480/0 (socket says 172.21.15.148:45480) 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 -- 172.21.15.148:0/3433796168 learned_addr learned my addr 172.21.15.148:0/3433796168 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4162a00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480039c0 0x7f41641526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f415a000640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41641f60c0 0x7f416414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 -- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41641f60c0 msgr2=0x7f416414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41641f60c0 0x7f416414ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 -- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480039c0 msgr2=0x7f41641526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480039c0 0x7f41641526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 -- 172.21.15.148:0/3433796168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4164068350 con 0x7f41641f6500 2024-04-26T23:05:15.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f4163400640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f415c011860 tx=0x7f415c011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c019070 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c009e10 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.595+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c004480 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416414b7d0 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416415dbb0 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164077c20 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f415c01c070 con 0x7f41641f6500 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f415be00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 0x7f414006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f415c086b10 con 0x7f41641f6500 2024-04-26T23:05:15.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.599+0000 7f4162a00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 0x7f414006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.603+0000 7f4162a00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 0x7f414006a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41540ab000 tx=0x7f41540a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.603+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f415c0567d0 con 0x7f41641f6500 2024-04-26T23:05:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.759+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4164159b50 con 0x7f41641f6500 2024-04-26T23:05:15.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f415be00640 1 -- 172.21.15.148:0/3433796168 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f415c05aad0 con 0x7f41641f6500 2024-04-26T23:05:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:15.763 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 msgr2=0x7f414006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 0x7f414006a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41540ab000 tx=0x7f41540a7070 comp rx=0 tx=0).stop 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 msgr2=0x7f416414b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f415c011860 tx=0x7f415c011d20 comp rx=0 tx=0).stop 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 shutdown_connections 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41400683b0 0x7f414006a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41641f6500 0x7f416414b1b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41641f60c0 0x7f416414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 --2- 172.21.15.148:0/3433796168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41480039c0 0x7f41641526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 >> 172.21.15.148:0/3433796168 conn(0x7f416406c380 msgr2=0x7f416414d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 shutdown_connections 2024-04-26T23:05:15.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.763+0000 7f4169e00640 1 -- 172.21.15.148:0/3433796168 wait complete. 2024-04-26T23:05:15.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:05:15.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:05:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 Processor -- start 2024-04-26T23:05:15.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 -- start start 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcafc0cc000 0x7fcafc071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcafc0c6660 con 0x7fcafc072480 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcafc0cc740 con 0x7fcafc1540b0 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb04200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcafc0cca20 con 0x7fcafc0cc000 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb02200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcafc072480 0x7fcafc15d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43402/0 (socket says 172.21.15.148:43402) 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb02200640 1 -- 172.21.15.148:0/2479310152 learned_addr learned my addr 172.21.15.148:0/2479310152 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb00e00640 1 --2- 172.21.15.148:0/2479310152 >> v2:172.21.15.157:3300/0 conn(0x7fcafc0cc000 0x7fcafc071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997051165 0 0) 0x7fcafc0c6660 con 0x7fcafc072480 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae4003530 con 0x7fcafc072480 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb00e00640 1 -- 172.21.15.148:0/2479310152 >> v1:172.21.15.157:6789/0 conn(0x7fcafc1540b0 legacy=0x7fcafc0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb00e00640 1 -- 172.21.15.148:0/2479310152 >> v1:172.21.15.148:6789/0 conn(0x7fcafc072480 legacy=0x7fcafc15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1004629465 0 0) 0x7fcae4003530 con 0x7fcafc072480 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.923+0000 7fcb00e00640 1 -- 172.21.15.148:0/2479310152 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc0cb580 con 0x7fcafc0cc000 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb00e00640 1 --2- 172.21.15.148:0/2479310152 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc071f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcae80097c0 tx=0x7fcae801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce07ae637caed2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b5070 con 0x7fcafc0cc000 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80a8630 con 0x7fcafc0cc000 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcafbe00640 1 -- 172.21.15.148:0/2479310152 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4001a00 con 0x7fcafc0cc000 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 -- 172.21.15.148:0/2479310152 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 msgr2=0x7fcafc071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 --2- 172.21.15.148:0/2479310152 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc071f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcae80097c0 tx=0x7fcae801ebb0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 -- 172.21.15.148:0/2479310152 shutdown_connections 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 --2- 172.21.15.148:0/2479310152 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc071f40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 -- 172.21.15.148:0/2479310152 >> 172.21.15.148:0/2479310152 conn(0x7fcafc070570 msgr2=0x7fcafc06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 -- 172.21.15.148:0/2479310152 shutdown_connections 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.927+0000 7fcb04200640 1 -- 172.21.15.148:0/2479310152 wait complete. 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 Processor -- start 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- start start 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcafc156cd0 0x7fcafc1e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0cbb40 con 0x7fcafc072480 2024-04-26T23:05:15.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0c4e20 con 0x7fcafc0cc000 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0cc450 con 0x7fcafc156cd0 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45486/0 (socket says 172.21.15.148:45486) 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 -- 172.21.15.148:0/2054198758 learned_addr learned my addr 172.21.15.148:0/2054198758 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb00e00640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb02200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcafc156cd0 0x7fcafc1e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 -- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcafc156cd0 msgr2=0x7fcafc1e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcafc156cd0 0x7fcafc1e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 -- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 msgr2=0x7fcafc06edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc06edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 -- 172.21.15.148:0/2054198758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc156260 con 0x7fcafc072480 2024-04-26T23:05:15.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb01800640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c3f0 tx=0x7fcaf000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0017070 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf00052d0 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc154540 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0003840 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.931+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc154b00 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc077c20 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcaf001a070 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcaf9600640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcaf0085f60 con 0x7fcafc072480 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcb00e00640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.935+0000 7fcb00e00640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 0x7fcadc06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcae80b2000 tx=0x7fcae80aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:15.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:15.939+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcaf0005480 con 0x7fcafc072480 2024-04-26T23:05:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.099+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcafc0ccdf0 con 0x7fcafc072480 2024-04-26T23:05:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.099+0000 7fcaf9600640 1 -- 172.21.15.148:0/2054198758 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fcaf0055c20 con 0x7fcafc072480 2024-04-26T23:05:16.100 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:05:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 msgr2=0x7fcadc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 0x7fcadc06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcae80b2000 tx=0x7fcae80aa070 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 msgr2=0x7fcafc1f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c3f0 tx=0x7fcaf000c8b0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 shutdown_connections 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcafc156cd0 0x7fcafc1e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc0cc000 0x7fcafc06edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 --2- 172.21.15.148:0/2054198758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc072480 0x7fcafc1f4ac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 >> 172.21.15.148:0/2054198758 conn(0x7fcafc070570 msgr2=0x7fcafc152380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 shutdown_connections 2024-04-26T23:05:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.103+0000 7fcb04200640 1 -- 172.21.15.148:0/2054198758 wait complete. 2024-04-26T23:05:16.121 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:05:16.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.263+0000 7f8501400640 1 Processor -- start 2024-04-26T23:05:16.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.263+0000 7f8501400640 1 -- start start 2024-04-26T23:05:16.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f8501400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 0x7f84fc0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f8501400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f84fc15c070 0x7f84fc15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f8501400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84fc0c4b30 con 0x7f84fc073230 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f8501400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f84fc0c6f60 con 0x7f84fc15c070 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f8501400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc0c7240 con 0x7f84fc152d00 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f84fc15c070 0x7f84fc15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f84fc15c070 0x7f84fc15c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:56108/0 (socket says 172.21.15.148:56108) 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fa800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 0x7f84fc0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84f3e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f84fc073230 0x7f84fc073670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:41274/0 (socket says 172.21.15.148:41274) 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 -- 172.21.15.148:0/2853181842 learned_addr learned my addr 172.21.15.148:0/2853181842 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 -- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 msgr2=0x7f84fc0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 0x7f84fc0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 -- 172.21.15.148:0/2853181842 >> v1:172.21.15.157:6789/0 conn(0x7f84fc073230 legacy=0x7f84fc073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fb200640 1 -- 172.21.15.148:0/2853181842 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc0c7520 con 0x7f84fc15c070 2024-04-26T23:05:16.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.267+0000 7f84fa800640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 0x7f84fc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:16.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f84fb200640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc15c070 0x7f84fc15c4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84f400d150 tx=0x7f84f401ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b51db542924002 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f84f9e00640 1 -- 172.21.15.148:0/2853181842 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f400b2d0 con 0x7f84fc15c070 2024-04-26T23:05:16.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f84f9e00640 1 -- 172.21.15.148:0/2853181842 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f400b470 con 0x7f84fc15c070 2024-04-26T23:05:16.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f84f9e00640 1 -- 172.21.15.148:0/2853181842 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40a7bc0 con 0x7f84fc15c070 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc15c070 msgr2=0x7f84fc15c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc15c070 0x7f84fc15c4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84f400d150 tx=0x7f84f401ec30 comp rx=0 tx=0).stop 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- 172.21.15.148:0/2853181842 shutdown_connections 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc15c070 0x7f84fc15c4a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 --2- 172.21.15.148:0/2853181842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc152d00 0x7f84fc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- 172.21.15.148:0/2853181842 >> 172.21.15.148:0/2853181842 conn(0x7f84fc0c9d10 msgr2=0x7f84fc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- 172.21.15.148:0/2853181842 shutdown_connections 2024-04-26T23:05:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- 172.21.15.148:0/2853181842 wait complete. 2024-04-26T23:05:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 Processor -- start 2024-04-26T23:05:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.271+0000 7f8501400640 1 -- start start 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc073230 0x7f84fc14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc15c070 0x7f84fc140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc15cf70 con 0x7f84fc152d00 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc15cdf0 con 0x7f84fc073230 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc070500 con 0x7f84fc15c070 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45488/0 (socket says 172.21.15.148:45488) 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 -- 172.21.15.148:0/1586158107 learned_addr learned my addr 172.21.15.148:0/1586158107 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84fb200640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc15c070 0x7f84fc140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84fa800640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc073230 0x7f84fc14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 -- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc15c070 msgr2=0x7f84fc140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc15c070 0x7f84fc140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 -- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc073230 msgr2=0x7f84fc14e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc073230 0x7f84fc14e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 -- 172.21.15.148:0/1586158107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc14c970 con 0x7f84fc152d00 2024-04-26T23:05:16.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f3e00640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c450 tx=0x7f84e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4018070 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e4007480 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84fc13ff30 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e40047f0 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84fc14cf10 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.275+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84fc077c20 con 0x7f84fc152d00 2024-04-26T23:05:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.279+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84e401b070 con 0x7f84fc152d00 2024-04-26T23:05:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.279+0000 7f84f2a00640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.279+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f84e4085f20 con 0x7f84fc152d00 2024-04-26T23:05:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.279+0000 7f84fa800640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.279+0000 7f84fa800640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 0x7f84d806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009580 tx=0x7f84ec009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.283+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f84e4055a20 con 0x7f84fc152d00 2024-04-26T23:05:16.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.439+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84fc14ab30 con 0x7f84fc152d00 2024-04-26T23:05:16.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f84f2a00640 1 -- 172.21.15.148:0/1586158107 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f84e4059d20 con 0x7f84fc152d00 2024-04-26T23:05:16.442 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 msgr2=0x7f84d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 0x7f84d806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009580 tx=0x7f84ec009190 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 msgr2=0x7f84fc14bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c450 tx=0x7f84e400c910 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 shutdown_connections 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84fc15c070 0x7f84fc140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc152d00 0x7f84fc14bfc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 --2- 172.21.15.148:0/1586158107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc073230 0x7f84fc14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 >> 172.21.15.148:0/1586158107 conn(0x7f84fc0c9d10 msgr2=0x7f84fc14b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 shutdown_connections 2024-04-26T23:05:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.443+0000 7f8501400640 1 -- 172.21.15.148:0/1586158107 wait complete. 2024-04-26T23:05:16.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:05:16.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 Processor -- start 2024-04-26T23:05:16.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 -- start start 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6140c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff61415c070 0x7ff61415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6140c4b30 con 0x7ff614073230 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7ff6140c6f60 con 0x7ff61415c070 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff61a400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff6140c7240 con 0x7ff614152d00 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff613e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff61415c070 0x7ff61415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff60aa00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff614073230 0x7ff614073670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38440/0 (socket says 172.21.15.148:38440) 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff60aa00640 1 -- 172.21.15.148:0/1715959359 learned_addr learned my addr 172.21.15.148:0/1715959359 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.599+0000 7ff613400640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6140c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613e00640 1 -- 172.21.15.148:0/1715959359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 msgr2=0x7ff6140c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613e00640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6140c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613e00640 1 -- 172.21.15.148:0/1715959359 >> v1:172.21.15.148:6789/0 conn(0x7ff614073230 legacy=0x7ff614073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613e00640 1 -- 172.21.15.148:0/1715959359 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6140c7520 con 0x7ff61415c070 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff612a00640 1 -- 172.21.15.148:0/1715959359 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290570933 0 0) 0x7ff6140c4b30 con 0x7ff614073230 2024-04-26T23:05:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613400640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6140c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:16.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff613e00640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff61415c4a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009d90 tx=0x7ff60c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14310ffc715d2ada server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff612a00640 1 -- 172.21.15.148:0/1715959359 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0b2070 con 0x7ff61415c070 2024-04-26T23:05:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff612a00640 1 -- 172.21.15.148:0/1715959359 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0a59d0 con 0x7ff61415c070 2024-04-26T23:05:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff612a00640 1 -- 172.21.15.148:0/1715959359 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0a5da0 con 0x7ff61415c070 2024-04-26T23:05:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 -- 172.21.15.148:0/1715959359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 msgr2=0x7ff61415c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff61415c4a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009d90 tx=0x7ff60c01c970 comp rx=0 tx=0).stop 2024-04-26T23:05:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 -- 172.21.15.148:0/1715959359 shutdown_connections 2024-04-26T23:05:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff61415c4a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 --2- 172.21.15.148:0/1715959359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6140c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 -- 172.21.15.148:0/1715959359 >> 172.21.15.148:0/1715959359 conn(0x7ff6140c9d10 msgr2=0x7ff6140ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 -- 172.21.15.148:0/1715959359 shutdown_connections 2024-04-26T23:05:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.603+0000 7ff61a400640 1 -- 172.21.15.148:0/1715959359 wait complete. 2024-04-26T23:05:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 Processor -- start 2024-04-26T23:05:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- start start 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff614073230 0x7ff614150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6141f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff61415cf70 con 0x7ff61415c070 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff61415cdf0 con 0x7ff614073230 2024-04-26T23:05:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff61406fcf0 con 0x7ff614152d00 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff614073230 0x7ff614150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55964/0 (socket says 172.21.15.148:55964) 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 -- 172.21.15.148:0/2889540403 learned_addr learned my addr 172.21.15.148:0/2889540403 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff60aa00640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6141f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 -- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 msgr2=0x7ff6141f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6141f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 -- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff614073230 msgr2=0x7ff614150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff614073230 0x7ff614150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 -- 172.21.15.148:0/2889540403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6141f44d0 con 0x7ff61415c070 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff613e00640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0b0040 tx=0x7ff60c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0b2050 con 0x7ff61415c070 2024-04-26T23:05:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0be070 con 0x7ff61415c070 2024-04-26T23:05:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0ada50 con 0x7ff61415c070 2024-04-26T23:05:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6141f81a0 con 0x7ff61415c070 2024-04-26T23:05:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.607+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141f8760 con 0x7ff61415c070 2024-04-26T23:05:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff614077c20 con 0x7ff61415c070 2024-04-26T23:05:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff60c0adbf0 con 0x7ff61415c070 2024-04-26T23:05:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff60be00640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 0x7ff5f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff60c1217b0 con 0x7ff61415c070 2024-04-26T23:05:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff613400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 0x7ff5f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.611+0000 7ff613400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 0x7ff5f006a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff604009950 tx=0x7ff604008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.615+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff60c0c7020 con 0x7ff61415c070 2024-04-26T23:05:16.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.771+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff6140766a0 con 0x7ff61415c070 2024-04-26T23:05:16.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.771+0000 7ff60be00640 1 -- 172.21.15.148:0/2889540403 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7ff60c016560 con 0x7ff61415c070 2024-04-26T23:05:16.774 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 msgr2=0x7ff5f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 0x7ff5f006a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff604009950 tx=0x7ff604008040 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 msgr2=0x7ff6141f7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0b0040 tx=0x7ff60c019710 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 shutdown_connections 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5f00683b0 0x7ff5f006a870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff61415c070 0x7ff6141f7a40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff614152d00 0x7ff6141f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 --2- 172.21.15.148:0/2889540403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff614073230 0x7ff614150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 >> 172.21.15.148:0/2889540403 conn(0x7ff6140c9d10 msgr2=0x7ff6140cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 shutdown_connections 2024-04-26T23:05:16.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.775+0000 7ff61a400640 1 -- 172.21.15.148:0/2889540403 wait complete. 2024-04-26T23:05:16.795 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:05:16.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 Processor -- start 2024-04-26T23:05:16.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 -- start start 2024-04-26T23:05:16.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb7406f460 0x7feb7415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb74153eb0 0x7feb7406f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb7406fd80 0x7feb740c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7feb7415ac00 con 0x7feb7406f460 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb74070210 con 0x7feb7406fd80 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.931+0000 7feb7c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb740c96a0 con 0x7feb74153eb0 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb7406f460 0x7feb7415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb7406f460 0x7feb7415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55978/0 (socket says 172.21.15.148:55978) 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 -- 172.21.15.148:0/64581660 learned_addr learned my addr 172.21.15.148:0/64581660 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb7a000640 1 --2- 172.21.15.148:0/64581660 >> v2:172.21.15.157:3300/0 conn(0x7feb7406fd80 0x7feb740c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb78c00640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb74153eb0 0x7feb7406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 -- 172.21.15.148:0/64581660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb74153eb0 msgr2=0x7feb7406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb74153eb0 0x7feb7406f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 -- 172.21.15.148:0/64581660 >> v2:172.21.15.157:3300/0 conn(0x7feb7406fd80 msgr2=0x7feb740c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 --2- 172.21.15.148:0/64581660 >> v2:172.21.15.157:3300/0 conn(0x7feb7406fd80 0x7feb740c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 -- 172.21.15.148:0/64581660 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb740c9980 con 0x7feb7406f460 2024-04-26T23:05:16.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb79600640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406f460 0x7feb7415a6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb740cb0c0 tx=0x7feb6801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182822eb8578f501 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb73e00640 1 -- 172.21.15.148:0/64581660 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb680b4070 con 0x7feb7406f460 2024-04-26T23:05:16.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb73e00640 1 -- 172.21.15.148:0/64581660 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb680af400 con 0x7feb7406f460 2024-04-26T23:05:16.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.935+0000 7feb73e00640 1 -- 172.21.15.148:0/64581660 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb680af7d0 con 0x7feb7406f460 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- 172.21.15.148:0/64581660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406f460 msgr2=0x7feb7415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406f460 0x7feb7415a6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb740cb0c0 tx=0x7feb6801f1e0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- 172.21.15.148:0/64581660 shutdown_connections 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- 172.21.15.148:0/64581660 >> v2:172.21.15.157:3300/0 conn(0x7feb7406fd80 0x7feb740c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb74153eb0 0x7feb7406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- 172.21.15.148:0/64581660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406f460 0x7feb7415a6c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- 172.21.15.148:0/64581660 >> 172.21.15.148:0/64581660 conn(0x7feb740c9d10 msgr2=0x7feb740ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:16.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- 172.21.15.148:0/64581660 shutdown_connections 2024-04-26T23:05:16.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- 172.21.15.148:0/64581660 wait complete. 2024-04-26T23:05:16.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 Processor -- start 2024-04-26T23:05:16.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- start start 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7406f460 0x7feb74155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7414cf10 0x7feb741f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb740c5120 con 0x7feb7406fd80 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb740708f0 con 0x7feb7406f460 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb740c4d70 con 0x7feb7414cf10 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55980/0 (socket says 172.21.15.148:55980) 2024-04-26T23:05:16.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 -- 172.21.15.148:0/3127030114 learned_addr learned my addr 172.21.15.148:0/3127030114 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb79600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7406f460 0x7feb74155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb7a000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7414cf10 0x7feb741f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 -- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7414cf10 msgr2=0x7feb741f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7414cf10 0x7feb741f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 -- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7406f460 msgr2=0x7feb74155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7406f460 0x7feb74155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 -- 172.21.15.148:0/3127030114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7414d890 con 0x7feb7406fd80 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.939+0000 7feb78c00640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d830 tx=0x7feb6000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6000b660 con 0x7feb7406fd80 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb60019070 con 0x7feb7406fd80 2024-04-26T23:05:16.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7414db30 con 0x7feb7406fd80 2024-04-26T23:05:16.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6000ba00 con 0x7feb7406fd80 2024-04-26T23:05:16.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7414b5d0 con 0x7feb7406fd80 2024-04-26T23:05:16.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb74070c20 con 0x7feb7406fd80 2024-04-26T23:05:16.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb6001e460 con 0x7feb7406fd80 2024-04-26T23:05:16.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 0x7feb5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:16.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feb600873b0 con 0x7feb7406fd80 2024-04-26T23:05:16.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb79600640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 0x7feb5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:16.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.943+0000 7feb79600640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 0x7feb5406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb680b1000 tx=0x7feb680aa000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:16.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:16.947+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb60056eb0 con 0x7feb7406fd80 2024-04-26T23:05:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.103+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7feb740cc140 con 0x7feb7406fd80 2024-04-26T23:05:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.103+0000 7feb71600640 1 -- 172.21.15.148:0/3127030114 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7feb6005b1b0 con 0x7feb7406fd80 2024-04-26T23:05:17.104 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 msgr2=0x7feb5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 0x7feb5406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb680b1000 tx=0x7feb680aa000 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 msgr2=0x7feb740cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d830 tx=0x7feb6000dcf0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 shutdown_connections 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb54068380 0x7feb5406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7414cf10 0x7feb741f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7406fd80 0x7feb740cb270 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 --2- 172.21.15.148:0/3127030114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7406f460 0x7feb74155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 >> 172.21.15.148:0/3127030114 conn(0x7feb740c9d10 msgr2=0x7feb740cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 shutdown_connections 2024-04-26T23:05:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.107+0000 7feb7c000640 1 -- 172.21.15.148:0/3127030114 wait complete. 2024-04-26T23:05:17.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:05:17.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.259+0000 7fd8dbe00640 1 Processor -- start 2024-04-26T23:05:17.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.259+0000 7fd8dbe00640 1 -- start start 2024-04-26T23:05:17.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8dbe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd8d40c70e0 0x7fd8d40c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8dbe00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d4159b50 con 0x7fd8d40cca40 2024-04-26T23:05:17.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8dbe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d4159e10 con 0x7fd8d4071180 2024-04-26T23:05:17.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8dbe00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d415a990 con 0x7fd8d40c70e0 2024-04-26T23:05:17.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd8d40cca40 0x7fd8d40cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38456/0 (socket says 172.21.15.148:38456) 2024-04-26T23:05:17.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9e00640 1 -- 172.21.15.148:0/4200393214 learned_addr learned my addr 172.21.15.148:0/4200393214 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:17.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9400640 1 --2- 172.21.15.148:0/4200393214 >> v2:172.21.15.157:3300/0 conn(0x7fd8d40c70e0 0x7fd8d40c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d3e00640 1 -- 172.21.15.148:0/4200393214 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232073231 0 0) 0x7fd8d4159b50 con 0x7fd8d40cca40 2024-04-26T23:05:17.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d3e00640 1 -- 172.21.15.148:0/4200393214 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8bc003530 con 0x7fd8d40cca40 2024-04-26T23:05:17.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9400640 1 -- 172.21.15.148:0/4200393214 >> v1:172.21.15.157:6789/0 conn(0x7fd8d4071180 legacy=0x7fd8d40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9400640 1 -- 172.21.15.148:0/4200393214 >> v1:172.21.15.148:6789/0 conn(0x7fd8d40cca40 legacy=0x7fd8d40cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.263+0000 7fd8d9400640 1 -- 172.21.15.148:0/4200393214 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d415a0f0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8d9400640 1 --2- 172.21.15.148:0/4200393214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d40c70e0 0x7fd8d40c74c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097c0 tx=0x7fd8c801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=834f892aa830b805 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8d3e00640 1 -- 172.21.15.148:0/4200393214 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b0070 con 0x7fd8d40c70e0 2024-04-26T23:05:17.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8d3e00640 1 -- 172.21.15.148:0/4200393214 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c80ab600 con 0x7fd8d40c70e0 2024-04-26T23:05:17.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8d3e00640 1 -- 172.21.15.148:0/4200393214 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80ab9b0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- 172.21.15.148:0/4200393214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d40c70e0 msgr2=0x7fd8d40c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/4200393214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d40c70e0 0x7fd8d40c74c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097c0 tx=0x7fd8c801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- 172.21.15.148:0/4200393214 shutdown_connections 2024-04-26T23:05:17.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/4200393214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d40c70e0 0x7fd8d40c74c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- 172.21.15.148:0/4200393214 >> 172.21.15.148:0/4200393214 conn(0x7fd8d406c380 msgr2=0x7fd8d406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- 172.21.15.148:0/4200393214 shutdown_connections 2024-04-26T23:05:17.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- 172.21.15.148:0/4200393214 wait complete. 2024-04-26T23:05:17.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 Processor -- start 2024-04-26T23:05:17.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 -- start start 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d4071180 0x7fd8d414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.267+0000 7fd8dbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8d40cca40 0x7fd8d4155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4153cd0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40cb990 con 0x7fd8d4071180 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d4153e50 con 0x7fd8d40cca40 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d9400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d4071180 0x7fd8d414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55986/0 (socket says 172.21.15.148:55986) 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 -- 172.21.15.148:0/1022677508 learned_addr learned my addr 172.21.15.148:0/1022677508 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d9e00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8d40cca40 0x7fd8d4155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 -- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8d40cca40 msgr2=0x7fd8d4155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8d40cca40 0x7fd8d4155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 -- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d4071180 msgr2=0x7fd8d414ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d4071180 0x7fd8d414ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 -- 172.21.15.148:0/1022677508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d41556c0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d8a00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c370 tx=0x7fd8c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00052d0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c0005470 con 0x7fd8d40c70e0 2024-04-26T23:05:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0007260 con 0x7fd8d40c70e0 2024-04-26T23:05:17.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d41f8b60 con 0x7fd8d40c70e0 2024-04-26T23:05:17.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d40c6a60 con 0x7fd8d40c70e0 2024-04-26T23:05:17.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d4077c20 con 0x7fd8d40c70e0 2024-04-26T23:05:17.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.271+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8c0007400 con 0x7fd8d40c70e0 2024-04-26T23:05:17.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.275+0000 7fd8d1600640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 0x7fd8b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.275+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8c0086090 con 0x7fd8d40c70e0 2024-04-26T23:05:17.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.275+0000 7fd8d9400640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 0x7fd8b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.275+0000 7fd8d9400640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 0x7fd8b406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80ad000 tx=0x7fd8c80a6000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.279+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd8c0055cc0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.467+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8d4159b50 con 0x7fd8d40c70e0 2024-04-26T23:05:17.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.467+0000 7fd8d1600640 1 -- 172.21.15.148:0/1022677508 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7fd8c0059fc0 con 0x7fd8d40c70e0 2024-04-26T23:05:17.468 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:17.468 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:05:17.468 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:05:17.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 msgr2=0x7fd8b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 0x7fd8b406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80ad000 tx=0x7fd8c80a6000 comp rx=0 tx=0).stop 2024-04-26T23:05:17.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 msgr2=0x7fd8d4154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c370 tx=0x7fd8c000c830 comp rx=0 tx=0).stop 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 shutdown_connections 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd8b40683b0 0x7fd8b406a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8d40cca40 0x7fd8d4155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8d40c70e0 0x7fd8d4154b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 --2- 172.21.15.148:0/1022677508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d4071180 0x7fd8d414ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 >> 172.21.15.148:0/1022677508 conn(0x7fd8d406c380 msgr2=0x7fd8d406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 shutdown_connections 2024-04-26T23:05:17.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.471+0000 7fd8dbe00640 1 -- 172.21.15.148:0/1022677508 wait complete. 2024-04-26T23:05:17.490 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:17.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.623+0000 7f67e8a00640 1 Processor -- start 2024-04-26T23:05:17.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.623+0000 7f67e8a00640 1 -- start start 2024-04-26T23:05:17.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e8a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67e4072d70 0x7f67e40731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e8a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f67e40c9b60 0x7f67e40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e8a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e4152fa0 con 0x7f67e4152bc0 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e8a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f67e4073700 con 0x7f67e4072d70 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e8a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f67e4159790 con 0x7f67e40c9b60 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67e4072d70 0x7f67e40731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67e4072d70 0x7f67e40731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55990/0 (socket says 172.21.15.148:55990) 2024-04-26T23:05:17.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 -- 172.21.15.148:0/3588983902 learned_addr learned my addr 172.21.15.148:0/3588983902 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:17.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e2800640 1 --2- 172.21.15.148:0/3588983902 >> v2:172.21.15.157:3300/0 conn(0x7f67e40c9b60 0x7f67e40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 -- 172.21.15.148:0/3588983902 >> v2:172.21.15.157:3300/0 conn(0x7f67e40c9b60 msgr2=0x7f67e40c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:17.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 --2- 172.21.15.148:0/3588983902 >> v2:172.21.15.157:3300/0 conn(0x7f67e40c9b60 0x7f67e40c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 -- 172.21.15.148:0/3588983902 >> v1:172.21.15.157:6789/0 conn(0x7f67e4152bc0 legacy=0x7f67e40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 -- 172.21.15.148:0/3588983902 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e4158930 con 0x7f67e4072d70 2024-04-26T23:05:17.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.627+0000 7f67e1400640 1 --2- 172.21.15.148:0/3588983902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e4072d70 0x7f67e40731c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f67e4158820 tx=0x7f67d001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7ef24590ad42ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e0a00640 1 -- 172.21.15.148:0/3588983902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d00b5070 con 0x7f67e4072d70 2024-04-26T23:05:17.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e0a00640 1 -- 172.21.15.148:0/3588983902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d00a8a10 con 0x7f67e4072d70 2024-04-26T23:05:17.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e0a00640 1 -- 172.21.15.148:0/3588983902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d00a8de0 con 0x7f67e4072d70 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- 172.21.15.148:0/3588983902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e4072d70 msgr2=0x7f67e40731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- 172.21.15.148:0/3588983902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e4072d70 0x7f67e40731c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f67e4158820 tx=0x7f67d001ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- 172.21.15.148:0/3588983902 shutdown_connections 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- 172.21.15.148:0/3588983902 >> v2:172.21.15.157:3300/0 conn(0x7f67e40c9b60 0x7f67e40c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- 172.21.15.148:0/3588983902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e4072d70 0x7f67e40731c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- 172.21.15.148:0/3588983902 >> 172.21.15.148:0/3588983902 conn(0x7f67e406c380 msgr2=0x7f67e406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- 172.21.15.148:0/3588983902 shutdown_connections 2024-04-26T23:05:17.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- 172.21.15.148:0/3588983902 wait complete. 2024-04-26T23:05:17.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 Processor -- start 2024-04-26T23:05:17.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- start start 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e40c9b60 0x7f67e4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e4152bc0 0x7f67e41f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41591d0 con 0x7f67e41f5a00 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4158ef0 con 0x7f67e40c9b60 2024-04-26T23:05:17.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e8a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67e41594b0 con 0x7f67e4152bc0 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55994/0 (socket says 172.21.15.148:55994) 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e2800640 1 -- 172.21.15.148:0/2865302193 learned_addr learned my addr 172.21.15.148:0/2865302193 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e1e00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e40c9b60 0x7f67e4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.631+0000 7f67e1400640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e4152bc0 0x7f67e41f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 -- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e4152bc0 msgr2=0x7f67e41f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e4152bc0 0x7f67e41f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 -- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e40c9b60 msgr2=0x7f67e4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e40c9b60 0x7f67e4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 -- 172.21.15.148:0/2865302193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e4156a40 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e2800640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00d830 tx=0x7f67dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00b6c0 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc019070 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00baa0 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e4156480 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41f4f20 con 0x7f67e41f5a00 2024-04-26T23:05:17.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e4077c20 con 0x7f67e41f5a00 2024-04-26T23:05:17.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67dc01e460 con 0x7f67e41f5a00 2024-04-26T23:05:17.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 0x7f67c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.635+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f67dc087280 con 0x7f67e41f5a00 2024-04-26T23:05:17.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.639+0000 7f67e1e00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 0x7f67c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.639+0000 7f67e1e00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 0x7f67c406a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001ea0 tx=0x7f67d4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.639+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67e4156a40 con 0x7f67e41f5a00 2024-04-26T23:05:17.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67e414b910 con 0x7f67e41f5a00 2024-04-26T23:05:17.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67da000640 1 -- 172.21.15.148:0/2865302193 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f67dc056e10 con 0x7f67e41f5a00 2024-04-26T23:05:17.799 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:17.799 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 msgr2=0x7f67c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 0x7f67c406a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001ea0 tx=0x7f67d4009040 comp rx=0 tx=0).stop 2024-04-26T23:05:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 msgr2=0x7f67e4157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00d830 tx=0x7f67dc00dcf0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 shutdown_connections 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f67c40683b0 0x7f67c406a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67e41f5a00 0x7f67e4157f80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e4152bc0 0x7f67e41f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 --2- 172.21.15.148:0/2865302193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e40c9b60 0x7f67e4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 >> 172.21.15.148:0/2865302193 conn(0x7f67e406c380 msgr2=0x7f67e40759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 shutdown_connections 2024-04-26T23:05:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.799+0000 7f67e8a00640 1 -- 172.21.15.148:0/2865302193 wait complete. 2024-04-26T23:05:17.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:05:17.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.955+0000 7f907a600640 1 Processor -- start 2024-04-26T23:05:17.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.955+0000 7f907a600640 1 -- start start 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9074153af0 0x7f907415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90740c9010 0x7f90740c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f90740ca630 con 0x7f9074153af0 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f90740c99e0 con 0x7f90740c9010 2024-04-26T23:05:17.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f907a600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f90740c9d90 con 0x7f90740c7b80 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9074153af0 0x7f907415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90740c9010 0x7f90740c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9074153af0 0x7f907415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56000/0 (socket says 172.21.15.148:56000) 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 -- 172.21.15.148:0/2412084524 learned_addr learned my addr 172.21.15.148:0/2412084524 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9072a00640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 -- 172.21.15.148:0/2412084524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 msgr2=0x7f90740c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 -- 172.21.15.148:0/2412084524 >> v2:172.21.15.157:3300/0 conn(0x7f90740c9010 msgr2=0x7f90740c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 --2- 172.21.15.148:0/2412084524 >> v2:172.21.15.157:3300/0 conn(0x7f90740c9010 0x7f90740c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.959+0000 7f9073400640 1 -- 172.21.15.148:0/2412084524 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90740ca070 con 0x7f9074153af0 2024-04-26T23:05:17.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f9073400640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9074153af0 0x7f907415d7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90740c3af0 tx=0x7f905c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f21d5909046035 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f9072000640 1 -- 172.21.15.148:0/2412084524 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c0b5070 con 0x7f9074153af0 2024-04-26T23:05:17.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f9072000640 1 -- 172.21.15.148:0/2412084524 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f905c0a89d0 con 0x7f9074153af0 2024-04-26T23:05:17.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f9072000640 1 -- 172.21.15.148:0/2412084524 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c0a8da0 con 0x7f9074153af0 2024-04-26T23:05:17.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- 172.21.15.148:0/2412084524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9074153af0 msgr2=0x7f907415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9074153af0 0x7f907415d7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90740c3af0 tx=0x7f905c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:17.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- 172.21.15.148:0/2412084524 shutdown_connections 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 --2- 172.21.15.148:0/2412084524 >> v2:172.21.15.157:3300/0 conn(0x7f90740c9010 0x7f90740c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 --2- 172.21.15.148:0/2412084524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9074153af0 0x7f907415d7b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- 172.21.15.148:0/2412084524 >> 172.21.15.148:0/2412084524 conn(0x7f907406c380 msgr2=0x7f907406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- 172.21.15.148:0/2412084524 shutdown_connections 2024-04-26T23:05:17.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- 172.21.15.148:0/2412084524 wait complete. 2024-04-26T23:05:17.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 Processor -- start 2024-04-26T23:05:17.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.963+0000 7f907a600640 1 -- start start 2024-04-26T23:05:17.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 0x7f9074159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f907415d290 con 0x7f90740c9010 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f907415cfb0 con 0x7f9074153af0 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9074153ed0 con 0x7f90740c7b80 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56006/0 (socket says 172.21.15.148:56006) 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 -- 172.21.15.148:0/3402888695 learned_addr learned my addr 172.21.15.148:0/3402888695 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9073400640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9073e00640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 0x7f9074159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 -- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 msgr2=0x7f90740cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 -- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 msgr2=0x7f9074159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:17.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 0x7f9074159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:17.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 -- 172.21.15.148:0/3402888695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90741f4d80 con 0x7f90740c9010 2024-04-26T23:05:17.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9073e00640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 0x7f9074159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:17.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f9072a00640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f906400e960 tx=0x7f906400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064017070 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906400ca00 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90741f5060 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906400cdb0 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90741f5620 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074077c20 con 0x7f90740c9010 2024-04-26T23:05:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.967+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f906401a070 con 0x7f90740c9010 2024-04-26T23:05:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.971+0000 7f906b400640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 0x7f905006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.971+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9064086fe0 con 0x7f90740c9010 2024-04-26T23:05:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.971+0000 7f9073400640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 0x7f905006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:17.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.971+0000 7f9073400640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 0x7f905006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f905c0b2000 tx=0x7f905c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:17.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:17.975+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9064056c00 con 0x7f90740c9010 2024-04-26T23:05:18.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.163+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90741e6970 con 0x7f90740c9010 2024-04-26T23:05:18.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.163+0000 7f906b400640 1 -- 172.21.15.148:0/3402888695 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7f906405af00 con 0x7f90740c9010 2024-04-26T23:05:18.165 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:18.165 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:05:18.165 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 msgr2=0x7f905006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 0x7f905006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f905c0b2000 tx=0x7f905c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 msgr2=0x7f9074158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f906400e960 tx=0x7f906400ee20 comp rx=0 tx=0).stop 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 shutdown_connections 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90500683b0 0x7f905006a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9074153af0 0x7f9074159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90740c9010 0x7f9074158d50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 --2- 172.21.15.148:0/3402888695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90740c7b80 0x7f90740cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 >> 172.21.15.148:0/3402888695 conn(0x7f907406c380 msgr2=0x7f9074073aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 shutdown_connections 2024-04-26T23:05:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.167+0000 7f907a600640 1 -- 172.21.15.148:0/3402888695 wait complete. 2024-04-26T23:05:18.789 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:04:39.499207+0000', 'modified': '2024-04-26T23:05:15.993167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4312, 'mds_1': 4309, 'mds_2': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.157:6836/4095294629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 4095294629}, {'type': 'v1', 'addr': '172.21.15.157:6836', 'nonce': 4095294629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4309': {'gid': 4309, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.157:6837/4088233623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6835', 'nonce': 4088233623}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 4088233623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4312': {'gid': 4312, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.157:6839/1573676603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 1573676603}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 1573676603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4312, 'qdb_cluster': [4245, 4309, 4312]} 2024-04-26T23:05:18.789 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T23:05:18.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T23:05:18.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.931+0000 7f418be00640 1 Processor -- start 2024-04-26T23:05:18.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418be00640 1 -- start start 2024-04-26T23:05:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 0x7f418c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418be00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c0ca6a0 con 0x7f418c0c7030 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418be00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c0ca980 con 0x7f418c0ca0d0 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f418c159de0 con 0x7f418c0c6c50 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 0x7f418c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f4183e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f418c0c7030 0x7f418c1596d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38466/0 (socket says 172.21.15.148:38466) 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f4183e00640 1 -- 172.21.15.148:0/2378112654 learned_addr learned my addr 172.21.15.148:0/2378112654 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418a000640 1 -- 172.21.15.148:0/2378112654 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845470298 0 0) 0x7f418c0ca6a0 con 0x7f418c0c7030 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418a000640 1 -- 172.21.15.148:0/2378112654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4170003530 con 0x7f418c0c7030 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418aa00640 1 -- 172.21.15.148:0/2378112654 >> v1:172.21.15.157:6789/0 conn(0x7f418c0ca0d0 legacy=0x7f418c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418aa00640 1 -- 172.21.15.148:0/2378112654 >> v1:172.21.15.148:6789/0 conn(0x7f418c0c7030 legacy=0x7f418c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.935+0000 7f418aa00640 1 -- 172.21.15.148:0/2378112654 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c072df0 con 0x7f418c0c6c50 2024-04-26T23:05:18.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418aa00640 1 --2- 172.21.15.148:0/2378112654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 0x7f418c0cdaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097f0 tx=0x7f417c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c116cde07cafad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:18.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418a000640 1 -- 172.21.15.148:0/2378112654 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0ab5f0 con 0x7f418c0c6c50 2024-04-26T23:05:18.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418a000640 1 -- 172.21.15.148:0/2378112654 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0070 con 0x7f418c0c6c50 2024-04-26T23:05:18.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418a000640 1 -- 172.21.15.148:0/2378112654 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0ab990 con 0x7f418c0c6c50 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- 172.21.15.148:0/2378112654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 msgr2=0x7f418c0cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 --2- 172.21.15.148:0/2378112654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 0x7f418c0cdaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097f0 tx=0x7f417c01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- 172.21.15.148:0/2378112654 shutdown_connections 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 --2- 172.21.15.148:0/2378112654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0c6c50 0x7f418c0cdaf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- 172.21.15.148:0/2378112654 >> 172.21.15.148:0/2378112654 conn(0x7f418c06e0a0 msgr2=0x7f418c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- 172.21.15.148:0/2378112654 shutdown_connections 2024-04-26T23:05:18.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- 172.21.15.148:0/2378112654 wait complete. 2024-04-26T23:05:18.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 Processor -- start 2024-04-26T23:05:18.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.939+0000 7f418be00640 1 -- start start 2024-04-26T23:05:18.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0ca0d0 0x7f418c149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f418c14c470 0x7f418c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f418c073440 con 0x7f418c0c6c50 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0cac60 con 0x7f418c14c470 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f418c0738d0 con 0x7f418c0ca0d0 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56012/0 (socket says 172.21.15.148:56012) 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 -- 172.21.15.148:0/3151991702 learned_addr learned my addr 172.21.15.148:0/3151991702 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f4183e00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0ca0d0 0x7f418c149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418b400640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f418c14c470 0x7f418c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 -- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0ca0d0 msgr2=0x7f418c149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0ca0d0 0x7f418c149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 -- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f418c14c470 msgr2=0x7f418c14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f418c14c470 0x7f418c14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 -- 172.21.15.148:0/3151991702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c150260 con 0x7f418c0c6c50 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418aa00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f417c009740 tx=0x7f417c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f4182a00640 1 -- 172.21.15.148:0/3151991702 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c006e20 con 0x7f418c0c6c50 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f4182a00640 1 -- 172.21.15.148:0/3151991702 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c004020 con 0x7f418c0c6c50 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c150500 con 0x7f418c0c6c50 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f4182a00640 1 -- 172.21.15.148:0/3151991702 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0043d0 con 0x7f418c0c6c50 2024-04-26T23:05:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.943+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c14f100 con 0x7f418c0c6c50 2024-04-26T23:05:18.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4182a00640 1 -- 172.21.15.148:0/3151991702 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f417c003620 con 0x7f418c0c6c50 2024-04-26T23:05:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4182a00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 0x7f416806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4182a00640 1 -- 172.21.15.148:0/3151991702 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f417c120ff0 con 0x7f418c0c6c50 2024-04-26T23:05:18.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4183e00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 0x7f416806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 Processor -- start 2024-04-26T23:05:18.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 -- start start 2024-04-26T23:05:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4183e00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 0x7f416806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c7900 tx=0x7f4174007d40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce020 0x56435e2ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce940 0x56435e31b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56435e188140 con 0x56435e2cd700 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56435e11de00 con 0x56435e2ce020 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56435e0d6a00 con 0x56435e2ce940 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56018/0 (socket says 172.21.15.148:56018) 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 -- 172.21.15.148:0/3681240510 learned_addr learned my addr 172.21.15.148:0/3681240510 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418b400640 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce940 0x56435e31b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f4183e00640 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce020 0x56435e2ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 -- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce940 msgr2=0x56435e31b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce940 0x56435e31b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 -- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce020 msgr2=0x56435e2ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce020 0x56435e2ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 -- 172.21.15.148:0/3681240510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435e0db0e0 con 0x56435e2cd700 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.947+0000 7f418aa00640 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f417c0ed1b0 tx=0x7f417c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d93087ae9d8169a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f417b400640 1 -- 172.21.15.148:0/3681240510 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0c4040 con 0x56435e2cd700 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f417b400640 1 -- 172.21.15.148:0/3681240510 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0040 con 0x56435e2cd700 2024-04-26T23:05:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f417b400640 1 -- 172.21.15.148:0/3681240510 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0f9880 con 0x56435e2cd700 2024-04-26T23:05:18.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/3681240510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 msgr2=0x56435e2cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:18.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f417c0ed1b0 tx=0x7f417c0094a0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/3681240510 shutdown_connections 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce940 0x56435e31b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce020 0x56435e2ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- 172.21.15.148:0/3681240510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e2cdae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/3681240510 >> 172.21.15.148:0/3681240510 conn(0x56435e30f5f0 msgr2=0x56435e3119e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/3681240510 shutdown_connections 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/3681240510 wait complete. 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- start start 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 Processor -- start 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e30e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e319c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56435e12b200 con 0x56435e2cd700 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56435e0c1e80 con 0x56435e2ce940 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56435e118ae0 con 0x56435e2ce020 2024-04-26T23:05:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 10 client.0 _ll_register_callbacks cb 0x56435e12ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4183e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e30e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56032/0 (socket says 172.21.15.148:56032) 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 -- 172.21.15.148:0/792727432 learned_addr learned my addr 172.21.15.148:0/792727432 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418b400640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e319c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 -- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 msgr2=0x56435e30e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e30e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 -- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 msgr2=0x56435e319c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e319c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 -- 172.21.15.148:0/792727432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435e0bd4e0 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f418aa00640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f417c0f0a50 tx=0x7f417c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfad37e3abe513a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f416fe00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0c4040 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f417c104de0 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417c0b0040 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.951+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f417c0f9880 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 10 client.4827 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x56435e0a3e80 con 0x56435e2cd700 2024-04-26T23:05:18.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0040 con 0x56435e2cd700 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f417c118b50 con 0x56435e2cd700 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 10 client.4827 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 10 client.4827 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 20 client.4827 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e31a8a0 0x56435e31ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 4 client.4827 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 --> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56435e0b6bc0 con 0x56435e31a8a0 2024-04-26T23:05:18.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4183e00640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e31a8a0 0x56435e31ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:18.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f4183e00640 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e31a8a0 0x56435e31ac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d76bd25d71d414fc server_cookie=26429dd42605c5d3 in_seq=0 out_seq=0 2024-04-26T23:05:18.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:18.955+0000 7f416fe00640 10 client.4827 ms_handle_connect on v2:172.21.15.157:6834/4095294629 2024-04-26T23:05:21.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f416fe00640 1 -- 172.21.15.148:0/792727432 <== mds.2 v2:172.21.15.157:6834/4095294629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56435e0b6bc0 con 0x56435e31a8a0 2024-04-26T23:05:21.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f416fe00640 10 client.4827 handle_command_reply: tid=0 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 client.4827 shutdown 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 msgr2=0x56435e30e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f417c0f0a50 tx=0x7f417c019280 comp rx=0 tx=0).stop 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 shutdown_connections 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e31a8a0 0x56435e31ac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e319c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e30e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 --2- 172.21.15.148:0/792727432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e3d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 >> 172.21.15.148:0/792727432 conn(0x56435e30f5f0 msgr2=0x56435e2cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f416fe00640 0 client.4827 ms_handle_reset on v2:172.21.15.157:6834/4095294629 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 shutdown_connections 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 1 -- 172.21.15.148:0/792727432 wait complete. 2024-04-26T23:05:21.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.002+0000 7f4194fba000 20 client.4827 trim_cache size 0 max 16384 2024-04-26T23:05:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 Processor -- start 2024-04-26T23:05:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 -- start start 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e2cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e2ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56435e11d110 con 0x56435e2cd700 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56435e122430 con 0x56435e2ce940 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56435e12a0a0 con 0x56435e2ce020 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56038/0 (socket says 172.21.15.148:56038) 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 -- 172.21.15.148:0/2342317936 learned_addr learned my addr 172.21.15.148:0/2342317936 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418b400640 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e2ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f4183e00640 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e2cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 -- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 msgr2=0x56435e2cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e2cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 -- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 msgr2=0x56435e2ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e2ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.022+0000 7f418aa00640 1 -- 172.21.15.148:0/2342317936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435e2d3990 con 0x56435e2cd700 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f418aa00640 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f417c0f0ce0 tx=0x7f417c0fa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838aed731dacceb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f417aa00640 1 -- 172.21.15.148:0/2342317936 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0c4040 con 0x56435e2cd700 2024-04-26T23:05:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f417aa00640 1 -- 172.21.15.148:0/2342317936 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0040 con 0x56435e2cd700 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f417aa00640 1 -- 172.21.15.148:0/2342317936 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c118b50 con 0x56435e2cd700 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- 172.21.15.148:0/2342317936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 msgr2=0x56435e30e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f417c0f0ce0 tx=0x7f417c0fa000 comp rx=0 tx=0).stop 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- 172.21.15.148:0/2342317936 shutdown_connections 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2ce940 0x56435e2ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e2cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- 172.21.15.148:0/2342317936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2cd700 0x56435e30e660 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- 172.21.15.148:0/2342317936 >> 172.21.15.148:0/2342317936 conn(0x56435e30f5f0 msgr2=0x56435e32c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- 172.21.15.148:0/2342317936 shutdown_connections 2024-04-26T23:05:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- 172.21.15.148:0/2342317936 wait complete. 2024-04-26T23:05:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- start start 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 Processor -- start 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 0x56435e3227a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e321710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56435e12b200 con 0x56435e2ce940 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x56435e2d9860 con 0x56435e2cd700 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x56435e0c1e80 con 0x56435e2ce020 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4194fba000 10 client.0 _ll_register_callbacks cb 0x7f4174006b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f418b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f4183e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e321710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f418b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56040/0 (socket says 172.21.15.148:56040) 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f418b400640 1 -- 172.21.15.148:0/3060696707 learned_addr learned my addr 172.21.15.148:0/3060696707 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.026+0000 7f418aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 0x56435e3227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 -- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 msgr2=0x56435e3227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 0x56435e3227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 -- 172.21.15.148:0/3060696707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 msgr2=0x56435e321c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 -- 172.21.15.148:0/3060696707 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56435e0d6c50 con 0x56435e2ce020 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f418b400640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f418aa00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 0x56435e3227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:21.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4183e00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e321710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x56435e124ca0 tx=0x7f4174000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ad5cda02a2bdc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 10 client.0 ms_handle_connect on v2:172.21.15.157:3301/0 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174029350 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mon.2 v2:172.21.15.157:3301/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f41740294f0 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417c0b0040 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4174036050 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 10 client.4658 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x56435e1a0160 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mon.2 v2:172.21.15.157:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0040 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mon.2 v2:172.21.15.157:3301/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f4174039020 con 0x56435e2ce020 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 10 client.4658 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 10 client.4658 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 20 client.4658 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e38ac80 0x56435e38d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 4 client.4658 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 --> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] -- command(tid 0: {"prefix": "status"}) -- 0x56435e12ba10 con 0x56435e38ac80 2024-04-26T23:05:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f418aa00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e38ac80 0x56435e38d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f418aa00640 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e38ac80 0x56435e38d070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7654dcdc218e2d37 server_cookie=80aec2d0a037514f in_seq=0 out_seq=0 2024-04-26T23:05:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 10 client.4658 ms_handle_connect on v2:172.21.15.157:6834/4095294629 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 1 -- 172.21.15.148:0/3060696707 <== mds.2 v2:172.21.15.157:6834/4095294629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x56435e12ba10 con 0x56435e38ac80 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 10 client.4658 handle_command_reply: tid=0 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 client.4658 shutdown 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 msgr2=0x56435e321710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e321710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x56435e124ca0 tx=0x7f4174000ee0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 shutdown_connections 2024-04-26T23:05:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:6834/4095294629,v1:172.21.15.157:6836/4095294629] conn(0x56435e38ac80 0x56435e38d070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435e2ce940 0x56435e321c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56435e2ce020 0x56435e321710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 --2- 172.21.15.148:0/3060696707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56435e2cd700 0x56435e3227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f416fe00640 0 client.4658 ms_handle_reset on v2:172.21.15.157:6834/4095294629 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 >> 172.21.15.148:0/3060696707 conn(0x56435e30f5f0 msgr2=0x56435e32b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 shutdown_connections 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.030+0000 7f4194fba000 1 -- 172.21.15.148:0/3060696707 wait complete. 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f4194fba000 20 client.4658 trim_cache size 0 max 16384 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4245, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 11.054462699, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 15, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 24, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T23:05:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 47.669797994 2024-04-26T23:05:21.038 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:21.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 msgr2=0x7f416806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 0x7f416806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c7900 tx=0x7f4174007d40 comp rx=0 tx=0).stop 2024-04-26T23:05:21.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 msgr2=0x7f418c150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f417c009740 tx=0x7f417c01ad20 comp rx=0 tx=0).stop 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 shutdown_connections 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f41680683b0 0x7f416806a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f418c14c470 0x7f418c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f418c0ca0d0 0x7f418c149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 --2- 172.21.15.148:0/3151991702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418c0c6c50 0x7f418c150aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 >> 172.21.15.148:0/3151991702 conn(0x7f418c06e0a0 msgr2=0x7f418c153360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 shutdown_connections 2024-04-26T23:05:21.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.034+0000 7f418be00640 1 -- 172.21.15.148:0/3151991702 wait complete. 2024-04-26T23:05:21.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T23:05:21.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 Processor -- start 2024-04-26T23:05:21.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 -- start start 2024-04-26T23:05:21.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06f460 0x7f0a7c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a7c153eb0 0x7f0a7c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a7c06fd80 0x7f0a7c0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c15ac00 con 0x7f0a7c153eb0 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c070210 con 0x7f0a7c06fd80 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a83e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0c96a0 con 0x7f0a7c06f460 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a7c153eb0 0x7f0a7c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a7c153eb0 0x7f0a7c06f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56048/0 (socket says 172.21.15.148:56048) 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 -- 172.21.15.148:0/4172082915 learned_addr learned my addr 172.21.15.148:0/4172082915 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a81e00640 1 --2- 172.21.15.148:0/4172082915 >> v2:172.21.15.157:3300/0 conn(0x7f0a7c06fd80 0x7f0a7c0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a81400640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06f460 0x7f0a7c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 -- 172.21.15.148:0/4172082915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06f460 msgr2=0x7f0a7c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06f460 0x7f0a7c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 -- 172.21.15.148:0/4172082915 >> v2:172.21.15.157:3300/0 conn(0x7f0a7c06fd80 msgr2=0x7f0a7c0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 --2- 172.21.15.148:0/4172082915 >> v2:172.21.15.157:3300/0 conn(0x7f0a7c06fd80 0x7f0a7c0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.198+0000 7f0a80a00640 1 -- 172.21.15.148:0/4172082915 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0c9980 con 0x7f0a7c153eb0 2024-04-26T23:05:21.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a80a00640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c153eb0 0x7f0a7c06f840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0cb0c0 tx=0x7f0a6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a492ff12cb06e8d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a7be00640 1 -- 172.21.15.148:0/4172082915 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680b5070 con 0x7f0a7c153eb0 2024-04-26T23:05:21.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a7be00640 1 -- 172.21.15.148:0/4172082915 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680a89d0 con 0x7f0a7c153eb0 2024-04-26T23:05:21.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a7be00640 1 -- 172.21.15.148:0/4172082915 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680a8da0 con 0x7f0a7c153eb0 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 -- 172.21.15.148:0/4172082915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c153eb0 msgr2=0x7f0a7c06f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c153eb0 0x7f0a7c06f840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0cb0c0 tx=0x7f0a6801ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 -- 172.21.15.148:0/4172082915 shutdown_connections 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c153eb0 0x7f0a7c06f840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 --2- 172.21.15.148:0/4172082915 >> v2:172.21.15.157:3300/0 conn(0x7f0a7c06fd80 0x7f0a7c0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 --2- 172.21.15.148:0/4172082915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06f460 0x7f0a7c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 -- 172.21.15.148:0/4172082915 >> 172.21.15.148:0/4172082915 conn(0x7f0a7c0c9d10 msgr2=0x7f0a7c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 -- 172.21.15.148:0/4172082915 shutdown_connections 2024-04-26T23:05:21.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.202+0000 7f0a83e00640 1 -- 172.21.15.148:0/4172082915 wait complete. 2024-04-26T23:05:21.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 Processor -- start 2024-04-26T23:05:21.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- start start 2024-04-26T23:05:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06fd80 0x7f0a7c14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c1e48f0 0x7f0a7c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0c5120 con 0x7f0a7c06f460 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0708f0 con 0x7f0a7c1e48f0 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0c4d70 con 0x7f0a7c06fd80 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56054/0 (socket says 172.21.15.148:56054) 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 -- 172.21.15.148:0/312898170 learned_addr learned my addr 172.21.15.148:0/312898170 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c1e48f0 0x7f0a7c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a80a00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06fd80 0x7f0a7c14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 -- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06fd80 msgr2=0x7f0a7c14bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06fd80 0x7f0a7c14bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 -- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c1e48f0 msgr2=0x7f0a7c14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c1e48f0 0x7f0a7c14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 -- 172.21.15.148:0/312898170 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c14d810 con 0x7f0a7c06f460 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a81400640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e8a0 tx=0x7f0a7000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a79600640 1 -- 172.21.15.148:0/312898170 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70017070 con 0x7f0a7c06f460 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a79600640 1 -- 172.21.15.148:0/312898170 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7000ee90 con 0x7f0a7c06f460 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a79600640 1 -- 172.21.15.148:0/312898170 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000cb80 con 0x7f0a7c06f460 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c14daf0 con 0x7f0a7c06f460 2024-04-26T23:05:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.206+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c1edc50 con 0x7f0a7c06f460 2024-04-26T23:05:21.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a79600640 1 -- 172.21.15.148:0/312898170 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a7001a070 con 0x7f0a7c06f460 2024-04-26T23:05:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a79600640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 0x7f0a5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a79600640 1 -- 172.21.15.148:0/312898170 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a70086f60 con 0x7f0a7c06f460 2024-04-26T23:05:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 Processor -- start 2024-04-26T23:05:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a80a00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 0x7f0a5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 -- start start 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b020 0x555acf77b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77b940 0x555acf7c8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555acf635140 con 0x555acf77a700 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x555acf5cae00 con 0x555acf77b020 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x555acf583a00 con 0x555acf77b940 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a80a00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 0x7f0a5c06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b2000 tx=0x7f0a68008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56064/0 (socket says 172.21.15.148:56064) 2024-04-26T23:05:21.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 -- 172.21.15.148:0/2713074916 learned_addr learned my addr 172.21.15.148:0/2713074916 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a80a00640 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b020 0x555acf77b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81e00640 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77b940 0x555acf7c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 -- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77b940 msgr2=0x555acf7c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77b940 0x555acf7c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 -- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b020 msgr2=0x555acf77b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b020 0x555acf77b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 -- 172.21.15.148:0/2713074916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555acf5880e0 con 0x555acf77a700 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a81400640 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a70085020 tx=0x7f0a70056a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d13678fb79f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a6e000640 1 -- 172.21.15.148:0/2713074916 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70021070 con 0x555acf77a700 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a6e000640 1 -- 172.21.15.148:0/2713074916 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70054d40 con 0x555acf77a700 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.210+0000 7f0a6e000640 1 -- 172.21.15.148:0/2713074916 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700530b0 con 0x555acf77a700 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/2713074916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 msgr2=0x555acf77aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a70085020 tx=0x7f0a70056a40 comp rx=0 tx=0).stop 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/2713074916 shutdown_connections 2024-04-26T23:05:21.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77b940 0x555acf7c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b020 0x555acf77b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- 172.21.15.148:0/2713074916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77a700 0x555acf77aae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/2713074916 >> 172.21.15.148:0/2713074916 conn(0x555acf7bc5f0 msgr2=0x555acf7be9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/2713074916 shutdown_connections 2024-04-26T23:05:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/2713074916 wait complete. 2024-04-26T23:05:21.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- start start 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 Processor -- start 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555acf5d8200 con 0x555acf77b020 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x555acf56ee80 con 0x555acf77b940 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x555acf5c5ae0 con 0x555acf77a700 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 10 client.0 _ll_register_callbacks cb 0x555acf5d7da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56080/0 (socket says 172.21.15.148:56080) 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 -- 172.21.15.148:0/1046660961 learned_addr learned my addr 172.21.15.148:0/1046660961 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a81400640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a81e00640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 -- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 msgr2=0x555acf7bb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7bb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 -- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 msgr2=0x555acf7c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 -- 172.21.15.148:0/1046660961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555acf56a4e0 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68000c10 tx=0x7f0a6801d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aaa205563f1f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a62a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680b5040 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a680c7de0 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a70054d40 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f0a680bab30 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 10 client.4845 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555acf550e80 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.214+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70054d40 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f0a680bacd0 con 0x555acf77b020 2024-04-26T23:05:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 10 client.4845 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 10 client.4845 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 20 client.4845 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7c7960 0x555acf7c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 4 client.4845 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 --> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555acf563bc0 con 0x555acf7c7960 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a81400640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7c7960 0x555acf7c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a81400640 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7c7960 0x555acf7c7d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f83878f2a64626e server_cookie=34b52c8672286bbe in_seq=0 out_seq=0 2024-04-26T23:05:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a62a00640 10 client.4845 ms_handle_connect on v2:172.21.15.157:6835/4088233623 2024-04-26T23:05:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a62a00640 1 -- 172.21.15.148:0/1046660961 <== mds.1 v2:172.21.15.157:6835/4088233623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555acf563bc0 con 0x555acf7c7960 2024-04-26T23:05:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a62a00640 10 client.4845 handle_command_reply: tid=0 2024-04-26T23:05:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 client.4845 shutdown 2024-04-26T23:05:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 msgr2=0x555acf7bb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68000c10 tx=0x7f0a6801d550 comp rx=0 tx=0).stop 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 shutdown_connections 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7bb910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7c7960 0x555acf7c7d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1046660961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7bb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 >> 172.21.15.148:0/1046660961 conn(0x555acf7bc5f0 msgr2=0x555acf779e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a62a00640 0 client.4845 ms_handle_reset on v2:172.21.15.157:6835/4088233623 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 shutdown_connections 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 1 -- 172.21.15.148:0/1046660961 wait complete. 2024-04-26T23:05:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.218+0000 7f0a8726a000 20 client.4845 trim_cache size 0 max 16384 2024-04-26T23:05:21.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 Processor -- start 2024-04-26T23:05:21.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- start start 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c149f20 con 0x555acf77b020 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1f9e30 con 0x555acf77b940 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x555acf5607b0 con 0x555acf77a700 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56084/0 (socket says 172.21.15.148:56084) 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 -- 172.21.15.148:0/1857402016 learned_addr learned my addr 172.21.15.148:0/1857402016 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a81e00640 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a81400640 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 -- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 msgr2=0x555acf7c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 -- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 msgr2=0x555acf7ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 -- 172.21.15.148:0/1857402016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555acf780990 con 0x555acf77b020 2024-04-26T23:05:21.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a80a00640 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a6801ed50 tx=0x7f0a680be070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872c000e96c1c5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a6d600640 1 -- 172.21.15.148:0/1857402016 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680d4020 con 0x555acf77b020 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a6d600640 1 -- 172.21.15.148:0/1857402016 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680d1910 con 0x555acf77b020 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a6d600640 1 -- 172.21.15.148:0/1857402016 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680b5040 con 0x555acf77b020 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- 172.21.15.148:0/1857402016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 msgr2=0x555acf7c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a6801ed50 tx=0x7f0a680be070 comp rx=0 tx=0).stop 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- 172.21.15.148:0/1857402016 shutdown_connections 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7c9290 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 --2- 172.21.15.148:0/1857402016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- 172.21.15.148:0/1857402016 >> 172.21.15.148:0/1857402016 conn(0x555acf7bc5f0 msgr2=0x555acf7796f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- 172.21.15.148:0/1857402016 shutdown_connections 2024-04-26T23:05:21.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- 172.21.15.148:0/1857402016 wait complete. 2024-04-26T23:05:21.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.238+0000 7f0a8726a000 1 -- start start 2024-04-26T23:05:21.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 Processor -- start 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555acf5cf430 con 0x555acf77b020 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x555acf5ca110 con 0x555acf77b940 2024-04-26T23:05:21.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x555acf5d70a0 con 0x555acf77a700 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 10 client.0 _ll_register_callbacks cb 0x7f0a680b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56094/0 (socket says 172.21.15.148:56094) 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 -- 172.21.15.148:0/3944079577 learned_addr learned my addr 172.21.15.148:0/3944079577 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a81400640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a81e00640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 -- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 msgr2=0x555acf7cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 -- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 msgr2=0x555acf7cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 -- 172.21.15.148:0/3944079577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555acf583c50 con 0x555acf77b020 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a80a00640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b3040 tx=0x7f0a680aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e186232754c6d7bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a680b5050 con 0x555acf77b020 2024-04-26T23:05:21.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a680d1240 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a680d1910 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f0a680d4040 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 10 client.4851 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555acf64d160 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680d1910 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f0a680c76e0 con 0x555acf77b020 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 10 client.4851 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 10 client.4851 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 20 client.4851 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7ccc80 0x555acf7cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 4 client.4851 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 --> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] -- command(tid 0: {"prefix": "status"}) -- 0x555acf5d8a10 con 0x555acf7ccc80 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a81400640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7ccc80 0x555acf7cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a81400640 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7ccc80 0x555acf7cd060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ea51b3758a8ac39 server_cookie=b42dcc6e84dc6973 in_seq=0 out_seq=0 2024-04-26T23:05:21.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.242+0000 7f0a62a00640 10 client.4851 ms_handle_connect on v2:172.21.15.157:6835/4088233623 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a62a00640 1 -- 172.21.15.148:0/3944079577 <== mds.1 v2:172.21.15.157:6835/4088233623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555acf5d8a10 con 0x555acf7ccc80 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a62a00640 10 client.4851 handle_command_reply: tid=0 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 client.4851 shutdown 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 msgr2=0x555acf7cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b3040 tx=0x7f0a680aa000 comp rx=0 tx=0).stop 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 shutdown_connections 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555acf77b940 0x555acf7cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555acf77b020 0x555acf7cc200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:6835/4088233623,v1:172.21.15.157:6837/4088233623] conn(0x555acf7ccc80 0x555acf7cd060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 --2- 172.21.15.148:0/3944079577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x555acf77a700 0x555acf7cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 >> 172.21.15.148:0/3944079577 conn(0x555acf7bc5f0 msgr2=0x555acf778e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a62a00640 0 client.4851 ms_handle_reset on v2:172.21.15.157:6835/4088233623 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 shutdown_connections 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 1 -- 172.21.15.148:0/3944079577 wait complete. 2024-04-26T23:05:21.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a8726a000 20 client.4851 trim_cache size 0 max 16384 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4309, 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 16.306157211999999, 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 15, 2024-04-26T23:05:21.250 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 24, 2024-04-26T23:05:21.251 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T23:05:21.251 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 47.882508762000001 2024-04-26T23:05:21.251 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:21.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 msgr2=0x7f0a5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 0x7f0a5c06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b2000 tx=0x7f0a68008040 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 msgr2=0x7f0a7c1ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e8a0 tx=0x7f0a7000ed60 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 shutdown_connections 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a5c0683b0 0x7f0a5c06a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c1e48f0 0x7f0a7c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a7c06fd80 0x7f0a7c14bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 --2- 172.21.15.148:0/312898170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a7c06f460 0x7f0a7c1ee450 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 >> 172.21.15.148:0/312898170 conn(0x7f0a7c0c9d10 msgr2=0x7f0a7c0c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 shutdown_connections 2024-04-26T23:05:21.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.246+0000 7f0a83e00640 1 -- 172.21.15.148:0/312898170 wait complete. 2024-04-26T23:05:21.266 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:05:21.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 Processor -- start 2024-04-26T23:05:21.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 -- start start 2024-04-26T23:05:21.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41800cabf0 0x7f418015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41800cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41800ca950 con 0x7f418015c360 2024-04-26T23:05:21.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f41800c9df0 con 0x7f41800cabf0 2024-04-26T23:05:21.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417f200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f418015cce0 con 0x7f41800c8360 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41800cabf0 0x7f418015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41800cabf0 0x7f418015fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56100/0 (socket says 172.21.15.148:56100) 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 -- 172.21.15.148:0/3724227694 learned_addr learned my addr 172.21.15.148:0/3724227694 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f4175400640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41800cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 -- 172.21.15.148:0/3724227694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 msgr2=0x7f41800cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41800cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 -- 172.21.15.148:0/3724227694 >> v1:172.21.15.157:6789/0 conn(0x7f418015c360 legacy=0x7f418006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.402+0000 7f417de00640 1 -- 172.21.15.148:0/3724227694 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41800ca020 con 0x7f41800cabf0 2024-04-26T23:05:21.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417de00640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41800cabf0 0x7f418015fcb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4170009870 tx=0x7f417001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc455bf68a37fab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417d400640 1 -- 172.21.15.148:0/3724227694 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41700b2070 con 0x7f41800cabf0 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417d400640 1 -- 172.21.15.148:0/3724227694 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41700a9070 con 0x7f41800cabf0 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417d400640 1 -- 172.21.15.148:0/3724227694 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41700ad880 con 0x7f41800cabf0 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 -- 172.21.15.148:0/3724227694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41800cabf0 msgr2=0x7f418015fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41800cabf0 0x7f418015fcb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4170009870 tx=0x7f417001c560 comp rx=0 tx=0).stop 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 -- 172.21.15.148:0/3724227694 shutdown_connections 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41800cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 --2- 172.21.15.148:0/3724227694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41800cabf0 0x7f418015fcb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 -- 172.21.15.148:0/3724227694 >> 172.21.15.148:0/3724227694 conn(0x7f4180070ce0 msgr2=0x7f41800710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 -- 172.21.15.148:0/3724227694 shutdown_connections 2024-04-26T23:05:21.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.406+0000 7f417f200640 1 -- 172.21.15.148:0/3724227694 wait complete. 2024-04-26T23:05:21.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 Processor -- start 2024-04-26T23:05:21.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- start start 2024-04-26T23:05:21.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41801f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41800cabf0 0x7f41800bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f418015be40 con 0x7f418015c360 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f41800c9630 con 0x7f41800cabf0 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f418006df90 con 0x7f41800c8360 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417de00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41801f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56108/0 (socket says 172.21.15.148:56108) 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 -- 172.21.15.148:0/2354678008 learned_addr learned my addr 172.21.15.148:0/2354678008 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f4175400640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41800cabf0 0x7f41800bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 -- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 msgr2=0x7f41801f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41801f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 -- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41800cabf0 msgr2=0x7f41800bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41800cabf0 0x7f41800bf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 -- 172.21.15.148:0/2354678008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41800c03f0 con 0x7f418015c360 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417e800640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f417800c760 tx=0x7f417800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f4176a00640 1 -- 172.21.15.148:0/2354678008 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178003ba0 con 0x7f418015c360 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f4176a00640 1 -- 172.21.15.148:0/2354678008 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4178003d60 con 0x7f418015c360 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41800c0690 con 0x7f418015c360 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f4176a00640 1 -- 172.21.15.148:0/2354678008 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417800aa90 con 0x7f418015c360 2024-04-26T23:05:21.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.410+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41800c0c50 con 0x7f418015c360 2024-04-26T23:05:21.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4176a00640 1 -- 172.21.15.148:0/2354678008 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f417800ac30 con 0x7f418015c360 2024-04-26T23:05:21.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4176a00640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 0x7f415c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4176a00640 1 -- 172.21.15.148:0/2354678008 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4178086bf0 con 0x7f418015c360 2024-04-26T23:05:21.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f417de00640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 0x7f415c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 Processor -- start 2024-04-26T23:05:21.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 -- start start 2024-04-26T23:05:21.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f417de00640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 0x7f415c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f41700a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cafae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cb21b6a140 con 0x55cb21cb0020 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55cb21affe00 con 0x55cb21caf700 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55cb21ab8a00 con 0x55cb21cb0940 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56110/0 (socket says 172.21.15.148:56110) 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 -- 172.21.15.148:0/205314303 learned_addr learned my addr 172.21.15.148:0/205314303 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f417de00640 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f417e800640 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 -- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 msgr2=0x55cb21cfd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 -- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 msgr2=0x55cb21cafae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cafae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 -- 172.21.15.148:0/205314303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb21abd0e0 con 0x55cb21cb0020 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.414+0000 7f4175400640 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416800b8b0 tx=0x7f416800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d4bbb3498bd9fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f416ea00640 1 -- 172.21.15.148:0/205314303 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168018020 con 0x55cb21cb0020 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f416ea00640 1 -- 172.21.15.148:0/205314303 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416800f9c0 con 0x55cb21cb0020 2024-04-26T23:05:21.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f416ea00640 1 -- 172.21.15.148:0/205314303 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416800fdb0 con 0x55cb21cb0020 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/205314303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 msgr2=0x55cb21cb0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416800b8b0 tx=0x7f416800bd70 comp rx=0 tx=0).stop 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/205314303 shutdown_connections 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0020 0x55cb21cb0400 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- 172.21.15.148:0/205314303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cafae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/205314303 >> 172.21.15.148:0/205314303 conn(0x55cb21cf15f0 msgr2=0x55cb21cf39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/205314303 shutdown_connections 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/205314303 wait complete. 2024-04-26T23:05:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- start start 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 Processor -- start 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21cf0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cb21b0d200 con 0x55cb21caf700 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55cb21aa3e80 con 0x55cb21cb0020 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55cb21afaae0 con 0x55cb21cb0940 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 10 client.0 _ll_register_callbacks cb 0x55cb21b0cda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56112/0 (socket says 172.21.15.148:56112) 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 -- 172.21.15.148:0/529772390 learned_addr learned my addr 172.21.15.148:0/529772390 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417e800640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4175400640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21cf0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 -- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 msgr2=0x55cb21cfbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 -- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 msgr2=0x55cb21cf0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21cf0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 -- 172.21.15.148:0/529772390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb21a9f4e0 con 0x55cb21caf700 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f417de00640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4170009870 tx=0x7f41700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44b4e6d26e938a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4163400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41700cb060 con 0x55cb21caf700 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f41700b9df0 con 0x55cb21caf700 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.418+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f416800f9c0 con 0x55cb21caf700 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f41700d1050 con 0x55cb21caf700 2024-04-26T23:05:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 10 client.4863 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cb21a85e80 con 0x55cb21caf700 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416800f9c0 con 0x55cb21caf700 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f41700d4020 con 0x55cb21caf700 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 10 client.4863 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 10 client.4863 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 20 client.4863 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21cfc910 0x55cb21cfccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 4 client.4863 mds_command: new command op to 4312 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 --> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb21a98bc0 con 0x55cb21cfc910 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4175400640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21cfc910 0x55cb21cfccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4175400640 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21cfc910 0x55cb21cfccf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb6ee27bcc326f9 server_cookie=ed8202f6af1cc483 in_seq=0 out_seq=0 2024-04-26T23:05:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 10 client.4863 ms_handle_connect on v2:172.21.15.157:6838/1573676603 2024-04-26T23:05:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 1 -- 172.21.15.148:0/529772390 <== mds.0 v2:172.21.15.157:6838/1573676603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb21a98bc0 con 0x55cb21cfc910 2024-04-26T23:05:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 10 client.4863 handle_command_reply: tid=0 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 client.4863 shutdown 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 msgr2=0x55cb21cf03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4170009870 tx=0x7f41700046d0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 shutdown_connections 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21cfc910 0x55cb21cfccf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0940 0x55cb21cfbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21cf0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 --2- 172.21.15.148:0/529772390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21caf700 0x55cb21cf03d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4163400640 0 client.4863 ms_handle_reset on v2:172.21.15.157:6838/1573676603 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 >> 172.21.15.148:0/529772390 conn(0x55cb21cf15f0 msgr2=0x55cb21caee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 shutdown_connections 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 1 -- 172.21.15.148:0/529772390 wait complete. 2024-04-26T23:05:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.422+0000 7f4188591000 20 client.4863 trim_cache size 0 max 16384 2024-04-26T23:05:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 Processor -- start 2024-04-26T23:05:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- start start 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cfdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0020 0x55cb21cfe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f41801525e0 con 0x55cb21cb0940 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4180201200 con 0x55cb21caf700 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55cb21a957b0 con 0x55cb21cb0020 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56116/0 (socket says 172.21.15.148:56116) 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 -- 172.21.15.148:0/1889634391 learned_addr learned my addr 172.21.15.148:0/1889634391 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4175400640 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0020 0x55cb21cfe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417de00640 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cfdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 -- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0020 msgr2=0x55cb21cfe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0020 0x55cb21cfe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 -- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 msgr2=0x55cb21cfdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cfdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 -- 172.21.15.148:0/1889634391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb21cb5990 con 0x55cb21cb0940 2024-04-26T23:05:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f417e800640 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4178056580 tx=0x7f4178005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25de0bf4924e3c51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f416e000640 1 -- 172.21.15.148:0/1889634391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178073070 con 0x55cb21cb0940 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f416e000640 1 -- 172.21.15.148:0/1889634391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417805f2b0 con 0x55cb21cb0940 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f416e000640 1 -- 172.21.15.148:0/1889634391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178082070 con 0x55cb21cb0940 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- 172.21.15.148:0/1889634391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 msgr2=0x55cb21cef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4178056580 tx=0x7f4178005040 comp rx=0 tx=0).stop 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 -- 172.21.15.148:0/1889634391 shutdown_connections 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21cef230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21cb0020 0x55cb21cfe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.442+0000 7f4188591000 1 --2- 172.21.15.148:0/1889634391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21caf700 0x55cb21cfdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/1889634391 >> 172.21.15.148:0/1889634391 conn(0x55cb21cf15f0 msgr2=0x55cb21cae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/1889634391 shutdown_connections 2024-04-26T23:05:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/1889634391 wait complete. 2024-04-26T23:05:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- start start 2024-04-26T23:05:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 Processor -- start 2024-04-26T23:05:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 0x55cb21d00cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21d01200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cb21b04430 con 0x55cb21cb0940 2024-04-26T23:05:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55cb21aff110 con 0x55cb21cb0020 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55cb21b0c0a0 con 0x55cb21caf700 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 10 client.0 _ll_register_callbacks cb 0x7f41700ad640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56118/0 (socket says 172.21.15.148:56118) 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 -- 172.21.15.148:0/2714195750 learned_addr learned my addr 172.21.15.148:0/2714195750 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417de00640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 0x55cb21d00cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4175400640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21d01200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 -- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 msgr2=0x55cb21d00cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 0x55cb21d00cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 -- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 msgr2=0x55cb21d01200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21d01200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 -- 172.21.15.148:0/2714195750 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb21ab8c50 con 0x55cb21cb0940 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417de00640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 0x55cb21d00cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417e800640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41780548f0 tx=0x7f4178001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b4008ae24fa118 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178073070 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4178052cb0 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417805f2b0 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4178082040 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 10 client.4869 fetch_fsmap learned FSMap version 15 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cb21b82160 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417805f2b0 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f4178055a90 con 0x55cb21cb0940 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 10 client.4869 fetch_fsmap finished waiting for FSMap version 15 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 10 client.4869 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 20 client.4869 populate_metadata read hostname 'smithi148' 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21d01c80 0x55cb21d02060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 4 client.4869 mds_command: new command op to 4312 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:05:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 --> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] -- command(tid 0: {"prefix": "status"}) -- 0x55cb21b0da10 con 0x55cb21d01c80 2024-04-26T23:05:21.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.446+0000 7f417de00640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21d01c80 0x55cb21d02060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4163400640 10 client.4869 ms_handle_connect on v2:172.21.15.157:6838/1573676603 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417de00640 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21d01c80 0x55cb21d02060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278b9bbedf0e2c6d server_cookie=c2d02a6dd5e5a478 in_seq=0 out_seq=0 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4163400640 1 -- 172.21.15.148:0/2714195750 <== mds.0 v2:172.21.15.157:6838/1573676603 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55cb21b0da10 con 0x55cb21d01c80 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4163400640 10 client.4869 handle_command_reply: tid=0 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 client.4869 shutdown 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 msgr2=0x55cb21d01740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41780548f0 tx=0x7f4178001260 comp rx=0 tx=0).stop 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 shutdown_connections 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:6838/1573676603,v1:172.21.15.157:6839/1573676603] conn(0x55cb21d01c80 0x55cb21d02060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cb21cb0940 0x55cb21d01740 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55cb21cb0020 0x55cb21d01200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4163400640 0 client.4869 ms_handle_reset on v2:172.21.15.157:6838/1573676603 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 --2- 172.21.15.148:0/2714195750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55cb21caf700 0x55cb21d00cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 >> 172.21.15.148:0/2714195750 conn(0x55cb21cf15f0 msgr2=0x55cb21cade60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 shutdown_connections 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 1 -- 172.21.15.148:0/2714195750 wait complete. 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f4188591000 20 client.4869 trim_cache size 0 max 16384 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-04-26T23:05:21.455 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4312, 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 41.290715058000004, 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 15, 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 24, 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 48.081724477999998 2024-04-26T23:05:21.456 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 msgr2=0x7f415c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 0x7f415c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41700af000 tx=0x7f41700a7000 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 msgr2=0x7f41800be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f417800c760 tx=0x7f417800cc20 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 shutdown_connections 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f415c068380 0x7f415c06a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418015c360 0x7f41800be5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41800cabf0 0x7f41800bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 --2- 172.21.15.148:0/2354678008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41800c8360 0x7f41801f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 >> 172.21.15.148:0/2354678008 conn(0x7f4180070ce0 msgr2=0x7f418015b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 shutdown_connections 2024-04-26T23:05:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:21.450+0000 7f417f200640 1 -- 172.21.15.148:0/2354678008 wait complete. 2024-04-26T23:05:21.470 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:05:22.020 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:05:22.437 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:05:22.437 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:05:22.437 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T23:05:23.380 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T23:05:23.380 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T23:05:23.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:23.380 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-04-26T23:05:23.392 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T23:05:23.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:23.393 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T23:05:23.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:23.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-04-26T23:05:23.612 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-26T23:05:23.612 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:05:23.613 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:23.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:05:23.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 Processor -- start 2024-04-26T23:05:23.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 -- start start 2024-04-26T23:05:23.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8a9c1574b0 0x7f8a9c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c0cb7f0 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c0ca0d0 con 0x7f8a9c0b47e0 2024-04-26T23:05:23.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa2e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c0ccd80 con 0x7f8a9c1574b0 2024-04-26T23:05:23.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa0e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8a9c0c63f0 0x7f8a9c164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38482/0 (socket says 172.21.15.148:38482) 2024-04-26T23:05:23.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8aa0e00640 1 -- 172.21.15.148:0/2246482424 learned_addr learned my addr 172.21.15.148:0/2246482424 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9be00640 1 --2- 172.21.15.148:0/2246482424 >> v2:172.21.15.157:3300/0 conn(0x7f8a9c1574b0 0x7f8a9c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287243672 0 0) 0x7f8a9c0cb7f0 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a80003530 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660537955 0 0) 0x7f8a9c0ca0d0 con 0x7f8a9c0b47e0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a9c0cb7f0 con 0x7f8a9c0b47e0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4294080927 0 0) 0x7f8a80003530 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 >> v2:172.21.15.157:3300/0 conn(0x7f8a9c1574b0 msgr2=0x7f8a9c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 --2- 172.21.15.148:0/2246482424 >> v2:172.21.15.157:3300/0 conn(0x7f8a9c1574b0 0x7f8a9c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 >> v1:172.21.15.157:6789/0 conn(0x7f8a9c0b47e0 legacy=0x7f8a9c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c0cba90 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f8a94001680 con 0x7f8a9c0c63f0 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 >> v1:172.21.15.148:6789/0 conn(0x7f8a9c0c63f0 legacy=0x7f8a9c164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.750+0000 7f8a9aa00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a80003b50 0x7f8a80003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a80004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a800051d0 0x7f8a8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0ccd80 con 0x7f8a80004810 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8000c050 con 0x7f8a800051d0 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8000c250 con 0x7f8a80003b50 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a80004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a800051d0 0x7f8a8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9be00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a80003b50 0x7f8a80003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 -- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a80003b50 msgr2=0x7f8a80003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a80003b50 0x7f8a80003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 -- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a800051d0 msgr2=0x7f8a8000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a800051d0 0x7f8a8000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8aa0e00640 1 -- 172.21.15.148:0/2246482424 reap_dead start 2024-04-26T23:05:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 -- 172.21.15.148:0/2246482424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a80003530 con 0x7f8a80004810 2024-04-26T23:05:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9b400640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a80004c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0b4c00 tx=0x7f8a8801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3880564603dac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88001520 con 0x7f8a80004810 2024-04-26T23:05:23.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a880052f0 con 0x7f8a80004810 2024-04-26T23:05:23.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.754+0000 7f8a9aa00640 1 -- 172.21.15.148:0/2246482424 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880a8910 con 0x7f8a80004810 2024-04-26T23:05:23.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 msgr2=0x7f8a80004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a80004c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0b4c00 tx=0x7f8a8801ecb0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- 172.21.15.148:0/2246482424 shutdown_connections 2024-04-26T23:05:23.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/2246482424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a80004c90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- 172.21.15.148:0/2246482424 >> 172.21.15.148:0/2246482424 conn(0x7f8a9c071160 msgr2=0x7f8a9c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:23.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- 172.21.15.148:0/2246482424 shutdown_connections 2024-04-26T23:05:23.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- 172.21.15.148:0/2246482424 wait complete. 2024-04-26T23:05:23.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 Processor -- start 2024-04-26T23:05:23.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- start start 2024-04-26T23:05:23.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c1551b0 0x7f8a9c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 0x7f8a9c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0ca3b0 con 0x7f8a80004810 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0c9e80 con 0x7f8a9c06d8b0 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa2e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c0b1900 con 0x7f8a9c1551b0 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56136/0 (socket says 172.21.15.148:56136) 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 -- 172.21.15.148:0/3227156808 learned_addr learned my addr 172.21.15.148:0/3227156808 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9b400640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c1551b0 0x7f8a9c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 0x7f8a9c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 -- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c1551b0 msgr2=0x7f8a9c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c1551b0 0x7f8a9c0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 -- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 msgr2=0x7f8a9c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 0x7f8a9c06e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8a9be00640 1 -- 172.21.15.148:0/3227156808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c156d30 con 0x7f8a80004810 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.758+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 0x7f8a9c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:23.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a9be00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009f30 tx=0x7f8a8c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c019070 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8c0039a0 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c0cd320 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c003d70 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c0cd8a0 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c077c20 con 0x7f8a80004810 2024-04-26T23:05:23.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a8c01c070 con 0x7f8a80004810 2024-04-26T23:05:23.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.762+0000 7f8a93e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 0x7f8a7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:23.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.766+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a8c087830 con 0x7f8a80004810 2024-04-26T23:05:23.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.766+0000 7f8a9b400640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 0x7f8a7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:23.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.766+0000 7f8a9b400640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 0x7f8a7c06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a880b0000 tx=0x7f8a880aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:23.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.770+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a8c010040 con 0x7f8a80004810 2024-04-26T23:05:23.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.958+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8a9c0b1510 con 0x7f8a80004810 2024-04-26T23:05:23.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.958+0000 7f8a93e00640 1 -- 172.21.15.148:0/3227156808 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+88 (secure 0 0 0) 0x7f8a8c057aa0 con 0x7f8a80004810 2024-04-26T23:05:23.962 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 msgr2=0x7f8a7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 0x7f8a7c06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a880b0000 tx=0x7f8a880aa070 comp rx=0 tx=0).stop 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 msgr2=0x7f8a9c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009f30 tx=0x7f8a8c00f580 comp rx=0 tx=0).stop 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 shutdown_connections 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068380 0x7f8a7c06a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c06d8b0 0x7f8a9c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c1551b0 0x7f8a9c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 --2- 172.21.15.148:0/3227156808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a80004810 0x7f8a9c0ce0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:23.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 >> 172.21.15.148:0/3227156808 conn(0x7f8a9c071160 msgr2=0x7f8a9c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:23.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 shutdown_connections 2024-04-26T23:05:23.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:23.962+0000 7f8aa2e00640 1 -- 172.21.15.148:0/3227156808 wait complete. 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:05:23.983 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:05:23.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:23.984 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:05:23.993 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:f5:6a:5a:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:05:23.994 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:05:23.995 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:05:23.995 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:05:23.996 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:05:24.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:24.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:24.151 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:05:24.170 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-04-26T23:05:24.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:24.172 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-04-26T23:05:24.229 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-04-26T23:05:24.229 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:05:24.230 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:05:24.231 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:05:24.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:24.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:24.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:24.369 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-04-26T23:05:24.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:24.423 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-04-26T23:05:24.479 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:05:24.479 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:05:24.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:05:24.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T23:05:24.480 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:05:24.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:24.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:24.604 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T23:05:24.604 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:05:24.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:24.744 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:05:24.744 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-04-26T23:05:24.744 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-04-26T23:05:24.744 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:05:24.744 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-04-26T23:05:24.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:24.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:05:24.828 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:24.838 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:05:24.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:05:24.839 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:24.889 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T23:05:24.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:24.889 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:05:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:05:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:05:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2024-04-26T23:05:25.513 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:05:25.513 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:05:25.513 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2024-04-26T23:05:25.513 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.148:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-04-26T23:05:25.513 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.148:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.148:6789,172.21.15.157:6789,172.21.15.157:6790" 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.148:6789,172.21.15.157:6789,172.21.15.157:6790:/ 2024-04-26T23:05:25.527 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d6966320-e81f-47bf-b2a0-b4169b90f47b" will pass to kernel 2024-04-26T23:05:25.531 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:05:25.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:05:25.531 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:25.593 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:05:25.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:05:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:25.692 INFO:teuthology.orchestra.run.smithi148.stdout:client4878 2024-04-26T23:05:25.693 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:05:25.693 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:05:25.701 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:05:25.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:05:25.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:25.798 INFO:teuthology.orchestra.run.smithi148.stdout:client4878 2024-04-26T23:05:25.798 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:05:25.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:05:25.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:25.855 INFO:teuthology.orchestra.run.smithi148.stdout:client4878 2024-04-26T23:05:25.855 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d6966320-e81f-47bf-b2a0-b4169b90f47b.client4878/status') 2024-04-26T23:05:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:05:25.956 INFO:teuthology.orchestra.run.smithi148.stdout:instance: client.4878 (3)192.168.0.1:0/2604267158 2024-04-26T23:05:25.956 INFO:teuthology.orchestra.run.smithi148.stdout:blocklisted: false 2024-04-26T23:05:25.956 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records in 2024-04-26T23:05:25.956 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records out 2024-04-26T23:05:25.957 INFO:teuthology.orchestra.run.smithi148.stderr:69 bytes copied, 5.1454e-05 s, 1.3 MB/s 2024-04-26T23:05:25.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:05:25.964 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-04-26T23:05:25.976 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-04-26T23:05:25.977 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:26.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 Processor -- start 2024-04-26T23:05:26.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 -- start start 2024-04-26T23:05:26.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71500c82c0 0x7f71500c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715015f310 con 0x7f715015c0a0 2024-04-26T23:05:26.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715015f5f0 con 0x7f7150155ee0 2024-04-26T23:05:26.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.110+0000 7f714fe00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f715015fe90 con 0x7f71500c82c0 2024-04-26T23:05:26.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f7146000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71500c82c0 0x7f71500c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714f400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f715015c0a0 0x7f7150166360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38490/0 (socket says 172.21.15.148:38490) 2024-04-26T23:05:26.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714f400640 1 -- 172.21.15.148:0/3914526665 learned_addr learned my addr 172.21.15.148:0/3914526665 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:26.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714e000640 1 -- 172.21.15.148:0/3914526665 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561876623 0 0) 0x7f715015f310 con 0x7f715015c0a0 2024-04-26T23:05:26.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f7146000640 1 -- 172.21.15.148:0/3914526665 >> v1:172.21.15.157:6789/0 conn(0x7f7150155ee0 legacy=0x7f7150073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f7146000640 1 -- 172.21.15.148:0/3914526665 >> v1:172.21.15.148:6789/0 conn(0x7f715015c0a0 legacy=0x7f7150166360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f7146000640 1 -- 172.21.15.148:0/3914526665 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715015f8d0 con 0x7f71500c82c0 2024-04-26T23:05:26.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f7146000640 1 --2- 172.21.15.148:0/3914526665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c95d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71380097c0 tx=0x7f713801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10585b0ff060187 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714e000640 1 -- 172.21.15.148:0/3914526665 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71380b5070 con 0x7f71500c82c0 2024-04-26T23:05:26.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714e000640 1 -- 172.21.15.148:0/3914526665 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71380a8990 con 0x7f71500c82c0 2024-04-26T23:05:26.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.114+0000 7f714e000640 1 -- 172.21.15.148:0/3914526665 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71380a8d60 con 0x7f71500c82c0 2024-04-26T23:05:26.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- 172.21.15.148:0/3914526665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 msgr2=0x7f71500c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 --2- 172.21.15.148:0/3914526665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c95d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71380097c0 tx=0x7f713801ec90 comp rx=0 tx=0).stop 2024-04-26T23:05:26.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- 172.21.15.148:0/3914526665 shutdown_connections 2024-04-26T23:05:26.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 --2- 172.21.15.148:0/3914526665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c95d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- 172.21.15.148:0/3914526665 >> 172.21.15.148:0/3914526665 conn(0x7f715006e4f0 msgr2=0x7f715006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- 172.21.15.148:0/3914526665 shutdown_connections 2024-04-26T23:05:26.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- 172.21.15.148:0/3914526665 wait complete. 2024-04-26T23:05:26.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 Processor -- start 2024-04-26T23:05:26.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- start start 2024-04-26T23:05:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 0x7f7150157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715015c0a0 0x7f715014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7150068700 con 0x7f71500c82c0 2024-04-26T23:05:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f715015efd0 con 0x7f7150155ee0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714fe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7150073a60 con 0x7f715015c0a0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56146/0 (socket says 172.21.15.148:56146) 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 -- 172.21.15.148:0/890651598 learned_addr learned my addr 172.21.15.148:0/890651598 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f7146000640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 0x7f7150157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714f400640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715015c0a0 0x7f715014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 -- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715015c0a0 msgr2=0x7f715014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715015c0a0 0x7f715014b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 -- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 msgr2=0x7f7150157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 0x7f7150157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 -- 172.21.15.148:0/890651598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150158760 con 0x7f71500c82c0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f7146000640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 0x7f7150157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.118+0000 7f714ea00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f714000c3f0 tx=0x7f714000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140017070 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71400052d0 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140003840 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7150158df0 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71501f53c0 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71500506d0 con 0x7f71500c82c0 2024-04-26T23:05:26.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f714001a070 con 0x7f71500c82c0 2024-04-26T23:05:26.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 0x7f712c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f71400861c0 con 0x7f71500c82c0 2024-04-26T23:05:26.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.122+0000 7f7146000640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 0x7f712c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.126+0000 7f7146000640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 0x7f712c06a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71380b2000 tx=0x7f71380aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.126+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7140005480 con 0x7f71500c82c0 2024-04-26T23:05:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71500cd580 con 0x7f71500c82c0 2024-04-26T23:05:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f7147400640 1 -- 172.21.15.148:0/890651598 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f7140056310 con 0x7f71500c82c0 2024-04-26T23:05:26.292 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:26.292 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:04:44.580451+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 msgr2=0x7f712c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 0x7f712c06a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71380b2000 tx=0x7f71380aa070 comp rx=0 tx=0).stop 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 msgr2=0x7f71500c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f714000c3f0 tx=0x7f714000c8b0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 shutdown_connections 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f712c068380 0x7f712c06a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f715015c0a0 0x7f715014b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7150155ee0 0x7f7150157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 --2- 172.21.15.148:0/890651598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71500c82c0 0x7f71500c55f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 >> 172.21.15.148:0/890651598 conn(0x7f715006e4f0 msgr2=0x7f71500cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 shutdown_connections 2024-04-26T23:05:26.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.290+0000 7f714fe00640 1 -- 172.21.15.148:0/890651598 wait complete. 2024-04-26T23:05:26.314 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:05:26.315 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:05:26.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 Processor -- start 2024-04-26T23:05:26.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 -- start start 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0860152d00 0x7f08600c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0860158a80 0x7f0860158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0860073bb0 con 0x7f0860152d00 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f08600c4b30 con 0x7f0860158a80 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0868200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08600c6f60 con 0x7f0860073230 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0860152d00 0x7f08600c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0860152d00 0x7f08600c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45272/0 (socket says 172.21.15.148:45272) 2024-04-26T23:05:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 -- 172.21.15.148:0/1681112313 learned_addr learned my addr 172.21.15.148:0/1681112313 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0864e00640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0866200640 1 --2- 172.21.15.148:0/1681112313 >> v2:172.21.15.157:3300/0 conn(0x7f0860158a80 0x7f0860158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 -- 172.21.15.148:0/1681112313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 msgr2=0x7f0860073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 -- 172.21.15.148:0/1681112313 >> v2:172.21.15.157:3300/0 conn(0x7f0860158a80 msgr2=0x7f0860158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 --2- 172.21.15.148:0/1681112313 >> v2:172.21.15.157:3300/0 conn(0x7f0860158a80 0x7f0860158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.454+0000 7f0865800640 1 -- 172.21.15.148:0/1681112313 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08600c7240 con 0x7f0860152d00 2024-04-26T23:05:26.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0865800640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f08600c97d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08600c4540 tx=0x7f085401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9cafbc3139589a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f085fe00640 1 -- 172.21.15.148:0/1681112313 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540ab650 con 0x7f0860152d00 2024-04-26T23:05:26.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f085fe00640 1 -- 172.21.15.148:0/1681112313 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540b0070 con 0x7f0860152d00 2024-04-26T23:05:26.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f085fe00640 1 -- 172.21.15.148:0/1681112313 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540aba10 con 0x7f0860152d00 2024-04-26T23:05:26.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 -- 172.21.15.148:0/1681112313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 msgr2=0x7f08600c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f08600c97d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08600c4540 tx=0x7f085401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 -- 172.21.15.148:0/1681112313 shutdown_connections 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 --2- 172.21.15.148:0/1681112313 >> v2:172.21.15.157:3300/0 conn(0x7f0860158a80 0x7f0860158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 --2- 172.21.15.148:0/1681112313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f08600c97d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 -- 172.21.15.148:0/1681112313 >> 172.21.15.148:0/1681112313 conn(0x7f08600c9d10 msgr2=0x7f08600ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 -- 172.21.15.148:0/1681112313 shutdown_connections 2024-04-26T23:05:26.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.458+0000 7f0868200640 1 -- 172.21.15.148:0/1681112313 wait complete. 2024-04-26T23:05:26.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 Processor -- start 2024-04-26T23:05:26.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- start start 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0860158a80 0x7f08601416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08600c4f90 con 0x7f0860152d00 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08600c4e10 con 0x7f0860158a80 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08600c4710 con 0x7f0860073230 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45280/0 (socket says 172.21.15.148:45280) 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 -- 172.21.15.148:0/1333942305 learned_addr learned my addr 172.21.15.148:0/1333942305 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0865800640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0866200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0860158a80 0x7f08601416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 -- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 msgr2=0x7f0860147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 -- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0860158a80 msgr2=0x7f08601416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0860158a80 0x7f08601416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 -- 172.21.15.148:0/1333942305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0860158730 con 0x7f0860152d00 2024-04-26T23:05:26.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0864e00640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f084c00d830 tx=0x7f084c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c018030 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c00be10 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0098b0 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08601f8530 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08601f8af0 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.462+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0860077c20 con 0x7f0860152d00 2024-04-26T23:05:26.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.466+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f084c01b070 con 0x7f0860152d00 2024-04-26T23:05:26.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.466+0000 7f085d600640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 0x7f084006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.466+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f084c086db0 con 0x7f0860152d00 2024-04-26T23:05:26.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.466+0000 7f0865800640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 0x7f084006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.466+0000 7f0865800640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 0x7f084006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08540af000 tx=0x7f08540a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.470+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f084c08b070 con 0x7f0860152d00 2024-04-26T23:05:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0860075ff0 con 0x7f0860152d00 2024-04-26T23:05:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f085d600640 1 -- 172.21.15.148:0/1333942305 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f084c056940 con 0x7f0860152d00 2024-04-26T23:05:26.628 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 msgr2=0x7f084006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 0x7f084006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08540af000 tx=0x7f08540a7000 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 msgr2=0x7f0860141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f084c00d830 tx=0x7f084c00dcf0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 shutdown_connections 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0840068380 0x7f084006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0860158a80 0x7f08601416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0860152d00 0x7f0860141190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 --2- 172.21.15.148:0/1333942305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0860073230 0x7f0860147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 >> 172.21.15.148:0/1333942305 conn(0x7f08600c9d10 msgr2=0x7f0860148ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 shutdown_connections 2024-04-26T23:05:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.626+0000 7f0868200640 1 -- 172.21.15.148:0/1333942305 wait complete. 2024-04-26T23:05:26.649 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:05:26.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 Processor -- start 2024-04-26T23:05:26.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 -- start start 2024-04-26T23:05:26.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f683015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68300ccc10 0x7f683006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68301601b0 con 0x7f68300b1f60 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f683006d610 con 0x7f68300ccc10 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f6835600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f683015f3f0 con 0x7f6830155e80 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682f400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f68300b1f60 0x7f68300cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46438/0 (socket says 172.21.15.148:46438) 2024-04-26T23:05:26.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682f400640 1 -- 172.21.15.148:0/2363148053 learned_addr learned my addr 172.21.15.148:0/2363148053 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682e000640 1 --2- 172.21.15.148:0/2363148053 >> v2:172.21.15.157:3300/0 conn(0x7f68300ccc10 0x7f683006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682ea00640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f683015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645363364 0 0) 0x7f68301601b0 con 0x7f68300b1f60 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6814003530 con 0x7f68300b1f60 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 128390573 0 0) 0x7f6814003530 con 0x7f68300b1f60 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 msgr2=0x7f683015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f683015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 >> v2:172.21.15.157:3300/0 conn(0x7f68300ccc10 msgr2=0x7f683006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 --2- 172.21.15.148:0/2363148053 >> v2:172.21.15.157:3300/0 conn(0x7f68300ccc10 0x7f683006ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683015f6d0 con 0x7f68300b1f60 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f6828001a00 con 0x7f68300b1f60 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 >> v1:172.21.15.148:6789/0 conn(0x7f68300b1f60 legacy=0x7f68300cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68140039c0 0x7f6814003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f6814004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814004d50 0x7f68140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f683006d610 con 0x7f6814004d50 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f683015f3f0 con 0x7f68140039c0 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.786+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f681400b9d0 con 0x7f6830155e80 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814004d50 0x7f68140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682ea00640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68140039c0 0x7f6814003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682e000640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f6814004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 -- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 msgr2=0x7f6814004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6830155e80 0x7f6814004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 -- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68140039c0 msgr2=0x7f6814003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:26.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68140039c0 0x7f6814003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 -- 172.21.15.148:0/2363148053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6814003530 con 0x7f6814004d50 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814004d50 0x7f68140051d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f682800a870 tx=0x7f682801fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac782c7ed98497d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682800a4c0 con 0x7f6814004d50 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68280ad020 con 0x7f6814004d50 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682d600640 1 -- 172.21.15.148:0/2363148053 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280a9760 con 0x7f6814004d50 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f6835600640 1 -- 172.21.15.148:0/2363148053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814004d50 msgr2=0x7f68140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f6835600640 1 --2- 172.21.15.148:0/2363148053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814004d50 0x7f68140051d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f682800a870 tx=0x7f682801fb00 comp rx=0 tx=0).stop 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.790+0000 7f682f400640 1 -- 172.21.15.148:0/2363148053 reap_dead start 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- 172.21.15.148:0/2363148053 shutdown_connections 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- 172.21.15.148:0/2363148053 >> 172.21.15.148:0/2363148053 conn(0x7f6830068140 msgr2=0x7f6830068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- 172.21.15.148:0/2363148053 shutdown_connections 2024-04-26T23:05:26.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- 172.21.15.148:0/2363148053 wait complete. 2024-04-26T23:05:26.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 Processor -- start 2024-04-26T23:05:26.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- start start 2024-04-26T23:05:26.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6814004d50 0x7f68300b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68301536f0 0x7f6830154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6830156260 con 0x7f683015d5d0 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f683015fc90 con 0x7f6814004d50 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f6835600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68300b1a10 con 0x7f68301536f0 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45302/0 (socket says 172.21.15.148:45302) 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 -- 172.21.15.148:0/3682536092 learned_addr learned my addr 172.21.15.148:0/3682536092 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682ea00640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6814004d50 0x7f68300b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682e000640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68301536f0 0x7f6830154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 -- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68301536f0 msgr2=0x7f6830154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68301536f0 0x7f6830154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 -- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6814004d50 msgr2=0x7f68300b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6814004d50 0x7f68300b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 -- 172.21.15.148:0/3682536092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830152a10 con 0x7f683015d5d0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.794+0000 7f682f400640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f682801f930 tx=0x7f6814005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280011d0 con 0x7f683015d5d0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68280a9720 con 0x7f683015d5d0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828002040 con 0x7f683015d5d0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68300af8d0 con 0x7f683015d5d0 2024-04-26T23:05:26.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68300afe90 con 0x7f683015d5d0 2024-04-26T23:05:26.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6830077c20 con 0x7f683015d5d0 2024-04-26T23:05:26.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68280a9ad0 con 0x7f683015d5d0 2024-04-26T23:05:26.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 0x7f681006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:26.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6828123fe0 con 0x7f683015d5d0 2024-04-26T23:05:26.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.798+0000 7f682ea00640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 0x7f681006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:26.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.802+0000 7f682ea00640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 0x7f681006a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68300b19e0 tx=0x7f6820009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:26.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.802+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6828019810 con 0x7f683015d5d0 2024-04-26T23:05:26.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.958+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6830159680 con 0x7f683015d5d0 2024-04-26T23:05:26.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.958+0000 7f6826a00640 1 -- 172.21.15.148:0/3682536092 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f68280f4280 con 0x7f683015d5d0 2024-04-26T23:05:26.962 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 msgr2=0x7f681006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 0x7f681006a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68300b19e0 tx=0x7f6820009190 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 msgr2=0x7f683014b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f682801f930 tx=0x7f6814005840 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 shutdown_connections 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f68100683b0 0x7f681006a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f683015d5d0 0x7f683014b030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68301536f0 0x7f6830154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 --2- 172.21.15.148:0/3682536092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6814004d50 0x7f68300b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 >> 172.21.15.148:0/3682536092 conn(0x7f6830068140 msgr2=0x7f68300c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 shutdown_connections 2024-04-26T23:05:26.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:26.962+0000 7f6835600640 1 -- 172.21.15.148:0/3682536092 wait complete. 2024-04-26T23:05:26.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:05:27.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 Processor -- start 2024-04-26T23:05:27.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 -- start start 2024-04-26T23:05:27.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 0x7f3de006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 0x7f3de00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00cfb50 con 0x7f3de00c9e80 2024-04-26T23:05:27.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3de00cce10 con 0x7f3de00b1d80 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00cfe10 con 0x7f3de00c6340 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de4a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 0x7f3de006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 0x7f3de00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de5400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3de00c9e80 0x7f3de015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:54052/0 (socket says 172.21.15.148:54052) 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.122+0000 7f3de5400640 1 -- 172.21.15.148:0/1850157863 learned_addr learned my addr 172.21.15.148:0/1850157863 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1850157863 >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 msgr2=0x7f3de006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddfe00640 1 --2- 172.21.15.148:0/1850157863 >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 0x7f3de006feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1850157863 >> v1:172.21.15.157:6789/0 conn(0x7f3de00c9e80 legacy=0x7f3de015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1850157863 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de006d650 con 0x7f3de00c6340 2024-04-26T23:05:27.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3de4a00640 1 --2- 172.21.15.148:0/1850157863 >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 0x7f3de006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:27.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddfe00640 1 --2- 172.21.15.148:0/1850157863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 0x7f3de00703f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0097c0 tx=0x7f3dcc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ddbe5476800105 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddf400640 1 -- 172.21.15.148:0/1850157863 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0b5070 con 0x7f3de00c6340 2024-04-26T23:05:27.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddf400640 1 -- 172.21.15.148:0/1850157863 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0a8990 con 0x7f3de00c6340 2024-04-26T23:05:27.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.126+0000 7f3ddf400640 1 -- 172.21.15.148:0/1850157863 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0a8d60 con 0x7f3de00c6340 2024-04-26T23:05:27.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- 172.21.15.148:0/1850157863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 msgr2=0x7f3de00703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- 172.21.15.148:0/1850157863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 0x7f3de00703f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0097c0 tx=0x7f3dcc01ec90 comp rx=0 tx=0).stop 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- 172.21.15.148:0/1850157863 shutdown_connections 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- 172.21.15.148:0/1850157863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c6340 0x7f3de00703f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- 172.21.15.148:0/1850157863 >> v2:172.21.15.157:3300/0 conn(0x7f3de00b1d80 0x7f3de006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- 172.21.15.148:0/1850157863 >> 172.21.15.148:0/1850157863 conn(0x7f3de0071160 msgr2=0x7f3de0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- 172.21.15.148:0/1850157863 shutdown_connections 2024-04-26T23:05:27.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- 172.21.15.148:0/1850157863 wait complete. 2024-04-26T23:05:27.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 Processor -- start 2024-04-26T23:05:27.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- start start 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 0x7f3de00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c9e80 0x7f3de01493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00b2160 con 0x7f3de00c6340 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3de006dc10 con 0x7f3de00b1d80 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3de0071970 con 0x7f3de00c9e80 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45314/0 (socket says 172.21.15.148:45314) 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1444351337 learned_addr learned my addr 172.21.15.148:0/1444351337 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de5400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c9e80 0x7f3de01493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de4a00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 0x7f3de00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c9e80 msgr2=0x7f3de01493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c9e80 0x7f3de01493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 msgr2=0x7f3de00af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 0x7f3de00af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3ddfe00640 1 -- 172.21.15.148:0/1444351337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00b0c80 con 0x7f3de00c6340 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.130+0000 7f3de4a00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 0x7f3de00af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:27.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddfe00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0b3040 tx=0x7f3dcc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0bf070 con 0x7f3de00c6340 2024-04-26T23:05:27.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0b07a0 con 0x7f3de00c6340 2024-04-26T23:05:27.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de00b0f60 con 0x7f3de00c6340 2024-04-26T23:05:27.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0b5040 con 0x7f3de00c6340 2024-04-26T23:05:27.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de00b1520 con 0x7f3de00c6340 2024-04-26T23:05:27.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de0077c20 con 0x7f3de00c6340 2024-04-26T23:05:27.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3dcc0c2070 con 0x7f3de00c6340 2024-04-26T23:05:27.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 0x7f3dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3dcc123330 con 0x7f3de00c6340 2024-04-26T23:05:27.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.134+0000 7f3de4a00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 0x7f3dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.138+0000 7f3de4a00640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 0x7f3dc006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009bc0 tx=0x7f3dd4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.138+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3dcc0187f0 con 0x7f3de00c6340 2024-04-26T23:05:27.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.298+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3de00b4610 con 0x7f3de00c6340 2024-04-26T23:05:27.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3ddcc00640 1 -- 172.21.15.148:0/1444351337 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f3dcc0f2f50 con 0x7f3de00c6340 2024-04-26T23:05:27.302 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:05:27.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 msgr2=0x7f3dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 0x7f3dc006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009bc0 tx=0x7f3dd4008040 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 msgr2=0x7f3de0148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0b3040 tx=0x7f3dcc01ba30 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 shutdown_connections 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3dc0068380 0x7f3dc006a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3de00c9e80 0x7f3de01493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de00c6340 0x7f3de0148e70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 --2- 172.21.15.148:0/1444351337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de00b1d80 0x7f3de00af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 >> 172.21.15.148:0/1444351337 conn(0x7f3de0071160 msgr2=0x7f3de0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 shutdown_connections 2024-04-26T23:05:27.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.302+0000 7f3de7400640 1 -- 172.21.15.148:0/1444351337 wait complete. 2024-04-26T23:05:27.326 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:05:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 Processor -- start 2024-04-26T23:05:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 -- start start 2024-04-26T23:05:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc3c0ccc10 0x7efc3c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc3c0b1f60 0x7efc3c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c1601b0 con 0x7efc3c155e80 2024-04-26T23:05:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c06d610 con 0x7efc3c0ccc10 2024-04-26T23:05:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc43c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c15f3f0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc41200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efc3c155e80 0x7efc3c15bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46446/0 (socket says 172.21.15.148:46446) 2024-04-26T23:05:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc41200640 1 -- 172.21.15.148:0/1206159738 learned_addr learned my addr 172.21.15.148:0/1206159738 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc3be00640 1 --2- 172.21.15.148:0/1206159738 >> v2:172.21.15.148:3300/0 conn(0x7efc3c0ccc10 0x7efc3c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.462+0000 7efc41c00640 1 --2- 172.21.15.148:0/1206159738 >> v2:172.21.15.157:3300/0 conn(0x7efc3c0b1f60 0x7efc3c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824284461 0 0) 0x7efc3c1601b0 con 0x7efc3c155e80 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc20003530 con 0x7efc3c155e80 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3be00640 1 -- 172.21.15.148:0/1206159738 >> v2:172.21.15.157:3300/0 conn(0x7efc3c0b1f60 msgr2=0x7efc3c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3be00640 1 --2- 172.21.15.148:0/1206159738 >> v2:172.21.15.157:3300/0 conn(0x7efc3c0b1f60 0x7efc3c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3be00640 1 -- 172.21.15.148:0/1206159738 >> v1:172.21.15.148:6789/0 conn(0x7efc3c155e80 legacy=0x7efc3c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3038487986 0 0) 0x7efc20003530 con 0x7efc3c155e80 2024-04-26T23:05:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3be00640 1 -- 172.21.15.148:0/1206159738 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c15f6d0 con 0x7efc3c0ccc10 2024-04-26T23:05:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3be00640 1 --2- 172.21.15.148:0/1206159738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0ccc10 0x7efc3c06ff00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efc280097c0 tx=0x7efc2801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57228dd35e91999d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc280b0070 con 0x7efc3c0ccc10 2024-04-26T23:05:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc280ab400 con 0x7efc3c0ccc10 2024-04-26T23:05:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc3b400640 1 -- 172.21.15.148:0/1206159738 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c001a00 con 0x7efc3c0ccc10 2024-04-26T23:05:27.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc43c00640 1 -- 172.21.15.148:0/1206159738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0ccc10 msgr2=0x7efc3c06ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.466+0000 7efc43c00640 1 --2- 172.21.15.148:0/1206159738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0ccc10 0x7efc3c06ff00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efc280097c0 tx=0x7efc2801c2f0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1206159738 shutdown_connections 2024-04-26T23:05:27.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 --2- 172.21.15.148:0/1206159738 >> v2:172.21.15.157:3300/0 conn(0x7efc3c0b1f60 0x7efc3c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 --2- 172.21.15.148:0/1206159738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0ccc10 0x7efc3c06ff00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1206159738 >> 172.21.15.148:0/1206159738 conn(0x7efc3c068140 msgr2=0x7efc3c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:27.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1206159738 shutdown_connections 2024-04-26T23:05:27.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1206159738 wait complete. 2024-04-26T23:05:27.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 Processor -- start 2024-04-26T23:05:27.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- start start 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 0x7efc3c149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc3c155e80 0x7efc3c14a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c168e00 con 0x7efc3c0b1f60 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c156260 con 0x7efc3c0ccc10 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c168f80 con 0x7efc3c155e80 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45336/0 (socket says 172.21.15.148:45336) 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 -- 172.21.15.148:0/1443410200 learned_addr learned my addr 172.21.15.148:0/1443410200 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc3c155e80 0x7efc3c14a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc3be00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 0x7efc3c149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 -- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc3c155e80 msgr2=0x7efc3c14a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc3c155e80 0x7efc3c14a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 -- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 msgr2=0x7efc3c149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 0x7efc3c149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 -- 172.21.15.148:0/1443410200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c154bb0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc3be00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 0x7efc3c149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc41200640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0018b0 tx=0x7efc2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c012400 con 0x7efc3c0b1f60 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0125c0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c154e90 con 0x7efc3c0b1f60 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0129b0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.470+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c14c470 con 0x7efc3c0b1f60 2024-04-26T23:05:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.474+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c14ca80 con 0x7efc3c0b1f60 2024-04-26T23:05:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.474+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc2c012b50 con 0x7efc3c0b1f60 2024-04-26T23:05:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.474+0000 7efc38c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.474+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc2c087560 con 0x7efc3c0b1f60 2024-04-26T23:05:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.474+0000 7efc3be00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.478+0000 7efc3be00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 0x7efc1c06a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc280ad000 tx=0x7efc28008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.478+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc2c0577d0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efc3c14c260 con 0x7efc3c0b1f60 2024-04-26T23:05:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc38c00640 1 -- 172.21.15.148:0/1443410200 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7efc2c0570d0 con 0x7efc3c0b1f60 2024-04-26T23:05:27.640 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 msgr2=0x7efc1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 0x7efc1c06a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc280ad000 tx=0x7efc28008040 comp rx=0 tx=0).stop 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 msgr2=0x7efc3c15e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0018b0 tx=0x7efc2c00a430 comp rx=0 tx=0).stop 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 shutdown_connections 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc3c155e80 0x7efc3c14a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0ccc10 0x7efc3c149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 --2- 172.21.15.148:0/1443410200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0b1f60 0x7efc3c15e980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 >> 172.21.15.148:0/1443410200 conn(0x7efc3c068140 msgr2=0x7efc3c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 shutdown_connections 2024-04-26T23:05:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.638+0000 7efc43c00640 1 -- 172.21.15.148:0/1443410200 wait complete. 2024-04-26T23:05:27.661 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-04-26T23:05:27.661 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:27.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 Processor -- start 2024-04-26T23:05:27.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 -- start start 2024-04-26T23:05:27.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc44c0c9b60 0x7fc44c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c152fa0 con 0x7fc44c072d70 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c159790 con 0x7fc44c152bc0 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc450c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc44c158930 con 0x7fc44c0c9b60 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc449400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc44c072d70 0x7fc44c0731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46450/0 (socket says 172.21.15.148:46450) 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc449400640 1 -- 172.21.15.148:0/398658696 learned_addr learned my addr 172.21.15.148:0/398658696 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.794+0000 7fc44a800640 1 --2- 172.21.15.148:0/398658696 >> v2:172.21.15.157:3300/0 conn(0x7fc44c0c9b60 0x7fc44c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484886215 0 0) 0x7fc44c152fa0 con 0x7fc44c072d70 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc430005740 con 0x7fc44c072d70 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453106800 0 0) 0x7fc44c159790 con 0x7fc44c152bc0 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c152fa0 con 0x7fc44c152bc0 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc44a800640 1 -- 172.21.15.148:0/398658696 >> v1:172.21.15.157:6789/0 conn(0x7fc44c152bc0 legacy=0x7fc44c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc44a800640 1 -- 172.21.15.148:0/398658696 >> v1:172.21.15.148:6789/0 conn(0x7fc44c072d70 legacy=0x7fc44c0731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc44a800640 1 -- 172.21.15.148:0/398658696 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c158c10 con 0x7fc44c0c9b60 2024-04-26T23:05:27.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc44a800640 1 --2- 172.21.15.148:0/398658696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c9fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc444009d90 tx=0x7fc44401f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17f712325bbe04e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4440b4070 con 0x7fc44c0c9b60 2024-04-26T23:05:27.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4440af600 con 0x7fc44c0c9b60 2024-04-26T23:05:27.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.798+0000 7fc448a00640 1 -- 172.21.15.148:0/398658696 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4440af9b0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- 172.21.15.148:0/398658696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c0c9b60 msgr2=0x7fc44c0c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 --2- 172.21.15.148:0/398658696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c9fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc444009d90 tx=0x7fc44401f120 comp rx=0 tx=0).stop 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- 172.21.15.148:0/398658696 shutdown_connections 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 --2- 172.21.15.148:0/398658696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c9fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- 172.21.15.148:0/398658696 >> 172.21.15.148:0/398658696 conn(0x7fc44c06c380 msgr2=0x7fc44c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- 172.21.15.148:0/398658696 shutdown_connections 2024-04-26T23:05:27.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- 172.21.15.148:0/398658696 wait complete. 2024-04-26T23:05:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 Processor -- start 2024-04-26T23:05:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- start start 2024-04-26T23:05:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 0x7fc44c157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c152bc0 0x7fc44c1f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1594b0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1591d0 con 0x7fc44c152bc0 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc450c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c0ca4f0 con 0x7fc44c072d70 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc449400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc449400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45344/0 (socket says 172.21.15.148:45344) 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc449400640 1 -- 172.21.15.148:0/3991006649 learned_addr learned my addr 172.21.15.148:0/3991006649 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc44a800640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c152bc0 0x7fc44c1f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.802+0000 7fc449e00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 0x7fc44c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 -- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 msgr2=0x7fc44c157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 0x7fc44c157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 -- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c152bc0 msgr2=0x7fc44c1f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c152bc0 0x7fc44c1f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 -- 172.21.15.148:0/3991006649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c157bf0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449e00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 0x7fc44c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:27.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc449400640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c4d0 tx=0x7fc43800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438017070 con 0x7fc44c0c9b60 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438005cf0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c1f4c10 con 0x7fc44c0c9b60 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438007270 con 0x7fc44c0c9b60 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1f51d0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c077c20 con 0x7fc44c0c9b60 2024-04-26T23:05:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc43801a070 con 0x7fc44c0c9b60 2024-04-26T23:05:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 0x7fc42c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.806+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc438085fe0 con 0x7fc44c0c9b60 2024-04-26T23:05:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.810+0000 7fc449e00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 0x7fc42c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.810+0000 7fc449e00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 0x7fc42c06a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007b50 tx=0x7fc43c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.810+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc438055b70 con 0x7fc44c0c9b60 2024-04-26T23:05:27.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.966+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc44c0c9940 con 0x7fc42c0683b0 2024-04-26T23:05:27.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.990+0000 7fc442000640 1 -- 172.21.15.148:0/3991006649 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332675 (secure 0 0 0) 0x7fc44c0c9940 con 0x7fc42c0683b0 2024-04-26T23:05:27.996 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:27.999 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 msgr2=0x7fc42c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 0x7fc42c06a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007b50 tx=0x7fc43c009040 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 msgr2=0x7fc44c0c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c4d0 tx=0x7fc43800c990 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 shutdown_connections 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc42c0683b0 0x7fc42c06a870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc44c152bc0 0x7fc44c1f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc44c0c9b60 0x7fc44c0c8f90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 --2- 172.21.15.148:0/3991006649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc44c072d70 0x7fc44c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 >> 172.21.15.148:0/3991006649 conn(0x7fc44c06c380 msgr2=0x7fc44c0c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 shutdown_connections 2024-04-26T23:05:28.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:27.994+0000 7fc450c00640 1 -- 172.21.15.148:0/3991006649 wait complete. 2024-04-26T23:05:28.016 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-26T23:05:27.858051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235040,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739680,"statfs":{"total":773094113280,"available":772853432320,"internally_reserved":0,"allocated":2326528,"data_stored":1997688,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005247"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.992951+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:05:14.992951+0000","last_peered":"2024-04-26T23:05:14.992951+0000","last_clean":"2024-04-26T23:05:14.992951+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:05:14.992951+0000","last_undegraded":"2024-04-26T23:05:14.992951+0000","last_fullsized":"2024-04-26T23:05:14.992951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301588+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301588+0000","last_peered":"2024-04-26T23:04:47.301588+0000","last_clean":"2024-04-26T23:04:47.301588+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301588+0000","last_undegraded":"2024-04-26T23:04:47.301588+0000","last_fullsized":"2024-04-26T23:04:47.301588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.988132+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:05:14.988132+0000","last_peered":"2024-04-26T23:05:14.988132+0000","last_clean":"2024-04-26T23:05:14.988132+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:05:14.988132+0000","last_undegraded":"2024-04-26T23:05:14.988132+0000","last_fullsized":"2024-04-26T23:05:14.988132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.952003+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:05:09.952003+0000","last_peered":"2024-04-26T23:05:09.952003+0000","last_clean":"2024-04-26T23:05:09.952003+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:05:09.952003+0000","last_undegraded":"2024-04-26T23:05:09.952003+0000","last_fullsized":"2024-04-26T23:05:09.952003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303209+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303209+0000","last_peered":"2024-04-26T23:04:47.303209+0000","last_clean":"2024-04-26T23:04:47.303209+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303209+0000","last_undegraded":"2024-04-26T23:04:47.303209+0000","last_fullsized":"2024-04-26T23:04:47.303209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.959157+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:05:09.959157+0000","last_peered":"2024-04-26T23:05:09.959157+0000","last_clean":"2024-04-26T23:05:09.959157+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:05:09.959157+0000","last_undegraded":"2024-04-26T23:05:09.959157+0000","last_fullsized":"2024-04-26T23:05:09.959157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.958454+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:05:09.958454+0000","last_peered":"2024-04-26T23:05:09.958454+0000","last_clean":"2024-04-26T23:05:09.958454+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:05:09.958454+0000","last_undegraded":"2024-04-26T23:05:09.958454+0000","last_fullsized":"2024-04-26T23:05:09.958454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955451+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:05:09.955451+0000","last_peered":"2024-04-26T23:05:09.955451+0000","last_clean":"2024-04-26T23:05:09.955451+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:05:09.955451+0000","last_undegraded":"2024-04-26T23:05:09.955451+0000","last_fullsized":"2024-04-26T23:05:09.955451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.990440+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:05:14.990440+0000","last_peered":"2024-04-26T23:05:14.990440+0000","last_clean":"2024-04-26T23:05:14.990440+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:05:14.990440+0000","last_undegraded":"2024-04-26T23:05:14.990440+0000","last_fullsized":"2024-04-26T23:05:14.990440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802544+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802544+0000","last_peered":"2024-04-26T23:04:46.802544+0000","last_clean":"2024-04-26T23:04:46.802544+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802544+0000","last_undegraded":"2024-04-26T23:04:46.802544+0000","last_fullsized":"2024-04-26T23:04:46.802544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303609+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303609+0000","last_peered":"2024-04-26T23:04:47.303609+0000","last_clean":"2024-04-26T23:04:47.303609+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303609+0000","last_undegraded":"2024-04-26T23:04:47.303609+0000","last_fullsized":"2024-04-26T23:04:47.303609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991666+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:05:14.991666+0000","last_peered":"2024-04-26T23:05:14.991666+0000","last_clean":"2024-04-26T23:05:14.991666+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:05:14.991666+0000","last_undegraded":"2024-04-26T23:05:14.991666+0000","last_fullsized":"2024-04-26T23:05:14.991666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.990449+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:05:14.990449+0000","last_peered":"2024-04-26T23:05:14.990449+0000","last_clean":"2024-04-26T23:05:14.990449+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:05:14.990449+0000","last_undegraded":"2024-04-26T23:05:14.990449+0000","last_fullsized":"2024-04-26T23:05:14.990449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.956503+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:05:09.956503+0000","last_peered":"2024-04-26T23:05:09.956503+0000","last_clean":"2024-04-26T23:05:09.956503+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:05:09.956503+0000","last_undegraded":"2024-04-26T23:05:09.956503+0000","last_fullsized":"2024-04-26T23:05:09.956503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991616+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:05:14.991616+0000","last_peered":"2024-04-26T23:05:14.991616+0000","last_clean":"2024-04-26T23:05:14.991616+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:05:14.991616+0000","last_undegraded":"2024-04-26T23:05:14.991616+0000","last_fullsized":"2024-04-26T23:05:14.991616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190332+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190332+0000","last_peered":"2024-04-26T23:04:45.190332+0000","last_clean":"2024-04-26T23:04:45.190332+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190332+0000","last_undegraded":"2024-04-26T23:04:45.190332+0000","last_fullsized":"2024-04-26T23:04:45.190332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.992356+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:05:14.992356+0000","last_peered":"2024-04-26T23:05:14.992356+0000","last_clean":"2024-04-26T23:05:14.992356+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:05:14.992356+0000","last_undegraded":"2024-04-26T23:05:14.992356+0000","last_fullsized":"2024-04-26T23:05:14.992356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.986998+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:05:14.986998+0000","last_peered":"2024-04-26T23:05:14.986998+0000","last_clean":"2024-04-26T23:05:14.986998+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:05:14.986998+0000","last_undegraded":"2024-04-26T23:05:14.986998+0000","last_fullsized":"2024-04-26T23:05:14.986998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955155+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:05:09.955155+0000","last_peered":"2024-04-26T23:05:09.955155+0000","last_clean":"2024-04-26T23:05:09.955155+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:05:09.955155+0000","last_undegraded":"2024-04-26T23:05:09.955155+0000","last_fullsized":"2024-04-26T23:05:09.955155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991316+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:05:14.991316+0000","last_peered":"2024-04-26T23:05:14.991316+0000","last_clean":"2024-04-26T23:05:14.991316+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:05:14.991316+0000","last_undegraded":"2024-04-26T23:05:14.991316+0000","last_fullsized":"2024-04-26T23:05:14.991316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.959859+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:09.959859+0000","last_peered":"2024-04-26T23:05:09.959859+0000","last_clean":"2024-04-26T23:05:09.959859+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:09.959859+0000","last_undegraded":"2024-04-26T23:05:09.959859+0000","last_fullsized":"2024-04-26T23:05:09.959859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303327+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303327+0000","last_peered":"2024-04-26T23:04:47.303327+0000","last_clean":"2024-04-26T23:04:47.303327+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303327+0000","last_undegraded":"2024-04-26T23:04:47.303327+0000","last_fullsized":"2024-04-26T23:04:47.303327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955128+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:05:09.955128+0000","last_peered":"2024-04-26T23:05:09.955128+0000","last_clean":"2024-04-26T23:05:09.955128+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:05:09.955128+0000","last_undegraded":"2024-04-26T23:05:09.955128+0000","last_fullsized":"2024-04-26T23:05:09.955128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.956857+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:05:09.956857+0000","last_peered":"2024-04-26T23:05:09.956857+0000","last_clean":"2024-04-26T23:05:09.956857+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:05:09.956857+0000","last_undegraded":"2024-04-26T23:05:09.956857+0000","last_fullsized":"2024-04-26T23:05:09.956857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301620+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301620+0000","last_peered":"2024-04-26T23:04:47.301620+0000","last_clean":"2024-04-26T23:04:47.301620+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301620+0000","last_undegraded":"2024-04-26T23:04:47.301620+0000","last_fullsized":"2024-04-26T23:04:47.301620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.988164+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:05:14.988164+0000","last_peered":"2024-04-26T23:05:14.988164+0000","last_clean":"2024-04-26T23:05:14.988164+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:05:14.988164+0000","last_undegraded":"2024-04-26T23:05:14.988164+0000","last_fullsized":"2024-04-26T23:05:14.988164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.987091+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:05:14.987091+0000","last_peered":"2024-04-26T23:05:14.987091+0000","last_clean":"2024-04-26T23:05:14.987091+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:05:14.987091+0000","last_undegraded":"2024-04-26T23:05:14.987091+0000","last_fullsized":"2024-04-26T23:05:14.987091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.957874+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:05:09.957874+0000","last_peered":"2024-04-26T23:05:09.957874+0000","last_clean":"2024-04-26T23:05:09.957874+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:05:09.957874+0000","last_undegraded":"2024-04-26T23:05:09.957874+0000","last_fullsized":"2024-04-26T23:05:09.957874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":691940,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":104776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":101634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":100970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":101200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":691284,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:28.021 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:05:28.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 Processor -- start 2024-04-26T23:05:28.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 -- start start 2024-04-26T23:05:28.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa9dc0c7b80 0x7fa9dc0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9dc0c9d90 con 0x7fa9dc153af0 2024-04-26T23:05:28.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9dc0ca070 con 0x7fa9dc0c9010 2024-04-26T23:05:28.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9e1000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa9dc15dec0 con 0x7fa9dc0c7b80 2024-04-26T23:05:28.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9d9e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9dc153af0 0x7fa9dc15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46466/0 (socket says 172.21.15.148:46466) 2024-04-26T23:05:28.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9d9e00640 1 -- 172.21.15.148:0/4092476822 learned_addr learned my addr 172.21.15.148:0/4092476822 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:28.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.198+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/4092476822 >> v2:172.21.15.157:3300/0 conn(0x7fa9dc0c7b80 0x7fa9dc0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247862544 0 0) 0x7fa9dc0c9d90 con 0x7fa9dc153af0 2024-04-26T23:05:28.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9c0003530 con 0x7fa9dc153af0 2024-04-26T23:05:28.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1444300189 0 0) 0x7fa9c0003530 con 0x7fa9dc153af0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 >> v2:172.21.15.157:3300/0 conn(0x7fa9dc0c7b80 msgr2=0x7fa9dc0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 --2- 172.21.15.148:0/4092476822 >> v2:172.21.15.157:3300/0 conn(0x7fa9dc0c7b80 0x7fa9dc0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 >> v1:172.21.15.157:6789/0 conn(0x7fa9dc0c9010 legacy=0x7fa9dc0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc0ca350 con 0x7fa9dc153af0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fa9cc001680 con 0x7fa9dc153af0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 >> v1:172.21.15.148:6789/0 conn(0x7fa9dc153af0 legacy=0x7fa9dc15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c00039c0 0x7fa9c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 0x7fa9c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9c00051d0 0x7fa9c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc15dec0 con 0x7fa9c0004810 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c000c080 con 0x7fa9c00051d0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c000c280 con 0x7fa9c00039c0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 0x7fa9c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d9e00640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c00039c0 0x7fa9c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9da800640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9c00051d0 0x7fa9c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 -- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c00039c0 msgr2=0x7fa9c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c00039c0 0x7fa9c0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 -- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9c00051d0 msgr2=0x7fa9c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9c00051d0 0x7fa9c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9da800640 1 -- 172.21.15.148:0/4092476822 reap_dead start 2024-04-26T23:05:28.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 -- 172.21.15.148:0/4092476822 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c0003530 con 0x7fa9c0004810 2024-04-26T23:05:28.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.202+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 0x7fa9c0004c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009ae0 tx=0x7fa9c401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6871a582588d10f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b2070 con 0x7fa9c0004810 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c40a5660 con 0x7fa9c0004810 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d9400640 1 -- 172.21.15.148:0/4092476822 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40096b0 con 0x7fa9c0004810 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 msgr2=0x7fa9c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 0x7fa9c0004c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009ae0 tx=0x7fa9c401ca70 comp rx=0 tx=0).stop 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- 172.21.15.148:0/4092476822 shutdown_connections 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 --2- 172.21.15.148:0/4092476822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9c0004810 0x7fa9c0004c90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- 172.21.15.148:0/4092476822 >> 172.21.15.148:0/4092476822 conn(0x7fa9dc06c380 msgr2=0x7fa9dc06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- 172.21.15.148:0/4092476822 shutdown_connections 2024-04-26T23:05:28.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- 172.21.15.148:0/4092476822 wait complete. 2024-04-26T23:05:28.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 Processor -- start 2024-04-26T23:05:28.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- start start 2024-04-26T23:05:28.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c0004810 0x7fa9dc156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9dc14cce0 0x7fa9dc14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc15d290 con 0x7fa9dc1560a0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc0ca630 con 0x7fa9dc14cce0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9e1000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa9dc153ed0 con 0x7fa9c0004810 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45374/0 (socket says 172.21.15.148:45374) 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d3e00640 1 -- 172.21.15.148:0/850832345 learned_addr learned my addr 172.21.15.148:0/850832345 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9da800640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9dc14cce0 0x7fa9dc14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.206+0000 7fa9d9e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c0004810 0x7fa9dc156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 -- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c0004810 msgr2=0x7fa9dc156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c0004810 0x7fa9dc156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 -- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9dc14cce0 msgr2=0x7fa9dc14d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9dc14cce0 0x7fa9dc14d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 -- 172.21.15.148:0/850832345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc1ef3d0 con 0x7fa9dc1560a0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d3e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b0040 tx=0x7fa9c4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b2040 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c4004020 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40096b0 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc1ef6b0 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc1efc70 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9dc077c20 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9c4003620 con 0x7fa9dc1560a0 2024-04-26T23:05:28.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 0x7fa9b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.210+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7fa9c4120a40 con 0x7fa9dc1560a0 2024-04-26T23:05:28.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.214+0000 7fa9d9e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 0x7fa9b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.214+0000 7fa9d9e00640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 0x7fa9b806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc001ce0 tx=0x7fa9cc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.214+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa9c4016780 con 0x7fa9dc1560a0 2024-04-26T23:05:28.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.370+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9dc156500 con 0x7fa9b8068380 2024-04-26T23:05:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.390+0000 7fa9d2000640 1 -- 172.21.15.148:0/850832345 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332675 (secure 0 0 0) 0x7fa9dc156500 con 0x7fa9b8068380 2024-04-26T23:05:28.397 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:28.399 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:05:28.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 msgr2=0x7fa9b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 0x7fa9b806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc001ce0 tx=0x7fa9cc009040 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 msgr2=0x7fa9dc150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b0040 tx=0x7fa9c4019810 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 shutdown_connections 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa9b8068380 0x7fa9b806a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9dc14cce0 0x7fa9dc14d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9dc1560a0 0x7fa9dc150310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 --2- 172.21.15.148:0/850832345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9c0004810 0x7fa9dc156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 >> 172.21.15.148:0/850832345 conn(0x7fa9dc06c380 msgr2=0x7fa9dc0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 shutdown_connections 2024-04-26T23:05:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.398+0000 7fa9e1000640 1 -- 172.21.15.148:0/850832345 wait complete. 2024-04-26T23:05:28.417 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-04-26T23:05:28.038538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235040,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739680,"statfs":{"total":773094113280,"available":772853432320,"internally_reserved":0,"allocated":2326528,"data_stored":1997688,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.184574"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.992951+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:05:14.992951+0000","last_peered":"2024-04-26T23:05:14.992951+0000","last_clean":"2024-04-26T23:05:14.992951+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:05:14.992951+0000","last_undegraded":"2024-04-26T23:05:14.992951+0000","last_fullsized":"2024-04-26T23:05:14.992951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302505+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:04:47.302505+0000","last_peered":"2024-04-26T23:04:47.302505+0000","last_clean":"2024-04-26T23:04:47.302505+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:04:47.302505+0000","last_undegraded":"2024-04-26T23:04:47.302505+0000","last_fullsized":"2024-04-26T23:04:47.302505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301550+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:04:47.301550+0000","last_peered":"2024-04-26T23:04:47.301550+0000","last_clean":"2024-04-26T23:04:47.301550+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:04:47.301550+0000","last_undegraded":"2024-04-26T23:04:47.301550+0000","last_fullsized":"2024-04-26T23:04:47.301550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301588+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:04:47.301588+0000","last_peered":"2024-04-26T23:04:47.301588+0000","last_clean":"2024-04-26T23:04:47.301588+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:04:47.301588+0000","last_undegraded":"2024-04-26T23:04:47.301588+0000","last_fullsized":"2024-04-26T23:04:47.301588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659878+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:04:45.659878+0000","last_peered":"2024-04-26T23:04:45.659878+0000","last_clean":"2024-04-26T23:04:45.659878+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:04:45.659878+0000","last_undegraded":"2024-04-26T23:04:45.659878+0000","last_fullsized":"2024-04-26T23:04:45.659878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189638+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:04:45.189638+0000","last_peered":"2024-04-26T23:04:45.189638+0000","last_clean":"2024-04-26T23:04:45.189638+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:04:45.189638+0000","last_undegraded":"2024-04-26T23:04:45.189638+0000","last_fullsized":"2024-04-26T23:04:45.189638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.988132+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:05:14.988132+0000","last_peered":"2024-04-26T23:05:14.988132+0000","last_clean":"2024-04-26T23:05:14.988132+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:05:14.988132+0000","last_undegraded":"2024-04-26T23:05:14.988132+0000","last_fullsized":"2024-04-26T23:05:14.988132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303008+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:04:47.303008+0000","last_peered":"2024-04-26T23:04:47.303008+0000","last_clean":"2024-04-26T23:04:47.303008+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:04:47.303008+0000","last_undegraded":"2024-04-26T23:04:47.303008+0000","last_fullsized":"2024-04-26T23:04:47.303008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189918+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:04:45.189918+0000","last_peered":"2024-04-26T23:04:45.189918+0000","last_clean":"2024-04-26T23:04:45.189918+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:04:45.189918+0000","last_undegraded":"2024-04-26T23:04:45.189918+0000","last_fullsized":"2024-04-26T23:04:45.189918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801788+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:04:46.801788+0000","last_peered":"2024-04-26T23:04:46.801788+0000","last_clean":"2024-04-26T23:04:46.801788+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:04:46.801788+0000","last_undegraded":"2024-04-26T23:04:46.801788+0000","last_fullsized":"2024-04-26T23:04:46.801788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302964+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:04:47.302964+0000","last_peered":"2024-04-26T23:04:47.302964+0000","last_clean":"2024-04-26T23:04:47.302964+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:04:47.302964+0000","last_undegraded":"2024-04-26T23:04:47.302964+0000","last_fullsized":"2024-04-26T23:04:47.302964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189793+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:04:45.189793+0000","last_peered":"2024-04-26T23:04:45.189793+0000","last_clean":"2024-04-26T23:04:45.189793+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:04:45.189793+0000","last_undegraded":"2024-04-26T23:04:45.189793+0000","last_fullsized":"2024-04-26T23:04:45.189793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187111+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:04:45.187111+0000","last_peered":"2024-04-26T23:04:45.187111+0000","last_clean":"2024-04-26T23:04:45.187111+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:04:45.187111+0000","last_undegraded":"2024-04-26T23:04:45.187111+0000","last_fullsized":"2024-04-26T23:04:45.187111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.952003+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:05:09.952003+0000","last_peered":"2024-04-26T23:05:09.952003+0000","last_clean":"2024-04-26T23:05:09.952003+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:05:09.952003+0000","last_undegraded":"2024-04-26T23:05:09.952003+0000","last_fullsized":"2024-04-26T23:05:09.952003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190598+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:04:45.190598+0000","last_peered":"2024-04-26T23:04:45.190598+0000","last_clean":"2024-04-26T23:04:45.190598+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:04:45.190598+0000","last_undegraded":"2024-04-26T23:04:45.190598+0000","last_fullsized":"2024-04-26T23:04:45.190598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301830+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:04:47.301830+0000","last_peered":"2024-04-26T23:04:47.301830+0000","last_clean":"2024-04-26T23:04:47.301830+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:04:47.301830+0000","last_undegraded":"2024-04-26T23:04:47.301830+0000","last_fullsized":"2024-04-26T23:04:47.301830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303209+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:04:47.303209+0000","last_peered":"2024-04-26T23:04:47.303209+0000","last_clean":"2024-04-26T23:04:47.303209+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:04:47.303209+0000","last_undegraded":"2024-04-26T23:04:47.303209+0000","last_fullsized":"2024-04-26T23:04:47.303209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190210+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:04:45.190210+0000","last_peered":"2024-04-26T23:04:45.190210+0000","last_clean":"2024-04-26T23:04:45.190210+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:04:45.190210+0000","last_undegraded":"2024-04-26T23:04:45.190210+0000","last_fullsized":"2024-04-26T23:04:45.190210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302233+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:04:47.302233+0000","last_peered":"2024-04-26T23:04:47.302233+0000","last_clean":"2024-04-26T23:04:47.302233+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:04:47.302233+0000","last_undegraded":"2024-04-26T23:04:47.302233+0000","last_fullsized":"2024-04-26T23:04:47.302233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.959157+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:05:09.959157+0000","last_peered":"2024-04-26T23:05:09.959157+0000","last_clean":"2024-04-26T23:05:09.959157+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:05:09.959157+0000","last_undegraded":"2024-04-26T23:05:09.959157+0000","last_fullsized":"2024-04-26T23:05:09.959157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303507+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:04:47.303507+0000","last_peered":"2024-04-26T23:04:47.303507+0000","last_clean":"2024-04-26T23:04:47.303507+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:04:47.303507+0000","last_undegraded":"2024-04-26T23:04:47.303507+0000","last_fullsized":"2024-04-26T23:04:47.303507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190735+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:04:45.190735+0000","last_peered":"2024-04-26T23:04:45.190735+0000","last_clean":"2024-04-26T23:04:45.190735+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:04:45.190735+0000","last_undegraded":"2024-04-26T23:04:45.190735+0000","last_fullsized":"2024-04-26T23:04:45.190735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.958454+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:05:09.958454+0000","last_peered":"2024-04-26T23:05:09.958454+0000","last_clean":"2024-04-26T23:05:09.958454+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:05:09.958454+0000","last_undegraded":"2024-04-26T23:05:09.958454+0000","last_fullsized":"2024-04-26T23:05:09.958454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190048+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:04:45.190048+0000","last_peered":"2024-04-26T23:04:45.190048+0000","last_clean":"2024-04-26T23:04:45.190048+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:04:45.190048+0000","last_undegraded":"2024-04-26T23:04:45.190048+0000","last_fullsized":"2024-04-26T23:04:45.190048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659958+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:04:45.659958+0000","last_peered":"2024-04-26T23:04:45.659958+0000","last_clean":"2024-04-26T23:04:45.659958+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:04:45.659958+0000","last_undegraded":"2024-04-26T23:04:45.659958+0000","last_fullsized":"2024-04-26T23:04:45.659958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955451+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:05:09.955451+0000","last_peered":"2024-04-26T23:05:09.955451+0000","last_clean":"2024-04-26T23:05:09.955451+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:05:09.955451+0000","last_undegraded":"2024-04-26T23:05:09.955451+0000","last_fullsized":"2024-04-26T23:05:09.955451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189838+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:04:45.189838+0000","last_peered":"2024-04-26T23:04:45.189838+0000","last_clean":"2024-04-26T23:04:45.189838+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:04:45.189838+0000","last_undegraded":"2024-04-26T23:04:45.189838+0000","last_fullsized":"2024-04-26T23:04:45.189838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302676+0000","last_change":"2024-04-26T23:04:40.182540+0000","last_active":"2024-04-26T23:04:47.302676+0000","last_peered":"2024-04-26T23:04:47.302676+0000","last_clean":"2024-04-26T23:04:47.302676+0000","last_became_active":"2024-04-26T23:04:40.182259+0000","last_became_peered":"2024-04-26T23:04:40.182259+0000","last_unstale":"2024-04-26T23:04:47.302676+0000","last_undegraded":"2024-04-26T23:04:47.302676+0000","last_fullsized":"2024-04-26T23:04:47.302676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:16.247884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.990440+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:05:14.990440+0000","last_peered":"2024-04-26T23:05:14.990440+0000","last_clean":"2024-04-26T23:05:14.990440+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:05:14.990440+0000","last_undegraded":"2024-04-26T23:05:14.990440+0000","last_fullsized":"2024-04-26T23:05:14.990440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301921+0000","last_change":"2024-04-26T23:04:44.378671+0000","last_active":"2024-04-26T23:04:47.301921+0000","last_peered":"2024-04-26T23:04:47.301921+0000","last_clean":"2024-04-26T23:04:47.301921+0000","last_became_active":"2024-04-26T23:04:44.378239+0000","last_became_peered":"2024-04-26T23:04:44.378239+0000","last_unstale":"2024-04-26T23:04:47.301921+0000","last_undegraded":"2024-04-26T23:04:47.301921+0000","last_fullsized":"2024-04-26T23:04:47.301921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:37.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303121+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:04:47.303121+0000","last_peered":"2024-04-26T23:04:47.303121+0000","last_clean":"2024-04-26T23:04:47.303121+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:04:47.303121+0000","last_undegraded":"2024-04-26T23:04:47.303121+0000","last_fullsized":"2024-04-26T23:04:47.303121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802544+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:04:46.802544+0000","last_peered":"2024-04-26T23:04:46.802544+0000","last_clean":"2024-04-26T23:04:46.802544+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:04:46.802544+0000","last_undegraded":"2024-04-26T23:04:46.802544+0000","last_fullsized":"2024-04-26T23:04:46.802544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659470+0000","last_change":"2024-04-26T23:04:44.378709+0000","last_active":"2024-04-26T23:04:45.659470+0000","last_peered":"2024-04-26T23:04:45.659470+0000","last_clean":"2024-04-26T23:04:45.659470+0000","last_became_active":"2024-04-26T23:04:44.378311+0000","last_became_peered":"2024-04-26T23:04:44.378311+0000","last_unstale":"2024-04-26T23:04:45.659470+0000","last_undegraded":"2024-04-26T23:04:45.659470+0000","last_fullsized":"2024-04-26T23:04:45.659470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:31.228472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303241+0000","last_change":"2024-04-26T23:04:40.175787+0000","last_active":"2024-04-26T23:04:47.303241+0000","last_peered":"2024-04-26T23:04:47.303241+0000","last_clean":"2024-04-26T23:04:47.303241+0000","last_became_active":"2024-04-26T23:04:40.175419+0000","last_became_peered":"2024-04-26T23:04:40.175419+0000","last_unstale":"2024-04-26T23:04:47.303241+0000","last_undegraded":"2024-04-26T23:04:47.303241+0000","last_fullsized":"2024-04-26T23:04:47.303241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:27.847453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301717+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:04:47.301717+0000","last_peered":"2024-04-26T23:04:47.301717+0000","last_clean":"2024-04-26T23:04:47.301717+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:04:47.301717+0000","last_undegraded":"2024-04-26T23:04:47.301717+0000","last_fullsized":"2024-04-26T23:04:47.301717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302907+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:04:47.302907+0000","last_peered":"2024-04-26T23:04:47.302907+0000","last_clean":"2024-04-26T23:04:47.302907+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:04:47.302907+0000","last_undegraded":"2024-04-26T23:04:47.302907+0000","last_fullsized":"2024-04-26T23:04:47.302907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190333+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:04:45.190333+0000","last_peered":"2024-04-26T23:04:45.190333+0000","last_clean":"2024-04-26T23:04:45.190333+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:04:45.190333+0000","last_undegraded":"2024-04-26T23:04:45.190333+0000","last_fullsized":"2024-04-26T23:04:45.190333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303609+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:04:47.303609+0000","last_peered":"2024-04-26T23:04:47.303609+0000","last_clean":"2024-04-26T23:04:47.303609+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:04:47.303609+0000","last_undegraded":"2024-04-26T23:04:47.303609+0000","last_fullsized":"2024-04-26T23:04:47.303609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303184+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:04:47.303184+0000","last_peered":"2024-04-26T23:04:47.303184+0000","last_clean":"2024-04-26T23:04:47.303184+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:04:47.303184+0000","last_undegraded":"2024-04-26T23:04:47.303184+0000","last_fullsized":"2024-04-26T23:04:47.303184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302419+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:04:47.302419+0000","last_peered":"2024-04-26T23:04:47.302419+0000","last_clean":"2024-04-26T23:04:47.302419+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:04:47.302419+0000","last_undegraded":"2024-04-26T23:04:47.302419+0000","last_fullsized":"2024-04-26T23:04:47.302419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991666+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:05:14.991666+0000","last_peered":"2024-04-26T23:05:14.991666+0000","last_clean":"2024-04-26T23:05:14.991666+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:05:14.991666+0000","last_undegraded":"2024-04-26T23:05:14.991666+0000","last_fullsized":"2024-04-26T23:05:14.991666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303576+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:04:47.303576+0000","last_peered":"2024-04-26T23:04:47.303576+0000","last_clean":"2024-04-26T23:04:47.303576+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:04:47.303576+0000","last_undegraded":"2024-04-26T23:04:47.303576+0000","last_fullsized":"2024-04-26T23:04:47.303576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659290+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:04:45.659290+0000","last_peered":"2024-04-26T23:04:45.659290+0000","last_clean":"2024-04-26T23:04:45.659290+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:04:45.659290+0000","last_undegraded":"2024-04-26T23:04:45.659290+0000","last_fullsized":"2024-04-26T23:04:45.659290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.990449+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:05:14.990449+0000","last_peered":"2024-04-26T23:05:14.990449+0000","last_clean":"2024-04-26T23:05:14.990449+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:05:14.990449+0000","last_undegraded":"2024-04-26T23:05:14.990449+0000","last_fullsized":"2024-04-26T23:05:14.990449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659848+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:04:45.659848+0000","last_peered":"2024-04-26T23:04:45.659848+0000","last_clean":"2024-04-26T23:04:45.659848+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:04:45.659848+0000","last_undegraded":"2024-04-26T23:04:45.659848+0000","last_fullsized":"2024-04-26T23:04:45.659848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301946+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:04:47.301946+0000","last_peered":"2024-04-26T23:04:47.301946+0000","last_clean":"2024-04-26T23:04:47.301946+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:04:47.301946+0000","last_undegraded":"2024-04-26T23:04:47.301946+0000","last_fullsized":"2024-04-26T23:04:47.301946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.956503+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:05:09.956503+0000","last_peered":"2024-04-26T23:05:09.956503+0000","last_clean":"2024-04-26T23:05:09.956503+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:05:09.956503+0000","last_undegraded":"2024-04-26T23:05:09.956503+0000","last_fullsized":"2024-04-26T23:05:09.956503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801281+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:04:46.801281+0000","last_peered":"2024-04-26T23:04:46.801281+0000","last_clean":"2024-04-26T23:04:46.801281+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:04:46.801281+0000","last_undegraded":"2024-04-26T23:04:46.801281+0000","last_fullsized":"2024-04-26T23:04:46.801281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187405+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:04:45.187405+0000","last_peered":"2024-04-26T23:04:45.187405+0000","last_clean":"2024-04-26T23:04:45.187405+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:04:45.187405+0000","last_undegraded":"2024-04-26T23:04:45.187405+0000","last_fullsized":"2024-04-26T23:04:45.187405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801879+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:04:46.801879+0000","last_peered":"2024-04-26T23:04:46.801879+0000","last_clean":"2024-04-26T23:04:46.801879+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:04:46.801879+0000","last_undegraded":"2024-04-26T23:04:46.801879+0000","last_fullsized":"2024-04-26T23:04:46.801879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991616+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:05:14.991616+0000","last_peered":"2024-04-26T23:05:14.991616+0000","last_clean":"2024-04-26T23:05:14.991616+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:05:14.991616+0000","last_undegraded":"2024-04-26T23:05:14.991616+0000","last_fullsized":"2024-04-26T23:05:14.991616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186689+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:04:45.186689+0000","last_peered":"2024-04-26T23:04:45.186689+0000","last_clean":"2024-04-26T23:04:45.186689+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:04:45.186689+0000","last_undegraded":"2024-04-26T23:04:45.186689+0000","last_fullsized":"2024-04-26T23:04:45.186689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303160+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:04:47.303160+0000","last_peered":"2024-04-26T23:04:47.303160+0000","last_clean":"2024-04-26T23:04:47.303160+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:04:47.303160+0000","last_undegraded":"2024-04-26T23:04:47.303160+0000","last_fullsized":"2024-04-26T23:04:47.303160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301623+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:04:47.301623+0000","last_peered":"2024-04-26T23:04:47.301623+0000","last_clean":"2024-04-26T23:04:47.301623+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:04:47.301623+0000","last_undegraded":"2024-04-26T23:04:47.301623+0000","last_fullsized":"2024-04-26T23:04:47.301623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659686+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:04:45.659686+0000","last_peered":"2024-04-26T23:04:45.659686+0000","last_clean":"2024-04-26T23:04:45.659686+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:04:45.659686+0000","last_undegraded":"2024-04-26T23:04:45.659686+0000","last_fullsized":"2024-04-26T23:04:45.659686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802504+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:04:46.802504+0000","last_peered":"2024-04-26T23:04:46.802504+0000","last_clean":"2024-04-26T23:04:46.802504+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:04:46.802504+0000","last_undegraded":"2024-04-26T23:04:46.802504+0000","last_fullsized":"2024-04-26T23:04:46.802504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188416+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:04:45.188416+0000","last_peered":"2024-04-26T23:04:45.188416+0000","last_clean":"2024-04-26T23:04:45.188416+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:04:45.188416+0000","last_undegraded":"2024-04-26T23:04:45.188416+0000","last_fullsized":"2024-04-26T23:04:45.188416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302031+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:04:47.302031+0000","last_peered":"2024-04-26T23:04:47.302031+0000","last_clean":"2024-04-26T23:04:47.302031+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:04:47.302031+0000","last_undegraded":"2024-04-26T23:04:47.302031+0000","last_fullsized":"2024-04-26T23:04:47.302031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802365+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:04:46.802365+0000","last_peered":"2024-04-26T23:04:46.802365+0000","last_clean":"2024-04-26T23:04:46.802365+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:04:46.802365+0000","last_undegraded":"2024-04-26T23:04:46.802365+0000","last_fullsized":"2024-04-26T23:04:46.802365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190332+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:04:45.190332+0000","last_peered":"2024-04-26T23:04:45.190332+0000","last_clean":"2024-04-26T23:04:45.190332+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:04:45.190332+0000","last_undegraded":"2024-04-26T23:04:45.190332+0000","last_fullsized":"2024-04-26T23:04:45.190332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.189539+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:04:45.189539+0000","last_peered":"2024-04-26T23:04:45.189539+0000","last_clean":"2024-04-26T23:04:45.189539+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:04:45.189539+0000","last_undegraded":"2024-04-26T23:04:45.189539+0000","last_fullsized":"2024-04-26T23:04:45.189539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801445+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:04:46.801445+0000","last_peered":"2024-04-26T23:04:46.801445+0000","last_clean":"2024-04-26T23:04:46.801445+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:04:46.801445+0000","last_undegraded":"2024-04-26T23:04:46.801445+0000","last_fullsized":"2024-04-26T23:04:46.801445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.992356+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:05:14.992356+0000","last_peered":"2024-04-26T23:05:14.992356+0000","last_clean":"2024-04-26T23:05:14.992356+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:05:14.992356+0000","last_undegraded":"2024-04-26T23:05:14.992356+0000","last_fullsized":"2024-04-26T23:05:14.992356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659787+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:04:45.659787+0000","last_peered":"2024-04-26T23:04:45.659787+0000","last_clean":"2024-04-26T23:04:45.659787+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:04:45.659787+0000","last_undegraded":"2024-04-26T23:04:45.659787+0000","last_fullsized":"2024-04-26T23:04:45.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186702+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:04:45.186702+0000","last_peered":"2024-04-26T23:04:45.186702+0000","last_clean":"2024-04-26T23:04:45.186702+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:04:45.186702+0000","last_undegraded":"2024-04-26T23:04:45.186702+0000","last_fullsized":"2024-04-26T23:04:45.186702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.986998+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:05:14.986998+0000","last_peered":"2024-04-26T23:05:14.986998+0000","last_clean":"2024-04-26T23:05:14.986998+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:05:14.986998+0000","last_undegraded":"2024-04-26T23:05:14.986998+0000","last_fullsized":"2024-04-26T23:05:14.986998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302533+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:04:47.302533+0000","last_peered":"2024-04-26T23:04:47.302533+0000","last_clean":"2024-04-26T23:04:47.302533+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:04:47.302533+0000","last_undegraded":"2024-04-26T23:04:47.302533+0000","last_fullsized":"2024-04-26T23:04:47.302533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802458+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:04:46.802458+0000","last_peered":"2024-04-26T23:04:46.802458+0000","last_clean":"2024-04-26T23:04:46.802458+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:04:46.802458+0000","last_undegraded":"2024-04-26T23:04:46.802458+0000","last_fullsized":"2024-04-26T23:04:46.802458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955155+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:05:09.955155+0000","last_peered":"2024-04-26T23:05:09.955155+0000","last_clean":"2024-04-26T23:05:09.955155+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:05:09.955155+0000","last_undegraded":"2024-04-26T23:05:09.955155+0000","last_fullsized":"2024-04-26T23:05:09.955155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302400+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:04:47.302400+0000","last_peered":"2024-04-26T23:04:47.302400+0000","last_clean":"2024-04-26T23:04:47.302400+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:04:47.302400+0000","last_undegraded":"2024-04-26T23:04:47.302400+0000","last_fullsized":"2024-04-26T23:04:47.302400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659512+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:04:45.659512+0000","last_peered":"2024-04-26T23:04:45.659512+0000","last_clean":"2024-04-26T23:04:45.659512+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:04:45.659512+0000","last_undegraded":"2024-04-26T23:04:45.659512+0000","last_fullsized":"2024-04-26T23:04:45.659512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.991316+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:05:14.991316+0000","last_peered":"2024-04-26T23:05:14.991316+0000","last_clean":"2024-04-26T23:05:14.991316+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:05:14.991316+0000","last_undegraded":"2024-04-26T23:05:14.991316+0000","last_fullsized":"2024-04-26T23:05:14.991316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303091+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:04:47.303091+0000","last_peered":"2024-04-26T23:04:47.303091+0000","last_clean":"2024-04-26T23:04:47.303091+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:04:47.303091+0000","last_undegraded":"2024-04-26T23:04:47.303091+0000","last_fullsized":"2024-04-26T23:04:47.303091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801744+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:04:46.801744+0000","last_peered":"2024-04-26T23:04:46.801744+0000","last_clean":"2024-04-26T23:04:46.801744+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:04:46.801744+0000","last_undegraded":"2024-04-26T23:04:46.801744+0000","last_fullsized":"2024-04-26T23:04:46.801744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.959859+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:05:09.959859+0000","last_peered":"2024-04-26T23:05:09.959859+0000","last_clean":"2024-04-26T23:05:09.959859+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:05:09.959859+0000","last_undegraded":"2024-04-26T23:05:09.959859+0000","last_fullsized":"2024-04-26T23:05:09.959859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302981+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:04:47.302981+0000","last_peered":"2024-04-26T23:04:47.302981+0000","last_clean":"2024-04-26T23:04:47.302981+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:04:47.302981+0000","last_undegraded":"2024-04-26T23:04:47.302981+0000","last_fullsized":"2024-04-26T23:04:47.302981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190483+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:04:45.190483+0000","last_peered":"2024-04-26T23:04:45.190483+0000","last_clean":"2024-04-26T23:04:45.190483+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:04:45.190483+0000","last_undegraded":"2024-04-26T23:04:45.190483+0000","last_fullsized":"2024-04-26T23:04:45.190483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303327+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:04:47.303327+0000","last_peered":"2024-04-26T23:04:47.303327+0000","last_clean":"2024-04-26T23:04:47.303327+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:04:47.303327+0000","last_undegraded":"2024-04-26T23:04:47.303327+0000","last_fullsized":"2024-04-26T23:04:47.303327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190253+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:04:45.190253+0000","last_peered":"2024-04-26T23:04:45.190253+0000","last_clean":"2024-04-26T23:04:45.190253+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:04:45.190253+0000","last_undegraded":"2024-04-26T23:04:45.190253+0000","last_fullsized":"2024-04-26T23:04:45.190253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659934+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:04:45.659934+0000","last_peered":"2024-04-26T23:04:45.659934+0000","last_clean":"2024-04-26T23:04:45.659934+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:04:45.659934+0000","last_undegraded":"2024-04-26T23:04:45.659934+0000","last_fullsized":"2024-04-26T23:04:45.659934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.955128+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:05:09.955128+0000","last_peered":"2024-04-26T23:05:09.955128+0000","last_clean":"2024-04-26T23:05:09.955128+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:05:09.955128+0000","last_undegraded":"2024-04-26T23:05:09.955128+0000","last_fullsized":"2024-04-26T23:05:09.955128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302218+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:04:47.302218+0000","last_peered":"2024-04-26T23:04:47.302218+0000","last_clean":"2024-04-26T23:04:47.302218+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:04:47.302218+0000","last_undegraded":"2024-04-26T23:04:47.302218+0000","last_fullsized":"2024-04-26T23:04:47.302218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303567+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:04:47.303567+0000","last_peered":"2024-04-26T23:04:47.303567+0000","last_clean":"2024-04-26T23:04:47.303567+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:04:47.303567+0000","last_undegraded":"2024-04-26T23:04:47.303567+0000","last_fullsized":"2024-04-26T23:04:47.303567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.956857+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:05:09.956857+0000","last_peered":"2024-04-26T23:05:09.956857+0000","last_clean":"2024-04-26T23:05:09.956857+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:05:09.956857+0000","last_undegraded":"2024-04-26T23:05:09.956857+0000","last_fullsized":"2024-04-26T23:05:09.956857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301598+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:04:47.301598+0000","last_peered":"2024-04-26T23:04:47.301598+0000","last_clean":"2024-04-26T23:04:47.301598+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:04:47.301598+0000","last_undegraded":"2024-04-26T23:04:47.301598+0000","last_fullsized":"2024-04-26T23:04:47.301598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659542+0000","last_change":"2024-04-26T23:04:44.384744+0000","last_active":"2024-04-26T23:04:45.659542+0000","last_peered":"2024-04-26T23:04:45.659542+0000","last_clean":"2024-04-26T23:04:45.659542+0000","last_became_active":"2024-04-26T23:04:44.384071+0000","last_became_peered":"2024-04-26T23:04:44.384071+0000","last_unstale":"2024-04-26T23:04:45.659542+0000","last_undegraded":"2024-04-26T23:04:45.659542+0000","last_fullsized":"2024-04-26T23:04:45.659542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:34.539858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302761+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:04:47.302761+0000","last_peered":"2024-04-26T23:04:47.302761+0000","last_clean":"2024-04-26T23:04:47.302761+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:04:47.302761+0000","last_undegraded":"2024-04-26T23:04:47.302761+0000","last_fullsized":"2024-04-26T23:04:47.302761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301620+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:04:47.301620+0000","last_peered":"2024-04-26T23:04:47.301620+0000","last_clean":"2024-04-26T23:04:47.301620+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:04:47.301620+0000","last_undegraded":"2024-04-26T23:04:47.301620+0000","last_fullsized":"2024-04-26T23:04:47.301620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187689+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:04:45.187689+0000","last_peered":"2024-04-26T23:04:45.187689+0000","last_clean":"2024-04-26T23:04:45.187689+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:04:45.187689+0000","last_undegraded":"2024-04-26T23:04:45.187689+0000","last_fullsized":"2024-04-26T23:04:45.187689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302141+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:04:47.302141+0000","last_peered":"2024-04-26T23:04:47.302141+0000","last_clean":"2024-04-26T23:04:47.302141+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:04:47.302141+0000","last_undegraded":"2024-04-26T23:04:47.302141+0000","last_fullsized":"2024-04-26T23:04:47.302141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.988164+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:05:14.988164+0000","last_peered":"2024-04-26T23:05:14.988164+0000","last_clean":"2024-04-26T23:05:14.988164+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:05:14.988164+0000","last_undegraded":"2024-04-26T23:05:14.988164+0000","last_fullsized":"2024-04-26T23:05:14.988164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:14.987091+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:05:14.987091+0000","last_peered":"2024-04-26T23:05:14.987091+0000","last_clean":"2024-04-26T23:05:14.987091+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:05:14.987091+0000","last_undegraded":"2024-04-26T23:05:14.987091+0000","last_fullsized":"2024-04-26T23:05:14.987091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659768+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:04:45.659768+0000","last_peered":"2024-04-26T23:04:45.659768+0000","last_clean":"2024-04-26T23:04:45.659768+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:04:45.659768+0000","last_undegraded":"2024-04-26T23:04:45.659768+0000","last_fullsized":"2024-04-26T23:04:45.659768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188151+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:04:45.188151+0000","last_peered":"2024-04-26T23:04:45.188151+0000","last_clean":"2024-04-26T23:04:45.188151+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:04:45.188151+0000","last_undegraded":"2024-04-26T23:04:45.188151+0000","last_fullsized":"2024-04-26T23:04:45.188151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:05:09.957874+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:05:09.957874+0000","last_peered":"2024-04-26T23:05:09.957874+0000","last_clean":"2024-04-26T23:05:09.957874+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:05:09.957874+0000","last_undegraded":"2024-04-26T23:05:09.957874+0000","last_fullsized":"2024-04-26T23:05:09.957874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190009+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:04:45.190009+0000","last_peered":"2024-04-26T23:04:45.190009+0000","last_clean":"2024-04-26T23:04:45.190009+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:04:45.190009+0000","last_undegraded":"2024-04-26T23:04:45.190009+0000","last_fullsized":"2024-04-26T23:04:45.190009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302762+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:04:47.302762+0000","last_peered":"2024-04-26T23:04:47.302762+0000","last_clean":"2024-04-26T23:04:47.302762+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:04:47.302762+0000","last_undegraded":"2024-04-26T23:04:47.302762+0000","last_fullsized":"2024-04-26T23:04:47.302762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.186563+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:04:45.186563+0000","last_peered":"2024-04-26T23:04:45.186563+0000","last_clean":"2024-04-26T23:04:45.186563+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:04:45.186563+0000","last_undegraded":"2024-04-26T23:04:45.186563+0000","last_fullsized":"2024-04-26T23:04:45.186563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187952+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:04:45.187952+0000","last_peered":"2024-04-26T23:04:45.187952+0000","last_clean":"2024-04-26T23:04:45.187952+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:04:45.187952+0000","last_undegraded":"2024-04-26T23:04:45.187952+0000","last_fullsized":"2024-04-26T23:04:45.187952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303158+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:04:47.303158+0000","last_peered":"2024-04-26T23:04:47.303158+0000","last_clean":"2024-04-26T23:04:47.303158+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:04:47.303158+0000","last_undegraded":"2024-04-26T23:04:47.303158+0000","last_fullsized":"2024-04-26T23:04:47.303158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659655+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:04:45.659655+0000","last_peered":"2024-04-26T23:04:45.659655+0000","last_clean":"2024-04-26T23:04:45.659655+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:04:45.659655+0000","last_undegraded":"2024-04-26T23:04:45.659655+0000","last_fullsized":"2024-04-26T23:04:45.659655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302600+0000","last_change":"2024-04-26T23:04:40.154517+0000","last_active":"2024-04-26T23:04:47.302600+0000","last_peered":"2024-04-26T23:04:47.302600+0000","last_clean":"2024-04-26T23:04:47.302600+0000","last_became_active":"2024-04-26T23:04:40.154174+0000","last_became_peered":"2024-04-26T23:04:40.154174+0000","last_unstale":"2024-04-26T23:04:47.302600+0000","last_undegraded":"2024-04-26T23:04:47.302600+0000","last_fullsized":"2024-04-26T23:04:47.302600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303245+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:04:47.303245+0000","last_peered":"2024-04-26T23:04:47.303245+0000","last_clean":"2024-04-26T23:04:47.303245+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:04:47.303245+0000","last_undegraded":"2024-04-26T23:04:47.303245+0000","last_fullsized":"2024-04-26T23:04:47.303245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187853+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:04:45.187853+0000","last_peered":"2024-04-26T23:04:45.187853+0000","last_clean":"2024-04-26T23:04:45.187853+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:04:45.187853+0000","last_undegraded":"2024-04-26T23:04:45.187853+0000","last_fullsized":"2024-04-26T23:04:45.187853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302631+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:04:47.302631+0000","last_peered":"2024-04-26T23:04:47.302631+0000","last_clean":"2024-04-26T23:04:47.302631+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:04:47.302631+0000","last_undegraded":"2024-04-26T23:04:47.302631+0000","last_fullsized":"2024-04-26T23:04:47.302631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302513+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:04:47.302513+0000","last_peered":"2024-04-26T23:04:47.302513+0000","last_clean":"2024-04-26T23:04:47.302513+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:04:47.302513+0000","last_undegraded":"2024-04-26T23:04:47.302513+0000","last_fullsized":"2024-04-26T23:04:47.302513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301695+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:04:47.301695+0000","last_peered":"2024-04-26T23:04:47.301695+0000","last_clean":"2024-04-26T23:04:47.301695+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:04:47.301695+0000","last_undegraded":"2024-04-26T23:04:47.301695+0000","last_fullsized":"2024-04-26T23:04:47.301695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303057+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:04:47.303057+0000","last_peered":"2024-04-26T23:04:47.303057+0000","last_clean":"2024-04-26T23:04:47.303057+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:04:47.303057+0000","last_undegraded":"2024-04-26T23:04:47.303057+0000","last_fullsized":"2024-04-26T23:04:47.303057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659572+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:04:45.659572+0000","last_peered":"2024-04-26T23:04:45.659572+0000","last_clean":"2024-04-26T23:04:45.659572+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:04:45.659572+0000","last_undegraded":"2024-04-26T23:04:45.659572+0000","last_fullsized":"2024-04-26T23:04:45.659572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187899+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:04:45.187899+0000","last_peered":"2024-04-26T23:04:45.187899+0000","last_clean":"2024-04-26T23:04:45.187899+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:04:45.187899+0000","last_undegraded":"2024-04-26T23:04:45.187899+0000","last_fullsized":"2024-04-26T23:04:45.187899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802232+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:04:46.802232+0000","last_peered":"2024-04-26T23:04:46.802232+0000","last_clean":"2024-04-26T23:04:46.802232+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:04:46.802232+0000","last_undegraded":"2024-04-26T23:04:46.802232+0000","last_fullsized":"2024-04-26T23:04:46.802232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.188350+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:04:45.188350+0000","last_peered":"2024-04-26T23:04:45.188350+0000","last_clean":"2024-04-26T23:04:45.188350+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:04:45.188350+0000","last_undegraded":"2024-04-26T23:04:45.188350+0000","last_fullsized":"2024-04-26T23:04:45.188350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303817+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:04:47.303817+0000","last_peered":"2024-04-26T23:04:47.303817+0000","last_clean":"2024-04-26T23:04:47.303817+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:04:47.303817+0000","last_undegraded":"2024-04-26T23:04:47.303817+0000","last_fullsized":"2024-04-26T23:04:47.303817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302346+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:04:47.302346+0000","last_peered":"2024-04-26T23:04:47.302346+0000","last_clean":"2024-04-26T23:04:47.302346+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:04:47.302346+0000","last_undegraded":"2024-04-26T23:04:47.302346+0000","last_fullsized":"2024-04-26T23:04:47.302346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302858+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:04:47.302858+0000","last_peered":"2024-04-26T23:04:47.302858+0000","last_clean":"2024-04-26T23:04:47.302858+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:04:47.302858+0000","last_undegraded":"2024-04-26T23:04:47.302858+0000","last_fullsized":"2024-04-26T23:04:47.302858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659415+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:04:45.659415+0000","last_peered":"2024-04-26T23:04:45.659415+0000","last_clean":"2024-04-26T23:04:45.659415+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:04:45.659415+0000","last_undegraded":"2024-04-26T23:04:45.659415+0000","last_fullsized":"2024-04-26T23:04:45.659415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.301906+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:04:47.301906+0000","last_peered":"2024-04-26T23:04:47.301906+0000","last_clean":"2024-04-26T23:04:47.301906+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:04:47.301906+0000","last_undegraded":"2024-04-26T23:04:47.301906+0000","last_fullsized":"2024-04-26T23:04:47.301906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.190407+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:04:45.190407+0000","last_peered":"2024-04-26T23:04:45.190407+0000","last_clean":"2024-04-26T23:04:45.190407+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:04:45.190407+0000","last_undegraded":"2024-04-26T23:04:45.190407+0000","last_fullsized":"2024-04-26T23:04:45.190407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187489+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:04:45.187489+0000","last_peered":"2024-04-26T23:04:45.187489+0000","last_clean":"2024-04-26T23:04:45.187489+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:04:45.187489+0000","last_undegraded":"2024-04-26T23:04:45.187489+0000","last_fullsized":"2024-04-26T23:04:45.187489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.187833+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:04:45.187833+0000","last_peered":"2024-04-26T23:04:45.187833+0000","last_clean":"2024-04-26T23:04:45.187833+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:04:45.187833+0000","last_undegraded":"2024-04-26T23:04:45.187833+0000","last_fullsized":"2024-04-26T23:04:45.187833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802417+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:04:46.802417+0000","last_peered":"2024-04-26T23:04:46.802417+0000","last_clean":"2024-04-26T23:04:46.802417+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:04:46.802417+0000","last_undegraded":"2024-04-26T23:04:46.802417+0000","last_fullsized":"2024-04-26T23:04:46.802417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302034+0000","last_change":"2024-04-26T23:04:40.171562+0000","last_active":"2024-04-26T23:04:47.302034+0000","last_peered":"2024-04-26T23:04:47.302034+0000","last_clean":"2024-04-26T23:04:47.302034+0000","last_became_active":"2024-04-26T23:04:40.171332+0000","last_became_peered":"2024-04-26T23:04:40.171332+0000","last_unstale":"2024-04-26T23:04:47.302034+0000","last_undegraded":"2024-04-26T23:04:47.302034+0000","last_fullsized":"2024-04-26T23:04:47.302034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.571568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801317+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:04:46.801317+0000","last_peered":"2024-04-26T23:04:46.801317+0000","last_clean":"2024-04-26T23:04:46.801317+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:04:46.801317+0000","last_undegraded":"2024-04-26T23:04:46.801317+0000","last_fullsized":"2024-04-26T23:04:46.801317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302802+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:04:47.302802+0000","last_peered":"2024-04-26T23:04:47.302802+0000","last_clean":"2024-04-26T23:04:47.302802+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:04:47.302802+0000","last_undegraded":"2024-04-26T23:04:47.302802+0000","last_fullsized":"2024-04-26T23:04:47.302802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.801750+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:04:46.801750+0000","last_peered":"2024-04-26T23:04:46.801750+0000","last_clean":"2024-04-26T23:04:46.801750+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:04:46.801750+0000","last_undegraded":"2024-04-26T23:04:46.801750+0000","last_fullsized":"2024-04-26T23:04:46.801750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.302298+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:04:47.302298+0000","last_peered":"2024-04-26T23:04:47.302298+0000","last_clean":"2024-04-26T23:04:47.302298+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:04:47.302298+0000","last_undegraded":"2024-04-26T23:04:47.302298+0000","last_fullsized":"2024-04-26T23:04:47.302298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:45.659501+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:04:45.659501+0000","last_peered":"2024-04-26T23:04:45.659501+0000","last_clean":"2024-04-26T23:04:45.659501+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:04:45.659501+0000","last_undegraded":"2024-04-26T23:04:45.659501+0000","last_fullsized":"2024-04-26T23:04:45.659501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:47.303486+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:04:47.303486+0000","last_peered":"2024-04-26T23:04:47.303486+0000","last_clean":"2024-04-26T23:04:47.303486+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:04:47.303486+0000","last_undegraded":"2024-04-26T23:04:47.303486+0000","last_fullsized":"2024-04-26T23:04:47.303486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:04:46.802160+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:04:46.802160+0000","last_peered":"2024-04-26T23:04:46.802160+0000","last_clean":"2024-04-26T23:04:46.802160+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:04:46.802160+0000","last_undegraded":"2024-04-26T23:04:46.802160+0000","last_fullsized":"2024-04-26T23:04:46.802160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":691940,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":104776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":101634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":100970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":101200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":691284,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:05:28.423 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-04-26T23:05:28.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:05:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 Processor -- start 2024-04-26T23:05:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 -- start start 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84c015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f84c00c9720 0x7f84c00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c00c9d90 con 0x7f84c00c7b80 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00ca630 con 0x7f84c00c9720 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84c6400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84c00ca070 con 0x7f84c0153af0 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84b6a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f84c00c7b80 0x7f84c00c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46474/0 (socket says 172.21.15.148:46474) 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.590+0000 7f84b6a00640 1 -- 172.21.15.148:0/234822172 learned_addr learned my addr 172.21.15.148:0/234822172 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bfe00640 1 --2- 172.21.15.148:0/234822172 >> v2:172.21.15.157:3300/0 conn(0x7f84c00c9720 0x7f84c00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84c015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184847933 0 0) 0x7f84c00c9d90 con 0x7f84c00c7b80 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a4003530 con 0x7f84c00c7b80 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2028264544 0 0) 0x7f84a4003530 con 0x7f84c00c7b80 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 msgr2=0x7f84c015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84c015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 >> v2:172.21.15.157:3300/0 conn(0x7f84c00c9720 msgr2=0x7f84c00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 --2- 172.21.15.148:0/234822172 >> v2:172.21.15.157:3300/0 conn(0x7f84c00c9720 0x7f84c00c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c00ca350 con 0x7f84c00c7b80 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f84a8001680 con 0x7f84c00c7b80 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 >> v1:172.21.15.148:6789/0 conn(0x7f84c00c7b80 legacy=0x7f84c00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84a4004810 0x7f84a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00ca630 con 0x7f84a40039c0 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00ca070 con 0x7f84a4004810 2024-04-26T23:05:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84a400b9d0 con 0x7f84c0153af0 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84b6a00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84a4004810 0x7f84a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bfe00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 -- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 msgr2=0x7f84a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0153af0 0x7f84a40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 -- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84a4004810 msgr2=0x7f84a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84a4004810 0x7f84a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84bf400640 1 -- 172.21.15.148:0/234822172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a4003530 con 0x7f84a40039c0 2024-04-26T23:05:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.594+0000 7f84b6a00640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84a4004810 0x7f84a4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:28.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84bf400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84a4003de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009fc0 tx=0x7f84b001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2613c752a0b77fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b2070 con 0x7f84a40039c0 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b00a5bb0 con 0x7f84a40039c0 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84bea00640 1 -- 172.21.15.148:0/234822172 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0009c10 con 0x7f84a40039c0 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- 172.21.15.148:0/234822172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 msgr2=0x7f84a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 --2- 172.21.15.148:0/234822172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84a4003de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009fc0 tx=0x7f84b001cc80 comp rx=0 tx=0).stop 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84bfe00640 1 -- 172.21.15.148:0/234822172 reap_dead start 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- 172.21.15.148:0/234822172 shutdown_connections 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- 172.21.15.148:0/234822172 >> 172.21.15.148:0/234822172 conn(0x7f84c006c380 msgr2=0x7f84c006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- 172.21.15.148:0/234822172 shutdown_connections 2024-04-26T23:05:28.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- 172.21.15.148:0/234822172 wait complete. 2024-04-26T23:05:28.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 Processor -- start 2024-04-26T23:05:28.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- start start 2024-04-26T23:05:28.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 0x7f84c01f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 0x7f84c0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0153ed0 con 0x7f84a40039c0 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84c015d290 con 0x7f84c00cbb60 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.598+0000 7f84c6400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f84c0154050 con 0x7f84c0150a60 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45392/0 (socket says 172.21.15.148:45392) 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 -- 172.21.15.148:0/2907957000 learned_addr learned my addr 172.21.15.148:0/2907957000 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bfe00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 0x7f84c0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b6a00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 0x7f84c01f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 -- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 msgr2=0x7f84c0150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 0x7f84c0150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 -- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 msgr2=0x7f84c01f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 0x7f84c01f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 -- 172.21.15.148:0/2907957000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c01e6430 con 0x7f84a40039c0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bfe00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 0x7f84c0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b6a00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 0x7f84c01f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84bf400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84b001d160 tx=0x7f84b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b2040 con 0x7f84a40039c0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b00a59b0 con 0x7f84a40039c0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00ade60 con 0x7f84a40039c0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c00cdf60 con 0x7f84a40039c0 2024-04-26T23:05:28.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c00cdc80 con 0x7f84a40039c0 2024-04-26T23:05:28.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0077c20 con 0x7f84a40039c0 2024-04-26T23:05:28.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84b00bf030 con 0x7f84a40039c0 2024-04-26T23:05:28.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 0x7f849c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.602+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f84b01216b0 con 0x7f84a40039c0 2024-04-26T23:05:28.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.606+0000 7f84b6a00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 0x7f849c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.606+0000 7f84b6a00640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 0x7f849c06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001000 tx=0x7f84a8001e80 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.606+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f84b00c6020 con 0x7f84a40039c0 2024-04-26T23:05:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.766+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84c00c8670 con 0x7f84a40039c0 2024-04-26T23:05:28.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.766+0000 7f84b7e00640 1 -- 172.21.15.148:0/2907957000 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18925 (secure 0 0 0) 0x7f84b0016990 con 0x7f84a40039c0 2024-04-26T23:05:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:28.770 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:05:28.029673+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:05:28.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 msgr2=0x7f849c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 0x7f849c06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001000 tx=0x7f84a8001e80 comp rx=0 tx=0).stop 2024-04-26T23:05:28.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 msgr2=0x7f84c0159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84b001d160 tx=0x7f84b0009750 comp rx=0 tx=0).stop 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 shutdown_connections 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f849c068380 0x7f849c06a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f84c0150a60 0x7f84c0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84c00cbb60 0x7f84c01f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 --2- 172.21.15.148:0/2907957000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84a40039c0 0x7f84c0159ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 >> 172.21.15.148:0/2907957000 conn(0x7f84c006c380 msgr2=0x7f84c0152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 shutdown_connections 2024-04-26T23:05:28.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.770+0000 7f84c6400640 1 -- 172.21.15.148:0/2907957000 wait complete. 2024-04-26T23:05:28.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:05:28.792 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:05:28.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.926+0000 7f4b57400640 1 Processor -- start 2024-04-26T23:05:28.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.926+0000 7f4b57400640 1 -- start start 2024-04-26T23:05:28.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b57400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4b50070330 0x7f4b500c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b57400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b50072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b57400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b500c96b0 con 0x7f4b5006ff50 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b57400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f4b500c84e0 con 0x7f4b50070330 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b57400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4b500c93d0 con 0x7f4b500708a0 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4b50070330 0x7f4b500c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b54a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4b5006ff50 0x7f4b50158d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46484/0 (socket says 172.21.15.148:46484) 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b54a00640 1 -- 172.21.15.148:0/2823403390 learned_addr learned my addr 172.21.15.148:0/2823403390 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:28.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b55400640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b50072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4f400640 1 -- 172.21.15.148:0/2823403390 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420420616 0 0) 0x7f4b500c96b0 con 0x7f4b5006ff50 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4f400640 1 -- 172.21.15.148:0/2823403390 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b34003530 con 0x7f4b5006ff50 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4fe00640 1 -- 172.21.15.148:0/2823403390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 msgr2=0x7f4b50072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4fe00640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b50072d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4fe00640 1 -- 172.21.15.148:0/2823403390 >> v1:172.21.15.148:6789/0 conn(0x7f4b5006ff50 legacy=0x7f4b50158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.930+0000 7f4b4fe00640 1 -- 172.21.15.148:0/2823403390 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500c7bb0 con 0x7f4b50070330 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b4fe00640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b500c8970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097c0 tx=0x7f4b3c01fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1554b4a002ea6dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b4f400640 1 -- 172.21.15.148:0/2823403390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0b6070 con 0x7f4b50070330 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b4f400640 1 -- 172.21.15.148:0/2823403390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0a9aa0 con 0x7f4b50070330 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b4f400640 1 -- 172.21.15.148:0/2823403390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0b1440 con 0x7f4b50070330 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- 172.21.15.148:0/2823403390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 msgr2=0x7f4b500c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b500c8970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097c0 tx=0x7f4b3c01fda0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- 172.21.15.148:0/2823403390 shutdown_connections 2024-04-26T23:05:28.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b50072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 --2- 172.21.15.148:0/2823403390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b500c8970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- 172.21.15.148:0/2823403390 >> 172.21.15.148:0/2823403390 conn(0x7f4b500c9d10 msgr2=0x7f4b500ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:28.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- 172.21.15.148:0/2823403390 shutdown_connections 2024-04-26T23:05:28.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- 172.21.15.148:0/2823403390 wait complete. 2024-04-26T23:05:28.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 Processor -- start 2024-04-26T23:05:28.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.934+0000 7f4b57400640 1 -- start start 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b5006ff50 0x7f4b501ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b5006c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500c8fd0 con 0x7f4b50070330 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500c8170 con 0x7f4b5006ff50 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4b500c9150 con 0x7f4b500708a0 2024-04-26T23:05:28.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45410/0 (socket says 172.21.15.148:45410) 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 -- 172.21.15.148:0/3980187485 learned_addr learned my addr 172.21.15.148:0/3980187485 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b54a00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b5006ff50 0x7f4b501ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b55400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b5006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 -- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 msgr2=0x7f4b5006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b5006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 -- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b5006ff50 msgr2=0x7f4b501ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b5006ff50 0x7f4b501ef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 -- 172.21.15.148:0/3980187485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500cc320 con 0x7f4b50070330 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4fe00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0b4040 tx=0x7f4b3c01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0c1070 con 0x7f4b50070330 2024-04-26T23:05:28.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0b29c0 con 0x7f4b50070330 2024-04-26T23:05:28.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b500cc5c0 con 0x7f4b50070330 2024-04-26T23:05:28.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0b6070 con 0x7f4b50070330 2024-04-26T23:05:28.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b500cc860 con 0x7f4b50070330 2024-04-26T23:05:28.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5006c550 con 0x7f4b50070330 2024-04-26T23:05:28.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.938+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b3c0c4070 con 0x7f4b50070330 2024-04-26T23:05:28.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.942+0000 7f4b4cc00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 0x7f4b3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:28.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.942+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f4b3c123ea0 con 0x7f4b50070330 2024-04-26T23:05:28.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.942+0000 7f4b54a00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 0x7f4b3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:28.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.942+0000 7f4b54a00640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 0x7f4b3006a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005c10 tx=0x7f4b40009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:28.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:28.946+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4b3c019900 con 0x7f4b50070330 2024-04-26T23:05:29.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b50077c20 con 0x7f4b50070330 2024-04-26T23:05:29.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b4cc00640 1 -- 172.21.15.148:0/3980187485 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f4b3c0f3fc0 con 0x7f4b50070330 2024-04-26T23:05:29.112 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:05:29.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 msgr2=0x7f4b3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 0x7f4b3006a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005c10 tx=0x7f4b40009040 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 msgr2=0x7f4b5015ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.110+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0b4040 tx=0x7f4b3c01cb40 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 shutdown_connections 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b30068380 0x7f4b3006a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b500708a0 0x7f4b5006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b50070330 0x7f4b5015ab10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 --2- 172.21.15.148:0/3980187485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b5006ff50 0x7f4b501ef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 >> 172.21.15.148:0/3980187485 conn(0x7f4b500c9d10 msgr2=0x7f4b50072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 shutdown_connections 2024-04-26T23:05:29.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.114+0000 7f4b57400640 1 -- 172.21.15.148:0/3980187485 wait complete. 2024-04-26T23:05:29.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:05:29.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 Processor -- start 2024-04-26T23:05:29.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 -- start start 2024-04-26T23:05:29.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90d8152d00 0x7f90d80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d80c4b30 con 0x7f90d8073230 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d80c6f60 con 0x7f90d815c070 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90df800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f90d80c7240 con 0x7f90d8152d00 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90cfe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f90d8073230 0x7f90d80736a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46494/0 (socket says 172.21.15.148:46494) 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90cfe00640 1 -- 172.21.15.148:0/1875769276 learned_addr learned my addr 172.21.15.148:0/1875769276 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:29.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90dce00640 1 --2- 172.21.15.148:0/1875769276 >> v2:172.21.15.157:3300/0 conn(0x7f90d8152d00 0x7f90d80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.274+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483158233 0 0) 0x7f90d80c4b30 con 0x7f90d8073230 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90bc005740 con 0x7f90d8073230 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3646817447 0 0) 0x7f90bc005740 con 0x7f90d8073230 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 >> v2:172.21.15.157:3300/0 conn(0x7f90d8152d00 msgr2=0x7f90d80c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 --2- 172.21.15.148:0/1875769276 >> v2:172.21.15.157:3300/0 conn(0x7f90d8152d00 0x7f90d80c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 >> v1:172.21.15.157:6789/0 conn(0x7f90d815c070 legacy=0x7f90d815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d80c7520 con 0x7f90d8073230 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f90c0001680 con 0x7f90d8073230 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 >> v1:172.21.15.148:6789/0 conn(0x7f90d8073230 legacy=0x7f90d80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90bc005bd0 0x7f90bc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 0x7f90bc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc0073e0 0x7f90bc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80c7240 con 0x7f90bc006a20 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc00e280 con 0x7f90bc0073e0 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc00e480 con 0x7f90bc005bd0 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 0x7f90bc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90dd800640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc0073e0 0x7f90bc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90dce00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90bc005bd0 0x7f90bc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 -- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90bc005bd0 msgr2=0x7f90bc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90bc005bd0 0x7f90bc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 -- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc0073e0 msgr2=0x7f90bc00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc0073e0 0x7f90bc00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 -- 172.21.15.148:0/1875769276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc005740 con 0x7f90bc006a20 2024-04-26T23:05:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90dd800640 1 -- 172.21.15.148:0/1875769276 reap_dead start 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.278+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 0x7f90bc006ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c240 tx=0x7f90c001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06a871381edcee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0007d20 con 0x7f90bc006a20 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0005ae0 con 0x7f90bc006a20 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90d7e00640 1 -- 172.21.15.148:0/1875769276 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0007070 con 0x7f90bc006a20 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 msgr2=0x7f90bc006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 0x7f90bc006ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c240 tx=0x7f90c001f3f0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- 172.21.15.148:0/1875769276 shutdown_connections 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 --2- 172.21.15.148:0/1875769276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90bc006a20 0x7f90bc006ea0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- 172.21.15.148:0/1875769276 >> 172.21.15.148:0/1875769276 conn(0x7f90d80c9d10 msgr2=0x7f90d80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- 172.21.15.148:0/1875769276 shutdown_connections 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- 172.21.15.148:0/1875769276 wait complete. 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 Processor -- start 2024-04-26T23:05:29.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- start start 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc006a20 0x7f90d81f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90d8156ca0 0x7f90d8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80c4f90 con 0x7f90d81594b0 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80c4e10 con 0x7f90bc006a20 2024-04-26T23:05:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90df800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f90d80c4710 con 0x7f90d8156ca0 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90cfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90cfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45434/0 (socket says 172.21.15.148:45434) 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90cfe00640 1 -- 172.21.15.148:0/1860337066 learned_addr learned my addr 172.21.15.148:0/1860337066 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90dce00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc006a20 0x7f90d81f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.282+0000 7f90dd800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90d8156ca0 0x7f90d8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 -- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90d8156ca0 msgr2=0x7f90d8157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90d8156ca0 0x7f90d8157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 -- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc006a20 msgr2=0x7f90d81f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc006a20 0x7f90d81f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 -- 172.21.15.148:0/1860337066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d8157660 con 0x7f90d81594b0 2024-04-26T23:05:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90cfe00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f90c001f220 tx=0x7f90bc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c00047f0 con 0x7f90d81594b0 2024-04-26T23:05:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0004990 con 0x7f90d81594b0 2024-04-26T23:05:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0004d60 con 0x7f90d81594b0 2024-04-26T23:05:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d81f19e0 con 0x7f90d81594b0 2024-04-26T23:05:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d81f1c80 con 0x7f90d81594b0 2024-04-26T23:05:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d80c8d30 con 0x7f90d81594b0 2024-04-26T23:05:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90c0007070 con 0x7f90d81594b0 2024-04-26T23:05:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.286+0000 7f90d5600640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 0x7f90b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.290+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f90c0123b10 con 0x7f90d81594b0 2024-04-26T23:05:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.290+0000 7f90dce00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 0x7f90b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.290+0000 7f90dce00640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 0x7f90b406a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90d806adf0 tx=0x7f90c8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.294+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f90c00c1070 con 0x7f90d81594b0 2024-04-26T23:05:29.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f90d81f1f40 con 0x7f90d81594b0 2024-04-26T23:05:29.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90d5600640 1 -- 172.21.15.148:0/1860337066 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f90d8157660 con 0x7f90d81594b0 2024-04-26T23:05:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:29.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 msgr2=0x7f90b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 0x7f90b406a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90d806adf0 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 msgr2=0x7f90d80c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f90c001f220 tx=0x7f90bc007a50 comp rx=0 tx=0).stop 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 shutdown_connections 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f90b40683b0 0x7f90b406a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90d8156ca0 0x7f90d8157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90d81594b0 0x7f90d80c6650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 --2- 172.21.15.148:0/1860337066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc006a20 0x7f90d81f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 >> 172.21.15.148:0/1860337066 conn(0x7f90d80c9d10 msgr2=0x7f90d80cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 shutdown_connections 2024-04-26T23:05:29.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.454+0000 7f90df800640 1 -- 172.21.15.148:0/1860337066 wait complete. 2024-04-26T23:05:29.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:05:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 Processor -- start 2024-04-26T23:05:29.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 -- start start 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc90015d8a0 0x7fc900165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9000c49e0 con 0x7fc900157250 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9000caf80 con 0x7fc9000c44a0 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc907200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc9000cbb50 con 0x7fc90015d8a0 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc8ffe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc900157250 0x7fc90006ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46506/0 (socket says 172.21.15.148:46506) 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc8ffe00640 1 -- 172.21.15.148:0/4261556328 learned_addr learned my addr 172.21.15.148:0/4261556328 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc905200640 1 --2- 172.21.15.148:0/4261556328 >> v2:172.21.15.148:3300/0 conn(0x7fc90015d8a0 0x7fc900165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc8ff400640 1 -- 172.21.15.148:0/4261556328 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893797205 0 0) 0x7fc9000c49e0 con 0x7fc900157250 2024-04-26T23:05:29.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc8ff400640 1 -- 172.21.15.148:0/4261556328 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e4003530 con 0x7fc900157250 2024-04-26T23:05:29.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc905200640 1 -- 172.21.15.148:0/4261556328 >> v1:172.21.15.157:6789/0 conn(0x7fc9000c44a0 legacy=0x7fc90015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc905200640 1 -- 172.21.15.148:0/4261556328 >> v1:172.21.15.148:6789/0 conn(0x7fc900157250 legacy=0x7fc90006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.614+0000 7fc905200640 1 -- 172.21.15.148:0/4261556328 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9000c6450 con 0x7fc90015d8a0 2024-04-26T23:05:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc905200640 1 --2- 172.21.15.148:0/4261556328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900165440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9000cbcd0 tx=0x7fc8f801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c0da35856ec04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc8ff400640 1 -- 172.21.15.148:0/4261556328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80b0070 con 0x7fc90015d8a0 2024-04-26T23:05:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc8ff400640 1 -- 172.21.15.148:0/4261556328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f80ab600 con 0x7fc90015d8a0 2024-04-26T23:05:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc8ff400640 1 -- 172.21.15.148:0/4261556328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80ab9d0 con 0x7fc90015d8a0 2024-04-26T23:05:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 -- 172.21.15.148:0/4261556328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 msgr2=0x7fc900165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 --2- 172.21.15.148:0/4261556328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900165440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9000cbcd0 tx=0x7fc8f801c410 comp rx=0 tx=0).stop 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 -- 172.21.15.148:0/4261556328 shutdown_connections 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 --2- 172.21.15.148:0/4261556328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900165440 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 -- 172.21.15.148:0/4261556328 >> 172.21.15.148:0/4261556328 conn(0x7fc900068140 msgr2=0x7fc900068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 -- 172.21.15.148:0/4261556328 shutdown_connections 2024-04-26T23:05:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.618+0000 7fc907200640 1 -- 172.21.15.148:0/4261556328 wait complete. 2024-04-26T23:05:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 Processor -- start 2024-04-26T23:05:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- start start 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9000c44a0 0x7fc9000b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 0x7fc9000b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9000b26c0 con 0x7fc90015d8a0 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc900157670 con 0x7fc9000c44a0 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc9000b2840 con 0x7fc900157250 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45454/0 (socket says 172.21.15.148:45454) 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 -- 172.21.15.148:0/533223220 learned_addr learned my addr 172.21.15.148:0/533223220 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8ffe00640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9000c44a0 0x7fc9000b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8f7400640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 0x7fc9000b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 -- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 msgr2=0x7fc9000b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 0x7fc9000b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 -- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9000c44a0 msgr2=0x7fc9000b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9000c44a0 0x7fc9000b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 -- 172.21.15.148:0/533223220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9000b4900 con 0x7fc90015d8a0 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8f7400640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 0x7fc9000b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc905200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8019020 tx=0x7fc8f80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80b0040 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f80b9070 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9000b3dc0 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80b4650 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.622+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9000b4340 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc900077c20 con 0x7fc90015d8a0 2024-04-26T23:05:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8f80b47f0 con 0x7fc90015d8a0 2024-04-26T23:05:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc8fcc00640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 0x7fc8dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc8f81208c0 con 0x7fc90015d8a0 2024-04-26T23:05:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc8ffe00640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 0x7fc8dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.626+0000 7fc8ffe00640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 0x7fc8dc06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0001570 tx=0x7fc8f0001aa0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.630+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc8f8016090 con 0x7fc90015d8a0 2024-04-26T23:05:29.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.786+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc9000ca540 con 0x7fc90015d8a0 2024-04-26T23:05:29.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.786+0000 7fc8fcc00640 1 -- 172.21.15.148:0/533223220 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc8f80f09d0 con 0x7fc90015d8a0 2024-04-26T23:05:29.790 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:05:29.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 msgr2=0x7fc8dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 0x7fc8dc06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0001570 tx=0x7fc8f0001aa0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 msgr2=0x7fc900154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8019020 tx=0x7fc8f80191b0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 shutdown_connections 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8dc0683b0 0x7fc8dc06a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc90015d8a0 0x7fc900154b70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900157250 0x7fc9000b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 --2- 172.21.15.148:0/533223220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9000c44a0 0x7fc9000b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 >> 172.21.15.148:0/533223220 conn(0x7fc900068140 msgr2=0x7fc90015c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 shutdown_connections 2024-04-26T23:05:29.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.790+0000 7fc907200640 1 -- 172.21.15.148:0/533223220 wait complete. 2024-04-26T23:05:29.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:05:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 Processor -- start 2024-04-26T23:05:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 -- start start 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f31b8152d00 0x7f31b80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b815c070 0x7f31b815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b80c4b30 con 0x7f31b8073230 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f31b80c6f60 con 0x7f31b8152d00 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31bce00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80c7240 con 0x7f31b815c070 2024-04-26T23:05:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f31b8152d00 0x7f31b80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f31b8152d00 0x7f31b80c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45468/0 (socket says 172.21.15.148:45468) 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 -- 172.21.15.148:0/3064203645 learned_addr learned my addr 172.21.15.148:0/3064203645 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b6800640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b815c070 0x7f31b815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 -- 172.21.15.148:0/3064203645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b815c070 msgr2=0x7f31b815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b815c070 0x7f31b815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 -- 172.21.15.148:0/3064203645 >> v1:172.21.15.157:6789/0 conn(0x7f31b8073230 legacy=0x7f31b80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.950+0000 7f31b5e00640 1 -- 172.21.15.148:0/3064203645 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b80c7520 con 0x7f31b8152d00 2024-04-26T23:05:29.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31b5e00640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8152d00 0x7f31b80c97d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31a800d150 tx=0x7f31a801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc9437f2dba30cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31b4a00640 1 -- 172.21.15.148:0/3064203645 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a800b2d0 con 0x7f31b8152d00 2024-04-26T23:05:29.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31b4a00640 1 -- 172.21.15.148:0/3064203645 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a800b470 con 0x7f31b8152d00 2024-04-26T23:05:29.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31b4a00640 1 -- 172.21.15.148:0/3064203645 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80a7bc0 con 0x7f31b8152d00 2024-04-26T23:05:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- 172.21.15.148:0/3064203645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8152d00 msgr2=0x7f31b80c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8152d00 0x7f31b80c97d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31a800d150 tx=0x7f31a801ec30 comp rx=0 tx=0).stop 2024-04-26T23:05:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- 172.21.15.148:0/3064203645 shutdown_connections 2024-04-26T23:05:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b815c070 0x7f31b815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 --2- 172.21.15.148:0/3064203645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8152d00 0x7f31b80c97d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- 172.21.15.148:0/3064203645 >> 172.21.15.148:0/3064203645 conn(0x7f31b80c9d10 msgr2=0x7f31b80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- 172.21.15.148:0/3064203645 shutdown_connections 2024-04-26T23:05:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- 172.21.15.148:0/3064203645 wait complete. 2024-04-26T23:05:29.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 Processor -- start 2024-04-26T23:05:29.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.954+0000 7f31bce00640 1 -- start start 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b8152d00 0x7f31b813fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 0x7f31b8140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31b815cfb0 con 0x7f31b8073230 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f31b815ce30 con 0x7f31b815c070 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f31b8070500 con 0x7f31b8152d00 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45482/0 (socket says 172.21.15.148:45482) 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 -- 172.21.15.148:0/776820129 learned_addr learned my addr 172.21.15.148:0/776820129 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:29.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5400640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b8152d00 0x7f31b813fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b6800640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 0x7f31b8140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 -- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b8152d00 msgr2=0x7f31b813fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b8152d00 0x7f31b813fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 -- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 msgr2=0x7f31b8140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 0x7f31b8140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 -- 172.21.15.148:0/776820129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b8140af0 con 0x7f31b8073230 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b6800640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 0x7f31b8140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31b5e00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31a801c860 tx=0x7f31a801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8009800 con 0x7f31b8073230 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a80c0070 con 0x7f31b8073230 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b8144ad0 con 0x7f31b8073230 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8009be0 con 0x7f31b8073230 2024-04-26T23:05:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b81f4630 con 0x7f31b8073230 2024-04-26T23:05:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8077c20 con 0x7f31b8073230 2024-04-26T23:05:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.958+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31a80ba470 con 0x7f31b8073230 2024-04-26T23:05:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.962+0000 7f31ae000640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 0x7f319806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.962+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f31a8123ec0 con 0x7f31b8073230 2024-04-26T23:05:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.962+0000 7f31b5400640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 0x7f319806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:29.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.962+0000 7f31b5400640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 0x7f319806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b81ee280 tx=0x7f31a4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:29.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:29.966+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f31a8018820 con 0x7f31b8073230 2024-04-26T23:05:30.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.122+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f31b806f510 con 0x7f31b8073230 2024-04-26T23:05:30.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.122+0000 7f31ae000640 1 -- 172.21.15.148:0/776820129 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f31a80f4010 con 0x7f31b8073230 2024-04-26T23:05:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 msgr2=0x7f319806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 0x7f319806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b81ee280 tx=0x7f31a4009040 comp rx=0 tx=0).stop 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 msgr2=0x7f31b813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31a801c860 tx=0x7f31a801b9d0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 shutdown_connections 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3198068380 0x7f319806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31b815c070 0x7f31b8140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31b8152d00 0x7f31b813fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 --2- 172.21.15.148:0/776820129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31b8073230 0x7f31b813c0e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 >> 172.21.15.148:0/776820129 conn(0x7f31b80c9d10 msgr2=0x7f31b80cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:30.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 shutdown_connections 2024-04-26T23:05:30.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.126+0000 7f31bce00640 1 -- 172.21.15.148:0/776820129 wait complete. 2024-04-26T23:05:30.146 DEBUG:tasks.mon_thrash:Yielding 2024-04-26T23:05:30.146 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T23:05:30.158 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:05:30.158 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T23:05:30.158 INFO:tasks.workunit:timeout=6h 2024-04-26T23:05:30.158 INFO:tasks.workunit:cleanup=True 2024-04-26T23:05:30.158 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:30.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:05:30.167 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:30.167 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-26 23:04:45.163172593 +0000 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-26 23:04:57.702170410 +0000 2024-04-26T23:05:30.168 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-04-26 23:04:45.163172593 +0000 2024-04-26T23:05:30.168 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T23:05:30.168 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T23:05:30.249 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:05:30.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 Processor -- start 2024-04-26T23:05:30.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 -- start start 2024-04-26T23:05:30.300 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T23:05:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa7c1574b0 0x7ffa7c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c0cb7f0 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c0ca0d0 con 0x7ffa7c0c63f0 2024-04-26T23:05:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa82c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7c0ccd80 con 0x7ffa7c1574b0 2024-04-26T23:05:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa73e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ffa7c0b47e0 0x7ffa7c06feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46510/0 (socket says 172.21.15.148:46510) 2024-04-26T23:05:30.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa73e00640 1 -- 172.21.15.148:0/3309222073 learned_addr learned my addr 172.21.15.148:0/3309222073 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:30.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa7be00640 1 --2- 172.21.15.148:0/3309222073 >> v2:172.21.15.157:3300/0 conn(0x7ffa7c1574b0 0x7ffa7c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131634916 0 0) 0x7ffa7c0cb7f0 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.298+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa60003530 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7be00640 1 -- 172.21.15.148:0/3309222073 >> v1:172.21.15.157:6789/0 conn(0x7ffa7c0c63f0 legacy=0x7ffa7c164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2157528232 0 0) 0x7ffa60003530 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7be00640 1 -- 172.21.15.148:0/3309222073 >> v1:172.21.15.148:6789/0 conn(0x7ffa7c0b47e0 legacy=0x7ffa7c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7be00640 1 -- 172.21.15.148:0/3309222073 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c0cba90 con 0x7ffa7c1574b0 2024-04-26T23:05:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7be00640 1 --2- 172.21.15.148:0/3309222073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c1574b0 0x7ffa7c0ca730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0097c0 tx=0x7ffa6c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ab9a572b97e595 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0b0070 con 0x7ffa7c1574b0 2024-04-26T23:05:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0ab400 con 0x7ffa7c1574b0 2024-04-26T23:05:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.302+0000 7ffa7b400640 1 -- 172.21.15.148:0/3309222073 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64001680 con 0x7ffa7c1574b0 2024-04-26T23:05:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- 172.21.15.148:0/3309222073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c1574b0 msgr2=0x7ffa7c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3309222073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c1574b0 0x7ffa7c0ca730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0097c0 tx=0x7ffa6c01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- 172.21.15.148:0/3309222073 shutdown_connections 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3309222073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c1574b0 0x7ffa7c0ca730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- 172.21.15.148:0/3309222073 >> 172.21.15.148:0/3309222073 conn(0x7ffa7c071160 msgr2=0x7ffa7c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- 172.21.15.148:0/3309222073 shutdown_connections 2024-04-26T23:05:30.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- 172.21.15.148:0/3309222073 wait complete. 2024-04-26T23:05:30.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 Processor -- start 2024-04-26T23:05:30.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- start start 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c0c63f0 0x7ffa7c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa7c1574b0 0x7ffa7c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c070740 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0705c0 con 0x7ffa7c0c63f0 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa82c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c168460 con 0x7ffa7c1574b0 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45498/0 (socket says 172.21.15.148:45498) 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 -- 172.21.15.148:0/3043552997 learned_addr learned my addr 172.21.15.148:0/3043552997 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa73e00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c0c63f0 0x7ffa7c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa80c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa7c1574b0 0x7ffa7c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 -- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa7c1574b0 msgr2=0x7ffa7c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa7c1574b0 0x7ffa7c13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 -- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c0c63f0 msgr2=0x7ffa7c0cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c0c63f0 0x7ffa7c0cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.306+0000 7ffa7be00640 1 -- 172.21.15.148:0/3043552997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c1f9180 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa7be00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0ae040 tx=0x7ffa6c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0b0050 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0b1040 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c06d630 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c006e20 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c06dbf0 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c077c20 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa6c0b7650 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 0x7ffa5806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffa6c120c20 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.310+0000 7ffa73e00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 0x7ffa5806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.314+0000 7ffa73e00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 0x7ffa5806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c14f580 tx=0x7ffa64009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.318+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffa6c015fb0 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa7c0cfd90 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa78c00640 1 -- 172.21.15.148:0/3043552997 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7ffa6c0f0cb0 con 0x7ffa7c0b47e0 2024-04-26T23:05:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:05:30.516 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:05:30.516 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 msgr2=0x7ffa5806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 0x7ffa5806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c14f580 tx=0x7ffa64009040 comp rx=0 tx=0).stop 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 msgr2=0x7ffa7c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0ae040 tx=0x7ffa6c01ac00 comp rx=0 tx=0).stop 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 shutdown_connections 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa580683b0 0x7ffa5806a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa7c1574b0 0x7ffa7c13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa7c0c63f0 0x7ffa7c0cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 --2- 172.21.15.148:0/3043552997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa7c0b47e0 0x7ffa7c0cd280 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 >> 172.21.15.148:0/3043552997 conn(0x7ffa7c071160 msgr2=0x7ffa7c14b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:30.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 shutdown_connections 2024-04-26T23:05:30.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.514+0000 7ffa82c00640 1 -- 172.21.15.148:0/3043552997 wait complete. 2024-04-26T23:05:30.537 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-04-26T23:05:30.537 INFO:tasks.mon_thrash.mon_thrasher:seed: 1714172728, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-04-26T23:05:30.538 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:05:30.538 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:05:30.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.710+0000 7f2981400640 1 Processor -- start 2024-04-26T23:05:30.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.710+0000 7f2981400640 1 -- start start 2024-04-26T23:05:30.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f2981400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f297c152120 0x7f297c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f2981400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c072a40 0x7f297c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f2981400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c072e90 con 0x7f297c0708f0 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f2981400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f297c0c8f40 con 0x7f297c152120 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f2981400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f297c0c9190 con 0x7f297c072a40 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f297c152120 0x7f297c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f297c152120 0x7f297c1589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45514/0 (socket says 172.21.15.148:45514) 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 -- 172.21.15.148:0/4181082976 learned_addr learned my addr 172.21.15.148:0/4181082976 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:30.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297b200640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c072a40 0x7f297c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 -- 172.21.15.148:0/4181082976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c072a40 msgr2=0x7f297c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:30.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c072a40 0x7f297c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 -- 172.21.15.148:0/4181082976 >> v1:172.21.15.157:6789/0 conn(0x7f297c0708f0 legacy=0x7f297c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.714+0000 7f297a800640 1 -- 172.21.15.148:0/4181082976 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c0c7c20 con 0x7f297c152120 2024-04-26T23:05:30.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f297a800640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1589e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f296c006fd0 tx=0x7f296c01e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15d833bff32560e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2979400640 1 -- 172.21.15.148:0/4181082976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c0ad070 con 0x7f297c152120 2024-04-26T23:05:30.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2979400640 1 -- 172.21.15.148:0/4181082976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c004230 con 0x7f297c152120 2024-04-26T23:05:30.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2979400640 1 -- 172.21.15.148:0/4181082976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c0a7750 con 0x7f297c152120 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- 172.21.15.148:0/4181082976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 msgr2=0x7f297c1589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1589e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f296c006fd0 tx=0x7f296c01e9f0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- 172.21.15.148:0/4181082976 shutdown_connections 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c072a40 0x7f297c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 --2- 172.21.15.148:0/4181082976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1589e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- 172.21.15.148:0/4181082976 >> 172.21.15.148:0/4181082976 conn(0x7f297c06c380 msgr2=0x7f297c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- 172.21.15.148:0/4181082976 shutdown_connections 2024-04-26T23:05:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- 172.21.15.148:0/4181082976 wait complete. 2024-04-26T23:05:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 Processor -- start 2024-04-26T23:05:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.718+0000 7f2981400640 1 -- start start 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c0708f0 0x7f297c1f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c072a40 0x7f297c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f297c152680 con 0x7f297c152120 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f297c152500 con 0x7f297c072a40 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f297c073120 con 0x7f297c0708f0 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45526/0 (socket says 172.21.15.148:45526) 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 -- 172.21.15.148:0/2126642808 learned_addr learned my addr 172.21.15.148:0/2126642808 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2979e00640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c072a40 0x7f297c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297a800640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c0708f0 0x7f297c1f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 -- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c0708f0 msgr2=0x7f297c1f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c0708f0 0x7f297c1f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 -- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c072a40 msgr2=0x7f297c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c072a40 0x7f297c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 -- 172.21.15.148:0/2126642808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c14f570 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f297b200640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f297400efc0 tx=0x7f297400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974018020 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974014480 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974014870 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c1f5310 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c14ecd0 con 0x7f297c152120 2024-04-26T23:05:30.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.722+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c077c20 con 0x7f297c152120 2024-04-26T23:05:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.726+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f297401b020 con 0x7f297c152120 2024-04-26T23:05:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.726+0000 7f2972a00640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.726+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2974087ad0 con 0x7f297c152120 2024-04-26T23:05:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.726+0000 7f297a800640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.726+0000 7f297a800640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 0x7f295c06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f296c0b1000 tx=0x7f296c0a9070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:30.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.730+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2974022030 con 0x7f297c152120 2024-04-26T23:05:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f297c072610 con 0x7f297c152120 2024-04-26T23:05:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2972a00640 1 -- 172.21.15.148:0/2126642808 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f2974010040 con 0x7f297c152120 2024-04-26T23:05:30.951 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":68,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 msgr2=0x7f295c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 0x7f295c06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f296c0b1000 tx=0x7f296c0a9070 comp rx=0 tx=0).stop 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 msgr2=0x7f297c1f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f297400efc0 tx=0x7f297400c490 comp rx=0 tx=0).stop 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 shutdown_connections 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f297c152120 0x7f297c1f81f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c072a40 0x7f297c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 --2- 172.21.15.148:0/2126642808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f297c0708f0 0x7f297c1f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:30.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 >> 172.21.15.148:0/2126642808 conn(0x7f297c06c380 msgr2=0x7f297c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:30.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 shutdown_connections 2024-04-26T23:05:30.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:30.950+0000 7f2981400640 1 -- 172.21.15.148:0/2126642808 wait complete. 2024-04-26T23:05:30.971 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:05:30.971 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:05:30.972 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:05:30.972 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:05:31.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.106+0000 7fade3200640 1 Processor -- start 2024-04-26T23:05:31.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.106+0000 7fade3200640 1 -- start start 2024-04-26T23:05:31.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade3200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fade415c910 0x7fade40c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade3200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade4153030 con 0x7fade4152c50 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade3200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40c5830 con 0x7fade4159360 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade3200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fade41598c0 con 0x7fade415c910 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fade4152c50 0x7fade40c71d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46516/0 (socket says 172.21.15.148:46516) 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1e00640 1 -- 172.21.15.148:0/2062539735 learned_addr learned my addr 172.21.15.148:0/2062539735 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade2800640 1 --2- 172.21.15.148:0/2062539735 >> v2:172.21.15.157:3300/0 conn(0x7fade415c910 0x7fade40c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874441365 0 0) 0x7fade4153030 con 0x7fade4152c50 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc8003530 con 0x7fade4152c50 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 500979703 0 0) 0x7fadc8003530 con 0x7fade4152c50 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 >> v2:172.21.15.157:3300/0 conn(0x7fade415c910 msgr2=0x7fade40c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 --2- 172.21.15.148:0/2062539735 >> v2:172.21.15.157:3300/0 conn(0x7fade415c910 0x7fade40c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 >> v1:172.21.15.157:6789/0 conn(0x7fade4159360 legacy=0x7fade415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40c5b10 con 0x7fade4152c50 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fadd4001680 con 0x7fade4152c50 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 >> v1:172.21.15.148:6789/0 conn(0x7fade4152c50 legacy=0x7fade40c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadc80039c0 0x7fadc8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fade41598c0 con 0x7fadc8004810 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadc800c080 con 0x7fadc80039c0 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fadc800c280 con 0x7fadc80051d0 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade1e00640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadc80039c0 0x7fadc8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade2800640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 -- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadc80051d0 msgr2=0x7fadc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 -- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadc80039c0 msgr2=0x7fadc8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadc80039c0 0x7fadc8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7faddbe00640 1 -- 172.21.15.148:0/2062539735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc8003530 con 0x7fadc8004810 2024-04-26T23:05:31.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.110+0000 7fade2800640 1 -- 172.21.15.148:0/2062539735 reap_dead start 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7faddbe00640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fadcc001780 tx=0x7fadcc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16983fcc70e67e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0013a0 con 0x7fadc8004810 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc0052f0 con 0x7fadc8004810 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade1400640 1 -- 172.21.15.148:0/2062539735 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc003840 con 0x7fadc8004810 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 -- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 msgr2=0x7fadc8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fadcc001780 tx=0x7fadcc01c400 comp rx=0 tx=0).stop 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 -- 172.21.15.148:0/2062539735 shutdown_connections 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 --2- 172.21.15.148:0/2062539735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 -- 172.21.15.148:0/2062539735 >> 172.21.15.148:0/2062539735 conn(0x7fade4070ce0 msgr2=0x7fade40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 -- 172.21.15.148:0/2062539735 shutdown_connections 2024-04-26T23:05:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.114+0000 7fade3200640 1 -- 172.21.15.148:0/2062539735 wait complete. 2024-04-26T23:05:31.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 Processor -- start 2024-04-26T23:05:31.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- start start 2024-04-26T23:05:31.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fade41502c0 0x7fade40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fade415aad0 0x7fade415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fade406e6f0 con 0x7fadc8004810 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fade406dcf0 con 0x7fade41502c0 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fade406e870 con 0x7fade415aad0 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45550/0 (socket says 172.21.15.148:45550) 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 -- 172.21.15.148:0/1011682816 learned_addr learned my addr 172.21.15.148:0/1011682816 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7faddbe00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fade41502c0 0x7fade40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade2800640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fade415aad0 0x7fade415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fade415aad0 msgr2=0x7fade415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fade415aad0 0x7fade415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fade41502c0 msgr2=0x7fade40ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fade41502c0 0x7fade40ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade414fa30 con 0x7fadc8004810 2024-04-26T23:05:31.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade1e00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadd4007320 tx=0x7fadd40077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd401a070 con 0x7fadc8004810 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd400f8c0 con 0x7fadc8004810 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade414fcd0 con 0x7fadc8004810 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd400fc90 con 0x7fadc8004810 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade40caf50 con 0x7fadc8004810 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 0x7fade40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fade41f5d10 con 0x7fade4150810 2024-04-26T23:05:31.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7faddbe00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 0x7fade40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.118+0000 7faddbe00640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fade40506d0 con 0x7fade4150810 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7faddbe00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 0x7fade40cb190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c050 tx=0x7fadc8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadd401d360 con 0x7fadc8004810 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadc00683b0 0x7fadc006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fadd40866a0 con 0x7fadc8004810 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0b9070 con 0x7fade4150810 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fadcc001460 con 0x7fade4150810 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 msgr2=0x7fade40cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 0x7fade40cb190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c050 tx=0x7fadc8005840 comp rx=0 tx=0).stop 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fade2800640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadc00683b0 0x7fadc006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 msgr2=0x7fade40cb190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fadda000640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150810 0x7fade40cb190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.122+0000 7fade2800640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadc00683b0 0x7fadc006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fade40cbbe0 tx=0x7faddc00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.126+0000 7fade3200640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 0x7fade41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.126+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fade4153030 con 0x7fade4150dd0 2024-04-26T23:05:31.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.126+0000 7faddbe00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 0x7fade41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.126+0000 7faddbe00640 1 -- 172.21.15.148:0/1011682816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fade406e4d0 con 0x7fade4150dd0 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7faddbe00640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 0x7fade41511f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c10 tx=0x7fadcc0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc006ce0 con 0x7fade4150dd0 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7fadcc006ce0 con 0x7fade4150dd0 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 msgr2=0x7fade41511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 0x7fade41511f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c10 tx=0x7fadcc0a6000 comp rx=0 tx=0).stop 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 msgr2=0x7fade41511f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fadda000640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fade4150dd0 0x7fade41511f0 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c10 tx=0x7fadcc0a6000 comp rx=0 tx=0).stop 2024-04-26T23:05:31.131 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 8, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 74002, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 68, 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:05:31.132 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.133 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.134 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:05:31.135 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.136 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.138 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:05:31.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.146 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:05:31.146 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:31.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadc00683b0 msgr2=0x7fadc006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fadc00683b0 0x7fadc006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fade40cbbe0 tx=0x7faddc00b040 comp rx=0 tx=0).stop 2024-04-26T23:05:31.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 msgr2=0x7fade41f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadd4007320 tx=0x7fadd40077e0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade2800640 1 -- 172.21.15.148:0/1011682816 reap_dead start 2024-04-26T23:05:31.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 shutdown_connections 2024-04-26T23:05:31.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 --2- 172.21.15.148:0/1011682816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc8004810 0x7fade41f57d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 >> 172.21.15.148:0/1011682816 conn(0x7fade4070ce0 msgr2=0x7fade406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 shutdown_connections 2024-04-26T23:05:31.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.130+0000 7fade3200640 1 -- 172.21.15.148:0/1011682816 wait complete. 2024-04-26T23:05:31.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:05:31.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:05:31.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:05:31.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 Processor -- start 2024-04-26T23:05:31.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 -- start start 2024-04-26T23:05:31.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2350070500 0x7f2350158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 0x7f23500708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23500cc330 con 0x7f2350070e20 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2350071270 con 0x7f2350070500 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2358400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23500cce60 con 0x7f23500cbe60 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2350070500 0x7f2350158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2350070500 0x7f2350158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45570/0 (socket says 172.21.15.148:45570) 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 -- 172.21.15.148:0/966491573 learned_addr learned my addr 172.21.15.148:0/966491573 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355000640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 0x7f23500708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 -- 172.21.15.148:0/966491573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 msgr2=0x7f23500708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 0x7f23500708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 -- 172.21.15.148:0/966491573 >> v1:172.21.15.157:6789/0 conn(0x7f2350070e20 legacy=0x7f23500c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355a00640 1 -- 172.21.15.148:0/966491573 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23500cd140 con 0x7f2350070500 2024-04-26T23:05:31.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.286+0000 7f2355000640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 0x7f23500708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2355a00640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f2350158a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f23500cc500 tx=0x7f234401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf194209aa1b061a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f234fe00640 1 -- 172.21.15.148:0/966491573 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b5070 con 0x7f2350070500 2024-04-26T23:05:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f234fe00640 1 -- 172.21.15.148:0/966491573 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23440a8a30 con 0x7f2350070500 2024-04-26T23:05:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f234fe00640 1 -- 172.21.15.148:0/966491573 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440a8e00 con 0x7f2350070500 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 -- 172.21.15.148:0/966491573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 msgr2=0x7f2350158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f2350158a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f23500cc500 tx=0x7f234401ed30 comp rx=0 tx=0).stop 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 -- 172.21.15.148:0/966491573 shutdown_connections 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23500cbe60 0x7f23500708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 --2- 172.21.15.148:0/966491573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f2350158a10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 -- 172.21.15.148:0/966491573 >> 172.21.15.148:0/966491573 conn(0x7f235006c380 msgr2=0x7f235006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 -- 172.21.15.148:0/966491573 shutdown_connections 2024-04-26T23:05:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.290+0000 7f2358400640 1 -- 172.21.15.148:0/966491573 wait complete. 2024-04-26T23:05:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 Processor -- start 2024-04-26T23:05:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- start start 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f23500ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2350070e20 0x7f23500c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23500cbe60 0x7f23500c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23500c70a0 con 0x7f2350070500 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f23501525e0 con 0x7f23500cbe60 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23500c7220 con 0x7f2350070e20 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f23500ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f23500ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45576/0 (socket says 172.21.15.148:45576) 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 -- 172.21.15.148:0/3564488184 learned_addr learned my addr 172.21.15.148:0/3564488184 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355000640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2350070e20 0x7f23500c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2356400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23500cbe60 0x7f23500c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2350070e20 msgr2=0x7f23500c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2350070e20 0x7f23500c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23500cbe60 msgr2=0x7f23500c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23500cbe60 0x7f23500c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235014dc60 con 0x7f2350070500 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2355a00640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f23500ca550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23440b3040 tx=0x7f234401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b5070 con 0x7f2350070500 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23440b0b40 con 0x7f2350070500 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440bb410 con 0x7f2350070500 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235014eb10 con 0x7f2350070500 2024-04-26T23:05:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.294+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235014e1e0 con 0x7f2350070500 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2358400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 0x7f235014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f235014e960 con 0x7f23501f3de0 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2355000640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 0x7f235014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2355000640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2350077c20 con 0x7f23501f3de0 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23440b9070 con 0x7f2350070500 2024-04-26T23:05:31.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2355000640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 0x7f235014e420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f233c00f550 tx=0x7f233c00fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f23300683b0 0x7f233006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2344123af0 con 0x7f2350070500 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c019020 con 0x7f23501f3de0 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2356400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f23300683b0 0x7f233006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f233c014870 con 0x7f23501f3de0 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 msgr2=0x7f235014e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 0x7f235014e420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f233c00f550 tx=0x7f233c00fa10 comp rx=0 tx=0).stop 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 msgr2=0x7f235014e420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f234d600640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23501f3de0 0x7f235014e420 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f233c00f550 tx=0x7f233c00fa10 comp rx=0 tx=0).stop 2024-04-26T23:05:31.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.298+0000 7f2356400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f23300683b0 0x7f233006a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f235006ccc0 tx=0x7f2348009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 0x7f23501f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f235014fba0 con 0x7f2350159150 2024-04-26T23:05:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2355000640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 0x7f23501f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2355000640 1 -- 172.21.15.148:0/3564488184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23500cca30 con 0x7f2350159150 2024-04-26T23:05:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2355000640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 0x7f23501f5460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f233c01a000 tx=0x7f233c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c019070 con 0x7f2350159150 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4898 (secure 0 0 0) 0x7f233c01e420 con 0x7f2350159150 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 msgr2=0x7f23501f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 0x7f23501f5460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f233c01a000 tx=0x7f233c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 msgr2=0x7f23501f5460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f234d600640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2350159150 0x7f23501f5460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:31.310 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 8, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 74156, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 68, 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:05:31.311 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:05:31.312 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:05:31.313 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:05:31.314 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.316 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:31.317 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:05:31.319 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.320 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:05:31.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:05:31.322 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f23300683b0 msgr2=0x7f233006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f23300683b0 0x7f233006a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f235006ccc0 tx=0x7f2348009040 comp rx=0 tx=0).stop 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 msgr2=0x7f23500ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2358400640 1 --2- 172.21.15.148:0/3564488184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2350070500 0x7f23500ca550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23440b3040 tx=0x7f234401bad0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.306+0000 7f2356400640 1 -- 172.21.15.148:0/3564488184 reap_dead start 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.310+0000 7f2356400640 1 -- 172.21.15.148:0/3564488184 reap_dead start 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.310+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 shutdown_connections 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.310+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 >> 172.21.15.148:0/3564488184 conn(0x7f235006c380 msgr2=0x7f2350157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.310+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 shutdown_connections 2024-04-26T23:05:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.310+0000 7f2358400640 1 -- 172.21.15.148:0/3564488184 wait complete. 2024-04-26T23:05:31.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:05:31.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:05:31.329 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:05:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.462+0000 7fc85c800640 1 Processor -- start 2024-04-26T23:05:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.462+0000 7fc85c800640 1 -- start start 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc854155e80 0x7fc85415bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc8540cd4e0 0x7fc854070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540cc580 con 0x7fc854155e80 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540cb8e0 con 0x7fc8540cd4e0 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85c800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540cbbc0 con 0x7fc8540cae70 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc854155e80 0x7fc85415bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc854155e80 0x7fc85415bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45580/0 (socket says 172.21.15.148:45580) 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 -- 172.21.15.148:0/1702766280 learned_addr learned my addr 172.21.15.148:0/1702766280 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc85a800640 1 --2- 172.21.15.148:0/1702766280 >> v2:172.21.15.157:3300/0 conn(0x7fc8540cd4e0 0x7fc854070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859400640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 -- 172.21.15.148:0/1702766280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 msgr2=0x7fc854070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 -- 172.21.15.148:0/1702766280 >> v2:172.21.15.157:3300/0 conn(0x7fc8540cd4e0 msgr2=0x7fc854070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 --2- 172.21.15.148:0/1702766280 >> v2:172.21.15.157:3300/0 conn(0x7fc8540cd4e0 0x7fc854070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 -- 172.21.15.148:0/1702766280 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8540cbea0 con 0x7fc854155e80 2024-04-26T23:05:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.466+0000 7fc859e00640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc85415bb40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc85415cc90 tx=0x7fc84801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f464e852481753c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc858a00640 1 -- 172.21.15.148:0/1702766280 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480b5070 con 0x7fc854155e80 2024-04-26T23:05:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc858a00640 1 -- 172.21.15.148:0/1702766280 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8480a89d0 con 0x7fc854155e80 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc858a00640 1 -- 172.21.15.148:0/1702766280 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a8da0 con 0x7fc854155e80 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- 172.21.15.148:0/1702766280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 msgr2=0x7fc85415bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc85415bb40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc85415cc90 tx=0x7fc84801ed10 comp rx=0 tx=0).stop 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- 172.21.15.148:0/1702766280 shutdown_connections 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- 172.21.15.148:0/1702766280 >> v2:172.21.15.157:3300/0 conn(0x7fc8540cd4e0 0x7fc854070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- 172.21.15.148:0/1702766280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc85415bb40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- 172.21.15.148:0/1702766280 >> 172.21.15.148:0/1702766280 conn(0x7fc85406c380 msgr2=0x7fc85406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- 172.21.15.148:0/1702766280 shutdown_connections 2024-04-26T23:05:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- 172.21.15.148:0/1702766280 wait complete. 2024-04-26T23:05:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 Processor -- start 2024-04-26T23:05:31.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- start start 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8540cd4e0 0x7fc8540c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc8540c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540ccfc0 con 0x7fc854155e80 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540ccce0 con 0x7fc8540cd4e0 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85c800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc854156260 con 0x7fc8540cae70 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc8540c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc8540c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45596/0 (socket says 172.21.15.148:45596) 2024-04-26T23:05:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 learned_addr learned my addr 172.21.15.148:0/238429790 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc859400640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8540cd4e0 0x7fc8540c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.470+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 msgr2=0x7fc854154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8540cd4e0 msgr2=0x7fc8540c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8540cd4e0 0x7fc8540c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8541f17a0 con 0x7fc854155e80 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc859400640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8540cd4e0 0x7fc8540c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8540cae70 0x7fc854154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85a800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc8540c8120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc85000efc0 tx=0x7fc85000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850018020 con 0x7fc854155e80 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc850014480 con 0x7fc854155e80 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8541f5a30 con 0x7fc854155e80 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850014870 con 0x7fc854155e80 2024-04-26T23:05:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8541f1d40 con 0x7fc854155e80 2024-04-26T23:05:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85c800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 0x7fc8540c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc854077c20 con 0x7fc8541f1f40 2024-04-26T23:05:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 0x7fc8540c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc859e00640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8540cc160 con 0x7fc8541f1f40 2024-04-26T23:05:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc85001b020 con 0x7fc854155e80 2024-04-26T23:05:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 0x7fc8540c8a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8540689a0 tx=0x7fc84801d550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc838068380 0x7fc83806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.474+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc850087b00 con 0x7fc854155e80 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480bf070 con 0x7fc8541f1f40 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc859400640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc838068380 0x7fc83806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc848009490 con 0x7fc8541f1f40 2024-04-26T23:05:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 msgr2=0x7fc8540c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 0x7fc8540c8a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8540689a0 tx=0x7fc84801d550 comp rx=0 tx=0).stop 2024-04-26T23:05:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 msgr2=0x7fc8540c8a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc84e000640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f1f40 0x7fc8540c8a60 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8540689a0 tx=0x7fc84801d550 comp rx=0 tx=0).stop 2024-04-26T23:05:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.478+0000 7fc859400640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc838068380 0x7fc83806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc85415a4e0 tx=0x7fc844008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.482+0000 7fc85c800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 0x7fc8540c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.482+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540c94e0 con 0x7fc8541f2320 2024-04-26T23:05:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.482+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 0x7fc8540c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.482+0000 7fc859e00640 1 -- 172.21.15.148:0/238429790 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc85415c050 con 0x7fc8541f2320 2024-04-26T23:05:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc859e00640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 0x7fc8540c8fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc84801d3c0 tx=0x7fc84801bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480bf040 con 0x7fc8541f2320 2024-04-26T23:05:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4898 (secure 0 0 0) 0x7fc8480c4c80 con 0x7fc8541f2320 2024-04-26T23:05:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 msgr2=0x7fc8540c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 0x7fc8540c8fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc84801d3c0 tx=0x7fc84801bab0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 msgr2=0x7fc8540c8fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc84e000640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8541f2320 0x7fc8540c8fa0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc84801d3c0 tx=0x7fc84801bab0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 8, 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 74332, 2024-04-26T23:05:31.488 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 69, 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.489 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.490 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:31.491 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:31.492 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.493 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.494 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.495 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:31.496 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:05:31.497 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:05:31.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:05:31.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:05:31.500 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc838068380 msgr2=0x7fc83806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc838068380 0x7fc83806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc85415a4e0 tx=0x7fc844008040 comp rx=0 tx=0).stop 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 msgr2=0x7fc8540c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 --2- 172.21.15.148:0/238429790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc854155e80 0x7fc8540c8120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc85000efc0 tx=0x7fc85000c490 comp rx=0 tx=0).stop 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 reap_dead start 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85a800640 1 -- 172.21.15.148:0/238429790 reap_dead start 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 shutdown_connections 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 >> 172.21.15.148:0/238429790 conn(0x7fc85406c380 msgr2=0x7fc85414f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 shutdown_connections 2024-04-26T23:05:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.486+0000 7fc85c800640 1 -- 172.21.15.148:0/238429790 wait complete. 2024-04-26T23:05:31.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:05:31.507 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:05:31.507 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:05:31.507 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:05:31.507 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:05:31.507 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:05:31.508 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:05:31.529 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:05:31.529 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:05:31.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:05:31.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 Processor -- start 2024-04-26T23:05:31.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 -- start start 2024-04-26T23:05:31.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 0x7f0cf40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf4152fa0 con 0x7f0cf40732b0 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0cf4073700 con 0x7f0cf4152bc0 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf9a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf4159790 con 0x7f0cf40c9340 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2a00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 msgr2=0x7f0cf40c8e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf3400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f0cf40732b0 legacy=0x7f0cf40c9b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 0x7f0cf40c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:51760/0 (socket says 172.21.15.148:51760) 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 -- 172.21.15.148:0/3075790238 learned_addr learned my addr 172.21.15.148:0/3075790238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 -- 172.21.15.148:0/3075790238 >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 msgr2=0x7f0cf40c8e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 --2- 172.21.15.148:0/3075790238 >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 0x7f0cf40c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 -- 172.21.15.148:0/3075790238 >> v1:172.21.15.148:6789/0 conn(0x7f0cf40732b0 legacy=0x7f0cf40c9b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:31.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.706+0000 7f0cf2000640 1 -- 172.21.15.148:0/3075790238 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf4158930 con 0x7f0cf40c9340 2024-04-26T23:05:31.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf2000640 1 --2- 172.21.15.148:0/3075790238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009870 tx=0x7f0ce001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745d1238433bed70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf1600640 1 -- 172.21.15.148:0/3075790238 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b5070 con 0x7f0cf40c9340 2024-04-26T23:05:31.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf1600640 1 -- 172.21.15.148:0/3075790238 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a89f0 con 0x7f0cf40c9340 2024-04-26T23:05:31.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf1600640 1 -- 172.21.15.148:0/3075790238 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a8dc0 con 0x7f0cf40c9340 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3075790238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 msgr2=0x7f0cf4072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3075790238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009870 tx=0x7f0ce001ed30 comp rx=0 tx=0).stop 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3075790238 shutdown_connections 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3075790238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40c9340 0x7f0cf4072d70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3075790238 >> v2:172.21.15.148:3300/0 conn(0x7f0cf4152bc0 0x7f0cf40c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3075790238 >> 172.21.15.148:0/3075790238 conn(0x7f0cf406c380 msgr2=0x7f0cf406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3075790238 shutdown_connections 2024-04-26T23:05:31.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.710+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3075790238 wait complete. 2024-04-26T23:05:31.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 Processor -- start 2024-04-26T23:05:31.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- start start 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cf40c9340 0x7f0cf406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 0x7f0cf41f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf41591d0 con 0x7f0cf4152bc0 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf4158ef0 con 0x7f0cf40c9340 2024-04-26T23:05:31.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf41594b0 con 0x7f0cf40732b0 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf3400640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 msgr2=0x7f0cf41f3590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 0x7f0cf41f3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cf40c9340 0x7f0cf406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:51762/0 (socket says 172.21.15.148:51762) 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 -- 172.21.15.148:0/3643078393 learned_addr learned my addr 172.21.15.148:0/3643078393 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 -- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cf40c9340 msgr2=0x7f0cf406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cf40c9340 0x7f0cf406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 -- 172.21.15.148:0/3643078393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 msgr2=0x7f0cf41f3590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 0x7f0cf41f3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 -- 172.21.15.148:0/3643078393 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf41438c0 con 0x7f0cf40732b0 2024-04-26T23:05:31.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf2a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400b9e0 tx=0x7f0ce400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400cb40 con 0x7f0cf40732b0 2024-04-26T23:05:31.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce4010070 con 0x7f0cf40732b0 2024-04-26T23:05:31.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf41511e0 con 0x7f0cf40732b0 2024-04-26T23:05:31.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4015470 con 0x7f0cf40732b0 2024-04-26T23:05:31.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.714+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf4143e40 con 0x7f0cf40732b0 2024-04-26T23:05:31.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.718+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf4077c20 con 0x7f0cf40732b0 2024-04-26T23:05:31.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.718+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ce401e3f0 con 0x7f0cf40732b0 2024-04-26T23:05:31.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.718+0000 7f0ceaa00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 0x7f0cd406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:31.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.718+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0ce4087190 con 0x7f0cf40732b0 2024-04-26T23:05:31.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.718+0000 7f0cf2000640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 0x7f0cd406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:31.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.722+0000 7f0cf2000640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 0x7f0cd406a7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b2000 tx=0x7f0ce0008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.730+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ce40574c0 con 0x7f0cf40732b0 2024-04-26T23:05:31.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.938+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0cf40ca100 con 0x7f0cf40732b0 2024-04-26T23:05:31.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0ceaa00640 1 -- 172.21.15.148:0/3643078393 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f0ce4056dc0 con 0x7f0cf40732b0 2024-04-26T23:05:31.942 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":69,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:05:31.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 msgr2=0x7f0cd406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 0x7f0cd406a7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b2000 tx=0x7f0ce0008040 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 msgr2=0x7f0cf4150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400b9e0 tx=0x7f0ce400bea0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 shutdown_connections 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0cd4068330 0x7f0cd406a7f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf4152bc0 0x7f0cf41f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cf40c9340 0x7f0cf406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 --2- 172.21.15.148:0/3643078393 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cf40732b0 0x7f0cf4150ca0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 >> 172.21.15.148:0/3643078393 conn(0x7f0cf406c380 msgr2=0x7f0cf40c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 shutdown_connections 2024-04-26T23:05:31.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:31.942+0000 7f0cf9a00640 1 -- 172.21.15.148:0/3643078393 wait complete. 2024-04-26T23:05:34.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:05:35.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 Processor -- start 2024-04-26T23:05:35.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 -- start start 2024-04-26T23:05:35.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdaa8153af0 0x7fdaa815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 0x7fdaa80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80c9d90 con 0x7fdaa80c9010 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa80ca630 con 0x7fdaa80c7b80 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaae800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa80ca070 con 0x7fdaa8153af0 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaa6a00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 msgr2=0x7fdaa80c7f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaa7e00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7fdaa80c9010 legacy=0x7fdaa80c9440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.105+0000 7fdaa6a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 0x7fdaa80c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdaa8153af0 0x7fdaa815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdaa8153af0 0x7fdaa815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:36124/0 (socket says 172.21.15.148:36124) 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 -- 172.21.15.148:0/930348038 learned_addr learned my addr 172.21.15.148:0/930348038 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 -- 172.21.15.148:0/930348038 >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 msgr2=0x7fdaa80c7f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:35.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 --2- 172.21.15.148:0/930348038 >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 0x7fdaa80c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 -- 172.21.15.148:0/930348038 >> v1:172.21.15.148:6789/0 conn(0x7fdaa80c9010 legacy=0x7fdaa80c9440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:35.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 -- 172.21.15.148:0/930348038 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa80ca350 con 0x7fdaa8153af0 2024-04-26T23:05:35.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.109+0000 7fdaa7400640 1 --2- 172.21.15.148:0/930348038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa8153af0 0x7fdaa815d7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80745d0 tx=0x7fda9801f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4b50e6b62c09f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:35.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6000640 1 -- 172.21.15.148:0/930348038 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980b4070 con 0x7fdaa8153af0 2024-04-26T23:05:35.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6000640 1 -- 172.21.15.148:0/930348038 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda980af400 con 0x7fdaa8153af0 2024-04-26T23:05:35.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6000640 1 -- 172.21.15.148:0/930348038 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980af7d0 con 0x7fdaa8153af0 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- 172.21.15.148:0/930348038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa8153af0 msgr2=0x7fdaa815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- 172.21.15.148:0/930348038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa8153af0 0x7fdaa815d7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80745d0 tx=0x7fda9801f1c0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- 172.21.15.148:0/930348038 shutdown_connections 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- 172.21.15.148:0/930348038 >> v2:172.21.15.148:3300/0 conn(0x7fdaa80c7b80 0x7fdaa80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- 172.21.15.148:0/930348038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa8153af0 0x7fdaa815d7b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- 172.21.15.148:0/930348038 >> 172.21.15.148:0/930348038 conn(0x7fdaa806c380 msgr2=0x7fdaa806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- 172.21.15.148:0/930348038 shutdown_connections 2024-04-26T23:05:35.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- 172.21.15.148:0/930348038 wait complete. 2024-04-26T23:05:35.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 Processor -- start 2024-04-26T23:05:35.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- start start 2024-04-26T23:05:35.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 0x7fdaa81f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaa8153af0 0x7fdaa814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8153ed0 con 0x7fdaa80c7b80 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa815d290 con 0x7fdaa80c9010 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaae800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa8154050 con 0x7fdaa8153af0 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa7400640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 msgr2=0x7fdaa81f0190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 0x7fdaa81f0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaa8153af0 0x7fdaa814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:36138/0 (socket says 172.21.15.148:36138) 2024-04-26T23:05:35.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.113+0000 7fdaa6a00640 1 -- 172.21.15.148:0/1015491513 learned_addr learned my addr 172.21.15.148:0/1015491513 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 -- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaa8153af0 msgr2=0x7fdaa814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaa8153af0 0x7fdaa814a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 -- 172.21.15.148:0/1015491513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 msgr2=0x7fdaa81f0190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 0x7fdaa81f0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 -- 172.21.15.148:0/1015491513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81f06d0 con 0x7fdaa80c9010 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaa6a00640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda9400b560 tx=0x7fda9400ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:35.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94013020 con 0x7fdaa80c9010 2024-04-26T23:05:35.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94003df0 con 0x7fdaa80c9010 2024-04-26T23:05:35.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa814f3c0 con 0x7fdaa80c9010 2024-04-26T23:05:35.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940052b0 con 0x7fdaa80c9010 2024-04-26T23:05:35.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa814f980 con 0x7fdaa80c9010 2024-04-26T23:05:35.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.117+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa8077c20 con 0x7fdaa80c9010 2024-04-26T23:05:35.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.121+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda94016020 con 0x7fdaa80c9010 2024-04-26T23:05:35.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.121+0000 7fda9f400640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 0x7fda8806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:35.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.121+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fda94087060 con 0x7fdaa80c9010 2024-04-26T23:05:35.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.121+0000 7fdaa7400640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 0x7fda8806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:35.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.121+0000 7fdaa7400640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 0x7fda8806a7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1000 tx=0x7fda980aa000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:35.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.133+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fda9401d020 con 0x7fdaa80c9010 2024-04-26T23:05:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.345+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdaa80c3460 con 0x7fdaa80c9010 2024-04-26T23:05:35.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.345+0000 7fda9f400640 1 -- 172.21.15.148:0/1015491513 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fdaa81f06d0 con 0x7fdaa80c9010 2024-04-26T23:05:35.350 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":72,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 msgr2=0x7fda8806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 0x7fda8806a7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1000 tx=0x7fda980aa000 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 msgr2=0x7fdaa8150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda9400b560 tx=0x7fda9400ba20 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 shutdown_connections 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fda88068330 0x7fda8806a7f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdaa8153af0 0x7fdaa814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdaa80c9010 0x7fdaa8150f70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 --2- 172.21.15.148:0/1015491513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaa80c7b80 0x7fdaa81f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:35.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 >> 172.21.15.148:0/1015491513 conn(0x7fdaa806c380 msgr2=0x7fdaa8157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:35.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 shutdown_connections 2024-04-26T23:05:35.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:35.349+0000 7fdaae800640 1 -- 172.21.15.148:0/1015491513 wait complete. 2024-04-26T23:05:38.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:05:38.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.513+0000 7f42acc00640 1 Processor -- start 2024-04-26T23:05:38.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.513+0000 7f42acc00640 1 -- start start 2024-04-26T23:05:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 0x7f42a815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 0x7f42a80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42a80c9010 0x7f42a80c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f42a80ca630 con 0x7f42a80c7b80 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f42a80c99e0 con 0x7f42a80c9010 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42acc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42a80c9d90 con 0x7f42a8153af0 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f429d400640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 msgr2=0x7f42a80c7f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f429d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 0x7f42a80c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42a80c9010 0x7f42a80c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 0x7f42a815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42a80c9010 0x7f42a80c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:39632/0 (socket says 172.21.15.148:39632) 2024-04-26T23:05:38.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 -- 172.21.15.148:0/3994558033 learned_addr learned my addr 172.21.15.148:0/3994558033 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 -- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 msgr2=0x7f42a815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 0x7f42a815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 -- 172.21.15.148:0/3994558033 >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 msgr2=0x7f42a80c7f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 --2- 172.21.15.148:0/3994558033 >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 0x7f42a80c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a6800640 1 -- 172.21.15.148:0/3994558033 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a80ca070 con 0x7f42a80c9010 2024-04-26T23:05:38.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.517+0000 7f42a5e00640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 0x7f42a815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42a6800640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80c94a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42a80c3af0 tx=0x7f42a001f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=393277b05bd6a87d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42a5400640 1 -- 172.21.15.148:0/3994558033 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a00b4070 con 0x7f42a80c9010 2024-04-26T23:05:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42a5400640 1 -- 172.21.15.148:0/3994558033 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a00af400 con 0x7f42a80c9010 2024-04-26T23:05:38.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42a5400640 1 -- 172.21.15.148:0/3994558033 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a00af7d0 con 0x7f42a80c9010 2024-04-26T23:05:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 msgr2=0x7f42a80c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80c94a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42a80c3af0 tx=0x7f42a001f200 comp rx=0 tx=0).stop 2024-04-26T23:05:38.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- 172.21.15.148:0/3994558033 shutdown_connections 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 --2- 172.21.15.148:0/3994558033 >> v2:172.21.15.148:3300/0 conn(0x7f42a80c7b80 0x7f42a80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80c94a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 --2- 172.21.15.148:0/3994558033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a8153af0 0x7f42a815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- 172.21.15.148:0/3994558033 >> 172.21.15.148:0/3994558033 conn(0x7f42a806c380 msgr2=0x7f42a806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- 172.21.15.148:0/3994558033 shutdown_connections 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- 172.21.15.148:0/3994558033 wait complete. 2024-04-26T23:05:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 Processor -- start 2024-04-26T23:05:38.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.521+0000 7f42acc00640 1 -- start start 2024-04-26T23:05:38.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 0x7f42a8150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42a815d290 con 0x7f42a8153af0 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f42a815cfb0 con 0x7f42a80c9010 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42a8153ed0 con 0x7f42a80c7b80 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a6800640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 msgr2=0x7f42a8150160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a6800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 0x7f42a8150160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429d400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429d400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:39638/0 (socket says 172.21.15.148:39638) 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429d400640 1 -- 172.21.15.148:0/992219089 learned_addr learned my addr 172.21.15.148:0/992219089 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:38.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52174/0 (socket says 172.21.15.148:52174) 2024-04-26T23:05:38.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 -- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 msgr2=0x7f42a80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 -- 172.21.15.148:0/992219089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 msgr2=0x7f42a8150160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 0x7f42a8150160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 -- 172.21.15.148:0/992219089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a80c4440 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42a5e00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f429800e910 tx=0x7f429800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298017070 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a8073480 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429800c9a0 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429800cd90 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a8073a20 con 0x7f42a80c7b80 2024-04-26T23:05:38.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.525+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a8077c20 con 0x7f42a80c7b80 2024-04-26T23:05:38.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.529+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f429801a070 con 0x7f42a80c7b80 2024-04-26T23:05:38.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.529+0000 7f429ea00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 0x7f428406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:38.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.529+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4298087320 con 0x7f42a80c7b80 2024-04-26T23:05:38.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.529+0000 7f429d400640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 0x7f428406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:38.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.529+0000 7f429d400640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 0x7f428406a7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42a80c54d0 tx=0x7f42900091c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.541+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4298056e90 con 0x7f42a80c7b80 2024-04-26T23:05:38.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.753+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f42a8151250 con 0x7f42a80c7b80 2024-04-26T23:05:38.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.753+0000 7f429ea00640 1 -- 172.21.15.148:0/992219089 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f429805b190 con 0x7f42a80c7b80 2024-04-26T23:05:38.758 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":76,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 msgr2=0x7f428406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 0x7f428406a7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42a80c54d0 tx=0x7f42900091c0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 msgr2=0x7f42a8150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f429800e910 tx=0x7f429800edd0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 shutdown_connections 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4284068330 0x7f428406a7f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42a8153af0 0x7f42a8150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42a80c9010 0x7f42a80cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 --2- 172.21.15.148:0/992219089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42a80c7b80 0x7f42a8150d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 >> 172.21.15.148:0/992219089 conn(0x7f42a806c380 msgr2=0x7f42a806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 shutdown_connections 2024-04-26T23:05:38.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:38.757+0000 7f42acc00640 1 -- 172.21.15.148:0/992219089 wait complete. 2024-04-26T23:05:41.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:05:41.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.921+0000 7fe956400640 1 Processor -- start 2024-04-26T23:05:41.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.921+0000 7fe956400640 1 -- start start 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe956400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe956400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe956400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95006fbd0 con 0x7fe9501597e0 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe956400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe95006f7d0 con 0x7fe9500c8080 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe956400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe95006fed0 con 0x7fe9500c7ca0 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe94fe00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7fe9501597e0 legacy=0x7fe950070360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:41.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955a00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 msgr2=0x7fe95006cc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52178/0 (socket says 172.21.15.148:52178) 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 learned_addr learned my addr 172.21.15.148:0/1223332712 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:41.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:41.925+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:42.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v1:172.21.15.148:6789/0 conn(0x7fe9501597e0 legacy=0x7fe950070360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:42.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955a00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 msgr2=0x7fe95006cc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:42.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955a00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:05:42.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:42.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:42.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:42.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:42.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.129+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:05:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v1:172.21.15.148:6789/0 conn(0x7fe9501597e0 legacy=0x7fe950070360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955a00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 msgr2=0x7fe95006cc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955a00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:05:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:42.533+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:05:42.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:05:42.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:05:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955a00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 msgr2=0x7fe95006cc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v1:172.21.15.148:6789/0 conn(0x7fe9501597e0 legacy=0x7fe950070360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955a00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:05:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:43.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:05:43.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:43.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:43.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:43.337+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 msgr2=0x7fe95006f1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9500c7ca0 0x7fe95006f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 msgr2=0x7fe95006cc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.148:3300/0 conn(0x7fe9500c8080 0x7fe95006cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 -- 172.21.15.148:0/1223332712 >> v1:172.21.15.148:6789/0 conn(0x7fe9501597e0 legacy=0x7fe950070360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:44.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 -- 172.21.15.148:0/1223332712 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9500ca7f0 con 0x7fe9300036b0 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94e000640 1 -- 172.21.15.148:0/1223332712 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe95006fed0 con 0x7fe930007360 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:44.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:44.925+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.129+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.129+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.129+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.129+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.129+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:05:45.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.533+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:45.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.533+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:05:45.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.533+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:05:45.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.533+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:05:45.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:45.533+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:05:46.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.077+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405987328 0 0) 0x7fe9500ca7f0 con 0x7fe9300036b0 2024-04-26T23:05:46.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.077+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe934003530 con 0x7fe9300036b0 2024-04-26T23:05:46.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3094502313 0 0) 0x7fe934003530 con 0x7fe9300036b0 2024-04-26T23:05:46.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 msgr2=0x7fe930009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:46.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 --2- 172.21.15.148:0/1223332712 >> v2:172.21.15.157:3300/0 conn(0x7fe930007360 0x7fe930009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95006fbd0 con 0x7fe9300036b0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fe9400073f0 con 0x7fe9300036b0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 >> v1:172.21.15.157:6789/0 conn(0x7fe9300036b0 legacy=0x7fe930005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe955a00640 1 -- 172.21.15.148:0/1223332712 reap_dead start 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9340039c0 0x7fe934003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 0x7fe934004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 0x7fe93400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe95006fed0 con 0x7fe934005220 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe93400c150 con 0x7fe934004810 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe93400c350 con 0x7fe9340039c0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe955a00640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 msgr2=0x7fe93400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe955a00640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 0x7fe93400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 0x7fe934004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe955000640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9340039c0 0x7fe934003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9340039c0 msgr2=0x7fe934003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:05:46.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9340039c0 0x7fe934003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 msgr2=0x7fe93400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:46.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 0x7fe93400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.085+0000 7fe94fe00640 1 -- 172.21.15.148:0/1223332712 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe934003530 con 0x7fe934004810 2024-04-26T23:05:46.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe94fe00640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 0x7fe934004c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe93c003990 tx=0x7fe93c01d730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63aa99351be9950 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0af020 con 0x7fe934004810 2024-04-26T23:05:46.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93c0a7670 con 0x7fe934004810 2024-04-26T23:05:46.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe94f400640 1 -- 172.21.15.148:0/1223332712 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c009b50 con 0x7fe934004810 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 -- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 msgr2=0x7fe934004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 0x7fe934004c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe93c003990 tx=0x7fe93c01d730 comp rx=0 tx=0).stop 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 -- 172.21.15.148:0/1223332712 shutdown_connections 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe934005220 0x7fe93400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934004810 0x7fe934004c90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 --2- 172.21.15.148:0/1223332712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9340039c0 0x7fe934003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 -- 172.21.15.148:0/1223332712 >> 172.21.15.148:0/1223332712 conn(0x7fe950070d40 msgr2=0x7fe950071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 -- 172.21.15.148:0/1223332712 shutdown_connections 2024-04-26T23:05:46.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.089+0000 7fe956400640 1 -- 172.21.15.148:0/1223332712 wait complete. 2024-04-26T23:05:46.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 Processor -- start 2024-04-26T23:05:46.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 -- start start 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 0x7fe95014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934005220 0x7fe9501df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500cadb0 con 0x7fe9340039c0 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500c8fa0 con 0x7fe934005220 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe956400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe95006f1b0 con 0x7fe934004810 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe955000640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 msgr2=0x7fe95014dff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe955000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 0x7fe95014dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52214/0 (socket says 172.21.15.148:52214) 2024-04-26T23:05:46.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 -- 172.21.15.148:0/2629501773 learned_addr learned my addr 172.21.15.148:0/2629501773 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 -- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934005220 msgr2=0x7fe9501df8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934005220 0x7fe9501df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 -- 172.21.15.148:0/2629501773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 msgr2=0x7fe95014dff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 0x7fe95014dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 -- 172.21.15.148:0/2629501773 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95014e530 con 0x7fe934004810 2024-04-26T23:05:46.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.093+0000 7fe94fe00640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe93c000eb0 tx=0x7fe93c01a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0af030 con 0x7fe934004810 2024-04-26T23:05:46.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93c0be630 con 0x7fe934004810 2024-04-26T23:05:46.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0ac040 con 0x7fe934004810 2024-04-26T23:05:46.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe950151610 con 0x7fe934004810 2024-04-26T23:05:46.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9501f1330 con 0x7fe934004810 2024-04-26T23:05:46.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.097+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9500506d0 con 0x7fe934004810 2024-04-26T23:05:46.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.101+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe93c0b2020 con 0x7fe934004810 2024-04-26T23:05:46.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.101+0000 7fe94cc00640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 0x7fe93006add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.101+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe93c121e70 con 0x7fe934004810 2024-04-26T23:05:46.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.101+0000 7fe955000640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 0x7fe93006add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.101+0000 7fe955000640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 0x7fe93006add0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe940007060 tx=0x7fe940009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.113+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe93c0c5030 con 0x7fe934004810 2024-04-26T23:05:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.333+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9500506d0 con 0x7fe934004810 2024-04-26T23:05:46.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.333+0000 7fe94cc00640 1 -- 172.21.15.148:0/2629501773 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fe93c017740 con 0x7fe934004810 2024-04-26T23:05:46.337 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":10,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:05:46.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 msgr2=0x7fe93006add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 0x7fe93006add0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe940007060 tx=0x7fe940009040 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 msgr2=0x7fe950150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe93c000eb0 tx=0x7fe93c01a4d0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 shutdown_connections 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe930068910 0x7fe93006add0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe934005220 0x7fe9501df8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe934004810 0x7fe950150ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 --2- 172.21.15.148:0/2629501773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9340039c0 0x7fe95014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 >> 172.21.15.148:0/2629501773 conn(0x7fe950070d40 msgr2=0x7fe950153280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 shutdown_connections 2024-04-26T23:05:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.337+0000 7fe956400640 1 -- 172.21.15.148:0/2629501773 wait complete. 2024-04-26T23:05:46.359 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:05:46.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:05:46.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:05:46.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 Processor -- start 2024-04-26T23:05:46.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 -- start start 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b080c97d0 0x7f4b0815c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080c4b30 con 0x7f4b08073940 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080c6f60 con 0x7f4b08152d00 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b0dc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4b080c7240 con 0x7f4b080c97d0 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b06000640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f4b08073940 legacy=0x7f4b0815c070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b07400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b080c97d0 0x7f4b0815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b06a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4b08152d00 0x7f4b08073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:58668/0 (socket says 172.21.15.148:58668) 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b07400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b080c97d0 0x7f4b0815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:37510/0 (socket says 172.21.15.148:37510) 2024-04-26T23:05:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b06a00640 1 -- 172.21.15.148:0/390322652 learned_addr learned my addr 172.21.15.148:0/390322652 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b07400640 1 -- 172.21.15.148:0/390322652 >> v1:172.21.15.157:6789/0 conn(0x7f4b08152d00 legacy=0x7f4b08073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b07400640 1 -- 172.21.15.148:0/390322652 >> v1:172.21.15.148:6789/0 conn(0x7f4b08073940 legacy=0x7f4b0815c070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.493+0000 7f4b07400640 1 -- 172.21.15.148:0/390322652 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080c7520 con 0x7f4b080c97d0 2024-04-26T23:05:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b07400640 1 --2- 172.21.15.148:0/390322652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b080c97d0 0x7f4b0815c780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009d90 tx=0x7f4b0001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f914bfb7a004dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b05600640 1 -- 172.21.15.148:0/390322652 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000b2070 con 0x7f4b080c97d0 2024-04-26T23:05:46.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b05600640 1 -- 172.21.15.148:0/390322652 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b000a5900 con 0x7f4b080c97d0 2024-04-26T23:05:46.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b05600640 1 -- 172.21.15.148:0/390322652 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000a5cd0 con 0x7f4b080c97d0 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 -- 172.21.15.148:0/390322652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b080c97d0 msgr2=0x7f4b0815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/390322652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b080c97d0 0x7f4b0815c780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009d90 tx=0x7f4b0001c930 comp rx=0 tx=0).stop 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 -- 172.21.15.148:0/390322652 shutdown_connections 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/390322652 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b080c97d0 0x7f4b0815c780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 -- 172.21.15.148:0/390322652 >> 172.21.15.148:0/390322652 conn(0x7f4b080c9d10 msgr2=0x7f4b080ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 -- 172.21.15.148:0/390322652 shutdown_connections 2024-04-26T23:05:46.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.497+0000 7f4b0dc00640 1 -- 172.21.15.148:0/390322652 wait complete. 2024-04-26T23:05:46.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 Processor -- start 2024-04-26T23:05:46.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 -- start start 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 0x7f4b081f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b080c97d0 0x7f4b0814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b08152d00 0x7f4b081547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08166db0 con 0x7f4b080c97d0 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08166c30 con 0x7f4b08073940 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4b08166f30 con 0x7f4b08152d00 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06000640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b080c97d0 msgr2=0x7f4b0814ed00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b080c97d0 0x7f4b0814ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 0x7f4b081f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 0x7f4b081f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:37518/0 (socket says 172.21.15.148:37518) 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b07400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b08152d00 0x7f4b081547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 -- 172.21.15.148:0/1006900353 learned_addr learned my addr 172.21.15.148:0/1006900353 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b08152d00 msgr2=0x7f4b081547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b08152d00 0x7f4b081547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b080c97d0 msgr2=0x7f4b0814ed00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b080c97d0 0x7f4b0814ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08153460 con 0x7f4b08073940 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.501+0000 7f4b06a00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 0x7f4b081f4940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c420 tx=0x7f4af000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0017070 con 0x7f4b08073940 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0005cf0 con 0x7f4b08073940 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00072f0 con 0x7f4b08073940 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b08153740 con 0x7f4b08073940 2024-04-26T23:05:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b08153d00 con 0x7f4b08073940 2024-04-26T23:05:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 0x7f4b0815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0814f930 con 0x7f4b08151340 2024-04-26T23:05:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b06000640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 0x7f4b0815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b06000640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b0806f8b0 con 0x7f4b08151340 2024-04-26T23:05:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4b06000640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 0x7f4b0815bb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b080c96d0 tx=0x7f4af800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.505+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4af001a070 con 0x7f4b08073940 2024-04-26T23:05:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4ae4068360 0x7f4ae406a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8003e20 con 0x7f4b08151340 2024-04-26T23:05:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4af0086080 con 0x7f4b08073940 2024-04-26T23:05:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4af8015070 con 0x7f4b08151340 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 msgr2=0x7f4b0815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 0x7f4b0815bb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b080c96d0 tx=0x7f4af800b8e0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 msgr2=0x7f4b0815bb50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4afea00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08151340 0x7f4b0815bb50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4b07400640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4ae4068360 0x7f4ae406a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.509+0000 7f4b07400640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4ae4068360 0x7f4ae406a820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b000af000 tx=0x7f4b000a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.513+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 0x7f4b0815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.513+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0815c5d0 con 0x7f4b08153ed0 2024-04-26T23:05:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.513+0000 7f4b06000640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 0x7f4b0815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.513+0000 7f4b06000640 1 -- 172.21.15.148:0/1006900353 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b080766a0 con 0x7f4b08153ed0 2024-04-26T23:05:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b06000640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 0x7f4b0815c090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b080c96d0 tx=0x7f4af8005a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005800 con 0x7f4b08153ed0 2024-04-26T23:05:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5202 (secure 0 0 0) 0x7f4af8005800 con 0x7f4b08153ed0 2024-04-26T23:05:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 msgr2=0x7f4b0815c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 0x7f4b0815c090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b080c96d0 tx=0x7f4af8005a30 comp rx=0 tx=0).stop 2024-04-26T23:05:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 msgr2=0x7f4b0815c090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4afea00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08153ed0 0x7f4b0815c090 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b080c96d0 tx=0x7f4af8005a30 comp rx=0 tx=0).stop 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 10, 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 89367, 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.521 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.522 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:05:46.524 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.525 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.527 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.529 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.530 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.531 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.532 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:46.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.534 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:05:46.534 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4ae4068360 msgr2=0x7f4ae406a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4ae4068360 0x7f4ae406a820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b000af000 tx=0x7f4b000a7070 comp rx=0 tx=0).stop 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 msgr2=0x7f4b081f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 --2- 172.21.15.148:0/1006900353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b08073940 0x7f4b081f4940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c420 tx=0x7f4af000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b07400640 1 -- 172.21.15.148:0/1006900353 reap_dead start 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b07400640 1 -- 172.21.15.148:0/1006900353 reap_dead start 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 shutdown_connections 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 >> 172.21.15.148:0/1006900353 conn(0x7f4b080c9d10 msgr2=0x7f4b080c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 shutdown_connections 2024-04-26T23:05:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.517+0000 7f4b0dc00640 1 -- 172.21.15.148:0/1006900353 wait complete. 2024-04-26T23:05:46.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:05:46.540 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:05:46.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:05:46.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 Processor -- start 2024-04-26T23:05:46.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 -- start start 2024-04-26T23:05:46.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 0x7fb3280c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb328073230 0x7fb3280736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb328073be0 con 0x7fb328158a80 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb3280c4b30 con 0x7fb328152d00 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb32ce00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3280c6f60 con 0x7fb328073230 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 msgr2=0x7fb3280c97d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 0x7fb3280c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb328073230 0x7fb3280736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb326800640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb328158a80 0x7fb328158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:58682/0 (socket says 172.21.15.148:58682) 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb328073230 0x7fb3280736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:37554/0 (socket says 172.21.15.148:37554) 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb326800640 1 -- 172.21.15.148:0/1759458682 learned_addr learned my addr 172.21.15.148:0/1759458682 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 -- 172.21.15.148:0/1759458682 >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 msgr2=0x7fb3280c97d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 --2- 172.21.15.148:0/1759458682 >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 0x7fb3280c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 -- 172.21.15.148:0/1759458682 >> v1:172.21.15.157:6789/0 conn(0x7fb328158a80 legacy=0x7fb328158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.673+0000 7fb325400640 1 -- 172.21.15.148:0/1759458682 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280c7240 con 0x7fb328073230 2024-04-26T23:05:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb325400640 1 --2- 172.21.15.148:0/1759458682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328073230 0x7fb3280736a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3280cad50 tx=0x7fb31401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f6eeafdd887ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb324a00640 1 -- 172.21.15.148:0/1759458682 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140b0070 con 0x7fb328073230 2024-04-26T23:05:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb324a00640 1 -- 172.21.15.148:0/1759458682 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140ab600 con 0x7fb328073230 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb324a00640 1 -- 172.21.15.148:0/1759458682 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ab9d0 con 0x7fb328073230 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 -- 172.21.15.148:0/1759458682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328073230 msgr2=0x7fb3280736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 --2- 172.21.15.148:0/1759458682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328073230 0x7fb3280736a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3280cad50 tx=0x7fb31401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 -- 172.21.15.148:0/1759458682 shutdown_connections 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 --2- 172.21.15.148:0/1759458682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328073230 0x7fb3280736a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 --2- 172.21.15.148:0/1759458682 >> v2:172.21.15.148:3300/0 conn(0x7fb328152d00 0x7fb3280c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 -- 172.21.15.148:0/1759458682 >> 172.21.15.148:0/1759458682 conn(0x7fb3280c9d10 msgr2=0x7fb3280ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 -- 172.21.15.148:0/1759458682 shutdown_connections 2024-04-26T23:05:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.677+0000 7fb32ce00640 1 -- 172.21.15.148:0/1759458682 wait complete. 2024-04-26T23:05:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 Processor -- start 2024-04-26T23:05:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 -- start start 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328073230 0x7fb328157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 0x7fb3281f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 0x7fb3281f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328073230 msgr2=0x7fb328157a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280c4890 con 0x7fb328073230 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280c4710 con 0x7fb328158a80 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb328163c10 con 0x7fb328152d00 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328073230 0x7fb328157a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:05:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 0x7fb3281f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb326800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 0x7fb3281f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb326800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 0x7fb3281f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:37560/0 (socket says 172.21.15.148:37560) 2024-04-26T23:05:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 0x7fb3281f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:37718/0 (socket says 172.21.15.148:37718) 2024-04-26T23:05:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb326800640 1 -- 172.21.15.148:0/3748229319 learned_addr learned my addr 172.21.15.148:0/3748229319 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 msgr2=0x7fb3281f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 0x7fb3281f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328073230 msgr2=0x7fb328157a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328073230 0x7fb328157a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3281511d0 con 0x7fb328152d00 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb326800640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb328158a80 0x7fb3281f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:05:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb325400640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 0x7fb3281f4c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ab000 tx=0x7fb314019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140b0040 con 0x7fb328152d00 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140ba070 con 0x7fb328152d00 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140b4850 con 0x7fb328152d00 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.681+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32814ad70 con 0x7fb328152d00 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3280cb390 con 0x7fb328152d00 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb32ce00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 0x7fb328162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb328070430 con 0x7fb3280cb780 2024-04-26T23:05:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb325e00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 0x7fb328162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb325e00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb32814c950 con 0x7fb3280cb780 2024-04-26T23:05:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3140ab480 con 0x7fb328152d00 2024-04-26T23:05:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb325e00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 0x7fb328162c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb31800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb308068330 0x7fb30806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb314120b60 con 0x7fb328152d00 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318003e20 con 0x7fb3280cb780 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb326800640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb308068330 0x7fb30806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb318015070 con 0x7fb3280cb780 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 msgr2=0x7fb328162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 0x7fb328162c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb31800b910 comp rx=0 tx=0).stop 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.685+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 msgr2=0x7fb328162c80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.689+0000 7fb31e000640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3280cb780 0x7fb328162c80 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb31800b910 comp rx=0 tx=0).stop 2024-04-26T23:05:46.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.689+0000 7fb326800640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb308068330 0x7fb30806a7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb328151550 tx=0x7fb320009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb32ce00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 0x7fb32814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:05:46.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb32814c670 con 0x7fb32814af40 2024-04-26T23:05:46.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb325e00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 0x7fb32814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:05:46.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb325e00640 1 -- 172.21.15.148:0/3748229319 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3280766a0 con 0x7fb32814af40 2024-04-26T23:05:46.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb325e00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 0x7fb32814b350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb318005a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:05:46.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.693+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318005850 con 0x7fb32814af40 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fb318005850 con 0x7fb32814af40 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 msgr2=0x7fb32814b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb31e000640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 0x7fb32814b350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb318005a30 comp rx=0 tx=0).stop 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb31e000640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 msgr2=0x7fb32814b350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb31e000640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb32814af40 0x7fb32814b350 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb31800b450 tx=0x7fb318005a30 comp rx=0 tx=0).stop 2024-04-26T23:05:46.699 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 10, 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 89543, 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:05:46.700 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.701 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:05:46.702 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:05:46.703 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.704 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.706 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.707 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:05:46.708 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:05:46.709 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.710 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.711 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:05:46.712 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:05:46.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb308068330 msgr2=0x7fb30806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb308068330 0x7fb30806a7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb328151550 tx=0x7fb320009040 comp rx=0 tx=0).stop 2024-04-26T23:05:46.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 msgr2=0x7fb3281f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:05:46.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 --2- 172.21.15.148:0/3748229319 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb328152d00 0x7fb3281f4c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ab000 tx=0x7fb314019240 comp rx=0 tx=0).stop 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb326800640 1 -- 172.21.15.148:0/3748229319 reap_dead start 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb326800640 1 -- 172.21.15.148:0/3748229319 reap_dead start 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 shutdown_connections 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 >> 172.21.15.148:0/3748229319 conn(0x7fb3280c9d10 msgr2=0x7fb328148ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 shutdown_connections 2024-04-26T23:05:46.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:05:46.697+0000 7fb32ce00640 1 -- 172.21.15.148:0/3748229319 wait complete. 2024-04-26T23:05:46.718 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:05:46.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:06:06.719 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:06:06.719 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:06:06.719 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:06:06.720 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:06:06.724 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:06:06.724 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:06:06.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:06.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 Processor -- start 2024-04-26T23:06:06.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 -- start start 2024-04-26T23:06:06.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 0x7f7cf40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf40c9d90 con 0x7f7cf40c7b80 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf40ca630 con 0x7f7cf4153af0 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfc400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf40ca070 con 0x7f7cf40c9720 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7cf40c7b80 0x7f7cf40c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43730/0 (socket says 172.21.15.148:43730) 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9000640 1 -- 172.21.15.148:0/3685688264 learned_addr learned my addr 172.21.15.148:0/3685688264 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfa400640 1 --2- 172.21.15.148:0/3685688264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 0x7f7cf40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9a00640 1 -- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 msgr2=0x7f7cf415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9a00640 1 -- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 msgr2=0x7f7cf415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:06.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfa400640 1 -- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 msgr2=0x7f7cf415d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:06.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfa400640 1 --2- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:06.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfa400640 1 -- 172.21.15.148:0/3685688264 >> v1:172.21.15.148:6789/0 conn(0x7f7cf40c7b80 legacy=0x7f7cf40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:06.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.868+0000 7f7cfa400640 1 -- 172.21.15.148:0/3685688264 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf40ca350 con 0x7f7cf40c9720 2024-04-26T23:06:06.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfa400640 1 --2- 172.21.15.148:0/3685688264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 0x7f7cf40c7f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009d90 tx=0x7f7cec01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101c4c682347a03d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:06.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cf3e00640 1 -- 172.21.15.148:0/3685688264 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0b4070 con 0x7f7cf40c9720 2024-04-26T23:06:06.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cf3e00640 1 -- 172.21.15.148:0/3685688264 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec0af600 con 0x7f7cf40c9720 2024-04-26T23:06:06.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cf3e00640 1 -- 172.21.15.148:0/3685688264 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0af9d0 con 0x7f7cf40c9720 2024-04-26T23:06:06.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 -- 172.21.15.148:0/3685688264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 msgr2=0x7f7cf40c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:06.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 --2- 172.21.15.148:0/3685688264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 0x7f7cf40c7f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009d90 tx=0x7f7cec01f150 comp rx=0 tx=0).stop 2024-04-26T23:06:06.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 -- 172.21.15.148:0/3685688264 shutdown_connections 2024-04-26T23:06:06.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 --2- 172.21.15.148:0/3685688264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c9720 0x7f7cf40c7f80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:06.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 --2- 172.21.15.148:0/3685688264 >> v2:172.21.15.148:3300/0 conn(0x7f7cf4153af0 0x7f7cf415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 -- 172.21.15.148:0/3685688264 >> 172.21.15.148:0/3685688264 conn(0x7f7cf406c380 msgr2=0x7f7cf406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 -- 172.21.15.148:0/3685688264 shutdown_connections 2024-04-26T23:06:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.872+0000 7f7cfc400640 1 -- 172.21.15.148:0/3685688264 wait complete. 2024-04-26T23:06:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 Processor -- start 2024-04-26T23:06:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- start start 2024-04-26T23:06:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 0x7f7cf4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 0x7f7cf41e2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4153ed0 con 0x7f7cf4153af0 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf415d290 con 0x7f7cf40c9720 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf4154050 con 0x7f7cf40c7b80 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44370/0 (socket says 172.21.15.148:44370) 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 -- 172.21.15.148:0/4216276449 learned_addr learned my addr 172.21.15.148:0/4216276449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 0x7f7cf4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 msgr2=0x7f7cf41e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 msgr2=0x7f7cf41e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9000640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 0x7f7cf41e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfa400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 msgr2=0x7f7cf41e2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 0x7f7cf41e2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 msgr2=0x7f7cf41e2c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 -- 172.21.15.148:0/4216276449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf40723d0 con 0x7f7cf40c7b80 2024-04-26T23:06:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9000640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 0x7f7cf41e2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf9a00640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 0x7f7cf4152970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e810 tx=0x7f7ce800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017030 con 0x7f7cf40c7b80 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce800ee00 con 0x7f7cf40c7b80 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf40726b0 con 0x7f7cf40c7b80 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800f040 con 0x7f7cf40c7b80 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.876+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf4153270 con 0x7f7cf40c7b80 2024-04-26T23:06:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.880+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf4077c20 con 0x7f7cf40c7b80 2024-04-26T23:06:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.880+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ce801a070 con 0x7f7cf40c7b80 2024-04-26T23:06:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.880+0000 7f7cf1600640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 0x7f7cd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.880+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7ce8086e30 con 0x7f7cf40c7b80 2024-04-26T23:06:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.880+0000 7f7cf9000640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 0x7f7cd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:06.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.884+0000 7f7cf9000640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 0x7f7cd406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cf415b4f0 tx=0x7f7ce0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:06.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:06.892+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ce80570d0 con 0x7f7cf40c7b80 2024-04-26T23:06:07.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.108+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7cf40c8670 con 0x7f7cf40c7b80 2024-04-26T23:06:07.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.452+0000 7f7cf1600640 1 -- 172.21.15.148:0/4216276449 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f7ce80569d0 con 0x7f7cf40c7b80 2024-04-26T23:06:07.459 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:07.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 msgr2=0x7f7cd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 0x7f7cd406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cf415b4f0 tx=0x7f7ce0009040 comp rx=0 tx=0).stop 2024-04-26T23:06:07.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 msgr2=0x7f7cf4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 0x7f7cf4152970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e810 tx=0x7f7ce800ecd0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 shutdown_connections 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f7cd4068380 0x7f7cd406a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf4153af0 0x7f7cf41e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cf40c9720 0x7f7cf41e2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 --2- 172.21.15.148:0/4216276449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7cf40c7b80 0x7f7cf4152970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 >> 172.21.15.148:0/4216276449 conn(0x7f7cf406c380 msgr2=0x7f7cf4149060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 shutdown_connections 2024-04-26T23:06:07.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.456+0000 7f7cfc400640 1 -- 172.21.15.148:0/4216276449 wait complete. 2024-04-26T23:06:07.482 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:06:07.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:06:07.483 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:06:07.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 Processor -- start 2024-04-26T23:06:07.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 -- start start 2024-04-26T23:06:07.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5650152d00 0x7f56500c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650073230 0x7f5650073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5650158a80 0x7f5650158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5650073bb0 con 0x7f5650152d00 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f56500c4b30 con 0x7f5650158a80 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5658400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f56500c6f60 con 0x7f5650073230 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5650152d00 0x7f56500c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5650152d00 0x7f56500c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44380/0 (socket says 172.21.15.148:44380) 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 -- 172.21.15.148:0/2978814590 learned_addr learned my addr 172.21.15.148:0/2978814590 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655000640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650073230 0x7f5650073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5656400640 1 --2- 172.21.15.148:0/2978814590 >> v2:172.21.15.157:3300/0 conn(0x7f5650158a80 0x7f5650158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 -- 172.21.15.148:0/2978814590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650073230 msgr2=0x7f5650073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650073230 0x7f5650073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 -- 172.21.15.148:0/2978814590 >> v2:172.21.15.157:3300/0 conn(0x7f5650158a80 msgr2=0x7f5650158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 --2- 172.21.15.148:0/2978814590 >> v2:172.21.15.157:3300/0 conn(0x7f5650158a80 0x7f5650158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.616+0000 7f5655a00640 1 -- 172.21.15.148:0/2978814590 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56500c7240 con 0x7f5650152d00 2024-04-26T23:06:07.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5655a00640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650152d00 0x7f56500c97d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f56500c4540 tx=0x7f564401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c873a1ff1f037a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f564fe00640 1 -- 172.21.15.148:0/2978814590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56440a57e0 con 0x7f5650152d00 2024-04-26T23:06:07.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f564fe00640 1 -- 172.21.15.148:0/2978814590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56440a5980 con 0x7f5650152d00 2024-04-26T23:06:07.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f564fe00640 1 -- 172.21.15.148:0/2978814590 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56440a5d50 con 0x7f5650152d00 2024-04-26T23:06:07.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 -- 172.21.15.148:0/2978814590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650152d00 msgr2=0x7f56500c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650152d00 0x7f56500c97d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f56500c4540 tx=0x7f564401c9c0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 -- 172.21.15.148:0/2978814590 shutdown_connections 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 --2- 172.21.15.148:0/2978814590 >> v2:172.21.15.157:3300/0 conn(0x7f5650158a80 0x7f5650158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650073230 0x7f5650073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 --2- 172.21.15.148:0/2978814590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650152d00 0x7f56500c97d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 -- 172.21.15.148:0/2978814590 >> 172.21.15.148:0/2978814590 conn(0x7f56500c9d10 msgr2=0x7f56500ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 -- 172.21.15.148:0/2978814590 shutdown_connections 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.620+0000 7f5658400640 1 -- 172.21.15.148:0/2978814590 wait complete. 2024-04-26T23:06:07.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 Processor -- start 2024-04-26T23:06:07.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- start start 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5650073230 0x7f5650159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650152d00 0x7f5650149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 0x7f56500cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56500c4f90 con 0x7f5650158a80 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f56500c4e10 con 0x7f5650073230 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f56500c4710 con 0x7f5650152d00 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 0x7f56500cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 0x7f56500cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44390/0 (socket says 172.21.15.148:44390) 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 learned_addr learned my addr 172.21.15.148:0/3130475590 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5655a00640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5650073230 0x7f5650159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5655000640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650152d00 0x7f5650149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650152d00 msgr2=0x7f5650149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650152d00 0x7f5650149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5650073230 msgr2=0x7f5650159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5650073230 0x7f5650159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56501f4f80 con 0x7f5650158a80 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5655000640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5650152d00 0x7f5650149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5656400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 0x7f56500cbb90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f564800d560 tx=0x7f564800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480125f0 con 0x7f5650158a80 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5648019070 con 0x7f5650158a80 2024-04-26T23:06:07.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56501f5220 con 0x7f5650158a80 2024-04-26T23:06:07.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480129f0 con 0x7f5650158a80 2024-04-26T23:06:07.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56501f57e0 con 0x7f5650158a80 2024-04-26T23:06:07.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 0x7f56500cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.624+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56500c4350 con 0x7f56500cb5d0 2024-04-26T23:06:07.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f5655a00640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 0x7f56500cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f5655a00640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f565014d1a0 con 0x7f56500cb5d0 2024-04-26T23:06:07.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f5655a00640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 0x7f56500cc0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5650068e40 tx=0x7f5644019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644009510 con 0x7f56500cb5d0 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f56440c0640 con 0x7f56500cb5d0 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 msgr2=0x7f56500cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 0x7f56500cc0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5650068e40 tx=0x7f5644019760 comp rx=0 tx=0).stop 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 msgr2=0x7f56500cc0d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56500cb5d0 0x7f56500cc0d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5648012b90 con 0x7f5650158a80 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5630067d30 0x7f563006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5648087120 con 0x7f5650158a80 2024-04-26T23:06:07.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f5655a00640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5630067d30 0x7f563006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.628+0000 7f5655a00640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5630067d30 0x7f563006a1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56500c9a00 tx=0x7f56440b9000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.632+0000 7f5658400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 0x7f5650146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.632+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f565014cec0 con 0x7f56501f80d0 2024-04-26T23:06:07.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5655000640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 0x7f5650146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5655000640 1 -- 172.21.15.148:0/3130475590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f565014cbe0 con 0x7f56501f80d0 2024-04-26T23:06:07.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5655000640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 0x7f5650146950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5650073b80 tx=0x7f563c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c018030 con 0x7f56501f80d0 2024-04-26T23:06:07.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4558 (secure 0 0 0) 0x7f563c014670 con 0x7f56501f80d0 2024-04-26T23:06:07.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 msgr2=0x7f5650146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 0x7f5650146950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5650073b80 tx=0x7f563c00f880 comp rx=0 tx=0).stop 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 msgr2=0x7f5650146950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f564d600640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56501f80d0 0x7f5650146950 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5650073b80 tx=0x7f563c00f880 comp rx=0 tx=0).stop 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 803, 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:07.641 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.642 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.643 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:07.644 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.645 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:07.646 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.647 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.648 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.649 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.650 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.651 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.653 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:07.653 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5630067d30 msgr2=0x7f563006a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5630067d30 0x7f563006a1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56500c9a00 tx=0x7f56440b9000 comp rx=0 tx=0).stop 2024-04-26T23:06:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 msgr2=0x7f56500cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 --2- 172.21.15.148:0/3130475590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5650158a80 0x7f56500cbb90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f564800d560 tx=0x7f564800da20 comp rx=0 tx=0).stop 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 reap_dead start 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5656400640 1 -- 172.21.15.148:0/3130475590 reap_dead start 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 shutdown_connections 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 >> 172.21.15.148:0/3130475590 conn(0x7f56500c9d10 msgr2=0x7f5650156850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 shutdown_connections 2024-04-26T23:06:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.636+0000 7f5658400640 1 -- 172.21.15.148:0/3130475590 wait complete. 2024-04-26T23:06:07.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:07.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:06:07.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:06:07.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 Processor -- start 2024-04-26T23:06:07.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 -- start start 2024-04-26T23:06:07.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 0x7f4b880cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b880cd3a0 0x7f4b880cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b880c8470 con 0x7f4b88155f80 2024-04-26T23:06:07.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4b880c8750 con 0x7f4b880cd3a0 2024-04-26T23:06:07.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8ec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4b880c8a30 con 0x7f4b880ccec0 2024-04-26T23:06:07.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8cc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b880cd3a0 0x7f4b880cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b7f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 0x7f4b880cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b87e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4b88155f80 0x7f4b8815bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:55958/0 (socket says 172.21.15.148:55958) 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b87e00640 1 -- 172.21.15.148:0/1026256396 learned_addr learned my addr 172.21.15.148:0/1026256396 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8cc00640 1 -- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 msgr2=0x7f4b880cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8cc00640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 0x7f4b880cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8cc00640 1 -- 172.21.15.148:0/1026256396 >> v1:172.21.15.157:6789/0 conn(0x7f4b88155f80 legacy=0x7f4b8815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b8cc00640 1 -- 172.21.15.148:0/1026256396 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b880c8e80 con 0x7f4b880cd3a0 2024-04-26T23:06:07.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.792+0000 7f4b7f400640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 0x7f4b880cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:07.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8cc00640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880cc380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4faf15f320d90993 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b87400640 1 -- 172.21.15.148:0/1026256396 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800b5070 con 0x7f4b880cd3a0 2024-04-26T23:06:07.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b87400640 1 -- 172.21.15.148:0/1026256396 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b800a8990 con 0x7f4b880cd3a0 2024-04-26T23:06:07.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b87400640 1 -- 172.21.15.148:0/1026256396 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800a8d60 con 0x7f4b880cd3a0 2024-04-26T23:06:07.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 -- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 msgr2=0x7f4b880cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880cc380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001ec90 comp rx=0 tx=0).stop 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 -- 172.21.15.148:0/1026256396 shutdown_connections 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880cc380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/1026256396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b880ccec0 0x7f4b880cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 -- 172.21.15.148:0/1026256396 >> 172.21.15.148:0/1026256396 conn(0x7f4b8806c380 msgr2=0x7f4b8806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 -- 172.21.15.148:0/1026256396 shutdown_connections 2024-04-26T23:06:07.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.796+0000 7f4b8ec00640 1 -- 172.21.15.148:0/1026256396 wait complete. 2024-04-26T23:06:07.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 Processor -- start 2024-04-26T23:06:07.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- start start 2024-04-26T23:06:07.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 0x7f4b8814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b88155f80 0x7f4b880c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8815c250 con 0x7f4b880ccec0 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880c9440 con 0x7f4b880cd3a0 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4b880c9960 con 0x7f4b88155f80 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 0x7f4b8814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 0x7f4b8814f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44404/0 (socket says 172.21.15.148:44404) 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 -- 172.21.15.148:0/2144666770 learned_addr learned my addr 172.21.15.148:0/2144666770 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b7f400640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8cc00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b88155f80 0x7f4b880c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b88155f80 msgr2=0x7f4b880c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b88155f80 0x7f4b880c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 msgr2=0x7f4b880c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880cd3a0 0x7f4b880c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b881592e0 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b87e00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 0x7f4b8814f790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ca70 tx=0x7f4b7800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78017070 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7800abd0 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b881f5c50 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78012400 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8815aba0 con 0x7f4b880ccec0 2024-04-26T23:06:07.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 0x7f4b8815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8814fcd0 con 0x7f4b881f5780 2024-04-26T23:06:07.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.800+0000 7f4b7f400640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 0x7f4b8815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b7f400640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b88077c20 con 0x7f4b881f5780 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b7801a070 con 0x7f4b880ccec0 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b7f400640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 0x7f4b8815ae80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815bbd0 tx=0x7f4b70011e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b64068380 0x7f4b6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4b78086a10 con 0x7f4b880ccec0 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000fb30 con 0x7f4b881f5780 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4b7000fcd0 con 0x7f4b881f5780 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 msgr2=0x7f4b8815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 0x7f4b8815ae80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815bbd0 tx=0x7f4b70011e30 comp rx=0 tx=0).stop 2024-04-26T23:06:07.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 msgr2=0x7f4b8815ae80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b84c00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f5780 0x7f4b8815ae80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b8cc00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b64068380 0x7f4b6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.804+0000 7f4b8cc00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b64068380 0x7f4b6406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b800b2000 tx=0x7f4b80008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.808+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 0x7f4b881f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.808+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880cc160 con 0x7f4b881f1ce0 2024-04-26T23:06:07.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b7f400640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 0x7f4b881f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b7f400640 1 -- 172.21.15.148:0/2144666770 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b880c61b0 con 0x7f4b881f1ce0 2024-04-26T23:06:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b7f400640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 0x7f4b881f2100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b70019000 tx=0x7f4b700046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70004220 con 0x7f4b881f1ce0 2024-04-26T23:06:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7f4b7000fe80 con 0x7f4b881f1ce0 2024-04-26T23:06:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 msgr2=0x7f4b881f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 0x7f4b881f2100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b70019000 tx=0x7f4b700046d0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 msgr2=0x7f4b881f2100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b84c00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b881f1ce0 0x7f4b881f2100 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b70019000 tx=0x7f4b700046d0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 110663, 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:07.831 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b64068380 msgr2=0x7f4b6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4b64068380 0x7f4b6406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b800b2000 tx=0x7f4b80008040 comp rx=0 tx=0).stop 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 msgr2=0x7f4b8814f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 --2- 172.21.15.148:0/2144666770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880ccec0 0x7f4b8814f790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ca70 tx=0x7f4b7800cf30 comp rx=0 tx=0).stop 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8cc00640 1 -- 172.21.15.148:0/2144666770 reap_dead start 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8cc00640 1 -- 172.21.15.148:0/2144666770 reap_dead start 2024-04-26T23:06:07.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 shutdown_connections 2024-04-26T23:06:07.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 >> 172.21.15.148:0/2144666770 conn(0x7f4b8806c380 msgr2=0x7f4b880c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 shutdown_connections 2024-04-26T23:06:07.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.812+0000 7f4b8ec00640 1 -- 172.21.15.148:0/2144666770 wait complete. 2024-04-26T23:06:07.836 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:07.836 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:06:07.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:06:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 Processor -- start 2024-04-26T23:06:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 -- start start 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 0x7f5bfc15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5bfc06ff50 0x7f5bfc0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0c96a0 con 0x7f5bfc153eb0 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc15ac00 con 0x7f5bfc06ff50 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c03200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc0c9980 con 0x7f5bfc06f460 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5bfc06ff50 0x7f5bfc0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5bfc06ff50 0x7f5bfc0c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44408/0 (socket says 172.21.15.148:44408) 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5bf3400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5bfc153eb0 0x7f5bfc06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43742/0 (socket says 172.21.15.148:43742) 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 -- 172.21.15.148:0/2813081090 learned_addr learned my addr 172.21.15.148:0/2813081090 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2813081090 >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 0x7f5bfc15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 -- 172.21.15.148:0/2813081090 >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 msgr2=0x7f5bfc15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 --2- 172.21.15.148:0/2813081090 >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 0x7f5bfc15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 -- 172.21.15.148:0/2813081090 >> v1:172.21.15.148:6789/0 conn(0x7f5bfc153eb0 legacy=0x7f5bfc06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5c01200640 1 -- 172.21.15.148:0/2813081090 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc070610 con 0x7f5bfc06ff50 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5bfb400640 1 -- 172.21.15.148:0/2813081090 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230679008 0 0) 0x7f5bfc0c96a0 con 0x7f5bfc153eb0 2024-04-26T23:06:07.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.968+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2813081090 >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 0x7f5bfc15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:07.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c01200640 1 --2- 172.21.15.148:0/2813081090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc06ff50 0x7f5bfc0c5640 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc06d800 tx=0x7f5bf401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2878336d3538528 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5bfb400640 1 -- 172.21.15.148:0/2813081090 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40b5070 con 0x7f5bfc06ff50 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5bfb400640 1 -- 172.21.15.148:0/2813081090 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf40a8a10 con 0x7f5bfc06ff50 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5bfb400640 1 -- 172.21.15.148:0/2813081090 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40a8de0 con 0x7f5bfc06ff50 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 -- 172.21.15.148:0/2813081090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc06ff50 msgr2=0x7f5bfc0c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 --2- 172.21.15.148:0/2813081090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc06ff50 0x7f5bfc0c5640 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc06d800 tx=0x7f5bf401ed10 comp rx=0 tx=0).stop 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 -- 172.21.15.148:0/2813081090 shutdown_connections 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 --2- 172.21.15.148:0/2813081090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc06ff50 0x7f5bfc0c5640 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 --2- 172.21.15.148:0/2813081090 >> v2:172.21.15.157:3300/0 conn(0x7f5bfc06f460 0x7f5bfc15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 -- 172.21.15.148:0/2813081090 >> 172.21.15.148:0/2813081090 conn(0x7f5bfc0c9d10 msgr2=0x7f5bfc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 -- 172.21.15.148:0/2813081090 shutdown_connections 2024-04-26T23:06:07.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.972+0000 7f5c03200640 1 -- 172.21.15.148:0/2813081090 wait complete. 2024-04-26T23:06:07.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 Processor -- start 2024-04-26T23:06:07.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 -- start start 2024-04-26T23:06:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc06f460 0x7f5bfc1e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc06ff50 0x7f5bfc1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 0x7f5bfc1f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0c4d70 con 0x7f5bfc073b50 2024-04-26T23:06:07.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0c5120 con 0x7f5bfc06f460 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc0c4ef0 con 0x7f5bfc06ff50 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 0x7f5bfc1f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 0x7f5bfc1f23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44410/0 (socket says 172.21.15.148:44410) 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 learned_addr learned my addr 172.21.15.148:0/2872070526 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc06f460 0x7f5bfc1e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5bf3400640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc06ff50 0x7f5bfc1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc06ff50 msgr2=0x7f5bfc1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc06ff50 0x7f5bfc1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc06f460 msgr2=0x7f5bfc1e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc06f460 0x7f5bfc1e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1e6150 con 0x7f5bfc073b50 2024-04-26T23:06:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c01200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 0x7f5bfc1f23c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40b3040 tx=0x7f5bf401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40b5070 con 0x7f5bfc073b50 2024-04-26T23:06:07.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf40b0ac0 con 0x7f5bfc073b50 2024-04-26T23:06:07.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc1e63f0 con 0x7f5bfc073b50 2024-04-26T23:06:07.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.976+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40bb410 con 0x7f5bfc073b50 2024-04-26T23:06:07.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1e69b0 con 0x7f5bfc073b50 2024-04-26T23:06:07.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5c03200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 0x7f5bfc1f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc1e6b80 con 0x7f5bfc153eb0 2024-04-26T23:06:07.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 0x7f5bfc1f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5bf40c2060 con 0x7f5bfc073b50 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bfbe00640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bfc077c20 con 0x7f5bfc153eb0 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 0x7f5bfc1f1c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bec004650 tx=0x7f5bec007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bd80683b0 0x7f5bd806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5bf4123e80 con 0x7f5bfc073b50 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec015680 con 0x7f5bfc153eb0 2024-04-26T23:06:07.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf3400640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bd80683b0 0x7f5bd806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5bec01a070 con 0x7f5bfc153eb0 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 msgr2=0x7f5bfc1f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 0x7f5bfc1f1c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bec004650 tx=0x7f5bec007700 comp rx=0 tx=0).stop 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 msgr2=0x7f5bfc1f1c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf8c00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc153eb0 0x7f5bfc1f1c90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.980+0000 7f5bf3400640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bd80683b0 0x7f5bd806a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc1ef8c0 tx=0x7f5be4007df0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5c03200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 0x7f5bfc1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:07.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc152330 con 0x7f5bfc073fe0 2024-04-26T23:06:07.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 0x7f5bfc1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:07.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bfbe00640 1 -- 172.21.15.148:0/2872070526 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5bfc070c20 con 0x7f5bfc073fe0 2024-04-26T23:06:07.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bfbe00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 0x7f5bfc1468e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5bec004650 tx=0x7f5bec004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:07.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0147f0 con 0x7f5bfc073fe0 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5069 (secure 0 0 0) 0x7f5bec0147f0 con 0x7f5bfc073fe0 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 msgr2=0x7f5bfc1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 0x7f5bfc1468e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5bec004650 tx=0x7f5bec004a50 comp rx=0 tx=0).stop 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 msgr2=0x7f5bfc1468e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.988+0000 7f5bf8c00640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bfc073fe0 0x7f5bfc1468e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:07.995 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 110839, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:07.996 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:07.997 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:07.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:07.999 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:08.000 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:08.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.003 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:08.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:08.005 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.006 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.007 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:08.009 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:08.009 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bd80683b0 msgr2=0x7f5bd806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bd80683b0 0x7f5bd806a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc1ef8c0 tx=0x7f5be4007df0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 msgr2=0x7f5bfc1f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 --2- 172.21.15.148:0/2872070526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bfc073b50 0x7f5bfc1f23c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40b3040 tx=0x7f5bf401bab0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 reap_dead start 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c01200640 1 -- 172.21.15.148:0/2872070526 reap_dead start 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 shutdown_connections 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 >> 172.21.15.148:0/2872070526 conn(0x7f5bfc0c9d10 msgr2=0x7f5bfc0c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 shutdown_connections 2024-04-26T23:06:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:07.992+0000 7f5c03200640 1 -- 172.21.15.148:0/2872070526 wait complete. 2024-04-26T23:06:08.014 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:08.014 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:06:08.014 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:06:08.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 Processor -- start 2024-04-26T23:06:08.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 -- start start 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c5c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c152fa0 con 0x7f4c5c0c9340 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c159790 con 0x7f4c5c073480 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.144+0000 7f4c64400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c158930 con 0x7f4c5c152bc0 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4c5c0c9340 0x7f4c5c072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43748/0 (socket says 172.21.15.148:43748) 2024-04-26T23:06:08.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61000640 1 -- 172.21.15.148:0/52013206 learned_addr learned my addr 172.21.15.148:0/52013206 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:08.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61a00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c5c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786611234 0 0) 0x7f4c5c152fa0 con 0x7f4c5c0c9340 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c44003530 con 0x7f4c5c0c9340 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2108417060 0 0) 0x7f4c5c159790 con 0x7f4c5c073480 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c152fa0 con 0x7f4c5c073480 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3256280080 0 0) 0x7f4c44003530 con 0x7f4c5c0c9340 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 msgr2=0x7f4c5c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c5c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 >> v1:172.21.15.157:6789/0 conn(0x7f4c5c073480 legacy=0x7f4c5c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c158c10 con 0x7f4c5c0c9340 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f4c48001680 con 0x7f4c5c0c9340 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61a00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c5c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 >> v1:172.21.15.148:6789/0 conn(0x7f4c5c0c9340 legacy=0x7f4c5c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c44003b80 0x7f4c44003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c44004d50 0x7f4c440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c158930 con 0x7f4c44004d50 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4400ba80 con 0x7f4c44003b80 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4400bc80 con 0x7f4c5c152bc0 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61a00640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c44003b80 0x7f4c44003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c61000640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c44004d50 0x7f4c440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 -- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 msgr2=0x7f4c44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:08.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c152bc0 0x7f4c44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 -- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c44003b80 msgr2=0x7f4c44003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:08.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c44003b80 0x7f4c44003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.148+0000 7f4c62400640 1 -- 172.21.15.148:0/52013206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c44003530 con 0x7f4c44004d50 2024-04-26T23:06:08.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c62400640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c44004d50 0x7f4c440051d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001fd0 tx=0x7f4c5401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad20d0d9d6701bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:08.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54001c20 con 0x7f4c44004d50 2024-04-26T23:06:08.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c54003ba0 con 0x7f4c44004d50 2024-04-26T23:06:08.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c5be00640 1 -- 172.21.15.148:0/52013206 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c540050d0 con 0x7f4c44004d50 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- 172.21.15.148:0/52013206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c44004d50 msgr2=0x7f4c440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 --2- 172.21.15.148:0/52013206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c44004d50 0x7f4c440051d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001fd0 tx=0x7f4c5401c900 comp rx=0 tx=0).stop 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c62400640 1 -- 172.21.15.148:0/52013206 reap_dead start 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- 172.21.15.148:0/52013206 shutdown_connections 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- 172.21.15.148:0/52013206 >> 172.21.15.148:0/52013206 conn(0x7f4c5c06c380 msgr2=0x7f4c5c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- 172.21.15.148:0/52013206 shutdown_connections 2024-04-26T23:06:08.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- 172.21.15.148:0/52013206 wait complete. 2024-04-26T23:06:08.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 Processor -- start 2024-04-26T23:06:08.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.152+0000 7f4c64400640 1 -- start start 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c5c13ac90 0x7f4c5c0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c141cb0 0x7f4c5c13b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c1594b0 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c1591d0 con 0x7f4c5c13ac90 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c0c47d0 con 0x7f4c5c141cb0 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44434/0 (socket says 172.21.15.148:44434) 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 -- 172.21.15.148:0/3794208463 learned_addr learned my addr 172.21.15.148:0/3794208463 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61a00640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c5c13ac90 0x7f4c5c0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c62400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c141cb0 0x7f4c5c13b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 -- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c141cb0 msgr2=0x7f4c5c13b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c141cb0 0x7f4c5c13b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 -- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c5c13ac90 msgr2=0x7f4c5c0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c5c13ac90 0x7f4c5c0cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 -- 172.21.15.148:0/3794208463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c0cb2b0 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c61000640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c48004fc0 tx=0x7f4c480074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48007740 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48018070 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c140200 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800fb80 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c1407c0 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c077c20 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.156+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c4800fd20 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.160+0000 7f4c59600640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 0x7f4c3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:08.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.160+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4c48086dc0 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.160+0000 7f4c61a00640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 0x7f4c3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.160+0000 7f4c61a00640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 0x7f4c3c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009bd0 tx=0x7f4c50009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.164+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c5c0cb2b0 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4c5c0c4290 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c59600640 1 -- 172.21.15.148:0/3794208463 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f4c48056890 con 0x7f4c5c1f20f0 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 msgr2=0x7f4c3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 0x7f4c3c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009bd0 tx=0x7f4c50009190 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 msgr2=0x7f4c5c141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c48004fc0 tx=0x7f4c480074f0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 shutdown_connections 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c3c068380 0x7f4c3c06a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c5c141cb0 0x7f4c5c13b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c5c1f20f0 0x7f4c5c141770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 --2- 172.21.15.148:0/3794208463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c5c13ac90 0x7f4c5c0cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 >> 172.21.15.148:0/3794208463 conn(0x7f4c5c06c380 msgr2=0x7f4c5c073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 shutdown_connections 2024-04-26T23:06:08.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:08.380+0000 7f4c64400640 1 -- 172.21.15.148:0/3794208463 wait complete. 2024-04-26T23:06:08.407 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:06:13.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:06:13.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:06:18.408 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:06:18.408 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.544+0000 7eff66000640 1 Processor -- start 2024-04-26T23:06:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.544+0000 7eff66000640 1 -- start start 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff66000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff600c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff66000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff600c9d90 con 0x7eff60153af0 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff66000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff600ca070 con 0x7eff600c7b80 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff66000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff6015dec0 con 0x7eff600c9720 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5f400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7eff60153af0 0x7eff6015d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59862/0 (socket says 172.21.15.148:59862) 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5f400640 1 -- 172.21.15.148:0/2338188131 learned_addr learned my addr 172.21.15.148:0/2338188131 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff600c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787235056 0 0) 0x7eff600c9d90 con 0x7eff60153af0 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff44003530 con 0x7eff60153af0 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475114695 0 0) 0x7eff600ca070 con 0x7eff600c7b80 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff600c9d90 con 0x7eff600c7b80 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3341659528 0 0) 0x7eff44003530 con 0x7eff60153af0 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 msgr2=0x7eff600c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff600c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 >> v1:172.21.15.157:6789/0 conn(0x7eff600c7b80 legacy=0x7eff600c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff600ca350 con 0x7eff60153af0 2024-04-26T23:06:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7eff50001680 con 0x7eff60153af0 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 >> v1:172.21.15.148:6789/0 conn(0x7eff60153af0 legacy=0x7eff6015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44003b80 0x7eff44003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44004d50 0x7eff440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff6015dec0 con 0x7eff44004d50 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff4400ba80 con 0x7eff44003b80 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff4400bc80 con 0x7eff600c9720 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5f400640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44003b80 0x7eff44003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44004d50 0x7eff440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff57e00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 -- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 msgr2=0x7eff44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600c9720 0x7eff44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 -- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44003b80 msgr2=0x7eff44003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44003b80 0x7eff44003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.548+0000 7eff5fe00640 1 -- 172.21.15.148:0/2338188131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff44003530 con 0x7eff44004d50 2024-04-26T23:06:18.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff5fe00640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44004d50 0x7eff440051d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff58009f90 tx=0x7eff5801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8e77f7929619da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580b2070 con 0x7eff44004d50 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff580a5c50 con 0x7eff44004d50 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff5ea00640 1 -- 172.21.15.148:0/2338188131 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58009c10 con 0x7eff44004d50 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 -- 172.21.15.148:0/2338188131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44004d50 msgr2=0x7eff440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 --2- 172.21.15.148:0/2338188131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44004d50 0x7eff440051d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff58009f90 tx=0x7eff5801cc40 comp rx=0 tx=0).stop 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff5fe00640 1 -- 172.21.15.148:0/2338188131 reap_dead start 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 -- 172.21.15.148:0/2338188131 shutdown_connections 2024-04-26T23:06:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 -- 172.21.15.148:0/2338188131 >> 172.21.15.148:0/2338188131 conn(0x7eff6006c380 msgr2=0x7eff6006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 -- 172.21.15.148:0/2338188131 shutdown_connections 2024-04-26T23:06:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.552+0000 7eff66000640 1 -- 172.21.15.148:0/2338188131 wait complete. 2024-04-26T23:06:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 Processor -- start 2024-04-26T23:06:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- start start 2024-04-26T23:06:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 0x7eff601512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600722a0 0x7eff6014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 0x7eff60073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff6015d290 con 0x7eff60073490 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff600ca630 con 0x7eff44004d50 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff60153ed0 con 0x7eff600722a0 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 0x7eff60073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 0x7eff601512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff57e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600722a0 0x7eff6014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 0x7eff601512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:52568/0 (socket says 172.21.15.148:52568) 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5f400640 1 -- 172.21.15.148:0/1118418799 learned_addr learned my addr 172.21.15.148:0/1118418799 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 -- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600722a0 msgr2=0x7eff6014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600722a0 0x7eff6014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 -- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 msgr2=0x7eff601512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 0x7eff601512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 -- 172.21.15.148:0/1118418799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff60151cf0 con 0x7eff60073490 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff5fe00640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 0x7eff60073910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff580ac000 tx=0x7eff58009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580bb020 con 0x7eff60073490 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff580a5a50 con 0x7eff60073490 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff60073e50 con 0x7eff60073490 2024-04-26T23:06:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580b2040 con 0x7eff60073490 2024-04-26T23:06:18.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff60151f60 con 0x7eff60073490 2024-04-26T23:06:18.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.556+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff60077c20 con 0x7eff60073490 2024-04-26T23:06:18.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.560+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff580be070 con 0x7eff60073490 2024-04-26T23:06:18.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.560+0000 7eff57400640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 0x7eff3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.560+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7eff58120c20 con 0x7eff60073490 2024-04-26T23:06:18.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.560+0000 7eff5f400640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 0x7eff3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.560+0000 7eff5f400640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 0x7eff3c06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff500017f0 tx=0x7eff50001000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.564+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7eff60073e50 con 0x7eff60073490 2024-04-26T23:06:18.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.788+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7eff600c5af0 con 0x7eff60073490 2024-04-26T23:06:18.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff57400640 1 -- 172.21.15.148:0/1118418799 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7eff58016950 con 0x7eff60073490 2024-04-26T23:06:18.796 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 msgr2=0x7eff3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 0x7eff3c06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff500017f0 tx=0x7eff50001000 comp rx=0 tx=0).stop 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 msgr2=0x7eff60073910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 0x7eff60073910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff580ac000 tx=0x7eff58009750 comp rx=0 tx=0).stop 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 shutdown_connections 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7eff3c068380 0x7eff3c06a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60073490 0x7eff60073910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff600722a0 0x7eff6014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 --2- 172.21.15.148:0/1118418799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff44004d50 0x7eff601512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 >> 172.21.15.148:0/1118418799 conn(0x7eff6006c380 msgr2=0x7eff600cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:18.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 shutdown_connections 2024-04-26T23:06:18.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.792+0000 7eff66000640 1 -- 172.21.15.148:0/1118418799 wait complete. 2024-04-26T23:06:18.820 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:06:18.820 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:06:18.820 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:06:18.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:06:18.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 Processor -- start 2024-04-26T23:06:18.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 -- start start 2024-04-26T23:06:18.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba30152c50 0x7fba300c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba30153030 con 0x7fba30159360 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba300c5830 con 0x7fba3006e6f0 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba36200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fba301598c0 con 0x7fba30152c50 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba30152c50 0x7fba300c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba30152c50 0x7fba300c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49718/0 (socket says 172.21.15.148:49718) 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 -- 172.21.15.148:0/3996456957 learned_addr learned my addr 172.21.15.148:0/3996456957 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 -- 172.21.15.148:0/3996456957 >> v1:172.21.15.157:6789/0 conn(0x7fba3006e6f0 legacy=0x7fba3015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 -- 172.21.15.148:0/3996456957 >> v1:172.21.15.148:6789/0 conn(0x7fba30159360 legacy=0x7fba300c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.960+0000 7fba34e00640 1 -- 172.21.15.148:0/3996456957 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba300c5b10 con 0x7fba30152c50 2024-04-26T23:06:18.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba34e00640 1 --2- 172.21.15.148:0/3996456957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba300c8a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba2400bb10 tx=0x7fba24021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a712c29865030226 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba2f400640 1 -- 172.21.15.148:0/3996456957 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240b6070 con 0x7fba30152c50 2024-04-26T23:06:18.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba2f400640 1 -- 172.21.15.148:0/3996456957 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba240b1600 con 0x7fba30152c50 2024-04-26T23:06:18.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba2f400640 1 -- 172.21.15.148:0/3996456957 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240b19d0 con 0x7fba30152c50 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 -- 172.21.15.148:0/3996456957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 msgr2=0x7fba300c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 --2- 172.21.15.148:0/3996456957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba300c8a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba2400bb10 tx=0x7fba24021420 comp rx=0 tx=0).stop 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 -- 172.21.15.148:0/3996456957 shutdown_connections 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 --2- 172.21.15.148:0/3996456957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba300c8a90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 -- 172.21.15.148:0/3996456957 >> 172.21.15.148:0/3996456957 conn(0x7fba30070ce0 msgr2=0x7fba300710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 -- 172.21.15.148:0/3996456957 shutdown_connections 2024-04-26T23:06:18.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.964+0000 7fba36200640 1 -- 172.21.15.148:0/3996456957 wait complete. 2024-04-26T23:06:18.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 Processor -- start 2024-04-26T23:06:18.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 -- start start 2024-04-26T23:06:18.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba3006e6f0 0x7fba301e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba301534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba30159360 0x7fba301f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba300c78e0 con 0x7fba30152c50 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fba3006dcf0 con 0x7fba30159360 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba36200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba300c7a60 con 0x7fba3006e6f0 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba301534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba301534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49732/0 (socket says 172.21.15.148:49732) 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba2fe00640 1 -- 172.21.15.148:0/1213979352 learned_addr learned my addr 172.21.15.148:0/1213979352 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba34e00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba3006e6f0 0x7fba301e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.968+0000 7fba35800640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba30159360 0x7fba301f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba3006e6f0 msgr2=0x7fba301e4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba3006e6f0 0x7fba301e4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba30159360 msgr2=0x7fba301f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba30159360 0x7fba301f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba301e2a30 con 0x7fba30152c50 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba35800640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba30159360 0x7fba301f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2fe00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba301534b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c390 tx=0x7fba1c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c017070 con 0x7fba30152c50 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c0052d0 con 0x7fba30152c50 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c003820 con 0x7fba30152c50 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba301e1eb0 con 0x7fba30152c50 2024-04-26T23:06:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba301e2470 con 0x7fba30152c50 2024-04-26T23:06:18.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba36200640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 0x7fba301489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba301e4ba0 con 0x7fba301f5d40 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba34e00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 0x7fba301489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba34e00640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba300506d0 con 0x7fba301f5d40 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba34e00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 0x7fba301489e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba300c7da0 tx=0x7fba2401e1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240c0070 con 0x7fba301f5d40 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba1c01a070 con 0x7fba30152c50 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.972+0000 7fba2cc00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba10068280 0x7fba1006a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fba1c086180 con 0x7fba30152c50 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba2400b730 con 0x7fba301f5d40 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 msgr2=0x7fba301489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 0x7fba301489e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba300c7da0 tx=0x7fba2401e1c0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 msgr2=0x7fba301489e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba2cc00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301f5d40 0x7fba301489e0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba300c7da0 tx=0x7fba2401e1c0 comp rx=0 tx=0).stop 2024-04-26T23:06:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba35800640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba10068280 0x7fba1006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.976+0000 7fba35800640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba10068280 0x7fba1006a740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba280012f0 tx=0x7fba28009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.980+0000 7fba36200640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 0x7fba301e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.980+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba3014f830 con 0x7fba30148f20 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.980+0000 7fba34e00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 0x7fba301e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.980+0000 7fba34e00640 1 -- 172.21.15.148:0/1213979352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba3006e4d0 con 0x7fba30148f20 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.980+0000 7fba34e00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 0x7fba301e2e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba2401f050 tx=0x7fba2400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240b6040 con 0x7fba30148f20 2024-04-26T23:06:18.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4561 (secure 0 0 0) 0x7fba24003b50 con 0x7fba30148f20 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 msgr2=0x7fba301e2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 0x7fba301e2e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba2401f050 tx=0x7fba2400b450 comp rx=0 tx=0).stop 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 msgr2=0x7fba301e2e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba2cc00640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30148f20 0x7fba301e2e10 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba2401f050 tx=0x7fba2400b450 comp rx=0 tx=0).stop 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 12151, 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 11, 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:19.002 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:19.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba10068280 msgr2=0x7fba1006a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba10068280 0x7fba1006a740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba280012f0 tx=0x7fba28009040 comp rx=0 tx=0).stop 2024-04-26T23:06:19.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 msgr2=0x7fba301534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 --2- 172.21.15.148:0/1213979352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba30152c50 0x7fba301534b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c390 tx=0x7fba1c00c850 comp rx=0 tx=0).stop 2024-04-26T23:06:19.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba35800640 1 -- 172.21.15.148:0/1213979352 reap_dead start 2024-04-26T23:06:19.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba35800640 1 -- 172.21.15.148:0/1213979352 reap_dead start 2024-04-26T23:06:19.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 shutdown_connections 2024-04-26T23:06:19.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 >> 172.21.15.148:0/1213979352 conn(0x7fba30070ce0 msgr2=0x7fba3014ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 shutdown_connections 2024-04-26T23:06:19.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:18.984+0000 7fba36200640 1 -- 172.21.15.148:0/1213979352 wait complete. 2024-04-26T23:06:19.011 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:19.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:06:19.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:06:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 Processor -- start 2024-04-26T23:06:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 -- start start 2024-04-26T23:06:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faef8072430 0x7faef815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 0x7faef8157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef80ccc60 con 0x7faef80c5610 2024-04-26T23:06:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7faef80cf240 con 0x7faef8072430 2024-04-26T23:06:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faefd200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faef80c4710 con 0x7faef80c9cd0 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 0x7faef8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faef8072430 0x7faef815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef6a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7faef80c5610 0x7faef8156a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:44226/0 (socket says 172.21.15.148:44226) 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef6a00640 1 -- 172.21.15.148:0/1938190950 learned_addr learned my addr 172.21.15.148:0/1938190950 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7400640 1 -- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 msgr2=0x7faef8157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7400640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 0x7faef8157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7400640 1 -- 172.21.15.148:0/1938190950 >> v1:172.21.15.157:6789/0 conn(0x7faef80c5610 legacy=0x7faef8156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7400640 1 -- 172.21.15.148:0/1938190950 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef80cf490 con 0x7faef8072430 2024-04-26T23:06:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.152+0000 7faef7e00640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 0x7faef8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:19.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faef7400640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faef80cf3c0 tx=0x7faee801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ef9ec0ff847638 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faef6000640 1 -- 172.21.15.148:0/1938190950 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80b2070 con 0x7faef8072430 2024-04-26T23:06:19.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faef6000640 1 -- 172.21.15.148:0/1938190950 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee80ad640 con 0x7faef8072430 2024-04-26T23:06:19.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faef6000640 1 -- 172.21.15.148:0/1938190950 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80ada10 con 0x7faef8072430 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 -- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 msgr2=0x7faef815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faef80cf3c0 tx=0x7faee801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 -- 172.21.15.148:0/1938190950 shutdown_connections 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c9cd0 0x7faef8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 --2- 172.21.15.148:0/1938190950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 -- 172.21.15.148:0/1938190950 >> 172.21.15.148:0/1938190950 conn(0x7faef80703b0 msgr2=0x7faef80707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 -- 172.21.15.148:0/1938190950 shutdown_connections 2024-04-26T23:06:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.156+0000 7faefd200640 1 -- 172.21.15.148:0/1938190950 wait complete. 2024-04-26T23:06:19.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 Processor -- start 2024-04-26T23:06:19.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 -- start start 2024-04-26T23:06:19.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c5610 0x7faef80c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef80c9cd0 0x7faef81f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faef80c42f0 con 0x7faef80c9cd0 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faef815d9a0 con 0x7faef8072430 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faefd200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faef80c4470 con 0x7faef80c5610 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:52586/0 (socket says 172.21.15.148:52586) 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef7400640 1 -- 172.21.15.148:0/4211237513 learned_addr learned my addr 172.21.15.148:0/4211237513 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c5610 0x7faef80c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef7e00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef80c9cd0 0x7faef81f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 msgr2=0x7faef815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef8072430 0x7faef815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef80c9cd0 msgr2=0x7faef81f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef80c9cd0 0x7faef81f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef80c6760 con 0x7faef80c5610 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef7e00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef80c9cd0 0x7faef81f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.160+0000 7faef6a00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c5610 0x7faef80c7940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faee400c390 tx=0x7faee400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4017070 con 0x7faef80c5610 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef80b4160 con 0x7faef80c5610 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee4005cf0 con 0x7faef80c5610 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40072f0 con 0x7faef80c5610 2024-04-26T23:06:19.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faef815c520 con 0x7faef80c5610 2024-04-26T23:06:19.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faefd200640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 0x7faef815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faef80c9a40 con 0x7faef80b3b90 2024-04-26T23:06:19.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faef7400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 0x7faef815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faef7400640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faef815c330 con 0x7faef80b3b90 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faef7400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 0x7faef815c720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faee801a0d0 tx=0x7faee801ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.164+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faee401a070 con 0x7faef80c5610 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faed8068380 0x7faed806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80b2040 con 0x7faef80b3b90 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faee4086060 con 0x7faef80c5610 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faef7e00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faed8068380 0x7faed806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faee80add80 con 0x7faef80b3b90 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 msgr2=0x7faef815c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 0x7faef815c720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faee801a0d0 tx=0x7faee801ace0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 msgr2=0x7faef815c720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:19.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faeef400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef80b3b90 0x7faef815c720 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.168+0000 7faef7e00640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faed8068380 0x7faed806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faef0003c10 tx=0x7faef000b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.172+0000 7faefd200640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 0x7faef814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.172+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faef81f5b10 con 0x7faef814ba40 2024-04-26T23:06:19.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.172+0000 7faef7400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 0x7faef814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.172+0000 7faef7400640 1 -- 172.21.15.148:0/4211237513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faef80506d0 con 0x7faef814ba40 2024-04-26T23:06:19.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.172+0000 7faef7400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 0x7faef814be20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faef814fb50 tx=0x7faee8019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80b2040 con 0x7faef814ba40 2024-04-26T23:06:19.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7faee8003da0 con 0x7faef814ba40 2024-04-26T23:06:19.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 msgr2=0x7faef814be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 0x7faef814be20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faef814fb50 tx=0x7faee8019240 comp rx=0 tx=0).stop 2024-04-26T23:06:19.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 msgr2=0x7faef814be20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:19.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faeef400640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef814ba40 0x7faef814be20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 122027, 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:19.181 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 11, 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.182 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.183 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:19.184 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:19.185 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.186 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:19.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:19.191 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:19.192 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.194 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.196 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:19.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:19.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:19.200 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:19.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faed8068380 msgr2=0x7faed806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faed8068380 0x7faed806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faef0003c10 tx=0x7faef000b040 comp rx=0 tx=0).stop 2024-04-26T23:06:19.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c5610 msgr2=0x7faef80c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 --2- 172.21.15.148:0/4211237513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef80c5610 0x7faef80c7940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faee400c390 tx=0x7faee400c790 comp rx=0 tx=0).stop 2024-04-26T23:06:19.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faef7e00640 1 -- 172.21.15.148:0/4211237513 reap_dead start 2024-04-26T23:06:19.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faef7e00640 1 -- 172.21.15.148:0/4211237513 reap_dead start 2024-04-26T23:06:19.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 shutdown_connections 2024-04-26T23:06:19.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 >> 172.21.15.148:0/4211237513 conn(0x7faef80703b0 msgr2=0x7faef80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 shutdown_connections 2024-04-26T23:06:19.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.176+0000 7faefd200640 1 -- 172.21.15.148:0/4211237513 wait complete. 2024-04-26T23:06:19.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:19.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:06:19.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:06:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 Processor -- start 2024-04-26T23:06:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 -- start start 2024-04-26T23:06:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a880c8f00 0x7f0a8815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 0x7f0a8815d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880c75e0 con 0x7f0a88153b90 2024-04-26T23:06:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880c5d40 con 0x7f0a880c8f00 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8d600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a88153f70 con 0x7f0a880c4a00 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a880c8f00 0x7f0a8815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0a88153b90 0x7f0a880c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59890/0 (socket says 172.21.15.148:59890) 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87e00640 1 -- 172.21.15.148:0/3333791921 learned_addr learned my addr 172.21.15.148:0/3333791921 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8cc00640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 0x7f0a8815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87400640 1 -- 172.21.15.148:0/3333791921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 msgr2=0x7f0a8815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87400640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 0x7f0a8815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87400640 1 -- 172.21.15.148:0/3333791921 >> v1:172.21.15.148:6789/0 conn(0x7f0a88153b90 legacy=0x7f0a880c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a87400640 1 -- 172.21.15.148:0/3333791921 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a880c78c0 con 0x7f0a880c8f00 2024-04-26T23:06:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.348+0000 7f0a8cc00640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 0x7f0a8815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a87400640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a8815ce10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097c0 tx=0x7f0a7401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f09b65ed12d716 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a86a00640 1 -- 172.21.15.148:0/3333791921 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740b5070 con 0x7f0a880c8f00 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a86a00640 1 -- 172.21.15.148:0/3333791921 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a740a8990 con 0x7f0a880c8f00 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a86a00640 1 -- 172.21.15.148:0/3333791921 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740a8d60 con 0x7f0a880c8f00 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a8d600640 1 -- 172.21.15.148:0/3333791921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 msgr2=0x7f0a8815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.352+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a8815ce10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097c0 tx=0x7f0a7401ec90 comp rx=0 tx=0).stop 2024-04-26T23:06:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- 172.21.15.148:0/3333791921 shutdown_connections 2024-04-26T23:06:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a880c4a00 0x7f0a8815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3333791921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a8815ce10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- 172.21.15.148:0/3333791921 >> 172.21.15.148:0/3333791921 conn(0x7f0a88068740 msgr2=0x7f0a8806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- 172.21.15.148:0/3333791921 shutdown_connections 2024-04-26T23:06:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- 172.21.15.148:0/3333791921 wait complete. 2024-04-26T23:06:19.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 Processor -- start 2024-04-26T23:06:19.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- start start 2024-04-26T23:06:19.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a880c4a00 0x7f0a88150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a88156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88153b90 0x7f0a881f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880c59d0 con 0x7f0a880c8f00 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880c56f0 con 0x7f0a880c4a00 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8d600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880c8510 con 0x7f0a88153b90 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a88156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a88156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49774/0 (socket says 172.21.15.148:49774) 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 -- 172.21.15.148:0/3384396595 learned_addr learned my addr 172.21.15.148:0/3384396595 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a8cc00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88153b90 0x7f0a881f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87e00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a880c4a00 0x7f0a88150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88153b90 msgr2=0x7f0a881f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88153b90 0x7f0a881f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a880c4a00 msgr2=0x7f0a88150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a880c4a00 0x7f0a88150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88155ad0 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.356+0000 7f0a87400640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a88156770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b3040 tx=0x7f0a7401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740bf070 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a740b0820 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a88155db0 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740b5040 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a88156370 con 0x7f0a880c8f00 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 0x7f0a881f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a881565b0 con 0x7f0a88074050 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a87e00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 0x7f0a881f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a87e00640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a880506d0 con 0x7f0a88074050 2024-04-26T23:06:19.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a87e00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 0x7f0a881f5340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e400 tx=0x7f0a7800e8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78019070 con 0x7f0a88074050 2024-04-26T23:06:19.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a740c2070 con 0x7f0a880c8f00 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a68068280 0x7f0a6806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.360+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0a74123580 con 0x7f0a880c8f00 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0a78005ad0 con 0x7f0a88074050 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 msgr2=0x7f0a881f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a7fe00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 0x7f0a881f5340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e400 tx=0x7f0a7800e8c0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 msgr2=0x7f0a881f5340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:19.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a7fe00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a88074050 0x7f0a881f5340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a8cc00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a68068280 0x7f0a6806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.364+0000 7f0a8cc00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a68068280 0x7f0a6806a740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a880c80e0 tx=0x7f0a80003a00 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.368+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 0x7f0a8814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.368+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880cad60 con 0x7f0a8814ced0 2024-04-26T23:06:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.368+0000 7f0a87e00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 0x7f0a8814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.368+0000 7f0a87e00640 1 -- 172.21.15.148:0/3384396595 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a880c8790 con 0x7f0a8814ced0 2024-04-26T23:06:19.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a87e00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 0x7f0a8814d2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e400 tx=0x7f0a78000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a780047f0 con 0x7f0a8814ced0 2024-04-26T23:06:19.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5070 (secure 0 0 0) 0x7f0a780047f0 con 0x7f0a8814ced0 2024-04-26T23:06:19.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 msgr2=0x7f0a8814d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 0x7f0a8814d2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e400 tx=0x7f0a78000ee0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 msgr2=0x7f0a8814d2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:19.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a7fe00640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a8814ced0 0x7f0a8814d2e0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e400 tx=0x7f0a78000ee0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 14, 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 122223, 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 11, 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:19.395 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:19.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a68068280 msgr2=0x7f0a6806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0a68068280 0x7f0a6806a740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a880c80e0 tx=0x7f0a80003a00 comp rx=0 tx=0).stop 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 msgr2=0x7f0a88156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 --2- 172.21.15.148:0/3384396595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a880c8f00 0x7f0a88156770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b3040 tx=0x7f0a7401ba30 comp rx=0 tx=0).stop 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8cc00640 1 -- 172.21.15.148:0/3384396595 reap_dead start 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8cc00640 1 -- 172.21.15.148:0/3384396595 reap_dead start 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 shutdown_connections 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 >> 172.21.15.148:0/3384396595 conn(0x7f0a88068740 msgr2=0x7f0a880ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 shutdown_connections 2024-04-26T23:06:19.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.372+0000 7f0a8d600640 1 -- 172.21.15.148:0/3384396595 wait complete. 2024-04-26T23:06:19.397 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:19.398 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:06:19.398 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:06:19.398 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:06:19.398 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:06:19.398 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:06:19.398 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:06:19.414 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:06:19.414 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:06:19.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 Processor -- start 2024-04-26T23:06:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 -- start start 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07001538b0 0x7f07000cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07000ca540 con 0x7f07000cb930 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f07000ccec0 con 0x7f07001538b0 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0707000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f070015a650 con 0x7f0700153c90 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0706600640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f07000cb930 legacy=0x7f070006feb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07001538b0 0x7f07000cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:37806/0 (socket says 172.21.15.148:37806) 2024-04-26T23:06:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 -- 172.21.15.148:0/1220152890 learned_addr learned my addr 172.21.15.148:0/1220152890 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 -- 172.21.15.148:0/1220152890 >> v2:172.21.15.157:3300/0 conn(0x7f07001538b0 msgr2=0x7f07000cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 --2- 172.21.15.148:0/1220152890 >> v2:172.21.15.157:3300/0 conn(0x7f07001538b0 0x7f07000cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 -- 172.21.15.148:0/1220152890 >> v1:172.21.15.148:6789/0 conn(0x7f07000cb930 legacy=0x7f070006feb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.604+0000 7f0705200640 1 -- 172.21.15.148:0/1220152890 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07000ca7b0 con 0x7f0700153c90 2024-04-26T23:06:19.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0705200640 1 --2- 172.21.15.148:0/1220152890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009870 tx=0x7f06ec01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed2b6040c0ce998e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f06ffe00640 1 -- 172.21.15.148:0/1220152890 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0ab5f0 con 0x7f0700153c90 2024-04-26T23:06:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f06ffe00640 1 -- 172.21.15.148:0/1220152890 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec0b0070 con 0x7f0700153c90 2024-04-26T23:06:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f06ffe00640 1 -- 172.21.15.148:0/1220152890 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0ab9b0 con 0x7f0700153c90 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 -- 172.21.15.148:0/1220152890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 msgr2=0x7f070015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 --2- 172.21.15.148:0/1220152890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009870 tx=0x7f06ec01c520 comp rx=0 tx=0).stop 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 -- 172.21.15.148:0/1220152890 shutdown_connections 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 --2- 172.21.15.148:0/1220152890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0700153c90 0x7f070015d4b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 --2- 172.21.15.148:0/1220152890 >> v2:172.21.15.157:3300/0 conn(0x7f07001538b0 0x7f07000cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 -- 172.21.15.148:0/1220152890 >> 172.21.15.148:0/1220152890 conn(0x7f0700068140 msgr2=0x7f0700068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.608+0000 7f0707000640 1 -- 172.21.15.148:0/1220152890 shutdown_connections 2024-04-26T23:06:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 -- 172.21.15.148:0/1220152890 wait complete. 2024-04-26T23:06:19.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 Processor -- start 2024-04-26T23:06:19.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 -- start start 2024-04-26T23:06:19.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07001538b0 0x7f0700146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 0x7f0700151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0700070740 con 0x7f0700153c90 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07000705c0 con 0x7f07001538b0 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0707000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f07001669a0 con 0x7f07000cb930 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0706600640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 msgr2=0x7f0700151840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0706600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 0x7f0700151840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07001538b0 0x7f0700146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:37814/0 (socket says 172.21.15.148:37814) 2024-04-26T23:06:19.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 -- 172.21.15.148:0/2666253643 learned_addr learned my addr 172.21.15.148:0/2666253643 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 -- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07001538b0 msgr2=0x7f0700146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07001538b0 0x7f0700146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 -- 172.21.15.148:0/2666253643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 msgr2=0x7f0700151840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.612+0000 7f0705c00640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 0x7f0700151840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f0705c00640 1 -- 172.21.15.148:0/2666253643 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0700152b30 con 0x7f07000cb930 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f0705c00640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e8a0 tx=0x7f06f400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4017070 con 0x7f07000cb930 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0700147300 con 0x7f07000cb930 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f400c940 con 0x7f07000cb930 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ccf0 con 0x7f07000cb930 2024-04-26T23:06:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07001592e0 con 0x7f07000cb930 2024-04-26T23:06:19.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07000506d0 con 0x7f07000cb930 2024-04-26T23:06:19.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.616+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06f401a070 con 0x7f07000cb930 2024-04-26T23:06:19.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.620+0000 7f06fd600640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 0x7f06e006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:19.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.620+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f06f4087470 con 0x7f07000cb930 2024-04-26T23:06:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.620+0000 7f0705200640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 0x7f06e006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.620+0000 7f0705200640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 0x7f06e006a7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0af000 tx=0x7f06ec0a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.632+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f06f4056fe0 con 0x7f07000cb930 2024-04-26T23:06:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0700153690 con 0x7f07000cb930 2024-04-26T23:06:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f06fd600640 1 -- 172.21.15.148:0/2666253643 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f06f405b2e0 con 0x7f07000cb930 2024-04-26T23:06:19.868 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:19.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 msgr2=0x7f06e006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 0x7f06e006a7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0af000 tx=0x7f06ec0a7000 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 msgr2=0x7f0700148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e8a0 tx=0x7f06f400eca0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 shutdown_connections 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f06e0068330 0x7f06e006a7f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0700153c90 0x7f0700151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07001538b0 0x7f0700146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 --2- 172.21.15.148:0/2666253643 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f07000cb930 0x7f0700148d50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 >> 172.21.15.148:0/2666253643 conn(0x7f0700068140 msgr2=0x7f07000cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 shutdown_connections 2024-04-26T23:06:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:19.864+0000 7f0707000640 1 -- 172.21.15.148:0/2666253643 wait complete. 2024-04-26T23:06:22.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:23.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 Processor -- start 2024-04-26T23:06:23.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 -- start start 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f228c0c9de0 0x7f228c070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0c9620 con 0x7f228c0c8680 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0c5a20 con 0x7f228c152d40 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2293200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0c9950 con 0x7f228c0c9de0 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2291200640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f228c0c9de0 msgr2=0x7f228c070d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f228b400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f228c0c8680 legacy=0x7f228c1613b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f2291200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f228c0c9de0 0x7f228c070d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:23.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f228be00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f228c152d40 0x7f228c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:44230/0 (socket says 172.21.15.148:44230) 2024-04-26T23:06:23.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f228be00640 1 -- 172.21.15.148:0/4103806962 learned_addr learned my addr 172.21.15.148:0/4103806962 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676069925 0 0) 0x7f228c0c5a20 con 0x7f228c152d40 2024-04-26T23:06:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.028+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2270003530 con 0x7f228c152d40 2024-04-26T23:06:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4058807865 0 0) 0x7f2270003530 con 0x7f228c152d40 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 >> v2:172.21.15.148:3300/0 conn(0x7f228c0c9de0 msgr2=0x7f228c070d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 --2- 172.21.15.148:0/4103806962 >> v2:172.21.15.148:3300/0 conn(0x7f228c0c9de0 0x7f228c070d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 >> v1:172.21.15.148:6789/0 conn(0x7f228c0c8680 legacy=0x7f228c1613b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0c5d00 con 0x7f228c152d40 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f227c001680 con 0x7f228c152d40 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 >> v1:172.21.15.157:6789/0 conn(0x7f228c152d40 legacy=0x7f228c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22700039c0 0x7f2270003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 0x7f2270004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2270005220 0x7f227000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f227000c130 con 0x7f2270005220 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f227000c2b0 con 0x7f2270004810 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f227000c4b0 con 0x7f22700039c0 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f2291200640 1 -- 172.21.15.148:0/4103806962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2270005220 msgr2=0x7f227000b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f2291200640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2270005220 0x7f227000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 0x7f2270004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228be00640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22700039c0 0x7f2270003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 -- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22700039c0 msgr2=0x7f2270003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22700039c0 0x7f2270003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 -- 172.21.15.148:0/4103806962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2270005220 msgr2=0x7f227000b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2270005220 0x7f227000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228b400640 1 -- 172.21.15.148:0/4103806962 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2270003530 con 0x7f2270004810 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f2291200640 1 -- 172.21.15.148:0/4103806962 reap_dead start 2024-04-26T23:06:23.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.032+0000 7f228be00640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22700039c0 0x7f2270003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:23.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f228b400640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 0x7f2270004c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2278003990 tx=0x7f227801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16cc74dfb6e8c1ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:23.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278009540 con 0x7f2270004810 2024-04-26T23:06:23.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278003bc0 con 0x7f2270004810 2024-04-26T23:06:23.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f228aa00640 1 -- 172.21.15.148:0/4103806962 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278005070 con 0x7f2270004810 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 msgr2=0x7f2270004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 0x7f2270004c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2278003990 tx=0x7f227801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- 172.21.15.148:0/4103806962 shutdown_connections 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 --2- 172.21.15.148:0/4103806962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004810 0x7f2270004c90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- 172.21.15.148:0/4103806962 >> 172.21.15.148:0/4103806962 conn(0x7f228c073240 msgr2=0x7f228c073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- 172.21.15.148:0/4103806962 shutdown_connections 2024-04-26T23:06:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- 172.21.15.148:0/4103806962 wait complete. 2024-04-26T23:06:23.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 Processor -- start 2024-04-26T23:06:23.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- start start 2024-04-26T23:06:23.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228c15be00 0x7f228c14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 0x7f228c148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0c5fe0 con 0x7f228c14a550 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f228c153120 con 0x7f228c15be00 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.036+0000 7f2293200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0c6160 con 0x7f2270004810 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2291200640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 msgr2=0x7f228c148d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2291200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 0x7f228c148d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228c15be00 0x7f228c14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:37832/0 (socket says 172.21.15.148:37832) 2024-04-26T23:06:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 -- 172.21.15.148:0/889381744 learned_addr learned my addr 172.21.15.148:0/889381744 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 -- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228c15be00 msgr2=0x7f228c14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228c15be00 0x7f228c14a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 -- 172.21.15.148:0/889381744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 msgr2=0x7f228c148d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 0x7f228c148d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 -- 172.21.15.148:0/889381744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c15b8c0 con 0x7f2270004810 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f228be00640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f227c007cf0 tx=0x7f227c0076d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c007d20 con 0x7f2270004810 2024-04-26T23:06:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1f5660 con 0x7f2270004810 2024-04-26T23:06:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c018070 con 0x7f2270004810 2024-04-26T23:06:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c00fb60 con 0x7f2270004810 2024-04-26T23:06:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c15a180 con 0x7f2270004810 2024-04-26T23:06:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.040+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c077c20 con 0x7f2270004810 2024-04-26T23:06:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.044+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f227c00fd00 con 0x7f2270004810 2024-04-26T23:06:23.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.044+0000 7f2283e00640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 0x7f226c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:23.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.044+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f227c087870 con 0x7f2270004810 2024-04-26T23:06:23.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.044+0000 7f228b400640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 0x7f226c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.044+0000 7f228b400640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 0x7f226c06a7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22780aa000 tx=0x7f2278005040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:23.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.056+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f227c057a30 con 0x7f2270004810 2024-04-26T23:06:23.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.288+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f228c0c6e40 con 0x7f2270004810 2024-04-26T23:06:23.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2283e00640 1 -- 172.21.15.148:0/889381744 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f227c057330 con 0x7f2270004810 2024-04-26T23:06:23.295 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:23.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 msgr2=0x7f226c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 0x7f226c06a7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22780aa000 tx=0x7f2278005040 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 msgr2=0x7f228c14bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f227c007cf0 tx=0x7f227c0076d0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 shutdown_connections 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f226c068330 0x7f226c06a7f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c14a550 0x7f228c148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228c15be00 0x7f228c14a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 --2- 172.21.15.148:0/889381744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270004810 0x7f228c14bf50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 >> 172.21.15.148:0/889381744 conn(0x7f228c073240 msgr2=0x7f228c06d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 shutdown_connections 2024-04-26T23:06:23.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:23.292+0000 7f2293200640 1 -- 172.21.15.148:0/889381744 wait complete. 2024-04-26T23:06:26.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:26.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.468+0000 7f54a7800640 1 Processor -- start 2024-04-26T23:06:26.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.468+0000 7f54a7800640 1 -- start start 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a7800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f54a00c9de0 0x7f54a0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a7800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a00c9620 con 0x7f54a00c8680 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a7800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a00c5a20 con 0x7f54a0152d40 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a7800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f54a00c9950 con 0x7f54a00c9de0 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f549fe00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f54a00c8680 legacy=0x7f54a01613b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:26.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a4e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f54a0152d40 0x7f54a00ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:53378/0 (socket says 172.21.15.148:53378) 2024-04-26T23:06:26.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a4e00640 1 -- 172.21.15.148:0/4175167409 learned_addr learned my addr 172.21.15.148:0/4175167409 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:26.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a5800640 1 --2- 172.21.15.148:0/4175167409 >> v2:172.21.15.157:3300/0 conn(0x7f54a00c9de0 0x7f54a0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:26.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a5800640 1 -- 172.21.15.148:0/4175167409 >> v1:172.21.15.157:6789/0 conn(0x7f54a0152d40 legacy=0x7f54a00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:26.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a5800640 1 -- 172.21.15.148:0/4175167409 >> v1:172.21.15.148:6789/0 conn(0x7f54a00c8680 legacy=0x7f54a01613b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:26.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.472+0000 7f54a5800640 1 -- 172.21.15.148:0/4175167409 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a00c5d00 con 0x7f54a00c9de0 2024-04-26T23:06:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.476+0000 7f54a5800640 1 --2- 172.21.15.148:0/4175167409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0070d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5498009d90 tx=0x7f549801f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205c855e32fe4baa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.476+0000 7f549f400640 1 -- 172.21.15.148:0/4175167409 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980b4070 con 0x7f54a00c9de0 2024-04-26T23:06:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.476+0000 7f549f400640 1 -- 172.21.15.148:0/4175167409 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54980af600 con 0x7f54a00c9de0 2024-04-26T23:06:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.476+0000 7f549f400640 1 -- 172.21.15.148:0/4175167409 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980af9d0 con 0x7f54a00c9de0 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- 172.21.15.148:0/4175167409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 msgr2=0x7f54a0070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 --2- 172.21.15.148:0/4175167409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0070d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5498009d90 tx=0x7f549801f120 comp rx=0 tx=0).stop 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- 172.21.15.148:0/4175167409 shutdown_connections 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 --2- 172.21.15.148:0/4175167409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0070d30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- 172.21.15.148:0/4175167409 >> 172.21.15.148:0/4175167409 conn(0x7f54a0073240 msgr2=0x7f54a0073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- 172.21.15.148:0/4175167409 shutdown_connections 2024-04-26T23:06:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- 172.21.15.148:0/4175167409 wait complete. 2024-04-26T23:06:26.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 Processor -- start 2024-04-26T23:06:26.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.480+0000 7f54a7800640 1 -- start start 2024-04-26T23:06:26.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 0x7f54a0154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:26.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:26.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54a0152d40 0x7f54a014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54a00c5fe0 con 0x7f54a00c8680 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0153120 con 0x7f54a00c9de0 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f54a00c6160 con 0x7f54a0152d40 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a4e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 msgr2=0x7f54a0154300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a4e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 0x7f54a0154300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a5800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54a0152d40 0x7f54a014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:35078/0 (socket says 172.21.15.148:35078) 2024-04-26T23:06:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 -- 172.21.15.148:0/4212433579 learned_addr learned my addr 172.21.15.148:0/4212433579 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 -- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54a0152d40 msgr2=0x7f54a014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54a0152d40 0x7f54a014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 -- 172.21.15.148:0/4212433579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 msgr2=0x7f54a0154300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 0x7f54a0154300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 -- 172.21.15.148:0/4212433579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a01f5f10 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549fe00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b550 tx=0x7f548c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c013020 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c003dd0 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c0052b0 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a014ee60 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.484+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a014f690 con 0x7f54a00c9de0 2024-04-26T23:06:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.488+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a0077c20 con 0x7f54a00c9de0 2024-04-26T23:06:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.488+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f548c016020 con 0x7f54a00c9de0 2024-04-26T23:06:26.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.488+0000 7f549cc00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 0x7f548006a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:26.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.488+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f548c086fe0 con 0x7f54a00c9de0 2024-04-26T23:06:26.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.492+0000 7f54a4e00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 0x7f548006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:26.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.492+0000 7f54a4e00640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 0x7f548006a820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5494004820 tx=0x7f5494007b10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:26.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.500+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f548c01d020 con 0x7f54a00c9de0 2024-04-26T23:06:26.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.880+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f54a0151df0 con 0x7f54a00c9de0 2024-04-26T23:06:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.880+0000 7f549cc00640 1 -- 172.21.15.148:0/4212433579 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f548c0571a0 con 0x7f54a00c9de0 2024-04-26T23:06:26.885 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 msgr2=0x7f548006a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 0x7f548006a820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5494004820 tx=0x7f5494007b10 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 msgr2=0x7f54a0154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b550 tx=0x7f548c00ba10 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 shutdown_connections 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5480068360 0x7f548006a820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54a0152d40 0x7f54a014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54a00c9de0 0x7f54a0154cf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 --2- 172.21.15.148:0/4212433579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a00c8680 0x7f54a0154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 >> 172.21.15.148:0/4212433579 conn(0x7f54a0073240 msgr2=0x7f54a006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 shutdown_connections 2024-04-26T23:06:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:26.884+0000 7f54a7800640 1 -- 172.21.15.148:0/4212433579 wait complete. 2024-04-26T23:06:29.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:30.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.080+0000 7f6c7d200640 1 Processor -- start 2024-04-26T23:06:30.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.080+0000 7f6c7d200640 1 -- start start 2024-04-26T23:06:30.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c7d200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c7d200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c7d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c78160240 con 0x7f6c780712e0 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c7d200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6c781598d0 con 0x7f6c7815ca90 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c7d200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7815f6c0 con 0x7f6c781594f0 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75400640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 msgr2=0x7f6c78070da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:30.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c76800640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6c780712e0 0x7f6c780ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:53388/0 (socket says 172.21.15.148:53388) 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c76800640 1 -- 172.21.15.148:0/3475440298 learned_addr learned my addr 172.21.15.148:0/3475440298 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:30.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.084+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:30.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 msgr2=0x7f6c78070da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:30.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:06:30.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:30.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:30.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:30.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:30.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.288+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:06:30.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 msgr2=0x7f6c78070da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:30.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:06:30.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:30.692+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:06:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 msgr2=0x7f6c78070da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:31.496+0000 7f6c75e00640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 msgr2=0x7f6c780c8e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.157:3300/0 conn(0x7f6c781594f0 0x7f6c780c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 -- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 msgr2=0x7f6c78070da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 --2- 172.21.15.148:0/3475440298 >> v2:172.21.15.148:3300/0 conn(0x7f6c7815ca90 0x7f6c78070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.157:6789/0 conn(0x7f6c780712e0 legacy=0x7f6c780ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 -- 172.21.15.148:0/3475440298 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7815f9a0 con 0x7f6c580036a0 2024-04-26T23:06:33.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c6f400640 1 -- 172.21.15.148:0/3475440298 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6c781598d0 con 0x7f6c58007380 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.148:6789/0 conn(0x7f6c580036a0 legacy=0x7f6c58005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:33.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.084+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:33.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.148:6789/0 conn(0x7f6c580036a0 legacy=0x7f6c58005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:33.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:33.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:06:33.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:33.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:33.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.288+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:06:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.148:6789/0 conn(0x7f6c580036a0 legacy=0x7f6c58005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:33.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:06:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:06:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:33.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:33.692+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:06:34.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.496+0000 7f6c75e00640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.148:6789/0 conn(0x7f6c580036a0 legacy=0x7f6c58005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:34.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.496+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:34.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.496+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 >> v1:172.21.15.148:6789/0 conn(0x7f6c580036a0 legacy=0x7f6c58005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:34.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.496+0000 7f6c75400640 1 -- 172.21.15.148:0/3475440298 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5800b060 con 0x7f6c58007380 2024-04-26T23:06:34.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c75400640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009d40 tx=0x7f6c6401d1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffa2286fdf9d4f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:34.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c74a00640 1 -- 172.21.15.148:0/3475440298 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640b3070 con 0x7f6c58007380 2024-04-26T23:06:34.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c74a00640 1 -- 172.21.15.148:0/3475440298 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c640ae410 con 0x7f6c58007380 2024-04-26T23:06:34.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c74a00640 1 -- 172.21.15.148:0/3475440298 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ae800 con 0x7f6c58007380 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c7d200640 1 -- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 msgr2=0x7f6c58009840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c7d200640 1 --2- 172.21.15.148:0/3475440298 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c58007380 0x7f6c58009840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009d40 tx=0x7f6c6401d1c0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c76800640 1 -- 172.21.15.148:0/3475440298 reap_dead start 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c7d200640 1 -- 172.21.15.148:0/3475440298 shutdown_connections 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c7d200640 1 -- 172.21.15.148:0/3475440298 >> 172.21.15.148:0/3475440298 conn(0x7f6c780ce2c0 msgr2=0x7f6c780ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.500+0000 7f6c7d200640 1 -- 172.21.15.148:0/3475440298 shutdown_connections 2024-04-26T23:06:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.504+0000 7f6c7d200640 1 -- 172.21.15.148:0/3475440298 wait complete. 2024-04-26T23:06:34.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.504+0000 7f6c7d200640 1 Processor -- start 2024-04-26T23:06:34.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.504+0000 7f6c7d200640 1 -- start start 2024-04-26T23:06:34.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58007380 0x7f6c780cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:34.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 0x7f6c780cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780c9c50 con 0x7f6c780c76f0 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7815ff60 con 0x7f6c58007380 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7815f360 con 0x7f6c7815ad50 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c76800640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 msgr2=0x7f6c780cca60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c76800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 0x7f6c780cca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58007380 0x7f6c780cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:34.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:50448/0 (socket says 172.21.15.148:50448) 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 -- 172.21.15.148:0/1826767789 learned_addr learned my addr 172.21.15.148:0/1826767789 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 -- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58007380 msgr2=0x7f6c780cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58007380 0x7f6c780cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 -- 172.21.15.148:0/1826767789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 msgr2=0x7f6c780cca60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 0x7f6c780cca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 -- 172.21.15.148:0/1826767789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7815b3f0 con 0x7f6c7815ad50 2024-04-26T23:06:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c75400640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c640038a0 tx=0x7f6c6401ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:34.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640b3040 con 0x7f6c7815ad50 2024-04-26T23:06:34.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c64009430 con 0x7f6c7815ad50 2024-04-26T23:06:34.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ac940 con 0x7f6c7815ad50 2024-04-26T23:06:34.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c780cd660 con 0x7f6c7815ad50 2024-04-26T23:06:34.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.508+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c780cc260 con 0x7f6c7815ad50 2024-04-26T23:06:34.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.512+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c780cdb80 con 0x7f6c7815ad50 2024-04-26T23:06:34.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.512+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c640c0020 con 0x7f6c7815ad50 2024-04-26T23:06:34.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.516+0000 7f6c6e000640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 0x7f6c5806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:34.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.516+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6c641229f0 con 0x7f6c7815ad50 2024-04-26T23:06:34.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.516+0000 7f6c75e00640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 0x7f6c5806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:34.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.516+0000 7f6c75e00640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 0x7f6c5806deb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c68000ee0 tx=0x7f6c68011390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.524+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c780cdb80 con 0x7f6c7815ad50 2024-04-26T23:06:34.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.968+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c78077c20 con 0x7f6c7815ad50 2024-04-26T23:06:34.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c6e000640 1 -- 172.21.15.148:0/1826767789 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f6c7815b3f0 con 0x7f6c7815ad50 2024-04-26T23:06:34.975 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":16,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:34.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 msgr2=0x7f6c5806deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:34.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 0x7f6c5806deb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c68000ee0 tx=0x7f6c68011390 comp rx=0 tx=0).stop 2024-04-26T23:06:34.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 msgr2=0x7f6c78159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:34.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c640038a0 tx=0x7f6c6401ba00 comp rx=0 tx=0).stop 2024-04-26T23:06:34.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 shutdown_connections 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6c5806b9f0 0x7f6c5806deb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c780c76f0 0x7f6c780cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c7815ad50 0x7f6c78159c60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 --2- 172.21.15.148:0/1826767789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58007380 0x7f6c780cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 >> 172.21.15.148:0/1826767789 conn(0x7f6c780ce2c0 msgr2=0x7f6c78157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 shutdown_connections 2024-04-26T23:06:34.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:34.972+0000 7f6c7d200640 1 -- 172.21.15.148:0/1826767789 wait complete. 2024-04-26T23:06:35.010 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:06:35.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:06:35.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:06:35.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 Processor -- start 2024-04-26T23:06:35.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 -- start start 2024-04-26T23:06:35.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d14153bc0 0x7f2d1406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140c8d70 con 0x7f2d1406dff0 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140c9050 con 0x7f2d14159930 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d13200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140c8b20 con 0x7f2d14153bc0 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d11400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f2d1406dff0 legacy=0x7f2d140c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d11e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f2d14153bc0 msgr2=0x7f2d1406c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:35.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d11e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d14153bc0 0x7f2d1406c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:35.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d12800640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2d14159930 0x7f2d14159d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:53404/0 (socket says 172.21.15.148:53404) 2024-04-26T23:06:35.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d12800640 1 -- 172.21.15.148:0/2066264977 learned_addr learned my addr 172.21.15.148:0/2066264977 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:35.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123851815 0 0) 0x7f2d140c9050 con 0x7f2d14159930 2024-04-26T23:06:35.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.236+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf8003530 con 0x7f2d14159930 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1897819619 0 0) 0x7f2cf8003530 con 0x7f2d14159930 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 >> v2:172.21.15.148:3300/0 conn(0x7f2d14153bc0 msgr2=0x7f2d1406c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 --2- 172.21.15.148:0/2066264977 >> v2:172.21.15.148:3300/0 conn(0x7f2d14153bc0 0x7f2d1406c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 >> v1:172.21.15.148:6789/0 conn(0x7f2d1406dff0 legacy=0x7f2d140c7830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140c9330 con 0x7f2d14159930 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f2d0c001a00 con 0x7f2d14159930 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 >> v1:172.21.15.157:6789/0 conn(0x7f2d14159930 legacy=0x7f2d14159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf80039c0 0x7f2cf8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cf8004810 0x7f2cf8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2cf800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140c8b20 con 0x7f2cf8004810 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf800c190 con 0x7f2cf8005240 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf800c390 con 0x7f2cf80039c0 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d11400640 1 -- 172.21.15.148:0/2066264977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cf8004810 msgr2=0x7f2cf8004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d11400640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cf8004810 0x7f2cf8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d11e00640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf80039c0 0x7f2cf8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2cf800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 -- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf80039c0 msgr2=0x7f2cf8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:35.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf80039c0 0x7f2cf8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 -- 172.21.15.148:0/2066264977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cf8004810 msgr2=0x7f2cf8004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:06:35.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cf8004810 0x7f2cf8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d12800640 1 -- 172.21.15.148:0/2066264977 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf8003530 con 0x7f2cf8005240 2024-04-26T23:06:35.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.240+0000 7f2d11e00640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf80039c0 0x7f2cf8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:35.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d12800640 1 -- 172.21.15.148:0/2066264977 reap_dead start 2024-04-26T23:06:35.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d12800640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2cf800b9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a840 tx=0x7f2d0c01d320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5d49fe79d76e7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04009470 con 0x7f2cf8005240 2024-04-26T23:06:35.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0ac640 con 0x7f2cf8005240 2024-04-26T23:06:35.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d10a00640 1 -- 172.21.15.148:0/2066264977 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00a460 con 0x7f2cf8005240 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d13200640 1 -- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 msgr2=0x7f2cf800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.244+0000 7f2d13200640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2cf800b9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a840 tx=0x7f2d0c01d320 comp rx=0 tx=0).stop 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 -- 172.21.15.148:0/2066264977 shutdown_connections 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 --2- 172.21.15.148:0/2066264977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2cf800b9d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 -- 172.21.15.148:0/2066264977 >> 172.21.15.148:0/2066264977 conn(0x7f2d140734b0 msgr2=0x7f2d14070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 -- 172.21.15.148:0/2066264977 shutdown_connections 2024-04-26T23:06:35.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 -- 172.21.15.148:0/2066264977 wait complete. 2024-04-26T23:06:35.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 Processor -- start 2024-04-26T23:06:35.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.248+0000 7f2d13200640 1 -- start start 2024-04-26T23:06:35.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2d140cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2d141e24a0 0x7f2d14154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d14155490 0x7f2d141e1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406fc00 con 0x7f2d14155490 2024-04-26T23:06:35.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406f920 con 0x7f2cf8005240 2024-04-26T23:06:35.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2d14153fa0 con 0x7f2d141e24a0 2024-04-26T23:06:35.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d12800640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d14155490 msgr2=0x7f2d141e1150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:35.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d12800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d14155490 0x7f2d141e1150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:35.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2d140cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2d140cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:35136/0 (socket says 172.21.15.148:35136) 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 -- 172.21.15.148:0/2904080983 learned_addr learned my addr 172.21.15.148:0/2904080983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11400640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2d141e24a0 0x7f2d14154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2d141e24a0 msgr2=0x7f2d14154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2d141e24a0 0x7f2d14154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d14155490 msgr2=0x7f2d141e1150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d14155490 0x7f2d141e1150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d141ec910 con 0x7f2cf8005240 2024-04-26T23:06:35.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d11e00640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2d140cbf20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f540 tx=0x7f2d0400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04017020 con 0x7f2cf8005240 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04003d00 con 0x7f2cf8005240 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04005310 con 0x7f2cf8005240 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d141ecbf0 con 0x7f2cf8005240 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141ed1b0 con 0x7f2cf8005240 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 0x7f2d141e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.252+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140506d0 con 0x7f2d141ed3b0 2024-04-26T23:06:35.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d11400640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 0x7f2d141e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d11400640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d141e0db0 con 0x7f2d141ed3b0 2024-04-26T23:06:35.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d11400640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 0x7f2d141e1690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d0000b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0001e070 con 0x7f2d141ed3b0 2024-04-26T23:06:35.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d0401a020 con 0x7f2cf8005240 2024-04-26T23:06:35.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2cf4068280 0x7f2cf406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2d04086990 con 0x7f2cf8005240 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2d000166f0 con 0x7f2d141ed3b0 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 msgr2=0x7f2d141e1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 0x7f2d141e1690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d0000b660 comp rx=0 tx=0).stop 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 msgr2=0x7f2d141e1690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.256+0000 7f2d0a000640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d141ed3b0 0x7f2d141e1690 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d0000b660 comp rx=0 tx=0).stop 2024-04-26T23:06:35.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.260+0000 7f2d12800640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2cf4068280 0x7f2cf406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.260+0000 7f2d12800640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2cf4068280 0x7f2cf406a740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c360 tx=0x7f2d1406f2f0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.268+0000 7f2d13200640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 0x7f2d14144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.268+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14069b70 con 0x7f2d14144990 2024-04-26T23:06:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d11400640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 0x7f2d14144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d11400640 1 -- 172.21.15.148:0/2904080983 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2d140701a0 con 0x7f2d14144990 2024-04-26T23:06:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d11400640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 0x7f2d14144d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d00009df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00021af0 con 0x7f2d14144990 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5203 (secure 0 0 0) 0x7f2d00021ad0 con 0x7f2d14144990 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 msgr2=0x7f2d14144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 0x7f2d14144d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d00009df0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 msgr2=0x7f2d14144d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d0a000640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d14144990 0x7f2d14144d70 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d141511c0 tx=0x7f2d00009df0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:35.277 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 16, 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 138123, 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:35.278 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.279 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:35.280 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:35.281 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.282 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:35.283 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.284 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:35.285 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.287 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.288 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:35.290 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2cf4068280 msgr2=0x7f2cf406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2cf4068280 0x7f2cf406a740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c360 tx=0x7f2d1406f2f0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 msgr2=0x7f2d140cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 --2- 172.21.15.148:0/2904080983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf8005240 0x7f2d140cbf20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f540 tx=0x7f2d0400fa00 comp rx=0 tx=0).stop 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d12800640 1 -- 172.21.15.148:0/2904080983 reap_dead start 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d12800640 1 -- 172.21.15.148:0/2904080983 reap_dead start 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 shutdown_connections 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 >> 172.21.15.148:0/2904080983 conn(0x7f2d140734b0 msgr2=0x7f2d14146d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 shutdown_connections 2024-04-26T23:06:35.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.272+0000 7f2d13200640 1 -- 172.21.15.148:0/2904080983 wait complete. 2024-04-26T23:06:35.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:06:35.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:06:35.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:06:35.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 Processor -- start 2024-04-26T23:06:35.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 -- start start 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3460070b30 0x7f346015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f34600c6140 0x7f3460159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34600b3dd0 con 0x7f3460070f10 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f346015a160 con 0x7f34600c6140 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f34600b3b80 con 0x7f3460070b30 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3466200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f34600c6140 0x7f3460159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3465800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3460070b30 0x7f346015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.532+0000 7f3464e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3460070f10 0x7f34600c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:53418/0 (socket says 172.21.15.148:53418) 2024-04-26T23:06:35.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.536+0000 7f3464e00640 1 -- 172.21.15.148:0/2315181763 learned_addr learned my addr 172.21.15.148:0/2315181763 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:35.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.536+0000 7f3466200640 1 -- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3460070b30 msgr2=0x7f346015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:35.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.536+0000 7f3466200640 1 --2- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3460070b30 0x7f346015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.536+0000 7f3466200640 1 -- 172.21.15.148:0/2315181763 >> v1:172.21.15.157:6789/0 conn(0x7f3460070f10 legacy=0x7f34600c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.536+0000 7f3466200640 1 -- 172.21.15.148:0/2315181763 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34600b40b0 con 0x7f34600c6140 2024-04-26T23:06:35.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466200640 1 --2- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34600c6140 0x7f3460159c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3458009d90 tx=0x7f345801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af209c024f45210d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f345fe00640 1 -- 172.21.15.148:0/2315181763 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580b4070 con 0x7f34600c6140 2024-04-26T23:06:35.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f345fe00640 1 -- 172.21.15.148:0/2315181763 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34580af600 con 0x7f34600c6140 2024-04-26T23:06:35.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f345fe00640 1 -- 172.21.15.148:0/2315181763 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580af9d0 con 0x7f34600c6140 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 -- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34600c6140 msgr2=0x7f3460159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 --2- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34600c6140 0x7f3460159c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3458009d90 tx=0x7f345801f150 comp rx=0 tx=0).stop 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 -- 172.21.15.148:0/2315181763 shutdown_connections 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 --2- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34600c6140 0x7f3460159c20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 --2- 172.21.15.148:0/2315181763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3460070b30 0x7f346015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 -- 172.21.15.148:0/2315181763 >> 172.21.15.148:0/2315181763 conn(0x7f346006c980 msgr2=0x7f3460068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 -- 172.21.15.148:0/2315181763 shutdown_connections 2024-04-26T23:06:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.540+0000 7f3466c00640 1 -- 172.21.15.148:0/2315181763 wait complete. 2024-04-26T23:06:35.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 Processor -- start 2024-04-26T23:06:35.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 -- start start 2024-04-26T23:06:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3460070b30 0x7f34600cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3460070f10 0x7f34601f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 0x7f34601f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f346015d510 con 0x7f3460070f10 2024-04-26T23:06:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f346015d230 con 0x7f3460070b30 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3460071840 con 0x7f34600c6140 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3464e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3460070f10 msgr2=0x7f34601f5000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3464e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3460070f10 0x7f34601f5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3465800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3460070b30 0x7f34600cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 0x7f34601f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 0x7f34601f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:50470/0 (socket says 172.21.15.148:50470) 2024-04-26T23:06:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.544+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 learned_addr learned my addr 172.21.15.148:0/2130541736 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3460070b30 msgr2=0x7f34600cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3460070b30 0x7f34600cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3460070f10 msgr2=0x7f34601f5000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3460070f10 0x7f34601f5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34600cdec0 con 0x7f34600c6140 2024-04-26T23:06:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3465800640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3460070b30 0x7f34600cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:35.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466200640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 0x7f34601f5540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34580b2040 tx=0x7f345801bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580b4040 con 0x7f34600c6140 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34580c1070 con 0x7f34600c6140 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458009450 con 0x7f34600c6140 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466c00640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34600d0020 con 0x7f34600c6140 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3466c00640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34600ce440 con 0x7f34600c6140 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3452a00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 0x7f34600ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3460069c00 con 0x7f346014a2d0 2024-04-26T23:06:35.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3465800640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 0x7f34600ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.548+0000 7f3465800640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34600506d0 con 0x7f346014a2d0 2024-04-26T23:06:35.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f3465800640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 0x7f34600ce680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3454011cf0 tx=0x7f345400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454004020 con 0x7f346014a2d0 2024-04-26T23:06:35.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34580ba6b0 con 0x7f34600c6140 2024-04-26T23:06:35.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3440068280 0x7f344006a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f34581255e0 con 0x7f34600c6140 2024-04-26T23:06:35.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f3464e00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3440068280 0x7f344006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f34540041c0 con 0x7f346014a2d0 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 msgr2=0x7f34600ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 0x7f34600ce680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3454011cf0 tx=0x7f345400f610 comp rx=0 tx=0).stop 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 msgr2=0x7f34600ce680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f345d600640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014a2d0 0x7f34600ce680 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3454011cf0 tx=0x7f345400f610 comp rx=0 tx=0).stop 2024-04-26T23:06:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.552+0000 7f3464e00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3440068280 0x7f344006a740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34600cf0b0 tx=0x7f344c007ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.564+0000 7f3452a00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 0x7f34601ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.564+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f34600cebc0 con 0x7f346014dcf0 2024-04-26T23:06:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.564+0000 7f3465800640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 0x7f34601ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.564+0000 7f3465800640 1 -- 172.21.15.148:0/2130541736 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3460071410 con 0x7f346014dcf0 2024-04-26T23:06:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3465800640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 0x7f34601ee5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f345401b000 tx=0x7f34540046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454014c60 con 0x7f346014dcf0 2024-04-26T23:06:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7f345401c3b0 con 0x7f346014dcf0 2024-04-26T23:06:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 msgr2=0x7f34601ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 0x7f34601ee5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f345401b000 tx=0x7f34540046d0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 msgr2=0x7f34601ee5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f345d600640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f346014dcf0 0x7f34601ee5f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f345401b000 tx=0x7f34540046d0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 16, 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 138419, 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:35.573 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.574 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.575 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:35.576 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:35.577 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:35.578 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.580 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:35.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.583 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.584 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:35.585 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:35.586 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3440068280 msgr2=0x7f344006a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3440068280 0x7f344006a740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34600cf0b0 tx=0x7f344c007ab0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 msgr2=0x7f34601f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 --2- 172.21.15.148:0/2130541736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34600c6140 0x7f34601f5540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34580b2040 tx=0x7f345801bef0 comp rx=0 tx=0).stop 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 reap_dead start 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3466200640 1 -- 172.21.15.148:0/2130541736 reap_dead start 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 shutdown_connections 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 >> 172.21.15.148:0/2130541736 conn(0x7f346006c980 msgr2=0x7f3460071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 shutdown_connections 2024-04-26T23:06:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:35.568+0000 7f3452a00640 1 -- 172.21.15.148:0/2130541736 wait complete. 2024-04-26T23:06:35.602 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:06:35.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:06:43.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:06:43.164 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:06:53.829 INFO:tasks.workunit.client.0.smithi148.stderr:Updating files: 67% (8238/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-04-26T23:06:54.779 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.780 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-04-26T23:06:54.780 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.780 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T23:06:54.780 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-04-26T23:06:54.780 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T23:06:54.792 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T23:06:54.801 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T23:06:54.804 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:06:54.804 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T23:06:55.562 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T23:06:55.603 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:06:55.603 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:06:55.603 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:06:55.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:06:55.607 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:06:55.607 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:06:55.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:55.661 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T23:06:55.721 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:06:55.723 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:06:55.723 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T23:06:55.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 Processor -- start 2024-04-26T23:06:55.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 -- start start 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb6700c63f0 0x7fb6700703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6700cb7f0 con 0x7fb6701574b0 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb6700ccd80 con 0x7fb6700c63f0 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb677c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb6700c9e80 con 0x7fb6700b47e0 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:57834/0 (socket says 172.21.15.148:57834) 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb675c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb6700c63f0 0x7fb6700703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.743+0000 7fb66fe00640 1 -- 172.21.15.148:0/3007966535 learned_addr learned my addr 172.21.15.148:0/3007966535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:55.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66fe00640 1 -- 172.21.15.148:0/3007966535 >> v2:172.21.15.157:3300/0 conn(0x7fb6700c63f0 msgr2=0x7fb6700703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:55.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66fe00640 1 --2- 172.21.15.148:0/3007966535 >> v2:172.21.15.157:3300/0 conn(0x7fb6700c63f0 0x7fb6700703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66fe00640 1 -- 172.21.15.148:0/3007966535 >> v1:172.21.15.157:6789/0 conn(0x7fb6701574b0 legacy=0x7fb6700ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:55.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66fe00640 1 -- 172.21.15.148:0/3007966535 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6700ca0d0 con 0x7fb6700b47e0 2024-04-26T23:06:55.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66fe00640 1 --2- 172.21.15.148:0/3007966535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009870 tx=0x7fb65c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf25c99f974f434 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:55.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66f400640 1 -- 172.21.15.148:0/3007966535 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0ab650 con 0x7fb6700b47e0 2024-04-26T23:06:55.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66f400640 1 -- 172.21.15.148:0/3007966535 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c0b0070 con 0x7fb6700b47e0 2024-04-26T23:06:55.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.747+0000 7fb66f400640 1 -- 172.21.15.148:0/3007966535 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0aba10 con 0x7fb6700b47e0 2024-04-26T23:06:55.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- 172.21.15.148:0/3007966535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 msgr2=0x7fb67006feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- 172.21.15.148:0/3007966535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009870 tx=0x7fb65c01c560 comp rx=0 tx=0).stop 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- 172.21.15.148:0/3007966535 shutdown_connections 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- 172.21.15.148:0/3007966535 >> v2:172.21.15.157:3300/0 conn(0x7fb6700c63f0 0x7fb6700703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- 172.21.15.148:0/3007966535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700b47e0 0x7fb67006feb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- 172.21.15.148:0/3007966535 >> 172.21.15.148:0/3007966535 conn(0x7fb670071160 msgr2=0x7fb670068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- 172.21.15.148:0/3007966535 shutdown_connections 2024-04-26T23:06:55.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- 172.21.15.148:0/3007966535 wait complete. 2024-04-26T23:06:55.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 Processor -- start 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- start start 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 0x7fb670157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb670166ec0 con 0x7fb6700b47e0 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb670166d40 con 0x7fb6701574b0 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb677c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb670167040 con 0x7fb6700c63f0 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:57840/0 (socket says 172.21.15.148:57840) 2024-04-26T23:06:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 0x7fb670157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59732/0 (socket says 172.21.15.148:59732) 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb66fe00640 1 -- 172.21.15.148:0/3763535208 learned_addr learned my addr 172.21.15.148:0/3763535208 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 msgr2=0x7fb6701f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 msgr2=0x7fb6701f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.751+0000 7fb675200640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 msgr2=0x7fb670157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 0x7fb670157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 msgr2=0x7fb6701f3f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:06:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 -- 172.21.15.148:0/3763535208 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6700ceed0 con 0x7fb6700c63f0 2024-04-26T23:06:55.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb675c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 0x7fb670157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66fe00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb65c01ce00 tx=0x7fb65c01ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0be630 con 0x7fb6700c63f0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c0be7d0 con 0x7fb6700c63f0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0bebc0 con 0x7fb6700c63f0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6700ce630 con 0x7fb6700c63f0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6700cebf0 con 0x7fb6700c63f0 2024-04-26T23:06:55.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.755+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb670077c20 con 0x7fb6700c63f0 2024-04-26T23:06:55.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.759+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb65c0c73f0 con 0x7fb6700c63f0 2024-04-26T23:06:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.759+0000 7fb66cc00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 0x7fb65006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.759+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb65c121900 con 0x7fb6700c63f0 2024-04-26T23:06:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.759+0000 7fb675200640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 0x7fb65006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:55.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.759+0000 7fb675200640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 0x7fb65006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb664007c80 tx=0x7fb664009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:55.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.771+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb65c016150 con 0x7fb6700c63f0 2024-04-26T23:06:55.779 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:06:55.785 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:06:55.785 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T23:06:55.793 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T23:06:55.799 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T23:06:55.799 DEBUG:teuthology.orchestra.run.smithi148:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T23:06:55.857 INFO:tasks.workunit.client.0.smithi148.stderr:+ mkdir -p fsstress 2024-04-26T23:06:55.860 INFO:tasks.workunit.client.0.smithi148.stderr:+ pushd fsstress 2024-04-26T23:06:55.861 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T23:06:55.861 INFO:tasks.workunit.client.0.smithi148.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T23:06:55.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.987+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6700b29f0 con 0x7fb6700c63f0 2024-04-26T23:06:55.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb66cc00640 1 -- 172.21.15.148:0/3763535208 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fb65c0f14e0 con 0x7fb6700c63f0 2024-04-26T23:06:55.995 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":16,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 msgr2=0x7fb65006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 0x7fb65006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb664007c80 tx=0x7fb664009040 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 msgr2=0x7fb670159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb65c01ce00 tx=0x7fb65c01ada0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 shutdown_connections 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb650068380 0x7fb65006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6701574b0 0x7fb670157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6700c63f0 0x7fb670159900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 --2- 172.21.15.148:0/3763535208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6700b47e0 0x7fb6701f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 >> 172.21.15.148:0/3763535208 conn(0x7fb670071160 msgr2=0x7fb67006feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:55.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 shutdown_connections 2024-04-26T23:06:55.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:55.991+0000 7fb677c00640 1 -- 172.21.15.148:0/3763535208 wait complete. 2024-04-26T23:06:58.730 INFO:tasks.workunit.client.0.smithi148.stderr:+ tar xzf ltp-full.tgz 2024-04-26T23:06:59.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:06:59.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.151+0000 7f4edf600640 1 Processor -- start 2024-04-26T23:06:59.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.151+0000 7f4edf600640 1 -- start start 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edf600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c7b80 0x7f4ed80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edf600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ed80c9010 0x7f4ed80c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edf600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ed80c99e0 con 0x7f4ed8153af0 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edf600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed815dec0 con 0x7f4ed80c9010 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edf600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed80ca630 con 0x7f4ed80c7b80 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edcc00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4ed8153af0 0x7f4ed815d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37606/0 (socket says 172.21.15.148:37606) 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edcc00640 1 -- 172.21.15.148:0/1551777653 learned_addr learned my addr 172.21.15.148:0/1551777653 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 --2- 172.21.15.148:0/1551777653 >> v2:172.21.15.148:3300/0 conn(0x7f4ed80c9010 0x7f4ed80c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4ed7e00640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c7b80 0x7f4ed80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 -- 172.21.15.148:0/1551777653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c7b80 msgr2=0x7f4ed80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:59.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c7b80 0x7f4ed80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 -- 172.21.15.148:0/1551777653 >> v1:172.21.15.148:6789/0 conn(0x7f4ed8153af0 legacy=0x7f4ed815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 -- 172.21.15.148:0/1551777653 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed80c9d90 con 0x7f4ed80c9010 2024-04-26T23:06:59.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.155+0000 7f4edd600640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c9010 0x7f4ed80c94a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009d90 tx=0x7f4ed001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c866ca25072abbbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4ed7400640 1 -- 172.21.15.148:0/1551777653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00b4070 con 0x7f4ed80c9010 2024-04-26T23:06:59.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4ed7400640 1 -- 172.21.15.148:0/1551777653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed00af600 con 0x7f4ed80c9010 2024-04-26T23:06:59.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4ed7400640 1 -- 172.21.15.148:0/1551777653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00af9d0 con 0x7f4ed80c9010 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- 172.21.15.148:0/1551777653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c9010 msgr2=0x7f4ed80c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c9010 0x7f4ed80c94a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009d90 tx=0x7f4ed001f150 comp rx=0 tx=0).stop 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- 172.21.15.148:0/1551777653 shutdown_connections 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c9010 0x7f4ed80c94a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- 172.21.15.148:0/1551777653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c7b80 0x7f4ed80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- 172.21.15.148:0/1551777653 >> 172.21.15.148:0/1551777653 conn(0x7f4ed806c380 msgr2=0x7f4ed806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- 172.21.15.148:0/1551777653 shutdown_connections 2024-04-26T23:06:59.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- 172.21.15.148:0/1551777653 wait complete. 2024-04-26T23:06:59.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 Processor -- start 2024-04-26T23:06:59.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- start start 2024-04-26T23:06:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c9010 0x7f4ed814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed8153af0 0x7f4ed81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed815cfb0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed80ca350 con 0x7f4ed8153af0 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edf600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed815d290 con 0x7f4ed80c9010 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51332/0 (socket says 172.21.15.148:51332) 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.159+0000 7f4edcc00640 1 -- 172.21.15.148:0/2059236740 learned_addr learned my addr 172.21.15.148:0/2059236740 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed7e00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c9010 0x7f4ed814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edd600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed8153af0 0x7f4ed81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 -- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c9010 msgr2=0x7f4ed814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c9010 0x7f4ed814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 -- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed8153af0 msgr2=0x7f4ed81596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed8153af0 0x7f4ed81596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 -- 172.21.15.148:0/2059236740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed81f5cb0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edcc00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c3a0 tx=0x7f4ecc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc017070 con 0x7f4ed80c7b80 2024-04-26T23:06:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ecc005cf0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0072f0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed80cdea0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed81f4ef0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed8077c20 con 0x7f4ed80c7b80 2024-04-26T23:06:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ecc01a070 con 0x7f4ed80c7b80 2024-04-26T23:06:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.163+0000 7f4ed4c00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 0x7f4eb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.167+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4ecc085ff0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.167+0000 7f4ed7e00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 0x7f4eb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.167+0000 7f4ed7e00640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 0x7f4eb806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8151b20 tx=0x7f4ec4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.171+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ed80c99e0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.391+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4ed8072a00 con 0x7f4ed80c7b80 2024-04-26T23:06:59.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.391+0000 7f4ed4c00640 1 -- 172.21.15.148:0/2059236740 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f4ecc055bb0 con 0x7f4ed80c7b80 2024-04-26T23:06:59.397 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 msgr2=0x7f4eb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 0x7f4eb806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8151b20 tx=0x7f4ec4008040 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 msgr2=0x7f4ed81e3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c3a0 tx=0x7f4ecc00c860 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 shutdown_connections 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4eb8068380 0x7f4eb806a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ed8153af0 0x7f4ed81596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ed80c9010 0x7f4ed814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 --2- 172.21.15.148:0/2059236740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ed80c7b80 0x7f4ed81e3ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 >> 172.21.15.148:0/2059236740 conn(0x7f4ed806c380 msgr2=0x7f4ed806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 shutdown_connections 2024-04-26T23:06:59.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.395+0000 7f4edf600640 1 -- 172.21.15.148:0/2059236740 wait complete. 2024-04-26T23:06:59.420 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:06:59.420 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:06:59.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:06:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.551+0000 7f088c400640 1 Processor -- start 2024-04-26T23:06:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.551+0000 7f088c400640 1 -- start start 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f088c400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f088406f460 0x7f088415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f088c400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0884153eb0 0x7f088406f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f088c400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08840701f0 con 0x7f088406fd80 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f088c400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f088415ac00 con 0x7f0884153eb0 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f088c400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f08840c96a0 con 0x7f088406f460 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0884153eb0 0x7f088406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0884153eb0 0x7f088406f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51348/0 (socket says 172.21.15.148:51348) 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 -- 172.21.15.148:0/870876692 learned_addr learned my addr 172.21.15.148:0/870876692 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889a00640 1 --2- 172.21.15.148:0/870876692 >> v2:172.21.15.157:3300/0 conn(0x7f088406f460 0x7f088415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 -- 172.21.15.148:0/870876692 >> v2:172.21.15.157:3300/0 conn(0x7f088406f460 msgr2=0x7f088415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 --2- 172.21.15.148:0/870876692 >> v2:172.21.15.157:3300/0 conn(0x7f088406f460 0x7f088415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 -- 172.21.15.148:0/870876692 >> v1:172.21.15.157:6789/0 conn(0x7f088406fd80 legacy=0x7f08840c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.555+0000 7f0889000640 1 -- 172.21.15.148:0/870876692 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840c9980 con 0x7f0884153eb0 2024-04-26T23:06:59.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f0889000640 1 --2- 172.21.15.148:0/870876692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f088406f840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f088406d800 tx=0x7f087001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2f465c02af3d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f0883e00640 1 -- 172.21.15.148:0/870876692 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700b5070 con 0x7f0884153eb0 2024-04-26T23:06:59.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f0883e00640 1 -- 172.21.15.148:0/870876692 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08700a8a10 con 0x7f0884153eb0 2024-04-26T23:06:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f0883e00640 1 -- 172.21.15.148:0/870876692 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700a8de0 con 0x7f0884153eb0 2024-04-26T23:06:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- 172.21.15.148:0/870876692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 msgr2=0x7f088406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 --2- 172.21.15.148:0/870876692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f088406f840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f088406d800 tx=0x7f087001ed10 comp rx=0 tx=0).stop 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- 172.21.15.148:0/870876692 shutdown_connections 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 --2- 172.21.15.148:0/870876692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f088406f840 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 --2- 172.21.15.148:0/870876692 >> v2:172.21.15.157:3300/0 conn(0x7f088406f460 0x7f088415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- 172.21.15.148:0/870876692 >> 172.21.15.148:0/870876692 conn(0x7f08840c9d10 msgr2=0x7f08840ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- 172.21.15.148:0/870876692 shutdown_connections 2024-04-26T23:06:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- 172.21.15.148:0/870876692 wait complete. 2024-04-26T23:06:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 Processor -- start 2024-04-26T23:06:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.559+0000 7f088c400640 1 -- start start 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 0x7f08841474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f088406fd80 0x7f08841482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f088415a080 0x7f0884144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08840c5120 con 0x7f088406f460 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08840708f0 con 0x7f088406fd80 2024-04-26T23:06:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08840c4d70 con 0x7f088415a080 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 0x7f08841474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 0x7f08841474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51352/0 (socket says 172.21.15.148:51352) 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 -- 172.21.15.148:0/4165246562 learned_addr learned my addr 172.21.15.148:0/4165246562 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889000640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f088406fd80 0x7f08841482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088a400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f088415a080 0x7f0884144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f088415a080 msgr2=0x7f0884144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f088415a080 0x7f0884144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f088406fd80 msgr2=0x7f08841482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f088406fd80 0x7f08841482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840734e0 con 0x7f088406f460 2024-04-26T23:06:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088a400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f088415a080 0x7f0884144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889a00640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 0x7f08841474a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f087800e8a0 tx=0x7f087800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878017070 con 0x7f088406f460 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087800c940 con 0x7f088406f460 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08840737a0 con 0x7f088406f460 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800ccf0 con 0x7f088406f460 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841f2f90 con 0x7f088406f460 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f0884145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0884147dc0 con 0x7f0884153eb0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889000640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f0884145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889000640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0884077c20 con 0x7f0884153eb0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0889000640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f0884145000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08840718c0 tx=0x7f087001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700bf070 con 0x7f0884153eb0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.563+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f087801a070 con 0x7f088406f460 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08640682b0 0x7f086406a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0878086b90 con 0x7f088406f460 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f08700b0640 con 0x7f0884153eb0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 msgr2=0x7f0884145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f0884145000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08840718c0 tx=0x7f087001d550 comp rx=0 tx=0).stop 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f088a400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08640682b0 0x7f086406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 msgr2=0x7f0884145000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f0881600640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0884153eb0 0x7f0884145000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.567+0000 7f088a400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08640682b0 0x7f086406a770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f088415a500 tx=0x7f087c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f088c400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 0x7f08841f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0884070c20 con 0x7f08841f31d0 2024-04-26T23:06:59.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0889000640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 0x7f08841f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0889000640 1 -- 172.21.15.148:0/4165246562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f08840c8970 con 0x7f08841f31d0 2024-04-26T23:06:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0889000640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 0x7f08841f3a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f087001c940 tx=0x7f087001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700ca070 con 0x7f08841f31d0 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7f08700c4c80 con 0x7f08841f31d0 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 msgr2=0x7f08841f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 0x7f08841f3a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f087001c940 tx=0x7f087001bab0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 msgr2=0x7f08841f3a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.571+0000 7f0881600640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08841f31d0 0x7f08841f3a70 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f087001c940 tx=0x7f087001bab0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:06:59.579 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 3871, 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 3, 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.580 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:59.581 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.582 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:59.583 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.584 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:59.585 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.586 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.587 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:59.588 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.589 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:59.591 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08640682b0 msgr2=0x7f086406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08640682b0 0x7f086406a770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f088415a500 tx=0x7f087c009040 comp rx=0 tx=0).stop 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 msgr2=0x7f08841474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 --2- 172.21.15.148:0/4165246562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f088406f460 0x7f08841474a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f087800e8a0 tx=0x7f087800eca0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088a400640 1 -- 172.21.15.148:0/4165246562 reap_dead start 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088a400640 1 -- 172.21.15.148:0/4165246562 reap_dead start 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 shutdown_connections 2024-04-26T23:06:59.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 >> 172.21.15.148:0/4165246562 conn(0x7f08840c9d10 msgr2=0x7f088414fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 shutdown_connections 2024-04-26T23:06:59.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.575+0000 7f088c400640 1 -- 172.21.15.148:0/4165246562 wait complete. 2024-04-26T23:06:59.597 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:59.597 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:06:59.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:06:59.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.727+0000 7feb7be00640 1 Processor -- start 2024-04-26T23:06:59.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.727+0000 7feb7be00640 1 -- start start 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb7c0ca380 0x7feb7c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 0x7feb7c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7be00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7c071740 con 0x7feb7c0c9fa0 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7be00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7feb7c0c4360 con 0x7feb7c0ca380 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c15a0b0 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7aa00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feb7c0c9fa0 0x7feb7c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37610/0 (socket says 172.21.15.148:37610) 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7aa00640 1 -- 172.21.15.148:0/3372019873 learned_addr learned my addr 172.21.15.148:0/3372019873 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:06:59.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb72000640 1 --2- 172.21.15.148:0/3372019873 >> v2:172.21.15.148:3300/0 conn(0x7feb7c0ca380 0x7feb7c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7b400640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 0x7feb7c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7a000640 1 -- 172.21.15.148:0/3372019873 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371826163 0 0) 0x7feb7c071740 con 0x7feb7c0c9fa0 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7a000640 1 -- 172.21.15.148:0/3372019873 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb60003530 con 0x7feb7c0c9fa0 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb72000640 1 -- 172.21.15.148:0/3372019873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 msgr2=0x7feb7c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb72000640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 0x7feb7c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb72000640 1 -- 172.21.15.148:0/3372019873 >> v1:172.21.15.148:6789/0 conn(0x7feb7c0c9fa0 legacy=0x7feb7c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb72000640 1 -- 172.21.15.148:0/3372019873 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c0c45b0 con 0x7feb7c0ca380 2024-04-26T23:06:59.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.731+0000 7feb7b400640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 0x7feb7c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:59.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb72000640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0ca380 0x7feb7c070b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0c44e0 tx=0x7feb6401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2be9e81163a540 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7a000640 1 -- 172.21.15.148:0/3372019873 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640b5070 con 0x7feb7c0ca380 2024-04-26T23:06:59.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7a000640 1 -- 172.21.15.148:0/3372019873 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb640a8990 con 0x7feb7c0ca380 2024-04-26T23:06:59.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7a000640 1 -- 172.21.15.148:0/3372019873 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640a8d60 con 0x7feb7c0ca380 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- 172.21.15.148:0/3372019873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0ca380 msgr2=0x7feb7c070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0ca380 0x7feb7c070b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0c44e0 tx=0x7feb6401ec90 comp rx=0 tx=0).stop 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- 172.21.15.148:0/3372019873 shutdown_connections 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0cfcc0 0x7feb7c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- 172.21.15.148:0/3372019873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0ca380 0x7feb7c070b70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- 172.21.15.148:0/3372019873 >> 172.21.15.148:0/3372019873 conn(0x7feb7c06c780 msgr2=0x7feb7c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- 172.21.15.148:0/3372019873 shutdown_connections 2024-04-26T23:06:59.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- 172.21.15.148:0/3372019873 wait complete. 2024-04-26T23:06:59.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 Processor -- start 2024-04-26T23:06:59.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- start start 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c0c9fa0 0x7feb7c148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0ca380 0x7feb7c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0c4b70 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c159d40 con 0x7feb7c0c9fa0 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c0cb1e0 con 0x7feb7c0ca380 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.735+0000 7feb7b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51390/0 (socket says 172.21.15.148:51390) 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 -- 172.21.15.148:0/2688950590 learned_addr learned my addr 172.21.15.148:0/2688950590 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb72000640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0ca380 0x7feb7c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c0c9fa0 0x7feb7c148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0ca380 msgr2=0x7feb7c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb7c0ca380 0x7feb7c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c0c9fa0 msgr2=0x7feb7c148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c0c9fa0 0x7feb7c148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c1f1610 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c0c9fa0 0x7feb7c148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7b400640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb74007f20 tx=0x7feb7400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7401a070 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74003ba0 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74004030 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c1f18b0 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c1f1e70 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7be00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 0x7feb7c1f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0506d0 con 0x7feb7c06d490 2024-04-26T23:06:59.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 0x7feb7c1f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7aa00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb7c154e50 con 0x7feb7c06d490 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb7401d070 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 0x7feb7c1f20b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c00e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb58068380 0x7feb5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.739+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7feb740870c0 con 0x7feb7c0cfcc0 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c005ad0 con 0x7feb7c06d490 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb72000640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb58068380 0x7feb5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feb6c018070 con 0x7feb7c06d490 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 msgr2=0x7feb7c1f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 0x7feb7c1f20b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c00e960 comp rx=0 tx=0).stop 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 msgr2=0x7feb7c1f20b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb73e00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c06d490 0x7feb7c1f20b0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c00e960 comp rx=0 tx=0).stop 2024-04-26T23:06:59.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.743+0000 7feb72000640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb58068380 0x7feb5806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb640b2000 tx=0x7feb64008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.747+0000 7feb7be00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 0x7feb7c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.747+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c1f25f0 con 0x7feb7c14a410 2024-04-26T23:06:59.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.747+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 0x7feb7c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.747+0000 7feb7aa00640 1 -- 172.21.15.148:0/2688950590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb7c071440 con 0x7feb7c14a410 2024-04-26T23:06:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.747+0000 7feb7aa00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 0x7feb7c06d9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c0010b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0070d0 con 0x7feb7c14a410 2024-04-26T23:06:59.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7feb6c0070d0 con 0x7feb7c14a410 2024-04-26T23:06:59.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 msgr2=0x7feb7c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 0x7feb7c06d9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c0010b0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 msgr2=0x7feb7c06d9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb73e00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb7c14a410 0x7feb7c06d9b0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f70 tx=0x7feb6c0010b0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 162598, 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:59.756 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 3, 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.758 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.759 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:59.760 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:59.761 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.762 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:59.763 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.766 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:59.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.771 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:59.772 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb58068380 msgr2=0x7feb5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb58068380 0x7feb5806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb640b2000 tx=0x7feb64008040 comp rx=0 tx=0).stop 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 msgr2=0x7feb7c0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb74007f20 tx=0x7feb7400d560 comp rx=0 tx=0).stop 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7b400640 1 -- 172.21.15.148:0/2688950590 reap_dead start 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 shutdown_connections 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 --2- 172.21.15.148:0/2688950590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb7c0cfcc0 0x7feb7c0c8e10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 >> 172.21.15.148:0/2688950590 conn(0x7feb7c06c780 msgr2=0x7feb7c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 shutdown_connections 2024-04-26T23:06:59.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.751+0000 7feb7be00640 1 -- 172.21.15.148:0/2688950590 wait complete. 2024-04-26T23:06:59.775 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:59.775 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:06:59.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:06:59.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 Processor -- start 2024-04-26T23:06:59.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 -- start start 2024-04-26T23:06:59.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fedc006f460 0x7fedc015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fedc0153eb0 0x7fedc006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc00c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fedc015ac00 con 0x7fedc0153eb0 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fedc0070210 con 0x7fedc006f460 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc8600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00c96a0 con 0x7fedc006fd80 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fedc0153eb0 0x7fedc006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fedc0153eb0 0x7fedc006f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51394/0 (socket says 172.21.15.148:51394) 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 -- 172.21.15.148:0/1170003892 learned_addr learned my addr 172.21.15.148:0/1170003892 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5c00640 1 --2- 172.21.15.148:0/1170003892 >> v2:172.21.15.157:3300/0 conn(0x7fedc006f460 0x7fedc015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc6600640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc00c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 -- 172.21.15.148:0/1170003892 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 msgr2=0x7fedc00c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:59.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc00c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 -- 172.21.15.148:0/1170003892 >> v2:172.21.15.157:3300/0 conn(0x7fedc006f460 msgr2=0x7fedc015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:06:59.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 --2- 172.21.15.148:0/1170003892 >> v2:172.21.15.157:3300/0 conn(0x7fedc006f460 0x7fedc015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.907+0000 7fedc5200640 1 -- 172.21.15.148:0/1170003892 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00c9980 con 0x7fedc0153eb0 2024-04-26T23:06:59.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc5200640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0153eb0 0x7fedc006f840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fedc006d800 tx=0x7fedac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91a197dfc9a3731 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedbfe00640 1 -- 172.21.15.148:0/1170003892 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac0b5070 con 0x7fedc0153eb0 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedbfe00640 1 -- 172.21.15.148:0/1170003892 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac0a89d0 con 0x7fedc0153eb0 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedbfe00640 1 -- 172.21.15.148:0/1170003892 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a8da0 con 0x7fedc0153eb0 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 -- 172.21.15.148:0/1170003892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0153eb0 msgr2=0x7fedc006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0153eb0 0x7fedc006f840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fedc006d800 tx=0x7fedac01ed10 comp rx=0 tx=0).stop 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 -- 172.21.15.148:0/1170003892 shutdown_connections 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0153eb0 0x7fedc006f840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 --2- 172.21.15.148:0/1170003892 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc00c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 --2- 172.21.15.148:0/1170003892 >> v2:172.21.15.157:3300/0 conn(0x7fedc006f460 0x7fedc015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 -- 172.21.15.148:0/1170003892 >> 172.21.15.148:0/1170003892 conn(0x7fedc00c9d10 msgr2=0x7fedc00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 -- 172.21.15.148:0/1170003892 shutdown_connections 2024-04-26T23:06:59.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.911+0000 7fedc8600640 1 -- 172.21.15.148:0/1170003892 wait complete. 2024-04-26T23:06:59.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 Processor -- start 2024-04-26T23:06:59.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- start start 2024-04-26T23:06:59.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedc006f460 0x7fedc0073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc01f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 0x7fedc01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00c5120 con 0x7fedc0159e50 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00708f0 con 0x7fedc006f460 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00c4d70 con 0x7fedc006fd80 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 0x7fedc01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 0x7fedc01f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51402/0 (socket says 172.21.15.148:51402) 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 learned_addr learned my addr 172.21.15.148:0/13048649 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedc006f460 0x7fedc0073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc5200640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc01f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 msgr2=0x7fedc01f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc01f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedc006f460 msgr2=0x7fedc0073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedc006f460 0x7fedc0073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01566b0 con 0x7fedc0159e50 2024-04-26T23:06:59.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc5200640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc006fd80 0x7fedc01f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedc006f460 0x7fedc0073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc6600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 0x7fedc01f3b20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedb800e930 tx=0x7fedb800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8017070 con 0x7fedc0159e50 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb800c9a0 con 0x7fedc0159e50 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb800cd70 con 0x7fedc0159e50 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc01f1f50 con 0x7fedc0159e50 2024-04-26T23:06:59.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01f2510 con 0x7fedc0159e50 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.915+0000 7fedc8600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 0x7fedc01f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedc0077c20 con 0x7fedc0153eb0 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 0x7fedc01f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedb801a070 con 0x7fedc0159e50 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc5c00640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedc00c90c0 con 0x7fedc0153eb0 2024-04-26T23:06:59.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 0x7fedc01f2750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedb4007ec0 tx=0x7fedb4011520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feda00683b0 0x7feda006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fedb8087270 con 0x7fedc0159e50 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb401a030 con 0x7fedc0153eb0 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc5200640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feda00683b0 0x7feda006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fedb40039a0 con 0x7fedc0153eb0 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 msgr2=0x7fedc01f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 0x7fedc01f2750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedb4007ec0 tx=0x7fedb4011520 comp rx=0 tx=0).stop 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 msgr2=0x7fedc01f2750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedbd600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0153eb0 0x7fedc01f2750 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedb4007ec0 tx=0x7fedb4011520 comp rx=0 tx=0).stop 2024-04-26T23:06:59.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.919+0000 7fedc5200640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feda00683b0 0x7feda006a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedac0b2000 tx=0x7fedac0aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 0x7fedc0149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:06:59.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedc0070c20 con 0x7fedc0149910 2024-04-26T23:06:59.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 0x7fedc0149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:06:59.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc5c00640 1 -- 172.21.15.148:0/13048649 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fedc01e4ef0 con 0x7fedc0149910 2024-04-26T23:06:59.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc5c00640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 0x7fedc0149d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedb4011a70 tx=0x7fedb4004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:06:59.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4004190 con 0x7fedc0149910 2024-04-26T23:06:59.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5069 (secure 0 0 0) 0x7fedb4004190 con 0x7fedc0149910 2024-04-26T23:06:59.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 msgr2=0x7fedc0149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 0x7fedc0149d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedb4011a70 tx=0x7fedb4004a50 comp rx=0 tx=0).stop 2024-04-26T23:06:59.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 msgr2=0x7fedc0149d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedbd600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedc0149910 0x7fedc0149d20 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedb4011a70 tx=0x7fedb4004a50 comp rx=0 tx=0).stop 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 162778, 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:06:59.934 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 3, 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.935 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.936 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:06:59.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:06:59.938 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.940 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:06:59.941 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:06:59.942 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:06:59.943 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.945 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:06:59.946 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:06:59.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feda00683b0 msgr2=0x7feda006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feda00683b0 0x7feda006a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedac0b2000 tx=0x7fedac0aa070 comp rx=0 tx=0).stop 2024-04-26T23:06:59.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 msgr2=0x7fedc01f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:06:59.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 --2- 172.21.15.148:0/13048649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedc0159e50 0x7fedc01f3b20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedb800e930 tx=0x7fedb800edf0 comp rx=0 tx=0).stop 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 reap_dead start 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc6600640 1 -- 172.21.15.148:0/13048649 reap_dead start 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 shutdown_connections 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 >> 172.21.15.148:0/13048649 conn(0x7fedc00c9d10 msgr2=0x7fedc0153040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 shutdown_connections 2024-04-26T23:06:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:06:59.927+0000 7fedc8600640 1 -- 172.21.15.148:0/13048649 wait complete. 2024-04-26T23:06:59.952 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:06:59.952 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:06:59.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:07:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.083+0000 7fc836600640 1 Processor -- start 2024-04-26T23:07:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.083+0000 7fc836600640 1 -- start start 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.083+0000 7fc836600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.083+0000 7fc836600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8300c63f0 0x7fc830164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc836600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8300cb7f0 con 0x7fc8300b47e0 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc836600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc8300ccd80 con 0x7fc8300c63f0 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc836600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300c9e80 con 0x7fc8301574b0 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8300c63f0 0x7fc830164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8300c63f0 0x7fc830164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51412/0 (socket says 172.21.15.148:51412) 2024-04-26T23:07:00.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 -- 172.21.15.148:0/3519174071 learned_addr learned my addr 172.21.15.148:0/3519174071 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc827e00640 1 --1- 172.21.15.148:0/3519174071 >> v1:172.21.15.148:6789/0 conn(0x7fc8300b47e0 0x7fc83006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37614/0 (socket says 172.21.15.148:37614) 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82f400640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 -- 172.21.15.148:0/3519174071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 msgr2=0x7fc8300ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 -- 172.21.15.148:0/3519174071 >> v1:172.21.15.148:6789/0 conn(0x7fc8300b47e0 legacy=0x7fc83006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 -- 172.21.15.148:0/3519174071 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8300ca0d0 con 0x7fc8300c63f0 2024-04-26T23:07:00.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82fe00640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830164520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe41092ec6838b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:00.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82ea00640 1 -- 172.21.15.148:0/3519174071 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a57f0 con 0x7fc8300c63f0 2024-04-26T23:07:00.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82ea00640 1 -- 172.21.15.148:0/3519174071 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8280a5990 con 0x7fc8300c63f0 2024-04-26T23:07:00.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.087+0000 7fc82ea00640 1 -- 172.21.15.148:0/3519174071 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5d60 con 0x7fc8300c63f0 2024-04-26T23:07:00.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- 172.21.15.148:0/3519174071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 msgr2=0x7fc830164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830164520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82801ca30 comp rx=0 tx=0).stop 2024-04-26T23:07:00.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- 172.21.15.148:0/3519174071 shutdown_connections 2024-04-26T23:07:00.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830164520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- 172.21.15.148:0/3519174071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- 172.21.15.148:0/3519174071 >> 172.21.15.148:0/3519174071 conn(0x7fc830071160 msgr2=0x7fc830068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:00.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- 172.21.15.148:0/3519174071 shutdown_connections 2024-04-26T23:07:00.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- 172.21.15.148:0/3519174071 wait complete. 2024-04-26T23:07:00.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 Processor -- start 2024-04-26T23:07:00.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- start start 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8300b47e0 0x7fc8301410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300705c0 con 0x7fc8300c63f0 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300ca3b0 con 0x7fc8300b47e0 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc836600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc830070740 con 0x7fc8301574b0 2024-04-26T23:07:00.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc827e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:34884/0 (socket says 172.21.15.148:34884) 2024-04-26T23:07:00.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc82f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8300b47e0 0x7fc8301410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.091+0000 7fc82fe00640 1 -- 172.21.15.148:0/1575220405 learned_addr learned my addr 172.21.15.148:0/1575220405 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 -- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8300b47e0 msgr2=0x7fc8301410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8300b47e0 0x7fc8301410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 -- 172.21.15.148:0/1575220405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 msgr2=0x7fc830156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 -- 172.21.15.148:0/1575220405 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc830141600 con 0x7fc8301574b0 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc827e00640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc82fe00640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc82801a660 tx=0x7fc8280197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280bc020 con 0x7fc8301574b0 2024-04-26T23:07:00.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8280b8670 con 0x7fc8301574b0 2024-04-26T23:07:00.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828009510 con 0x7fc8301574b0 2024-04-26T23:07:00.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8301f4d60 con 0x7fc8301574b0 2024-04-26T23:07:00.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8301f5320 con 0x7fc8301574b0 2024-04-26T23:07:00.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc830077c20 con 0x7fc8301574b0 2024-04-26T23:07:00.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.095+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8280bf020 con 0x7fc8301574b0 2024-04-26T23:07:00.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.099+0000 7fc827400640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 0x7fc80c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:00.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.099+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc828122280 con 0x7fc8301574b0 2024-04-26T23:07:00.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.099+0000 7fc82f400640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 0x7fc80c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:00.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.099+0000 7fc82f400640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 0x7fc80c06a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ac0 tx=0x7fc820009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:00.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.107+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc8280c6030 con 0x7fc8301574b0 2024-04-26T23:07:00.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.335+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc8300ca7f0 con 0x7fc8301574b0 2024-04-26T23:07:00.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc827400640 1 -- 172.21.15.148:0/1575220405 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc828016620 con 0x7fc8301574b0 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 msgr2=0x7fc80c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 0x7fc80c06a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ac0 tx=0x7fc820009190 comp rx=0 tx=0).stop 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 msgr2=0x7fc8300b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc82801a660 tx=0x7fc8280197d0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 shutdown_connections 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc80c0683b0 0x7fc80c06a870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8301574b0 0x7fc8300b0c90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8300c63f0 0x7fc830156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 --2- 172.21.15.148:0/1575220405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8300b47e0 0x7fc8301410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:00.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 >> 172.21.15.148:0/1575220405 conn(0x7fc830071160 msgr2=0x7fc8300b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:00.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 shutdown_connections 2024-04-26T23:07:00.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:00.339+0000 7fc836600640 1 -- 172.21.15.148:0/1575220405 wait complete. 2024-04-26T23:07:00.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:07:10.367 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:07:10.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:10.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 Processor -- start 2024-04-26T23:07:10.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 -- start start 2024-04-26T23:07:10.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5fa00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5fa00c9010 0x7f5fa00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa00c99e0 con 0x7f5fa0153af0 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa015dec0 con 0x7f5fa00c9010 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5fa5000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa00ca630 con 0x7f5fa00c7b80 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5fa0153af0 0x7f5fa015d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46750/0 (socket says 172.21.15.148:46750) 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 -- 172.21.15.148:0/573285406 learned_addr learned my addr 172.21.15.148:0/573285406 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9e800640 1 --2- 172.21.15.148:0/573285406 >> v2:172.21.15.157:3300/0 conn(0x7f5fa00c9010 0x7f5fa00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f95400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5fa00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410292570 0 0) 0x7f5f90001120 con 0x7f5fa0153af0 2024-04-26T23:07:10.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f84003530 con 0x7f5fa0153af0 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2278429628 0 0) 0x7f5f84003530 con 0x7f5fa0153af0 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 msgr2=0x7f5fa00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5fa00c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 >> v2:172.21.15.157:3300/0 conn(0x7f5fa00c9010 msgr2=0x7f5fa00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 --2- 172.21.15.148:0/573285406 >> v2:172.21.15.157:3300/0 conn(0x7f5fa00c9010 0x7f5fa00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa00c9d90 con 0x7f5fa0153af0 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f5f90001850 con 0x7f5fa0153af0 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 >> v1:172.21.15.148:6789/0 conn(0x7f5fa0153af0 legacy=0x7f5fa015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f840039c0 0x7f5f84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5f84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84004d50 0x7f5f840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa015dec0 con 0x7f5f840039c0 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa00ca630 con 0x7f5f84004d50 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8400b9d0 con 0x7f5fa00c7b80 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f840039c0 0x7f5f84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f95400640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5f84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9e800640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84004d50 0x7f5f840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 -- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 msgr2=0x7f5f84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fa00c7b80 0x7f5f84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 -- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84004d50 msgr2=0x7f5f840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84004d50 0x7f5f840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.515+0000 7f5f9de00640 1 -- 172.21.15.148:0/573285406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f84003530 con 0x7f5f840039c0 2024-04-26T23:07:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5f9de00640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f840039c0 0x7f5f84003de0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c4c0 tx=0x7f5f9001f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593e3b24a44269d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000c0e0 con 0x7f5f840039c0 2024-04-26T23:07:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f90005b00 con 0x7f5f840039c0 2024-04-26T23:07:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5f9d400640 1 -- 172.21.15.148:0/573285406 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90007070 con 0x7f5f840039c0 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 -- 172.21.15.148:0/573285406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f840039c0 msgr2=0x7f5f84003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 --2- 172.21.15.148:0/573285406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f840039c0 0x7f5f84003de0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c4c0 tx=0x7f5f9001f440 comp rx=0 tx=0).stop 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5f9e800640 1 -- 172.21.15.148:0/573285406 reap_dead start 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 -- 172.21.15.148:0/573285406 shutdown_connections 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 -- 172.21.15.148:0/573285406 >> 172.21.15.148:0/573285406 conn(0x7f5fa006c380 msgr2=0x7f5fa006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 -- 172.21.15.148:0/573285406 shutdown_connections 2024-04-26T23:07:10.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.519+0000 7f5fa5000640 1 -- 172.21.15.148:0/573285406 wait complete. 2024-04-26T23:07:10.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 Processor -- start 2024-04-26T23:07:10.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- start start 2024-04-26T23:07:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f840039c0 0x7f5fa01f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fa00ccd90 0x7f5fa00cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa015cfb0 con 0x7f5fa00cdce0 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa00ca350 con 0x7f5fa00ccd90 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa015d290 con 0x7f5f840039c0 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38016/0 (socket says 172.21.15.148:38016) 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 -- 172.21.15.148:0/2956458997 learned_addr learned my addr 172.21.15.148:0/2956458997 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f95400640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fa00ccd90 0x7f5fa00cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9de00640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f840039c0 0x7f5fa01f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 -- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f840039c0 msgr2=0x7f5fa01f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f840039c0 0x7f5fa01f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 -- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fa00ccd90 msgr2=0x7f5fa00cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fa00ccd90 0x7f5fa00cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 -- 172.21.15.148:0/2956458997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa0074210 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f9e800640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0070d30 tx=0x7f5f9800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800fc80 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9800fe20 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa00ccab0 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98015670 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa00cb490 con 0x7f5fa00cdce0 2024-04-26T23:07:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.523+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa0077c20 con 0x7f5fa00cdce0 2024-04-26T23:07:10.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.527+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f98015810 con 0x7f5fa00cdce0 2024-04-26T23:07:10.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.527+0000 7f5f96a00640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 0x7f5f7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.527+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5f98087a80 con 0x7f5fa00cdce0 2024-04-26T23:07:10.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.527+0000 7f5f9de00640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 0x7f5f7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.527+0000 7f5f9de00640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 0x7f5f7c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f900ae000 tx=0x7f5f90001c90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.531+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f98089e20 con 0x7f5fa00cdce0 2024-04-26T23:07:10.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.747+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5fa00c8670 con 0x7f5fa00cdce0 2024-04-26T23:07:10.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.747+0000 7f5f96a00640 1 -- 172.21.15.148:0/2956458997 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f5f98019030 con 0x7f5fa00cdce0 2024-04-26T23:07:10.753 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:10.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 msgr2=0x7f5f7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 0x7f5f7c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f900ae000 tx=0x7f5f90001c90 comp rx=0 tx=0).stop 2024-04-26T23:07:10.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 msgr2=0x7f5fa01521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0070d30 tx=0x7f5f9800f1b0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 shutdown_connections 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5f7c068380 0x7f5f7c06a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fa00cdce0 0x7f5fa01521c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fa00ccd90 0x7f5fa00cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 --2- 172.21.15.148:0/2956458997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f840039c0 0x7f5fa01f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 >> 172.21.15.148:0/2956458997 conn(0x7f5fa006c380 msgr2=0x7f5fa00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 shutdown_connections 2024-04-26T23:07:10.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.751+0000 7f5fa5000640 1 -- 172.21.15.148:0/2956458997 wait complete. 2024-04-26T23:07:10.773 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:07:10.773 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:07:10.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:07:10.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:07:10.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 Processor -- start 2024-04-26T23:07:10.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 -- start start 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c0ca710 con 0x7fc98c15c930 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c070cc0 con 0x7fc98c159510 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc993000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c0ca4e0 con 0x7fc98c159130 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc992600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc98c15c930 0x7fc98c166560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46762/0 (socket says 172.21.15.148:46762) 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc992600640 1 -- 172.21.15.148:0/2593847549 learned_addr learned my addr 172.21.15.148:0/2593847549 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:10.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc991c00640 1 --2- 172.21.15.148:0/2593847549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808841430 0 0) 0x7fc98c0ca710 con 0x7fc98c15c930 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc974003530 con 0x7fc98c15c930 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc991c00640 1 -- 172.21.15.148:0/2593847549 >> v1:172.21.15.157:6789/0 conn(0x7fc98c159510 legacy=0x7fc98c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc991c00640 1 -- 172.21.15.148:0/2593847549 >> v1:172.21.15.148:6789/0 conn(0x7fc98c15c930 legacy=0x7fc98c166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967359667 0 0) 0x7fc98c070cc0 con 0x7fc98c159510 2024-04-26T23:07:10.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.907+0000 7fc991c00640 1 -- 172.21.15.148:0/2593847549 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c070fa0 con 0x7fc98c159130 2024-04-26T23:07:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc991c00640 1 --2- 172.21.15.148:0/2593847549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c15c3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097f0 tx=0x7fc98001eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe73b530c32e4a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b5070 con 0x7fc98c159130 2024-04-26T23:07:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800a85d0 con 0x7fc98c159130 2024-04-26T23:07:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc98be00640 1 -- 172.21.15.148:0/2593847549 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984001a00 con 0x7fc98c159130 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 -- 172.21.15.148:0/2593847549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 msgr2=0x7fc98c15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 --2- 172.21.15.148:0/2593847549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c15c3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097f0 tx=0x7fc98001eb10 comp rx=0 tx=0).stop 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 -- 172.21.15.148:0/2593847549 shutdown_connections 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 --2- 172.21.15.148:0/2593847549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c15c3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 -- 172.21.15.148:0/2593847549 >> 172.21.15.148:0/2593847549 conn(0x7fc98c06c980 msgr2=0x7fc98c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 -- 172.21.15.148:0/2593847549 shutdown_connections 2024-04-26T23:07:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.911+0000 7fc993000640 1 -- 172.21.15.148:0/2593847549 wait complete. 2024-04-26T23:07:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 Processor -- start 2024-04-26T23:07:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- start start 2024-04-26T23:07:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98c159510 0x7fc98c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c071610 con 0x7fc98c15c930 2024-04-26T23:07:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c0c9cd0 con 0x7fc98c159510 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c0cf930 con 0x7fc98c159130 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38026/0 (socket says 172.21.15.148:38026) 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 -- 172.21.15.148:0/1615880113 learned_addr learned my addr 172.21.15.148:0/1615880113 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc991c00640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc991200640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98c159510 0x7fc98c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 msgr2=0x7fc98c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc98c159130 0x7fc98c159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98c159510 msgr2=0x7fc98c15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98c159510 0x7fc98c15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c0cd4d0 con 0x7fc98c15c930 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc991200640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc98c159510 0x7fc98c15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:07:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc992600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc98400caf0 tx=0x7fc9840021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984018070 con 0x7fc98c15c930 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98400a820 con 0x7fc98c15c930 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c0cd7b0 con 0x7fc98c15c930 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98400abd0 con 0x7fc98c15c930 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.915+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c152b40 con 0x7fc98c15c930 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc993000640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 0x7fc98c1f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c0cd280 con 0x7fc98c15b150 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc991c00640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 0x7fc98c1f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc991c00640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc98c0506d0 con 0x7fc98c15b150 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc991c00640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 0x7fc98c1f9730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0b1af0 tx=0x7fc98001d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc98401b070 con 0x7fc98c15c930 2024-04-26T23:07:10.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc96c0683b0 0x7fc96c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc984086670 con 0x7fc98c15c930 2024-04-26T23:07:10.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800c0070 con 0x7fc98c15b150 2024-04-26T23:07:10.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc980004020 con 0x7fc98c15b150 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 msgr2=0x7fc98c1f9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 0x7fc98c1f9730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0b1af0 tx=0x7fc98001d350 comp rx=0 tx=0).stop 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 msgr2=0x7fc98c1f9730 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc989600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15b150 0x7fc98c1f9730 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0b1af0 tx=0x7fc98001d350 comp rx=0 tx=0).stop 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc991200640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc96c0683b0 0x7fc96c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.919+0000 7fc991200640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc96c0683b0 0x7fc96c06a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0c59b0 tx=0x7fc978009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 0x7fc98c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c0713f0 con 0x7fc98c155470 2024-04-26T23:07:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc991c00640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 0x7fc98c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:10.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc991c00640 1 -- 172.21.15.148:0/1615880113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc98c0caa90 con 0x7fc98c155470 2024-04-26T23:07:10.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc991c00640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 0x7fc98c1f5a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc98001d1c0 tx=0x7fc98001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:10.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800c0040 con 0x7fc98c155470 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4561 (secure 0 0 0) 0x7fc980003620 con 0x7fc98c155470 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 msgr2=0x7fc98c1f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 0x7fc98c1f5a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc98001d1c0 tx=0x7fc98001b8b0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 msgr2=0x7fc98c1f5a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc989600640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c155470 0x7fc98c1f5a20 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc98001d1c0 tx=0x7fc98001b8b0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 15231, 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:10.945 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc96c0683b0 msgr2=0x7fc96c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc96c0683b0 0x7fc96c06a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0c59b0 tx=0x7fc978009040 comp rx=0 tx=0).stop 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 msgr2=0x7fc98c1f91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc98400caf0 tx=0x7fc9840021e0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc992600640 1 -- 172.21.15.148:0/1615880113 reap_dead start 2024-04-26T23:07:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 shutdown_connections 2024-04-26T23:07:10.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 --2- 172.21.15.148:0/1615880113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c15c930 0x7fc98c1f91f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:10.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 >> 172.21.15.148:0/1615880113 conn(0x7fc98c06c980 msgr2=0x7fc98c0c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:10.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 shutdown_connections 2024-04-26T23:07:10.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:10.931+0000 7fc993000640 1 -- 172.21.15.148:0/1615880113 wait complete. 2024-04-26T23:07:10.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:10.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:07:10.951 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:07:11.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 Processor -- start 2024-04-26T23:07:11.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- start start 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd3d4072430 0x7fd3d415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d4157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d40ccc60 con 0x7fd3d40c5610 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d40cf240 con 0x7fd3d4072430 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d40c4710 con 0x7fd3d40c9cd0 2024-04-26T23:07:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd3d4072430 0x7fd3d415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd3d4072430 0x7fd3d415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38050/0 (socket says 172.21.15.148:38050) 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 -- 172.21.15.148:0/3537792980 learned_addr learned my addr 172.21.15.148:0/3537792980 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d8a00640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 -- 172.21.15.148:0/3537792980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 msgr2=0x7fd3d4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 -- 172.21.15.148:0/3537792980 >> v1:172.21.15.157:6789/0 conn(0x7fd3d40c5610 legacy=0x7fd3d4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 -- 172.21.15.148:0/3537792980 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d40cf490 con 0x7fd3d4072430 2024-04-26T23:07:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3e00640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d415d050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40cf3c0 tx=0x7fd3c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64efce6363f00165 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3400640 1 -- 172.21.15.148:0/3537792980 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40ab430 con 0x7fd3d4072430 2024-04-26T23:07:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3400640 1 -- 172.21.15.148:0/3537792980 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40b0070 con 0x7fd3d4072430 2024-04-26T23:07:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d3400640 1 -- 172.21.15.148:0/3537792980 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40ab7f0 con 0x7fd3d4072430 2024-04-26T23:07:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- 172.21.15.148:0/3537792980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 msgr2=0x7fd3d415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d415d050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40cf3c0 tx=0x7fd3c401c540 comp rx=0 tx=0).stop 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- 172.21.15.148:0/3537792980 shutdown_connections 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 --2- 172.21.15.148:0/3537792980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d415d050 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- 172.21.15.148:0/3537792980 >> 172.21.15.148:0/3537792980 conn(0x7fd3d40703b0 msgr2=0x7fd3d40707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- 172.21.15.148:0/3537792980 shutdown_connections 2024-04-26T23:07:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.087+0000 7fd3d9400640 1 -- 172.21.15.148:0/3537792980 wait complete. 2024-04-26T23:07:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 Processor -- start 2024-04-26T23:07:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- start start 2024-04-26T23:07:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d40c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c5610 0x7fd3d406e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d40c42f0 con 0x7fd3d4072430 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d415d9a0 con 0x7fd3d40c5610 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d40c4470 con 0x7fd3d40c9cd0 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d40c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d40c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38054/0 (socket says 172.21.15.148:38054) 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 -- 172.21.15.148:0/2674499289 learned_addr learned my addr 172.21.15.148:0/2674499289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d8a00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3cb400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c5610 0x7fd3d406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 msgr2=0x7fd3d406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd3d40c9cd0 0x7fd3d406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c5610 msgr2=0x7fd3d406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c5610 0x7fd3d406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d40c9540 con 0x7fd3d4072430 2024-04-26T23:07:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d3e00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d40c7940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ad040 tx=0x7fd3c40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40abe40 con 0x7fd3d4072430 2024-04-26T23:07:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40bb070 con 0x7fd3d4072430 2024-04-26T23:07:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d406f240 con 0x7fd3d4072430 2024-04-26T23:07:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40b4660 con 0x7fd3d4072430 2024-04-26T23:07:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d41f5040 con 0x7fd3d4072430 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 0x7fd3d414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.091+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d41f5b00 con 0x7fd3d41f5280 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3cb400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 0x7fd3d414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3cb400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3d40506d0 con 0x7fd3d41f5280 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3c40b4800 con 0x7fd3d4072430 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3cb400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 0x7fd3d414fa80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc00e820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd3b0068380 0x7fd3b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd3c4120c90 con 0x7fd3d4072430 2024-04-26T23:07:11.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d8a00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd3b0068380 0x7fd3b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0052e0 con 0x7fd3d41f5280 2024-04-26T23:07:11.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd3bc007020 con 0x7fd3d41f5280 2024-04-26T23:07:11.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 msgr2=0x7fd3d414fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 0x7fd3d414fa80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc00e820 comp rx=0 tx=0).stop 2024-04-26T23:07:11.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 msgr2=0x7fd3d414fa80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:11.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d0c00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d41f5280 0x7fd3d414fa80 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc00e820 comp rx=0 tx=0).stop 2024-04-26T23:07:11.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.095+0000 7fd3d8a00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd3b0068380 0x7fd3b006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0074a0 tx=0x7fd3cc00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 0x7fd3d414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4150500 con 0x7fd3d40c70e0 2024-04-26T23:07:11.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3cb400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 0x7fd3d414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3cb400640 1 -- 172.21.15.148:0/2674499289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3d4164160 con 0x7fd3d40c70e0 2024-04-26T23:07:11.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3cb400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 0x7fd3d414ffc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0067e0 con 0x7fd3d40c70e0 2024-04-26T23:07:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7fd3bc0067e0 con 0x7fd3d40c70e0 2024-04-26T23:07:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 msgr2=0x7fd3d414ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 0x7fd3d414ffc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc000ee0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 msgr2=0x7fd3d414ffc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d0c00640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3d40c70e0 0x7fd3d414ffc0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3d415d170 tx=0x7fd3bc000ee0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 173954, 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:11.110 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.111 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.112 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:11.113 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.114 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:11.115 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:11.117 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.118 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.119 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:11.120 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.121 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:07:11.122 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:11.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd3b0068380 msgr2=0x7fd3b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd3b0068380 0x7fd3b006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0074a0 tx=0x7fd3cc00b040 comp rx=0 tx=0).stop 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 msgr2=0x7fd3d40c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 --2- 172.21.15.148:0/2674499289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d4072430 0x7fd3d40c7940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ad040 tx=0x7fd3c40192e0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d8a00640 1 -- 172.21.15.148:0/2674499289 reap_dead start 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d8a00640 1 -- 172.21.15.148:0/2674499289 reap_dead start 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 shutdown_connections 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 >> 172.21.15.148:0/2674499289 conn(0x7fd3d40703b0 msgr2=0x7fd3d40b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 shutdown_connections 2024-04-26T23:07:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.103+0000 7fd3d9400640 1 -- 172.21.15.148:0/2674499289 wait complete. 2024-04-26T23:07:11.129 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:11.129 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:07:11.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:07:11.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.263+0000 7ff791400640 1 Processor -- start 2024-04-26T23:07:11.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.263+0000 7ff791400640 1 -- start start 2024-04-26T23:07:11.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 0x7ff78c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff78c0713e0 0x7ff78c0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff78c0c9100 con 0x7ff78c0c9c40 2024-04-26T23:07:11.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff78c0742a0 con 0x7ff78c0713e0 2024-04-26T23:07:11.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c073720 con 0x7ff78c071000 2024-04-26T23:07:11.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff78c0713e0 0x7ff78c0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff78a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 0x7ff78c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff78b200640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff78c0c9c40 0x7ff78c152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52006/0 (socket says 172.21.15.148:52006) 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff78b200640 1 -- 172.21.15.148:0/3333258177 learned_addr learned my addr 172.21.15.148:0/3333258177 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 -- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 msgr2=0x7ff78c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 0x7ff78c0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 -- 172.21.15.148:0/3333258177 >> v1:172.21.15.157:6789/0 conn(0x7ff78c0c9c40 legacy=0x7ff78c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 -- 172.21.15.148:0/3333258177 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c0c5e50 con 0x7ff78c0713e0 2024-04-26T23:07:11.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff78a800640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 0x7ff78c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:07:11.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff781e00640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c0713e0 0x7ff78c0c8bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00f370 tx=0x7ff77c023550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9467119223cb2df8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff789e00640 1 -- 172.21.15.148:0/3333258177 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0b9070 con 0x7ff78c0713e0 2024-04-26T23:07:11.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff789e00640 1 -- 172.21.15.148:0/3333258177 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c00d2d0 con 0x7ff78c0713e0 2024-04-26T23:07:11.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff789e00640 1 -- 172.21.15.148:0/3333258177 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00b740 con 0x7ff78c0713e0 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c0713e0 msgr2=0x7ff78c0c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c0713e0 0x7ff78c0c8bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00f370 tx=0x7ff77c023550 comp rx=0 tx=0).stop 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- 172.21.15.148:0/3333258177 shutdown_connections 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c0713e0 0x7ff78c0c8bc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 --2- 172.21.15.148:0/3333258177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c071000 0x7ff78c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- 172.21.15.148:0/3333258177 >> 172.21.15.148:0/3333258177 conn(0x7ff78c0ce2c0 msgr2=0x7ff78c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- 172.21.15.148:0/3333258177 shutdown_connections 2024-04-26T23:07:11.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.271+0000 7ff791400640 1 -- 172.21.15.148:0/3333258177 wait complete. 2024-04-26T23:07:11.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 Processor -- start 2024-04-26T23:07:11.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- start start 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c071000 0x7ff78c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c0713e0 0x7ff78c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 0x7ff78c1ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c073f30 con 0x7ff78c0c9c40 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c073c50 con 0x7ff78c071000 2024-04-26T23:07:11.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0c96e0 con 0x7ff78c0713e0 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 0x7ff78c1ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 0x7ff78c1ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38056/0 (socket says 172.21.15.148:38056) 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 learned_addr learned my addr 172.21.15.148:0/457069524 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78a800640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c071000 0x7ff78c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff781e00640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c0713e0 0x7ff78c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c0713e0 msgr2=0x7ff78c155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c0713e0 0x7ff78c155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c071000 msgr2=0x7ff78c156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78c071000 0x7ff78c156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c153a10 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff78b200640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 0x7ff78c1ed6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c3f0 tx=0x7ff78400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784017070 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff784005cf0 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7840072f0 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c153cf0 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c1542b0 con 0x7ff78c0c9c40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 0x7ff78c1edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.275+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c077c20 con 0x7ff78c154a40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff78a800640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 0x7ff78c1edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff78a800640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff78c156540 con 0x7ff78c154a40 2024-04-26T23:07:11.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff78401a070 con 0x7ff78c0c9c40 2024-04-26T23:07:11.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff78a800640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 0x7ff78c1edc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff774010b50 tx=0x7ff77400f800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff768068380 0x7ff76806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff784085fe0 con 0x7ff78c0c9c40 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77401e070 con 0x7ff78c154a40 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff781e00640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff768068380 0x7ff76806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff77400e690 con 0x7ff78c154a40 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 msgr2=0x7ff78c1edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 0x7ff78c1edc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff774010b50 tx=0x7ff77400f800 comp rx=0 tx=0).stop 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 msgr2=0x7ff78c1edc10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff783400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c154a40 0x7ff78c1edc10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.279+0000 7ff781e00640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff768068380 0x7ff76806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b6000 tx=0x7ff77c0af000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.283+0000 7ff791400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 0x7ff78c143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.283+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0766a0 con 0x7ff78c143ac0 2024-04-26T23:07:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff78a800640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 0x7ff78c143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff78a800640 1 -- 172.21.15.148:0/457069524 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff78c068fd0 con 0x7ff78c143ac0 2024-04-26T23:07:11.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff78a800640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 0x7ff78c143ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff77401b000 tx=0x7ff7740046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77401e040 con 0x7ff78c143ac0 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5070 (secure 0 0 0) 0x7ff77402a400 con 0x7ff78c143ac0 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 msgr2=0x7ff78c143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 0x7ff78c143ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff77401b000 tx=0x7ff7740046d0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 msgr2=0x7ff78c143ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff783400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff78c143ac0 0x7ff78c143ed0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff77401b000 tx=0x7ff7740046d0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:11.293 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 20, 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 174138, 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.294 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.295 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:11.296 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:11.297 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:11.298 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.300 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.301 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.302 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:11.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.305 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:11.306 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:11.307 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:11.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff768068380 msgr2=0x7ff76806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff768068380 0x7ff76806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b6000 tx=0x7ff77c0af000 comp rx=0 tx=0).stop 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 msgr2=0x7ff78c1ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 --2- 172.21.15.148:0/457069524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c0c9c40 0x7ff78c1ed6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c3f0 tx=0x7ff78400c8b0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 reap_dead start 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff78b200640 1 -- 172.21.15.148:0/457069524 reap_dead start 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 shutdown_connections 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 >> 172.21.15.148:0/457069524 conn(0x7ff78c0ce2c0 msgr2=0x7ff78c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 shutdown_connections 2024-04-26T23:07:11.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.287+0000 7ff791400640 1 -- 172.21.15.148:0/457069524 wait complete. 2024-04-26T23:07:11.312 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:11.312 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:07:11.312 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:07:11.312 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:07:11.312 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:07:11.313 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:07:11.313 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:07:11.328 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:07:11.328 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:07:11.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:11.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 Processor -- start 2024-04-26T23:07:11.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 -- start start 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0b4c0d1640 0x7f0b4c0d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0ce550 con 0x7f0b4c15f490 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c0ce7c0 con 0x7f0b4c0d1640 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b52c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c0cea80 con 0x7f0b4c0cb270 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b43400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f0b4c15f490 legacy=0x7f0b4c0cde40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:57642/0 (socket says 172.21.15.148:57642) 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 -- 172.21.15.148:0/2000500389 learned_addr learned my addr 172.21.15.148:0/2000500389 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:11.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b50c00640 1 --2- 172.21.15.148:0/2000500389 >> v2:172.21.15.157:3300/0 conn(0x7f0b4c0d1640 0x7f0b4c0d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 -- 172.21.15.148:0/2000500389 >> v2:172.21.15.157:3300/0 conn(0x7f0b4c0d1640 msgr2=0x7f0b4c0d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:11.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 --2- 172.21.15.148:0/2000500389 >> v2:172.21.15.157:3300/0 conn(0x7f0b4c0d1640 0x7f0b4c0d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 -- 172.21.15.148:0/2000500389 >> v1:172.21.15.148:6789/0 conn(0x7f0b4c15f490 legacy=0x7f0b4c0cde40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:11.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.503+0000 7f0b4be00640 1 -- 172.21.15.148:0/2000500389 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0ced60 con 0x7f0b4c0cb270 2024-04-26T23:07:11.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b4be00640 1 --2- 172.21.15.148:0/2000500389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009870 tx=0x7f0b3c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64947d088ee92d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b4b400640 1 -- 172.21.15.148:0/2000500389 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0b5070 con 0x7f0b4c0cb270 2024-04-26T23:07:11.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b4b400640 1 -- 172.21.15.148:0/2000500389 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3c0a89d0 con 0x7f0b4c0cb270 2024-04-26T23:07:11.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b4b400640 1 -- 172.21.15.148:0/2000500389 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0a8da0 con 0x7f0b4c0cb270 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 -- 172.21.15.148:0/2000500389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 msgr2=0x7f0b4c0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2000500389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009870 tx=0x7f0b3c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 -- 172.21.15.148:0/2000500389 shutdown_connections 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2000500389 >> v2:172.21.15.157:3300/0 conn(0x7f0b4c0d1640 0x7f0b4c0d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2000500389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0cb270 0x7f0b4c0cb650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 -- 172.21.15.148:0/2000500389 >> 172.21.15.148:0/2000500389 conn(0x7f0b4c06eaf0 msgr2=0x7f0b4c06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 -- 172.21.15.148:0/2000500389 shutdown_connections 2024-04-26T23:07:11.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.507+0000 7f0b52c00640 1 -- 172.21.15.148:0/2000500389 wait complete. 2024-04-26T23:07:11.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 Processor -- start 2024-04-26T23:07:11.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 -- start start 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 0x7f0b4c1e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b4c15f490 0x7f0b4c1e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0ccc70 con 0x7f0b4c0cb270 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0cc990 con 0x7f0b4c15f490 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c0cd190 con 0x7f0b4c0d1640 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b4be00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 msgr2=0x7f0b4c1e5a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b4be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 0x7f0b4c1e5a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b50c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b4c15f490 0x7f0b4c1e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:57646/0 (socket says 172.21.15.148:57646) 2024-04-26T23:07:11.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 -- 172.21.15.148:0/2584727856 learned_addr learned my addr 172.21.15.148:0/2584727856 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 -- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b4c15f490 msgr2=0x7f0b4c1e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b4c15f490 0x7f0b4c1e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 -- 172.21.15.148:0/2584727856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 msgr2=0x7f0b4c1e5a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 0x7f0b4c1e5a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 -- 172.21.15.148:0/2584727856 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c15c6f0 con 0x7f0b4c0d1640 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b43400640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400b550 tx=0x7f0b3400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34003dd0 con 0x7f0b4c0d1640 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34015070 con 0x7f0b4c0d1640 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34005330 con 0x7f0b4c0d1640 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.511+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c1e6580 con 0x7f0b4c0d1640 2024-04-26T23:07:11.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c1f5b00 con 0x7f0b4c0d1640 2024-04-26T23:07:11.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c077c20 con 0x7f0b4c0d1640 2024-04-26T23:07:11.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b340054d0 con 0x7f0b4c0d1640 2024-04-26T23:07:11.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b48c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 0x7f0b2806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:11.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0b34087510 con 0x7f0b4c0d1640 2024-04-26T23:07:11.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.515+0000 7f0b4be00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 0x7f0b2806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:11.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.519+0000 7f0b4be00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 0x7f0b2806a820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0b2000 tx=0x7f0b3c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.527+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0b34057840 con 0x7f0b4c0d1640 2024-04-26T23:07:11.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0b4c0cac60 con 0x7f0b4c0d1640 2024-04-26T23:07:11.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b48c00640 1 -- 172.21.15.148:0/2584727856 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f0b34057140 con 0x7f0b4c0d1640 2024-04-26T23:07:11.744 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 msgr2=0x7f0b2806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 0x7f0b2806a820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0b2000 tx=0x7f0b3c008040 comp rx=0 tx=0).stop 2024-04-26T23:07:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 msgr2=0x7f0b4c15c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400b550 tx=0x7f0b3400ba10 comp rx=0 tx=0).stop 2024-04-26T23:07:11.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 shutdown_connections 2024-04-26T23:07:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0b28068360 0x7f0b2806a820 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b4c15f490 0x7f0b4c1e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b4c0d1640 0x7f0b4c15c1b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 --2- 172.21.15.148:0/2584727856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b4c0cb270 0x7f0b4c1e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:11.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 >> 172.21.15.148:0/2584727856 conn(0x7f0b4c06eaf0 msgr2=0x7f0b4c0c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:11.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 shutdown_connections 2024-04-26T23:07:11.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:11.743+0000 7f0b52c00640 1 -- 172.21.15.148:0/2584727856 wait complete. 2024-04-26T23:07:13.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:07:13.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:07:14.766 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.911+0000 7f623f000640 1 Processor -- start 2024-04-26T23:07:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.911+0000 7f623f000640 1 -- start start 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623f000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f62380c2b70 0x7f6238152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623f000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62380c3040 con 0x7f623815c130 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623f000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6238072a00 con 0x7f6238073d90 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623f000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6238068690 con 0x7f62380c2b70 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f623815c130 legacy=0x7f62380c4840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623e600640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f62380c2b70 msgr2=0x7f6238152650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623e600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f62380c2b70 0x7f6238152650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623d200640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6238073d90 0x7f623815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52008/0 (socket says 172.21.15.148:52008) 2024-04-26T23:07:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623d200640 1 -- 172.21.15.148:0/2060810733 learned_addr learned my addr 172.21.15.148:0/2060810733 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:14.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743763666 0 0) 0x7f6238072a00 con 0x7f6238073d90 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6220003530 con 0x7f6238073d90 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3435211042 0 0) 0x7f6220003530 con 0x7f6238073d90 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 >> v2:172.21.15.148:3300/0 conn(0x7f62380c2b70 msgr2=0x7f6238152650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 --2- 172.21.15.148:0/2060810733 >> v2:172.21.15.148:3300/0 conn(0x7f62380c2b70 0x7f6238152650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 >> v1:172.21.15.148:6789/0 conn(0x7f623815c130 legacy=0x7f62380c4840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6238072ce0 con 0x7f6238073d90 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f6224001680 con 0x7f6238073d90 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 >> v1:172.21.15.157:6789/0 conn(0x7f6238073d90 legacy=0x7f623815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6220003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6220004810 0x7f6220004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6220005240 0x7f622000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f622000c160 con 0x7f6220005240 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f622000c310 con 0x7f6220004810 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f622000c510 con 0x7f62200039c0 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623e600640 1 -- 172.21.15.148:0/2060810733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6220005240 msgr2=0x7f622000b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623e600640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6220005240 0x7f622000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623d200640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6220004810 0x7f6220004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6220003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 -- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6220004810 msgr2=0x7f6220004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6220004810 0x7f6220004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 -- 172.21.15.148:0/2060810733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6220005240 msgr2=0x7f622000b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6220005240 0x7f622000b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623dc00640 1 -- 172.21.15.148:0/2060810733 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6220003530 con 0x7f62200039c0 2024-04-26T23:07:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623e600640 1 -- 172.21.15.148:0/2060810733 reap_dead start 2024-04-26T23:07:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.915+0000 7f623d200640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6220004810 0x7f6220004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:07:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623dc00640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6220003dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f622c003990 tx=0x7f622c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31519b1b83f69e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c009520 con 0x7f62200039c0 2024-04-26T23:07:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c003bc0 con 0x7f62200039c0 2024-04-26T23:07:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f6237e00640 1 -- 172.21.15.148:0/2060810733 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c005070 con 0x7f62200039c0 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 -- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 msgr2=0x7f6220003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6220003dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f622c003990 tx=0x7f622c01c440 comp rx=0 tx=0).stop 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 -- 172.21.15.148:0/2060810733 shutdown_connections 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 --2- 172.21.15.148:0/2060810733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6220003dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 -- 172.21.15.148:0/2060810733 >> 172.21.15.148:0/2060810733 conn(0x7f62380cdc10 msgr2=0x7f62380cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 -- 172.21.15.148:0/2060810733 shutdown_connections 2024-04-26T23:07:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.919+0000 7f623f000640 1 -- 172.21.15.148:0/2060810733 wait complete. 2024-04-26T23:07:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 Processor -- start 2024-04-26T23:07:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- start start 2024-04-26T23:07:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 0x7f623815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62381f4780 0x7f62381f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62380ce880 con 0x7f6238157060 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f62380ce700 con 0x7f62381f4780 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f62380cea00 con 0x7f62200039c0 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623d200640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 msgr2=0x7f623815b0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 0x7f623815b0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623e600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62381f4780 0x7f62381f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:57654/0 (socket says 172.21.15.148:57654) 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 -- 172.21.15.148:0/1293236855 learned_addr learned my addr 172.21.15.148:0/1293236855 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 -- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62381f4780 msgr2=0x7f62381f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62381f4780 0x7f62381f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 -- 172.21.15.148:0/1293236855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 msgr2=0x7f623815b0b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 0x7f623815b0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 -- 172.21.15.148:0/1293236855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62381540f0 con 0x7f62200039c0 2024-04-26T23:07:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623dc00640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f622c097e50 tx=0x7f6220005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:14.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c009500 con 0x7f62200039c0 2024-04-26T23:07:14.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c0ae9f0 con 0x7f62200039c0 2024-04-26T23:07:14.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0aede0 con 0x7f62200039c0 2024-04-26T23:07:14.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6238158a80 con 0x7f62200039c0 2024-04-26T23:07:14.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.923+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6238159040 con 0x7f62200039c0 2024-04-26T23:07:14.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.927+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62380506d0 con 0x7f62200039c0 2024-04-26T23:07:14.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.927+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f622c005070 con 0x7f62200039c0 2024-04-26T23:07:14.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.927+0000 7f6235600640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 0x7f621806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:14.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.927+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f622c120be0 con 0x7f62200039c0 2024-04-26T23:07:14.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.927+0000 7f623d200640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 0x7f621806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:14.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.931+0000 7f623d200640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 0x7f621806a820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62380caa80 tx=0x7f6224001dc0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:14.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:14.939+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f622c016150 con 0x7f62200039c0 2024-04-26T23:07:15.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.159+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f62380b3cc0 con 0x7f62200039c0 2024-04-26T23:07:15.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.159+0000 7f6235600640 1 -- 172.21.15.148:0/1293236855 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f622c0f07e0 con 0x7f62200039c0 2024-04-26T23:07:15.162 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 msgr2=0x7f621806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 0x7f621806a820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62380caa80 tx=0x7f6224001dc0 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 msgr2=0x7f6238153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f622c097e50 tx=0x7f6220005840 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 shutdown_connections 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6218068360 0x7f621806a820 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62381f4780 0x7f62381f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6238157060 0x7f623815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 --2- 172.21.15.148:0/1293236855 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039c0 0x7f6238153a60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 >> 172.21.15.148:0/1293236855 conn(0x7f62380cdc10 msgr2=0x7f62380cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 shutdown_connections 2024-04-26T23:07:15.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:15.163+0000 7f623f000640 1 -- 172.21.15.148:0/1293236855 wait complete. 2024-04-26T23:07:18.184 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:18.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 Processor -- start 2024-04-26T23:07:18.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 -- start start 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c15a060 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c15a340 con 0x7f8a9c157670 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa4200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c0c4a50 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa1800640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f8a9c0cf6c0 legacy=0x7f8a9c156f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa0e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa0e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:44122/0 (socket says 172.21.15.148:44122) 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa0e00640 1 -- 172.21.15.148:0/3197904524 learned_addr learned my addr 172.21.15.148:0/3197904524 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:18.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.335+0000 7f8aa2200640 1 --1- 172.21.15.148:0/3197904524 >> v1:172.21.15.157:6789/0 conn(0x7f8a9c157670 0x7f8a9c0cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:39412/0 (socket says 172.21.15.148:39412) 2024-04-26T23:07:18.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8aa0e00640 1 -- 172.21.15.148:0/3197904524 >> v1:172.21.15.157:6789/0 conn(0x7f8a9c157670 legacy=0x7f8a9c0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:18.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8aa0e00640 1 -- 172.21.15.148:0/3197904524 >> v1:172.21.15.148:6789/0 conn(0x7f8a9c0cf6c0 legacy=0x7f8a9c156f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:18.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8aa0e00640 1 -- 172.21.15.148:0/3197904524 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c15a620 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/3197904524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0c4bd0 tx=0x7f8a8801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=820c7276762dc90c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:18.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8a9be00640 1 -- 172.21.15.148:0/3197904524 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880b5070 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8a9be00640 1 -- 172.21.15.148:0/3197904524 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a880a89f0 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.339+0000 7f8a9be00640 1 -- 172.21.15.148:0/3197904524 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880a8dc0 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- 172.21.15.148:0/3197904524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c0c9f80 msgr2=0x7f8a9c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 --2- 172.21.15.148:0/3197904524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0c4bd0 tx=0x7f8a8801ecf0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- 172.21.15.148:0/3197904524 shutdown_connections 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 --2- 172.21.15.148:0/3197904524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c0c4510 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- 172.21.15.148:0/3197904524 >> 172.21.15.148:0/3197904524 conn(0x7f8a9c071010 msgr2=0x7f8a9c071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- 172.21.15.148:0/3197904524 shutdown_connections 2024-04-26T23:07:18.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- 172.21.15.148:0/3197904524 wait complete. 2024-04-26T23:07:18.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 Processor -- start 2024-04-26T23:07:18.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- start start 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c1e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c15abe0 con 0x7f8a9c0c9f80 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0ca590 con 0x7f8a9c157670 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa4200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c0c5930 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa1800640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 msgr2=0x7f8a9c1e7960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa1800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c1e7960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa2200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa0e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa2200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:44124/0 (socket says 172.21.15.148:44124) 2024-04-26T23:07:18.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa2200640 1 -- 172.21.15.148:0/297878542 learned_addr learned my addr 172.21.15.148:0/297878542 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:18.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.343+0000 7f8aa0e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:38584/0 (socket says 172.21.15.148:38584) 2024-04-26T23:07:18.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 -- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 msgr2=0x7f8a9c1f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 -- 172.21.15.148:0/297878542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 msgr2=0x7f8a9c1e7960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c1e7960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 -- 172.21.15.148:0/297878542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c06eff0 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa2200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa0e00640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a880af000 tx=0x7f8a8801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880b5040 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c06f2b0 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1f56a0 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a880b0730 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880b0ae0 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.347+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c077c20 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.351+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a880c2030 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.351+0000 7f8a99600640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 0x7f8a7c06a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:18.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.351+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8a881248d0 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.351+0000 7f8aa1800640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 0x7f8a7c06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:18.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.351+0000 7f8aa1800640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 0x7f8a7c06a820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a90003990 tx=0x7f8a90006d90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:18.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.371+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a880c9020 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.583+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8a9c0cae10 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8a99600640 1 -- 172.21.15.148:0/297878542 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8a88018850 con 0x7f8a9c0cf6c0 2024-04-26T23:07:18.587 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:18.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 msgr2=0x7f8a7c06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:18.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 0x7f8a7c06a820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a90003990 tx=0x7f8a90006d90 comp rx=0 tx=0).stop 2024-04-26T23:07:18.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 msgr2=0x7f8a9c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a880af000 tx=0x7f8a8801ba90 comp rx=0 tx=0).stop 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 shutdown_connections 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8a7c068360 0x7f8a7c06a820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a9c157670 0x7f8a9c1f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8a9c0cf6c0 0x7f8a9c15afb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 --2- 172.21.15.148:0/297878542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c0c9f80 0x7f8a9c1e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 >> 172.21.15.148:0/297878542 conn(0x7f8a9c071010 msgr2=0x7f8a9c0cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 shutdown_connections 2024-04-26T23:07:18.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:18.587+0000 7f8aa4200640 1 -- 172.21.15.148:0/297878542 wait complete. 2024-04-26T23:07:21.609 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:21.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.755+0000 7f3cbd600640 1 Processor -- start 2024-04-26T23:07:21.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.755+0000 7f3cbd600640 1 -- start start 2024-04-26T23:07:21.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cbd600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cbd600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cbd600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb80cfb50 con 0x7f3cb80c6340 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cbd600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb80cce10 con 0x7f3cb815c7e0 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cbd600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb80cfe10 con 0x7f3cb80b1d80 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb7400640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 msgr2=0x7f3cb80703f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb7400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cae000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3cb80c6340 0x7f3cb815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:39418/0 (socket says 172.21.15.148:39418) 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 learned_addr learned my addr 172.21.15.148:0/2298423950 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:44130/0 (socket says 172.21.15.148:44130) 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.759+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:21.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb7400640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 msgr2=0x7f3cb80703f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:21.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb7400640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:07:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:07:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:21.963+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:07:22.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb7400640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 msgr2=0x7f3cb80703f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:22.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb7400640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:07:22.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:22.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:07:22.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:22.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:22.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:22.367+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:07:23.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb7400640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 msgr2=0x7f3cb80703f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb7400640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:23.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:23.171+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 msgr2=0x7f3cb806feb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.157:3300/0 conn(0x7f3cb80b1d80 0x7f3cb806feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 -- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 msgr2=0x7f3cb80703f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 --2- 172.21.15.148:0/2298423950 >> v2:172.21.15.148:3300/0 conn(0x7f3cb815c7e0 0x7f3cb80703f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.157:6789/0 conn(0x7f3cb80c6340 legacy=0x7f3cb815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 -- 172.21.15.148:0/2298423950 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb806d650 con 0x7f3c940036c0 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb4c00640 1 -- 172.21.15.148:0/2298423950 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb80cce10 con 0x7f3c94007380 2024-04-26T23:07:24.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.148:6789/0 conn(0x7f3c940036c0 legacy=0x7f3c94005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:24.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:24.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:07:24.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:24.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:24.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.759+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:24.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.148:6789/0 conn(0x7f3c940036c0 legacy=0x7f3c94005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:07:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:24.963+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.148:6789/0 conn(0x7f3c940036c0 legacy=0x7f3c94005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:25.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:25.367+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:07:26.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.171+0000 7f3cb6a00640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.148:6789/0 conn(0x7f3c940036c0 legacy=0x7f3c94005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:26.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.171+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:26.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.171+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 >> v1:172.21.15.148:6789/0 conn(0x7f3c940036c0 legacy=0x7f3c94005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:26.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.171+0000 7f3cae000640 1 -- 172.21.15.148:0/2298423950 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9400b0c0 con 0x7f3c94007380 2024-04-26T23:07:26.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cae000640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0002030 tx=0x7f3ca001d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d16894090c16649 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:26.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cb6000640 1 -- 172.21.15.148:0/2298423950 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ad630 con 0x7f3c94007380 2024-04-26T23:07:26.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cb6000640 1 -- 172.21.15.148:0/2298423950 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca00b2070 con 0x7f3c94007380 2024-04-26T23:07:26.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cb6000640 1 -- 172.21.15.148:0/2298423950 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ad9f0 con 0x7f3c94007380 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 -- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3c94009840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 --2- 172.21.15.148:0/2298423950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3c94009840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0002030 tx=0x7f3ca001d590 comp rx=0 tx=0).stop 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cb7400640 1 -- 172.21.15.148:0/2298423950 reap_dead start 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 -- 172.21.15.148:0/2298423950 shutdown_connections 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 -- 172.21.15.148:0/2298423950 >> 172.21.15.148:0/2298423950 conn(0x7f3cb8071160 msgr2=0x7f3cb8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 -- 172.21.15.148:0/2298423950 shutdown_connections 2024-04-26T23:07:26.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.175+0000 7f3cbd600640 1 -- 172.21.15.148:0/2298423950 wait complete. 2024-04-26T23:07:26.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 Processor -- start 2024-04-26T23:07:26.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 -- start start 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb8156700 0x7f3cb81f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 0x7f3cb815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80b2160 con 0x7f3cb81f5b70 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb806dc10 con 0x7f3cb8156700 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cbd600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb8071970 con 0x7f3c94007380 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb7400640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 msgr2=0x7f3cb815a640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 0x7f3cb815a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:26.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cae000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb8156700 0x7f3cb81f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:38638/0 (socket says 172.21.15.148:38638) 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 -- 172.21.15.148:0/4228121285 learned_addr learned my addr 172.21.15.148:0/4228121285 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 -- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb8156700 msgr2=0x7f3cb81f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb8156700 0x7f3cb81f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 -- 172.21.15.148:0/4228121285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 msgr2=0x7f3cb815a640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 0x7f3cb815a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.179+0000 7f3cb6a00640 1 -- 172.21.15.148:0/4228121285 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb815b380 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3cb6a00640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8013960 tx=0x7f3ca8013e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca801a070 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca800eab0 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800f040 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb81f1a70 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb815b8d0 con 0x7f3c94007380 2024-04-26T23:07:26.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8077c20 con 0x7f3c94007380 2024-04-26T23:07:26.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.183+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ca801d070 con 0x7f3c94007380 2024-04-26T23:07:26.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.187+0000 7f3caf400640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 0x7f3c9406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:26.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.187+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3ca80872a0 con 0x7f3c94007380 2024-04-26T23:07:26.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.187+0000 7f3cae000640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 0x7f3c9406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:26.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.187+0000 7f3cae000640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 0x7f3c9406df90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00b1000 tx=0x7f3ca0010040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:26.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.199+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3ca800ee60 con 0x7f3c94007380 2024-04-26T23:07:26.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.419+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3cb80d0210 con 0x7f3c94007380 2024-04-26T23:07:26.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3caf400640 1 -- 172.21.15.148:0/4228121285 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f3ca8056e80 con 0x7f3c94007380 2024-04-26T23:07:26.423 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":22,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 msgr2=0x7f3c9406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 0x7f3c9406df90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00b1000 tx=0x7f3ca0010040 comp rx=0 tx=0).stop 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 msgr2=0x7f3cb80b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8013960 tx=0x7f3ca8013e20 comp rx=0 tx=0).stop 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 shutdown_connections 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c9406bad0 0x7f3c9406df90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb81f5b70 0x7f3cb815a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb8156700 0x7f3cb81f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 --2- 172.21.15.148:0/4228121285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c94007380 0x7f3cb80b01f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:26.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 >> 172.21.15.148:0/4228121285 conn(0x7f3cb8071160 msgr2=0x7f3cb80cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:26.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 shutdown_connections 2024-04-26T23:07:26.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.423+0000 7f3cbd600640 1 -- 172.21.15.148:0/4228121285 wait complete. 2024-04-26T23:07:26.445 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:07:26.445 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:07:26.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.583+0000 7f1e40000640 1 Processor -- start 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.583+0000 7f1e40000640 1 -- start start 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e40000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 0x7f1e380c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e40000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e38070c70 con 0x7f1e381661e0 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e40000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e38169130 con 0x7f1e3808d8c0 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e40000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1e38072ea0 con 0x7f1e38168c80 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e3d600640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f1e381661e0 legacy=0x7f1e3806f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:27.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 0x7f1e380c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e3e000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1e3808d8c0 0x7f1e38073330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:55560/0 (socket says 172.21.15.148:55560) 2024-04-26T23:07:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e3e000640 1 -- 172.21.15.148:0/3430374448 learned_addr learned my addr 172.21.15.148:0/3430374448 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.587+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803274771 0 0) 0x7f1e38169130 con 0x7f1e3808d8c0 2024-04-26T23:07:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:26.791+0000 7f1e3d600640 1 -- 172.21.15.148:0/3430374448 >> v1:172.21.15.148:6789/0 conn(0x7f1e381661e0 legacy=0x7f1e3806f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.031+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e20003510 con 0x7f1e3808d8c0 2024-04-26T23:07:27.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.031+0000 7f1e3cc00640 1 -- 172.21.15.148:0/3430374448 >> v1:172.21.15.157:6789/0 conn(0x7f1e3808d8c0 legacy=0x7f1e38073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.031+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1482263583 0 0) 0x7f1e20003510 con 0x7f1e3808d8c0 2024-04-26T23:07:27.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.031+0000 7f1e3cc00640 1 -- 172.21.15.148:0/3430374448 >> v1:172.21.15.148:6789/0 conn(0x7f1e381661e0 legacy=0x7f1e3806f460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:27.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.031+0000 7f1e3cc00640 1 -- 172.21.15.148:0/3430374448 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e38169410 con 0x7f1e38168c80 2024-04-26T23:07:27.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e3cc00640 1 --2- 172.21.15.148:0/3430374448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 0x7f1e380c9720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400a890 tx=0x7f1e2401c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4fab0b1d906eac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e240ad070 con 0x7f1e38168c80 2024-04-26T23:07:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e240a9430 con 0x7f1e38168c80 2024-04-26T23:07:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e37e00640 1 -- 172.21.15.148:0/3430374448 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30001a00 con 0x7f1e38168c80 2024-04-26T23:07:27.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 -- 172.21.15.148:0/3430374448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 msgr2=0x7f1e380c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 --2- 172.21.15.148:0/3430374448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 0x7f1e380c9720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400a890 tx=0x7f1e2401c5d0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 -- 172.21.15.148:0/3430374448 shutdown_connections 2024-04-26T23:07:27.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 --2- 172.21.15.148:0/3430374448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e38168c80 0x7f1e380c9720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 -- 172.21.15.148:0/3430374448 >> 172.21.15.148:0/3430374448 conn(0x7f1e380c9d10 msgr2=0x7f1e380ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:27.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 -- 172.21.15.148:0/3430374448 shutdown_connections 2024-04-26T23:07:27.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.035+0000 7f1e40000640 1 -- 172.21.15.148:0/3430374448 wait complete. 2024-04-26T23:07:27.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 Processor -- start 2024-04-26T23:07:27.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- start start 2024-04-26T23:07:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3808d8c0 0x7f1e380c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 0x7f1e38209830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38168c80 0x7f1e38205fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3806fcf0 con 0x7f1e3808d8c0 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3806fb70 con 0x7f1e38168c80 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1e38176d50 con 0x7f1e381661e0 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3d600640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3808d8c0 msgr2=0x7f1e380c6300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3808d8c0 0x7f1e380c6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 0x7f1e38209830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38168c80 0x7f1e38205fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 0x7f1e38209830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:45822/0 (socket says 172.21.15.148:45822) 2024-04-26T23:07:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3cc00640 1 -- 172.21.15.148:0/4206375825 learned_addr learned my addr 172.21.15.148:0/4206375825 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 msgr2=0x7f1e38209830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 0x7f1e38209830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3808d8c0 msgr2=0x7f1e380c6300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e3808d8c0 0x7f1e380c6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380c6c70 con 0x7f1e38168c80 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3cc00640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e381661e0 0x7f1e38209830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e3e000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38168c80 0x7f1e38205fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e30005c10 tx=0x7f1e3000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30017070 con 0x7f1e38168c80 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3000ce50 con 0x7f1e38168c80 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30012640 con 0x7f1e38168c80 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e380c6f50 con 0x7f1e38168c80 2024-04-26T23:07:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.039+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e38209310 con 0x7f1e38168c80 2024-04-26T23:07:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e40000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 0x7f1e382064f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38209550 con 0x7f1e38205990 2024-04-26T23:07:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e3d600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 0x7f1e382064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e3d600640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e38077c20 con 0x7f1e38205990 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e3001a070 con 0x7f1e38168c80 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e3d600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 0x7f1e382064f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c9f0 tx=0x7f1e2c00ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1e18068360 0x7f1e1806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1e30086ca0 con 0x7f1e38168c80 2024-04-26T23:07:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c007da0 con 0x7f1e38205990 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e3cc00640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1e18068360 0x7f1e1806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1e2c007da0 con 0x7f1e38205990 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 msgr2=0x7f1e382064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 0x7f1e382064f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c9f0 tx=0x7f1e2c00ceb0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 msgr2=0x7f1e382064f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.043+0000 7f1e35600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38205990 0x7f1e382064f0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c9f0 tx=0x7f1e2c00ceb0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.047+0000 7f1e3cc00640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1e18068360 0x7f1e1806a820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e2401c610 tx=0x7f1e240b4040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.051+0000 7f1e40000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 0x7f1e380cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.051+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38074250 con 0x7f1e380cc460 2024-04-26T23:07:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.051+0000 7f1e3d600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 0x7f1e380cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.051+0000 7f1e3d600640 1 -- 172.21.15.148:0/4206375825 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e380733d0 con 0x7f1e380cc460 2024-04-26T23:07:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.051+0000 7f1e3d600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 0x7f1e380cc840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c015000 tx=0x7f1e2c0039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c01a040 con 0x7f1e380cc460 2024-04-26T23:07:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5203 (secure 0 0 0) 0x7f1e2c015650 con 0x7f1e380cc460 2024-04-26T23:07:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 msgr2=0x7f1e380cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 0x7f1e380cc840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c015000 tx=0x7f1e2c0039c0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 msgr2=0x7f1e380cc840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e35600640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e380cc460 0x7f1e380cc840 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c015000 tx=0x7f1e2c0039c0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 22, 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 189902, 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:07:27.056 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.057 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.058 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:27.059 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.060 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.062 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.063 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:27.065 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.067 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.068 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:27.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:27.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:27.071 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:27.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1e18068360 msgr2=0x7f1e1806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1e18068360 0x7f1e1806a820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e2401c610 tx=0x7f1e240b4040 comp rx=0 tx=0).stop 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38168c80 msgr2=0x7f1e38205fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 --2- 172.21.15.148:0/4206375825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e38168c80 0x7f1e38205fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e30005c10 tx=0x7f1e3000a430 comp rx=0 tx=0).stop 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e3e000640 1 -- 172.21.15.148:0/4206375825 reap_dead start 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e3e000640 1 -- 172.21.15.148:0/4206375825 reap_dead start 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 shutdown_connections 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 >> 172.21.15.148:0/4206375825 conn(0x7f1e380c9d10 msgr2=0x7f1e38072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 shutdown_connections 2024-04-26T23:07:27.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.055+0000 7f1e40000640 1 -- 172.21.15.148:0/4206375825 wait complete. 2024-04-26T23:07:27.078 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:07:27.078 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:07:27.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:07:27.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.219+0000 7feff4e00640 1 Processor -- start 2024-04-26T23:07:27.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.219+0000 7feff4e00640 1 -- start start 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7feff4e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feff00c9cd0 0x7feff0163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7feff4e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff00c4780 con 0x7feff0152900 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7feff4e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff00c4a20 con 0x7feff00c73a0 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7feff4e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7feff015bc60 con 0x7feff00c9cd0 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7feff0152900 legacy=0x7feff01586f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefefe00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7feff00c9cd0 msgr2=0x7feff0163fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefefe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feff00c9cd0 0x7feff0163fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefe6a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feff00c73a0 0x7feff00731b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:55570/0 (socket says 172.21.15.148:55570) 2024-04-26T23:07:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefe6a00640 1 -- 172.21.15.148:0/2616507727 learned_addr learned my addr 172.21.15.148:0/2616507727 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114936831 0 0) 0x7feff00c4a20 con 0x7feff00c73a0 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd4003530 con 0x7feff00c73a0 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3647803858 0 0) 0x7fefd4003530 con 0x7feff00c73a0 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 >> v2:172.21.15.148:3300/0 conn(0x7feff00c9cd0 msgr2=0x7feff0163fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 --2- 172.21.15.148:0/2616507727 >> v2:172.21.15.148:3300/0 conn(0x7feff00c9cd0 0x7feff0163fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 >> v1:172.21.15.148:6789/0 conn(0x7feff0152900 legacy=0x7feff01586f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff015beb0 con 0x7feff00c73a0 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fefd8001680 con 0x7feff00c73a0 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 >> v1:172.21.15.157:6789/0 conn(0x7feff00c73a0 legacy=0x7feff00731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7fefd4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd4004810 0x7fefd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd4005220 0x7fefd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feff015bc60 con 0x7fefd4005220 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fefd400c130 con 0x7fefd4004810 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fefd400c330 con 0x7fefd40039c0 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefefe00640 1 -- 172.21.15.148:0/2616507727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd4005220 msgr2=0x7fefd400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefefe00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd4005220 0x7fefd400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7fefd4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefe6a00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd4004810 0x7fefd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 -- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd4004810 msgr2=0x7fefd4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd4004810 0x7fefd4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 -- 172.21.15.148:0/2616507727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd4005220 msgr2=0x7fefd400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd4005220 0x7fefd400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefefe00640 1 -- 172.21.15.148:0/2616507727 reap_dead start 2024-04-26T23:07:27.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.223+0000 7fefef400640 1 -- 172.21.15.148:0/2616507727 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd4003530 con 0x7fefd40039c0 2024-04-26T23:07:27.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7fefef400640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7fefd4003dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7480b55d8a418a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0009520 con 0x7fefd40039c0 2024-04-26T23:07:27.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe0003bc0 con 0x7fefd40039c0 2024-04-26T23:07:27.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7fefeea00640 1 -- 172.21.15.148:0/2616507727 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0005070 con 0x7fefd40039c0 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 -- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 msgr2=0x7fefd4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7fefd4003dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe001c400 comp rx=0 tx=0).stop 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 -- 172.21.15.148:0/2616507727 shutdown_connections 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 --2- 172.21.15.148:0/2616507727 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7fefd4003dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 -- 172.21.15.148:0/2616507727 >> 172.21.15.148:0/2616507727 conn(0x7feff006e0a0 msgr2=0x7feff006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 -- 172.21.15.148:0/2616507727 shutdown_connections 2024-04-26T23:07:27.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.227+0000 7feff4e00640 1 -- 172.21.15.148:0/2616507727 wait complete. 2024-04-26T23:07:27.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 Processor -- start 2024-04-26T23:07:27.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 -- start start 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7feff015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff01485a0 0x7feff01e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feff00cbb10 0x7feff00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feff015c990 con 0x7feff01485a0 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feff015c470 con 0x7feff00cbb10 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7feff4e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feff01e38a0 con 0x7fefd40039c0 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefe6a00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff01485a0 msgr2=0x7feff01e1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff01485a0 0x7feff01e1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7feff015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7feff015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:45850/0 (socket says 172.21.15.148:45850) 2024-04-26T23:07:27.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 -- 172.21.15.148:0/3857721989 learned_addr learned my addr 172.21.15.148:0/3857721989 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:27.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefefe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feff00cbb10 0x7feff00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feff00cbb10 msgr2=0x7feff00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feff00cbb10 0x7feff00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff01485a0 msgr2=0x7feff01e1a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff01485a0 0x7feff01e1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff0147800 con 0x7fefd40039c0 2024-04-26T23:07:27.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.231+0000 7fefef400640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7feff015b5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefe001c970 tx=0x7fefd4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0009500 con 0x7fefd40039c0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff0146cf0 con 0x7fefd40039c0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe00039c0 con 0x7fefd40039c0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00adc90 con 0x7fefd40039c0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feff0147ac0 con 0x7fefd40039c0 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7feff4e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 0x7feff01f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feff015a8c0 con 0x7feff0147cc0 2024-04-26T23:07:27.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe6a00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 0x7feff01f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe6a00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feff00506d0 con 0x7feff0147cc0 2024-04-26T23:07:27.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fefe0005070 con 0x7fefd40039c0 2024-04-26T23:07:27.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe6a00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 0x7feff01f2780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feff01e3520 tx=0x7fefd8007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fefcc068360 0x7fefcc06a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.235+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fefe0120120 con 0x7fefd40039c0 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8001690 con 0x7feff0147cc0 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fefd8018070 con 0x7feff0147cc0 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 msgr2=0x7feff01f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 0x7feff01f2780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feff01e3520 tx=0x7fefd8007720 comp rx=0 tx=0).stop 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 msgr2=0x7feff01f2780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefe7e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff0147cc0 0x7feff01f2780 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feff01e3520 tx=0x7fefd8007720 comp rx=0 tx=0).stop 2024-04-26T23:07:27.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefefe00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fefcc068360 0x7fefcc06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.239+0000 7fefefe00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fefcc068360 0x7fefcc06a820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feff00ca0b0 tx=0x7fefe8009560 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7feff4e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 0x7feff01f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:27.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feff01f35e0 con 0x7feff01f2cc0 2024-04-26T23:07:27.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7fefe6a00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 0x7feff01f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:27.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7fefe6a00640 1 -- 172.21.15.148:0/3857721989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feff01e1fa0 con 0x7feff01f2cc0 2024-04-26T23:07:27.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7fefe6a00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 0x7feff01f30a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feff01480c0 tx=0x7fefd8001a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:27.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.243+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd800fe90 con 0x7feff01f2cc0 2024-04-26T23:07:27.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7fefd8026410 con 0x7feff01f2cc0 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 msgr2=0x7feff01f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefe7e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 0x7feff01f30a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feff01480c0 tx=0x7fefd8001a10 comp rx=0 tx=0).stop 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefe7e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 msgr2=0x7feff01f30a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefe7e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feff01f2cc0 0x7feff01f30a0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feff01480c0 tx=0x7fefd8001a10 comp rx=0 tx=0).stop 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:27.247 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 22, 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 190090, 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.249 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.250 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:27.251 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:27.252 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:27.253 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:27.254 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.255 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:27.256 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:27.258 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:27.259 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.260 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:27.261 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.262 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:27.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:27.264 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:27.264 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fefcc068360 msgr2=0x7fefcc06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fefcc068360 0x7fefcc06a820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feff00ca0b0 tx=0x7fefe8009560 comp rx=0 tx=0).stop 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 msgr2=0x7feff015b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 --2- 172.21.15.148:0/3857721989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fefd40039c0 0x7feff015b5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefe001c970 tx=0x7fefd4005840 comp rx=0 tx=0).stop 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefefe00640 1 -- 172.21.15.148:0/3857721989 reap_dead start 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7fefefe00640 1 -- 172.21.15.148:0/3857721989 reap_dead start 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 shutdown_connections 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 >> 172.21.15.148:0/3857721989 conn(0x7feff006e0a0 msgr2=0x7feff00c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 shutdown_connections 2024-04-26T23:07:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:27.247+0000 7feff4e00640 1 -- 172.21.15.148:0/3857721989 wait complete. 2024-04-26T23:07:27.266 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:07:27.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:07:43.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:07:43.287 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:07:47.268 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:07:47.268 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:07:47.268 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:07:47.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:07:47.272 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:07:47.272 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:07:47.272 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:47.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.419+0000 7f1660c00640 1 Processor -- start 2024-04-26T23:07:47.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 -- start start 2024-04-26T23:07:47.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f165c06c5e0 0x7f165c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f165c15f3f0 con 0x7f165c0cb970 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f165c15f690 con 0x7f165c06c5e0 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1660c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f165c15f930 con 0x7f165c06c9c0 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54836/0 (socket says 172.21.15.148:54836) 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 -- 172.21.15.148:0/148363671 learned_addr learned my addr 172.21.15.148:0/148363671 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 -- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 msgr2=0x7f165c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1659e00640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.157:3300/0 conn(0x7f165c06c5e0 0x7f165c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 -- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 msgr2=0x7f165c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 --2- 172.21.15.148:0/148363671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f165a800640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:47.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 -- 172.21.15.148:0/148363671 >> v2:172.21.15.157:3300/0 conn(0x7f165c06c5e0 msgr2=0x7f165c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:47.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.157:3300/0 conn(0x7f165c06c5e0 0x7f165c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 -- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 msgr2=0x7f165c156250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:07:47.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.423+0000 7f1651400640 1 -- 172.21.15.148:0/148363671 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c15fc10 con 0x7f165c06c9c0 2024-04-26T23:07:47.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1651400640 1 --2- 172.21.15.148:0/148363671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c155d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f165c06d460 tx=0x7f164401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d5d29572947562 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:47.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1659400640 1 -- 172.21.15.148:0/148363671 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440b0070 con 0x7f165c06c9c0 2024-04-26T23:07:47.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1659400640 1 -- 172.21.15.148:0/148363671 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440ab600 con 0x7f165c06c9c0 2024-04-26T23:07:47.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1659400640 1 -- 172.21.15.148:0/148363671 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440ab9d0 con 0x7f165c06c9c0 2024-04-26T23:07:47.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 -- 172.21.15.148:0/148363671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 msgr2=0x7f165c155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:47.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 --2- 172.21.15.148:0/148363671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c155d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f165c06d460 tx=0x7f164401c480 comp rx=0 tx=0).stop 2024-04-26T23:07:47.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 -- 172.21.15.148:0/148363671 shutdown_connections 2024-04-26T23:07:47.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.148:3300/0 conn(0x7f165c0cb970 0x7f165c156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 --2- 172.21.15.148:0/148363671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c155d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 --2- 172.21.15.148:0/148363671 >> v2:172.21.15.157:3300/0 conn(0x7f165c06c5e0 0x7f165c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 -- 172.21.15.148:0/148363671 >> 172.21.15.148:0/148363671 conn(0x7f165c073240 msgr2=0x7f165c073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 -- 172.21.15.148:0/148363671 shutdown_connections 2024-04-26T23:07:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.427+0000 7f1660c00640 1 -- 172.21.15.148:0/148363671 wait complete. 2024-04-26T23:07:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 Processor -- start 2024-04-26T23:07:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- start start 2024-04-26T23:07:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f165c0cb970 0x7f165c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0ce530 con 0x7f165c06c5e0 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0ce3b0 con 0x7f165c0cb970 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f165c0ce6b0 con 0x7f165c06c9c0 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54840/0 (socket says 172.21.15.148:54840) 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 -- 172.21.15.148:0/1395792008 learned_addr learned my addr 172.21.15.148:0/1395792008 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 msgr2=0x7f165c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 msgr2=0x7f165c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f165a800640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f165c0cb970 0x7f165c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1659e00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:07:47.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f165c0cb970 msgr2=0x7f165c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f165c0cb970 0x7f165c151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 msgr2=0x7f165c0cca20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 -- 172.21.15.148:0/1395792008 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c15dc20 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1651400640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c1517d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16440ab000 tx=0x7f1644019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440b0040 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16440ab400 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440b4630 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c15ea60 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c15e1c0 con 0x7f165c06c9c0 2024-04-26T23:07:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.431+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c077c20 con 0x7f165c06c9c0 2024-04-26T23:07:47.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.435+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16440bc020 con 0x7f165c06c9c0 2024-04-26T23:07:47.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.435+0000 7f1652a00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 0x7f163806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:47.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.435+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1644120c60 con 0x7f165c06c9c0 2024-04-26T23:07:47.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.435+0000 7f1659e00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 0x7f163806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:47.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.435+0000 7f1659e00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 0x7f163806a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f164c009560 tx=0x7f164c008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:47.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.447+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f16440c3020 con 0x7f165c06c9c0 2024-04-26T23:07:47.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.671+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f165c166540 con 0x7f165c06c9c0 2024-04-26T23:07:47.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.671+0000 7f1652a00640 1 -- 172.21.15.148:0/1395792008 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f1644016070 con 0x7f165c06c9c0 2024-04-26T23:07:47.672 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":22,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:47.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 msgr2=0x7f163806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:47.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 0x7f163806a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f164c009560 tx=0x7f164c008040 comp rx=0 tx=0).stop 2024-04-26T23:07:47.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 msgr2=0x7f165c1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:47.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c1517d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16440ab000 tx=0x7f1644019220 comp rx=0 tx=0).stop 2024-04-26T23:07:47.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 shutdown_connections 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1638068380 0x7f163806a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f165c0cb970 0x7f165c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f165c06c9c0 0x7f165c1517d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 --2- 172.21.15.148:0/1395792008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f165c06c5e0 0x7f165c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 >> 172.21.15.148:0/1395792008 conn(0x7f165c073240 msgr2=0x7f165c073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 shutdown_connections 2024-04-26T23:07:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:47.675+0000 7f1660c00640 1 -- 172.21.15.148:0/1395792008 wait complete. 2024-04-26T23:07:50.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:07:50.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 Processor -- start 2024-04-26T23:07:50.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 -- start start 2024-04-26T23:07:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbcf8153af0 0x7fbcf815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf80c9d90 con 0x7fbcf80c9720 2024-04-26T23:07:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf80ca070 con 0x7fbcf80c7b80 2024-04-26T23:07:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcfd600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf80ca630 con 0x7fbcf8153af0 2024-04-26T23:07:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf7400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbcf80c9720 0x7fbcf81642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32900/0 (socket says 172.21.15.148:32900) 2024-04-26T23:07:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf7400640 1 -- 172.21.15.148:0/2262179503 learned_addr learned my addr 172.21.15.148:0/2262179503 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/2262179503 >> v2:172.21.15.157:3300/0 conn(0x7fbcf8153af0 0x7fbcf815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6000640 1 -- 172.21.15.148:0/2262179503 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832452095 0 0) 0x7fbcf80c9d90 con 0x7fbcf80c9720 2024-04-26T23:07:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6000640 1 -- 172.21.15.148:0/2262179503 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcdc003530 con 0x7fbcf80c9720 2024-04-26T23:07:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6a00640 1 -- 172.21.15.148:0/2262179503 >> v1:172.21.15.157:6789/0 conn(0x7fbcf80c7b80 legacy=0x7fbcf80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6a00640 1 -- 172.21.15.148:0/2262179503 >> v1:172.21.15.148:6789/0 conn(0x7fbcf80c9720 legacy=0x7fbcf81642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.839+0000 7fbcf6a00640 1 -- 172.21.15.148:0/2262179503 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf80ca350 con 0x7fbcf8153af0 2024-04-26T23:07:50.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/2262179503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf8153af0 0x7fbcf815d7b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097c0 tx=0x7fbce801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1666a5590048af5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:50.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcf6000640 1 -- 172.21.15.148:0/2262179503 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80b5070 con 0x7fbcf8153af0 2024-04-26T23:07:50.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcf6000640 1 -- 172.21.15.148:0/2262179503 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce80a8990 con 0x7fbcf8153af0 2024-04-26T23:07:50.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcf6000640 1 -- 172.21.15.148:0/2262179503 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80a8d60 con 0x7fbcf8153af0 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 -- 172.21.15.148:0/2262179503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf8153af0 msgr2=0x7fbcf815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 --2- 172.21.15.148:0/2262179503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf8153af0 0x7fbcf815d7b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097c0 tx=0x7fbce801ec90 comp rx=0 tx=0).stop 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 -- 172.21.15.148:0/2262179503 shutdown_connections 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 --2- 172.21.15.148:0/2262179503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf8153af0 0x7fbcf815d7b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 -- 172.21.15.148:0/2262179503 >> 172.21.15.148:0/2262179503 conn(0x7fbcf806c380 msgr2=0x7fbcf806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 -- 172.21.15.148:0/2262179503 shutdown_connections 2024-04-26T23:07:50.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.843+0000 7fbcfd600640 1 -- 172.21.15.148:0/2262179503 wait complete. 2024-04-26T23:07:50.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 Processor -- start 2024-04-26T23:07:50.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 -- start start 2024-04-26T23:07:50.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 0x7fbcf8158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:50.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 0x7fbcf80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8153ed0 con 0x7fbcf8153af0 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf815d290 con 0x7fbcf80c7b80 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf8154050 con 0x7fbcf80c9720 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54848/0 (socket says 172.21.15.148:54848) 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 -- 172.21.15.148:0/4113841205 learned_addr learned my addr 172.21.15.148:0/4113841205 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcee000640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 0x7fbcf80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 0x7fbcf8158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 -- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 msgr2=0x7fbcf80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 0x7fbcf80cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 -- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 msgr2=0x7fbcf8158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 0x7fbcf8158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:50.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 -- 172.21.15.148:0/4113841205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf81f2190 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcee000640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 0x7fbcf80cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 0x7fbcf8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcf7400640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000cb40 tx=0x7fbcf000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf000ac40 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0012620 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.847+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf81571d0 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81f2450 con 0x7fbcf8153af0 2024-04-26T23:07:50.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf8077c20 con 0x7fbcf8153af0 2024-04-26T23:07:50.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcf001a070 con 0x7fbcf8153af0 2024-04-26T23:07:50.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcef400640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 0x7fbcd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:50.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbcf0086cd0 con 0x7fbcf8153af0 2024-04-26T23:07:50.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.851+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 0x7fbcd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:50.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.855+0000 7fbcf6a00640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 0x7fbcd406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce80b2000 tx=0x7fbce8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:50.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:50.859+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbcf0056d60 con 0x7fbcf8153af0 2024-04-26T23:07:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbcf80c8670 con 0x7fbcf8153af0 2024-04-26T23:07:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcef400640 1 -- 172.21.15.148:0/4113841205 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fbcf0056660 con 0x7fbcf8153af0 2024-04-26T23:07:51.075 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 msgr2=0x7fbcd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 0x7fbcd406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce80b2000 tx=0x7fbce8008040 comp rx=0 tx=0).stop 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 msgr2=0x7fbcf80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000cb40 tx=0x7fbcf000a060 comp rx=0 tx=0).stop 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 shutdown_connections 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbcd4068380 0x7fbcd406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf8153af0 0x7fbcf80cc170 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf80c9720 0x7fbcf80cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 --2- 172.21.15.148:0/4113841205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf80c7b80 0x7fbcf8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 >> 172.21.15.148:0/4113841205 conn(0x7fbcf806c380 msgr2=0x7fbcf815c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 shutdown_connections 2024-04-26T23:07:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.075+0000 7fbcfd600640 1 -- 172.21.15.148:0/4113841205 wait complete. 2024-04-26T23:07:51.096 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:07:51.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:07:51.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:07:51.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 Processor -- start 2024-04-26T23:07:51.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 -- start start 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f29b8156040 0x7f29b8070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b80706c0 con 0x7f29b80c7b10 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b80709a0 con 0x7f29b8073760 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bfa00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f29b8070c80 con 0x7f29b8156040 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29afe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f29b80c7b10 0x7f29b815c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32914/0 (socket says 172.21.15.148:32914) 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29afe00640 1 -- 172.21.15.148:0/3936840225 learned_addr learned my addr 172.21.15.148:0/3936840225 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29bd000640 1 --2- 172.21.15.148:0/3936840225 >> v2:172.21.15.157:3300/0 conn(0x7f29b8156040 0x7f29b8070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.235+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035951434 0 0) 0x7f29b80706c0 con 0x7f29b80c7b10 2024-04-26T23:07:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f299c003530 con 0x7f29b80c7b10 2024-04-26T23:07:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1417822411 0 0) 0x7f299c003530 con 0x7f29b80c7b10 2024-04-26T23:07:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 >> v2:172.21.15.157:3300/0 conn(0x7f29b8156040 msgr2=0x7f29b8070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 --2- 172.21.15.148:0/3936840225 >> v2:172.21.15.157:3300/0 conn(0x7f29b8156040 0x7f29b8070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 >> v1:172.21.15.157:6789/0 conn(0x7f29b8073760 legacy=0x7f29b806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8072c80 con 0x7f29b80c7b10 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f29a0001680 con 0x7f29b80c7b10 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 >> v1:172.21.15.148:6789/0 conn(0x7f29b80c7b10 legacy=0x7f29b815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f299c0039c0 0x7f299c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f299c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c0051d0 0x7f299c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8070c80 con 0x7f299c004810 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f299c00c050 con 0x7f299c0051d0 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f299c00c250 con 0x7f299c0039c0 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f299c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29bd000640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f299c0039c0 0x7f299c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29bda00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c0051d0 0x7f299c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 -- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f299c0039c0 msgr2=0x7f299c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f299c0039c0 0x7f299c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 -- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c0051d0 msgr2=0x7f299c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c0051d0 0x7f299c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29bda00640 1 -- 172.21.15.148:0/3936840225 reap_dead start 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 -- 172.21.15.148:0/3936840225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c003530 con 0x7f299c004810 2024-04-26T23:07:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29bd000640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f299c0039c0 0x7f299c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:07:51.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.239+0000 7f29afe00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f299c004c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c210 tx=0x7f29a001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959598384a254ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0007d40 con 0x7f299c004810 2024-04-26T23:07:51.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0005b00 con 0x7f299c004810 2024-04-26T23:07:51.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29b7e00640 1 -- 172.21.15.148:0/3936840225 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0007070 con 0x7f299c004810 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 msgr2=0x7f299c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f299c004c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c210 tx=0x7f29a001f3b0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- 172.21.15.148:0/3936840225 shutdown_connections 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 --2- 172.21.15.148:0/3936840225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f299c004c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- 172.21.15.148:0/3936840225 >> 172.21.15.148:0/3936840225 conn(0x7f29b80c9d10 msgr2=0x7f29b80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- 172.21.15.148:0/3936840225 shutdown_connections 2024-04-26T23:07:51.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- 172.21.15.148:0/3936840225 wait complete. 2024-04-26T23:07:51.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 Processor -- start 2024-04-26T23:07:51.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- start start 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f29b81f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29b8152bf0 0x7f29b80c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29b81e66d0 0x7f29b81e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8156420 con 0x7f299c004810 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8073240 con 0x7f29b8152bf0 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bfa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f29b80c9330 con 0x7f29b81e66d0 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bd000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f29b81f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bd000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f29b81f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54866/0 (socket says 172.21.15.148:54866) 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bd000640 1 -- 172.21.15.148:0/756461532 learned_addr learned my addr 172.21.15.148:0/756461532 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.243+0000 7f29bda00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29b81e66d0 0x7f29b81e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29afe00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29b8152bf0 0x7f29b80c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29b81e66d0 msgr2=0x7f29b81e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29b81e66d0 0x7f29b81e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29b8152bf0 msgr2=0x7f29b80c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29b8152bf0 0x7f29b80c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81e7090 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bd000640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f29b81f20a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29a8011540 tx=0x7f29a8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8004220 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a80043c0 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b80c7640 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8015890 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b80c7080 con 0x7f299c004810 2024-04-26T23:07:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bfa00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 0x7f29b8145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8077c20 con 0x7f29b80c48f0 2024-04-26T23:07:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29afe00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 0x7f29b8145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29afe00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29b8072720 con 0x7f29b80c48f0 2024-04-26T23:07:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29afe00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 0x7f29b8145a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29b815cf60 tx=0x7f29a001c150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00c0070 con 0x7f29b80c48f0 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f29a8015a30 con 0x7f299c004810 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29940682b0 0x7f299406a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.247+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f29a8087270 con 0x7f299c004810 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f29a00b6070 con 0x7f29b80c48f0 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 msgr2=0x7f29b8145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29b5600640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 0x7f29b8145a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29b815cf60 tx=0x7f29a001c150 comp rx=0 tx=0).stop 2024-04-26T23:07:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 msgr2=0x7f29b8145a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29b5600640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b80c48f0 0x7f29b8145a60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29bda00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29940682b0 0x7f299406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.251+0000 7f29bda00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29940682b0 0x7f299406a770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29b8068d60 tx=0x7f29b0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29bfa00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 0x7f29b81f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8151ae0 con 0x7f29b8145fa0 2024-04-26T23:07:51.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29afe00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 0x7f29b81f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29afe00640 1 -- 172.21.15.148:0/756461532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f29b80c4d30 con 0x7f29b8145fa0 2024-04-26T23:07:51.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29afe00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 0x7f29b81f4b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29a001f3f0 tx=0x7f299c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00c36c0 con 0x7f29b8145fa0 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7f29a00c36c0 con 0x7f29b8145fa0 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 msgr2=0x7f29b81f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 0x7f29b81f4b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29a001f3f0 tx=0x7f299c005840 comp rx=0 tx=0).stop 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 msgr2=0x7f29b81f4b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.255+0000 7f29b5600640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8145fa0 0x7f29b81f4b90 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29a001f3f0 tx=0x7f299c005840 comp rx=0 tx=0).stop 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 3879, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:51.270 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29940682b0 msgr2=0x7f299406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29940682b0 0x7f299406a770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29b8068d60 tx=0x7f29b0009040 comp rx=0 tx=0).stop 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 msgr2=0x7f29b81f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 --2- 172.21.15.148:0/756461532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c004810 0x7f29b81f20a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29a8011540 tx=0x7f29a8011a00 comp rx=0 tx=0).stop 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bda00640 1 -- 172.21.15.148:0/756461532 reap_dead start 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bda00640 1 -- 172.21.15.148:0/756461532 reap_dead start 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 shutdown_connections 2024-04-26T23:07:51.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 >> 172.21.15.148:0/756461532 conn(0x7f29b80c9d10 msgr2=0x7f29b8073bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 shutdown_connections 2024-04-26T23:07:51.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.259+0000 7f29bfa00640 1 -- 172.21.15.148:0/756461532 wait complete. 2024-04-26T23:07:51.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:51.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:07:51.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:07:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 Processor -- start 2024-04-26T23:07:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 -- start start 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6a8157250 0x7fc6a806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a80c49e0 con 0x7fc6a80c44a0 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a80cbb50 con 0x7fc6a8157250 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6af400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80caf80 con 0x7fc6a815d8a0 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6a8157250 0x7fc6a806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6a8157250 0x7fc6a806ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54892/0 (socket says 172.21.15.148:54892) 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 -- 172.21.15.148:0/3035432932 learned_addr learned my addr 172.21.15.148:0/3035432932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc69fe00640 1 --1- 172.21.15.148:0/3035432932 >> v1:172.21.15.148:6789/0 conn(0x7fc6a80c44a0 0x7fc6a815d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32930/0 (socket says 172.21.15.148:32930) 2024-04-26T23:07:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6ad400640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 -- 172.21.15.148:0/3035432932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 msgr2=0x7fc6a8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 -- 172.21.15.148:0/3035432932 >> v1:172.21.15.148:6789/0 conn(0x7fc6a80c44a0 legacy=0x7fc6a815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6aca00640 1 -- 172.21.15.148:0/3035432932 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a80c6450 con 0x7fc6a8157250 2024-04-26T23:07:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.415+0000 7fc6a7e00640 1 -- 172.21.15.148:0/3035432932 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358151884 0 0) 0x7fc6a80c49e0 con 0x7fc6a80c44a0 2024-04-26T23:07:51.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a806ff00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80cbcd0 tx=0x7fc69801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1034975c98a86883 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6a7e00640 1 -- 172.21.15.148:0/3035432932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980b1070 con 0x7fc6a8157250 2024-04-26T23:07:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6a7e00640 1 -- 172.21.15.148:0/3035432932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6980ac600 con 0x7fc6a8157250 2024-04-26T23:07:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6a7e00640 1 -- 172.21.15.148:0/3035432932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980ac9d0 con 0x7fc6a8157250 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 -- 172.21.15.148:0/3035432932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 msgr2=0x7fc6a806ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a806ff00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80cbcd0 tx=0x7fc69801c4b0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 -- 172.21.15.148:0/3035432932 shutdown_connections 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 --2- 172.21.15.148:0/3035432932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a806ff00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 -- 172.21.15.148:0/3035432932 >> 172.21.15.148:0/3035432932 conn(0x7fc6a8068140 msgr2=0x7fc6a8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 -- 172.21.15.148:0/3035432932 shutdown_connections 2024-04-26T23:07:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.419+0000 7fc6af400640 1 -- 172.21.15.148:0/3035432932 wait complete. 2024-04-26T23:07:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 Processor -- start 2024-04-26T23:07:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- start start 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80c44a0 0x7fc6a81f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a81f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80b26c0 con 0x7fc6a8157250 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8157630 con 0x7fc6a80c44a0 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80b2840 con 0x7fc6a815d8a0 2024-04-26T23:07:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a81f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a81f8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54894/0 (socket says 172.21.15.148:54894) 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 -- 172.21.15.148:0/3792922066 learned_addr learned my addr 172.21.15.148:0/3792922066 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80c44a0 0x7fc6a81f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6ad400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 msgr2=0x7fc6a81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6a815d8a0 0x7fc6a81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80c44a0 msgr2=0x7fc6a81f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80c44a0 0x7fc6a81f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a80c6b90 con 0x7fc6a8157250 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc69fe00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a81f8cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6900011f0 tx=0x7fc69000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690018070 con 0x7fc6a8157250 2024-04-26T23:07:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6900074e0 con 0x7fc6a8157250 2024-04-26T23:07:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690004a10 con 0x7fc6a8157250 2024-04-26T23:07:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a81627a0 con 0x7fc6a8157250 2024-04-26T23:07:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.423+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a81f84c0 con 0x7fc6a8157250 2024-04-26T23:07:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6af400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 0x7fc6a806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81f8690 con 0x7fc6a8162ed0 2024-04-26T23:07:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 0x7fc6a806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6aca00640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6a8077c20 con 0x7fc6a8162ed0 2024-04-26T23:07:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 0x7fc6a806f120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8070bc0 tx=0x7fc698019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc690004bb0 con 0x7fc6a8157250 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6840683b0 0x7fc68406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc690085f70 con 0x7fc6a8157250 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980b1040 con 0x7fc6a8162ed0 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6980acd60 con 0x7fc6a8162ed0 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 msgr2=0x7fc6a806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 0x7fc6a806f120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8070bc0 tx=0x7fc698019250 comp rx=0 tx=0).stop 2024-04-26T23:07:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 msgr2=0x7fc6a806f120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6a5600640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a8162ed0 0x7fc6a806f120 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8070bc0 tx=0x7fc698019250 comp rx=0 tx=0).stop 2024-04-26T23:07:51.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.427+0000 7fc6ad400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6840683b0 0x7fc68406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.431+0000 7fc6ad400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6840683b0 0x7fc68406a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00073f0 tx=0x7fc6a000b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6af400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 0x7fc6a80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a815cdc0 con 0x7fc6a80b1730 2024-04-26T23:07:51.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 0x7fc6a80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6aca00640 1 -- 172.21.15.148:0/3792922066 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6a80ca540 con 0x7fc6a80b1730 2024-04-26T23:07:51.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6aca00640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 0x7fc6a80ced80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc69801a0e0 tx=0x7fc698009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980b1040 con 0x7fc6a80b1730 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7fc6980c17f0 con 0x7fc6a80b1730 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 msgr2=0x7fc6a80ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 0x7fc6a80ced80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc69801a0e0 tx=0x7fc698009240 comp rx=0 tx=0).stop 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 msgr2=0x7fc6a80ced80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.435+0000 7fc6a5600640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a80b1730 0x7fc6a80ced80 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc69801a0e0 tx=0x7fc698009240 comp rx=0 tx=0).stop 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 214282, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:07:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:51.453 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6840683b0 msgr2=0x7fc68406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6840683b0 0x7fc68406a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00073f0 tx=0x7fc6a000b040 comp rx=0 tx=0).stop 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 msgr2=0x7fc6a81f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 --2- 172.21.15.148:0/3792922066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a8157250 0x7fc6a81f8cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6900011f0 tx=0x7fc69000c9b0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6ad400640 1 -- 172.21.15.148:0/3792922066 reap_dead start 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6ad400640 1 -- 172.21.15.148:0/3792922066 reap_dead start 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 shutdown_connections 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 >> 172.21.15.148:0/3792922066 conn(0x7fc6a8068140 msgr2=0x7fc6a81554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 shutdown_connections 2024-04-26T23:07:51.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.439+0000 7fc6af400640 1 -- 172.21.15.148:0/3792922066 wait complete. 2024-04-26T23:07:51.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:51.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:07:51.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:07:51.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 Processor -- start 2024-04-26T23:07:51.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 -- start start 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9fc155e80 0x7fb9fc15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9fc0b1f60 0x7fb9fc1665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc1601b0 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc06d610 con 0x7fb9fc155e80 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fba00c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc15f3f0 con 0x7fb9fc0b1f60 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fb9f9e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9fc155e80 0x7fb9fc15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fb9f1400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb9fc0ccc10 0x7fb9fc06ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32944/0 (socket says 172.21.15.148:32944) 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fb9f9e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9fc155e80 0x7fb9fc15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54898/0 (socket says 172.21.15.148:54898) 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.595+0000 7fb9f1400640 1 -- 172.21.15.148:0/3215422761 learned_addr learned my addr 172.21.15.148:0/3215422761 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9fa800640 1 --2- 172.21.15.148:0/3215422761 >> v2:172.21.15.157:3300/0 conn(0x7fb9fc0b1f60 0x7fb9fc1665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9e00640 1 -- 172.21.15.148:0/3215422761 >> v2:172.21.15.157:3300/0 conn(0x7fb9fc0b1f60 msgr2=0x7fb9fc1665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3215422761 >> v2:172.21.15.157:3300/0 conn(0x7fb9fc0b1f60 0x7fb9fc1665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9e00640 1 -- 172.21.15.148:0/3215422761 >> v1:172.21.15.148:6789/0 conn(0x7fb9fc0ccc10 legacy=0x7fb9fc06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9e00640 1 -- 172.21.15.148:0/3215422761 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc15f6d0 con 0x7fb9fc155e80 2024-04-26T23:07:51.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9400640 1 -- 172.21.15.148:0/3215422761 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454166843 0 0) 0x7fb9fc1601b0 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3215422761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc155e80 0x7fb9fc15bc60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b5c77913a14f3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9400640 1 -- 172.21.15.148:0/3215422761 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b0070 con 0x7fb9fc155e80 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9400640 1 -- 172.21.15.148:0/3215422761 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0ab600 con 0x7fb9fc155e80 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.599+0000 7fb9f9400640 1 -- 172.21.15.148:0/3215422761 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ab9d0 con 0x7fb9fc155e80 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- 172.21.15.148:0/3215422761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc155e80 msgr2=0x7fb9fc15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- 172.21.15.148:0/3215422761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc155e80 0x7fb9fc15bc60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- 172.21.15.148:0/3215422761 shutdown_connections 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- 172.21.15.148:0/3215422761 >> v2:172.21.15.157:3300/0 conn(0x7fb9fc0b1f60 0x7fb9fc1665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- 172.21.15.148:0/3215422761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc155e80 0x7fb9fc15bc60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- 172.21.15.148:0/3215422761 >> 172.21.15.148:0/3215422761 conn(0x7fb9fc068140 msgr2=0x7fb9fc068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- 172.21.15.148:0/3215422761 shutdown_connections 2024-04-26T23:07:51.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- 172.21.15.148:0/3215422761 wait complete. 2024-04-26T23:07:51.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 Processor -- start 2024-04-26T23:07:51.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- start start 2024-04-26T23:07:51.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc0b1f60 0x7fb9fc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 0x7fb9fc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9fc155e80 0x7fb9fc0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc070790 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc070610 con 0x7fb9fc155e80 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fba00c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc169340 con 0x7fb9fc0b1f60 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 0x7fb9fc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc0b1f60 0x7fb9fc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 0x7fb9fc0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54904/0 (socket says 172.21.15.148:54904) 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 -- 172.21.15.148:0/3499840093 learned_addr learned my addr 172.21.15.148:0/3499840093 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9fa800640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9fc155e80 0x7fb9fc0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc0b1f60 msgr2=0x7fb9fc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc0b1f60 0x7fb9fc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9fc155e80 msgr2=0x7fb9fc0b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9fc155e80 0x7fb9fc0b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc0b2f60 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.603+0000 7fb9f1400640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 0x7fb9fc0b45d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400c4b0 tx=0x7fb9e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4018070 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e4007500 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4004a30 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc0b3200 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc0b3810 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fba00c00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 0x7fb9fc0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc15a7a0 con 0x7fb9fc166610 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 0x7fb9fc0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f9e00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9fc0d0070 con 0x7fb9fc166610 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb9e4004bd0 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 0x7fb9fc0b3a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0c44a0 tx=0x7fb9ec019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9d8068380 0x7fb9d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb9e4086180 con 0x7fb9fc0ccc10 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0bc070 con 0x7fb9fc166610 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9fa800640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9d8068380 0x7fb9d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb9ec0b1040 con 0x7fb9fc166610 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 msgr2=0x7fb9fc0b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 0x7fb9fc0b3a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0c44a0 tx=0x7fb9ec019170 comp rx=0 tx=0).stop 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 msgr2=0x7fb9fc0b3a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.607+0000 7fb9f2a00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc166610 0x7fb9fc0b3a50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.611+0000 7fb9fa800640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9d8068380 0x7fb9d806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc159590 tx=0x7fb9f4009780 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.615+0000 7fba00c00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 0x7fb9fc1f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.615+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc077c20 con 0x7fb9fc1f83e0 2024-04-26T23:07:51.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.615+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 0x7fb9fc1f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.615+0000 7fb9f9e00640 1 -- 172.21.15.148:0/3499840093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9fc159680 con 0x7fb9fc1f83e0 2024-04-26T23:07:51.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f9e00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 0x7fb9fc1f87f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec01a000 tx=0x7fb9ec009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b0040 con 0x7fb9fc1f83e0 2024-04-26T23:07:51.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5069 (secure 0 0 0) 0x7fb9ec0093e0 con 0x7fb9fc1f83e0 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 msgr2=0x7fb9fc1f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 0x7fb9fc1f87f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec01a000 tx=0x7fb9ec009190 comp rx=0 tx=0).stop 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 msgr2=0x7fb9fc1f87f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9f2a00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9fc1f83e0 0x7fb9fc1f87f0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec01a000 tx=0x7fb9ec009190 comp rx=0 tx=0).stop 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:51.620 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 214466, 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.621 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.622 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:07:51.623 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:07:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.625 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:07:51.630 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:07:51.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:07:51.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:07:51.634 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:07:51.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:07:51.634 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:07:51.634 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9d8068380 msgr2=0x7fb9d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb9d8068380 0x7fb9d806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc159590 tx=0x7fb9f4009780 comp rx=0 tx=0).stop 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 msgr2=0x7fb9fc0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 --2- 172.21.15.148:0/3499840093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9fc0ccc10 0x7fb9fc0b45d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400c4b0 tx=0x7fb9e400c970 comp rx=0 tx=0).stop 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9fa800640 1 -- 172.21.15.148:0/3499840093 reap_dead start 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fb9fa800640 1 -- 172.21.15.148:0/3499840093 reap_dead start 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 shutdown_connections 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 >> 172.21.15.148:0/3499840093 conn(0x7fb9fc068140 msgr2=0x7fb9fc06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 shutdown_connections 2024-04-26T23:07:51.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.619+0000 7fba00c00640 1 -- 172.21.15.148:0/3499840093 wait complete. 2024-04-26T23:07:51.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:07:51.639 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:07:51.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:07:51.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.779+0000 7fe2a7e00640 1 Processor -- start 2024-04-26T23:07:51.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 -- start start 2024-04-26T23:07:51.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80c9ef0 0x7fe2a8158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2a80ca680 0x7fe2a8159400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a80c5f40 con 0x7fe2a80cc290 2024-04-26T23:07:51.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a8159940 con 0x7fe2a80ca680 2024-04-26T23:07:51.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a806d630 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a6a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe2a80cc290 0x7fe2a80cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32954/0 (socket says 172.21.15.148:32954) 2024-04-26T23:07:51.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a6a00640 1 -- 172.21.15.148:0/925910481 learned_addr learned my addr 172.21.15.148:0/925910481 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:07:51.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe29e000640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80c9ef0 0x7fe2a8158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7400640 1 --2- 172.21.15.148:0/925910481 >> v2:172.21.15.157:3300/0 conn(0x7fe2a80ca680 0x7fe2a8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756321067 0 0) 0x7fe2a80c5f40 con 0x7fe2a80cc290 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe28c003530 con 0x7fe2a80cc290 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1025778448 0 0) 0x7fe28c003530 con 0x7fe2a80cc290 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7400640 1 -- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80c9ef0 msgr2=0x7fe2a8158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7400640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80c9ef0 0x7fe2a8158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7400640 1 -- 172.21.15.148:0/925910481 >> v1:172.21.15.148:6789/0 conn(0x7fe2a80cc290 legacy=0x7fe2a80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.783+0000 7fe2a7400640 1 -- 172.21.15.148:0/925910481 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a806d910 con 0x7fe2a80ca680 2024-04-26T23:07:51.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7400640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a8159400 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a001f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5526d62afcd3475f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00b5070 con 0x7fe2a80ca680 2024-04-26T23:07:51.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00a8bd0 con 0x7fe2a80ca680 2024-04-26T23:07:51.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a6000640 1 -- 172.21.15.148:0/925910481 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298001680 con 0x7fe2a80ca680 2024-04-26T23:07:51.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 -- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 msgr2=0x7fe2a8159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a8159400 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a001f080 comp rx=0 tx=0).stop 2024-04-26T23:07:51.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 -- 172.21.15.148:0/925910481 shutdown_connections 2024-04-26T23:07:51.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a8159400 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/925910481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80c9ef0 0x7fe2a8158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 -- 172.21.15.148:0/925910481 >> 172.21.15.148:0/925910481 conn(0x7fe2a806c780 msgr2=0x7fe2a80704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:51.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 -- 172.21.15.148:0/925910481 shutdown_connections 2024-04-26T23:07:51.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.787+0000 7fe2a7e00640 1 -- 172.21.15.148:0/925910481 wait complete. 2024-04-26T23:07:51.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 Processor -- start 2024-04-26T23:07:51.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- start start 2024-04-26T23:07:51.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a81ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80cc290 0x7fe2a80c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a806f3d0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a806f250 con 0x7fe2a80ca680 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80c6380 con 0x7fe2a80cc290 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54908/0 (socket says 172.21.15.148:54908) 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 -- 172.21.15.148:0/1640054685 learned_addr learned my addr 172.21.15.148:0/1640054685 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe29e000640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a81ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7400640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80cc290 0x7fe2a80c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 -- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80cc290 msgr2=0x7fe2a80c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80cc290 0x7fe2a80c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 -- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 msgr2=0x7fe2a81ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:51.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a81ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 -- 172.21.15.148:0/1640054685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80c9880 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a6a00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c750 tx=0x7fe29800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298005ae0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298005ca0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a8156030 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980072b0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a81f57f0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.791+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a81e87b0 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.795+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe298007450 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.795+0000 7fe29f400640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 0x7fe28406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:07:51.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.795+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe298086c10 con 0x7fe2a80c9ef0 2024-04-26T23:07:51.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.795+0000 7fe29e000640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 0x7fe28406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:07:51.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.795+0000 7fe29e000640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 0x7fe28406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80cae60 tx=0x7fe290009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:07:51.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:51.799+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe298056dc0 con 0x7fe2a80c9ef0 2024-04-26T23:07:52.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.019+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe2a80506d0 con 0x7fe2a80c9ef0 2024-04-26T23:07:52.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.019+0000 7fe29f400640 1 -- 172.21.15.148:0/1640054685 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe2980566c0 con 0x7fe2a80c9ef0 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 msgr2=0x7fe28406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 0x7fe28406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80cae60 tx=0x7fe290009190 comp rx=0 tx=0).stop 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 msgr2=0x7fe2a8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c750 tx=0x7fe29800cc10 comp rx=0 tx=0).stop 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 shutdown_connections 2024-04-26T23:07:52.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe284068380 0x7fe28406a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2a80cc290 0x7fe2a80c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2a80ca680 0x7fe2a81ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 --2- 172.21.15.148:0/1640054685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a80c9ef0 0x7fe2a8155af0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 >> 172.21.15.148:0/1640054685 conn(0x7fe2a806c780 msgr2=0x7fe2a80cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 shutdown_connections 2024-04-26T23:07:52.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:07:52.023+0000 7fe2a7e00640 1 -- 172.21.15.148:0/1640054685 wait complete. 2024-04-26T23:07:52.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:08:02.043 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:08:02.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 Processor -- start 2024-04-26T23:08:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 -- start start 2024-04-26T23:08:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f22cc0c4580 0x7f22cc0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc0cf620 con 0x7f22cc1573a0 2024-04-26T23:08:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0ca5a0 con 0x7f22cc0c4580 2024-04-26T23:08:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.191+0000 7f22d3400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc0cf900 con 0x7f22cc0c5810 2024-04-26T23:08:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22c3e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f22cc0c4580 0x7f22cc0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:41414/0 (socket says 172.21.15.148:41414) 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 -- 172.21.15.148:0/574220471 learned_addr learned my addr 172.21.15.148:0/574220471 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d0a00640 1 --1- 172.21.15.148:0/574220471 >> v1:172.21.15.157:6789/0 conn(0x7f22cc1573a0 0x7f22cc0722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:39238/0 (socket says 172.21.15.148:39238) 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 -- 172.21.15.148:0/574220471 >> v2:172.21.15.157:3300/0 conn(0x7f22cc0c4580 msgr2=0x7f22cc0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 --2- 172.21.15.148:0/574220471 >> v2:172.21.15.157:3300/0 conn(0x7f22cc0c4580 0x7f22cc0c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 -- 172.21.15.148:0/574220471 >> v1:172.21.15.157:6789/0 conn(0x7f22cc1573a0 legacy=0x7f22cc0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 -- 172.21.15.148:0/574220471 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc0cfbe0 con 0x7f22cc0c5810 2024-04-26T23:08:02.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.195+0000 7f22d1400640 1 --2- 172.21.15.148:0/574220471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009e50 tx=0x7f22c401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359f133866d23222 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22cbe00640 1 -- 172.21.15.148:0/574220471 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40a5660 con 0x7f22cc0c5810 2024-04-26T23:08:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22cbe00640 1 -- 172.21.15.148:0/574220471 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c40a5800 con 0x7f22cc0c5810 2024-04-26T23:08:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22cbe00640 1 -- 172.21.15.148:0/574220471 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40a5bd0 con 0x7f22cc0c5810 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- 172.21.15.148:0/574220471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 msgr2=0x7f22cc15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- 172.21.15.148:0/574220471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009e50 tx=0x7f22c401c9a0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- 172.21.15.148:0/574220471 shutdown_connections 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- 172.21.15.148:0/574220471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc15d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- 172.21.15.148:0/574220471 >> v2:172.21.15.157:3300/0 conn(0x7f22cc0c4580 0x7f22cc0c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- 172.21.15.148:0/574220471 >> 172.21.15.148:0/574220471 conn(0x7f22cc0704d0 msgr2=0x7f22cc0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- 172.21.15.148:0/574220471 shutdown_connections 2024-04-26T23:08:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- 172.21.15.148:0/574220471 wait complete. 2024-04-26T23:08:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 Processor -- start 2024-04-26T23:08:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- start start 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22cc0c4580 0x7f22cc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0729c0 con 0x7f22cc1573a0 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc15dce0 con 0x7f22cc0c4580 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.199+0000 7f22d3400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc072b40 con 0x7f22cc0c5810 2024-04-26T23:08:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58532/0 (socket says 172.21.15.148:58532) 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 -- 172.21.15.148:0/1051683073 learned_addr learned my addr 172.21.15.148:0/1051683073 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22c3e00640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d0a00640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22cc0c4580 0x7f22cc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 -- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 msgr2=0x7f22cc0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 -- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22cc0c4580 msgr2=0x7f22cc06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22cc0c4580 0x7f22cc06d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 -- 172.21.15.148:0/1051683073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc1510e0 con 0x7f22cc1573a0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d1400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22c40af040 tx=0x7f22c4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b8470 con 0x7f22cc1573a0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c40b8610 con 0x7f22cc1573a0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b8a00 con 0x7f22cc1573a0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc06f430 con 0x7f22cc1573a0 2024-04-26T23:08:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc0b4cb0 con 0x7f22cc1573a0 2024-04-26T23:08:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22cc077c20 con 0x7f22cc1573a0 2024-04-26T23:08:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.203+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22c40c0020 con 0x7f22cc1573a0 2024-04-26T23:08:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.207+0000 7f22c9600640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 0x7f22a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.207+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f22c4121440 con 0x7f22cc1573a0 2024-04-26T23:08:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.207+0000 7f22d0a00640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 0x7f22a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.207+0000 7f22d0a00640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 0x7f22a806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22bc000f70 tx=0x7f22bc007cf0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.211+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f22c40c7020 con 0x7f22cc1573a0 2024-04-26T23:08:02.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f22cc0ca780 con 0x7f22cc1573a0 2024-04-26T23:08:02.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22c9600640 1 -- 172.21.15.148:0/1051683073 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f22c4016620 con 0x7f22cc1573a0 2024-04-26T23:08:02.436 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:02.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 msgr2=0x7f22a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 0x7f22a806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22bc000f70 tx=0x7f22bc007cf0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 msgr2=0x7f22cc14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.435+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22c40af040 tx=0x7f22c4019740 comp rx=0 tx=0).stop 2024-04-26T23:08:02.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 shutdown_connections 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22a80683b0 0x7f22a806a870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22cc1573a0 0x7f22cc14aff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22cc0c5810 0x7f22cc0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 --2- 172.21.15.148:0/1051683073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22cc0c4580 0x7f22cc06d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 >> 172.21.15.148:0/1051683073 conn(0x7f22cc0704d0 msgr2=0x7f22cc0c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 shutdown_connections 2024-04-26T23:08:02.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.439+0000 7f22d3400640 1 -- 172.21.15.148:0/1051683073 wait complete. 2024-04-26T23:08:02.457 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:08:02.457 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:08:02.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:08:02.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:08:02.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 Processor -- start 2024-04-26T23:08:02.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 -- start start 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c1593d0 0x7fb44c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb44c15f340 0x7fb44c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44c0cbb70 con 0x7fb44c0c9e50 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb44c0cbf50 con 0x7fb44c15f340 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb453000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb44c0ca630 con 0x7fb44c1593d0 2024-04-26T23:08:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb443e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb44c0c9e50 0x7fb44c0cc3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52866/0 (socket says 172.21.15.148:52866) 2024-04-26T23:08:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb443e00640 1 -- 172.21.15.148:0/974211263 learned_addr learned my addr 172.21.15.148:0/974211263 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb451000640 1 --2- 172.21.15.148:0/974211263 >> v2:172.21.15.157:3300/0 conn(0x7fb44c15f340 0x7fb44c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.595+0000 7fb44be00640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c1593d0 0x7fb44c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb44b400640 1 -- 172.21.15.148:0/974211263 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092269543 0 0) 0x7fb44c0cbb70 con 0x7fb44c0c9e50 2024-04-26T23:08:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb44b400640 1 -- 172.21.15.148:0/974211263 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb430003530 con 0x7fb44c0c9e50 2024-04-26T23:08:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb451000640 1 -- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c1593d0 msgr2=0x7fb44c0cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb451000640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c1593d0 0x7fb44c0cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb451000640 1 -- 172.21.15.148:0/974211263 >> v1:172.21.15.148:6789/0 conn(0x7fb44c0c9e50 legacy=0x7fb44c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb451000640 1 -- 172.21.15.148:0/974211263 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c0ca910 con 0x7fb44c15f340 2024-04-26T23:08:02.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb451000640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c071f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb444009d90 tx=0x7fb44401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba73579aeb55ee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb44b400640 1 -- 172.21.15.148:0/974211263 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440b4070 con 0x7fb44c15f340 2024-04-26T23:08:02.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb44b400640 1 -- 172.21.15.148:0/974211263 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4440af600 con 0x7fb44c15f340 2024-04-26T23:08:02.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.599+0000 7fb44b400640 1 -- 172.21.15.148:0/974211263 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440af9b0 con 0x7fb44c15f340 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 msgr2=0x7fb44c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c071f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb444009d90 tx=0x7fb44401f150 comp rx=0 tx=0).stop 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- 172.21.15.148:0/974211263 shutdown_connections 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c071f40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- 172.21.15.148:0/974211263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c1593d0 0x7fb44c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- 172.21.15.148:0/974211263 >> 172.21.15.148:0/974211263 conn(0x7fb44c070570 msgr2=0x7fb44c06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- 172.21.15.148:0/974211263 shutdown_connections 2024-04-26T23:08:02.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- 172.21.15.148:0/974211263 wait complete. 2024-04-26T23:08:02.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 Processor -- start 2024-04-26T23:08:02.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- start start 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c0c9e50 0x7fb44c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 0x7fb44c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c1597b0 con 0x7fb44c1593d0 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0caed0 con 0x7fb44c15f340 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb453000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb44c0c62c0 con 0x7fb44c0c9e50 2024-04-26T23:08:02.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 0x7fb44c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 0x7fb44c14ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58534/0 (socket says 172.21.15.148:58534) 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 -- 172.21.15.148:0/1094228673 learned_addr learned my addr 172.21.15.148:0/1094228673 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb451000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb44be00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c0c9e50 0x7fb44c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c0c9e50 msgr2=0x7fb44c1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb44c0c9e50 0x7fb44c1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 msgr2=0x7fb44c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c15f340 0x7fb44c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c151de0 con 0x7fb44c1593d0 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb443e00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 0x7fb44c14ddf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4340010f0 tx=0x7fb43400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.603+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434017070 con 0x7fb44c1593d0 2024-04-26T23:08:02.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb434005d10 con 0x7fb44c1593d0 2024-04-26T23:08:02.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434007310 con 0x7fb44c1593d0 2024-04-26T23:08:02.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c151b40 con 0x7fb44c1593d0 2024-04-26T23:08:02.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c1f5a00 con 0x7fb44c1593d0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb453000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 0x7fb44c1f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c151910 con 0x7fb44c0c67d0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb44be00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 0x7fb44c1f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb44be00640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb44c0c6bb0 con 0x7fb44c0c67d0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb44be00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 0x7fb44c1f1690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb43c011600 tx=0x7fb43c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c004230 con 0x7fb44c0c67d0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb43401a070 con 0x7fb44c1593d0 2024-04-26T23:08:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb428068280 0x7fb42806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb434086220 con 0x7fb44c1593d0 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb451000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb428068280 0x7fb42806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb43c0043d0 con 0x7fb44c0c67d0 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 msgr2=0x7fb44c1f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 0x7fb44c1f1690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb43c011600 tx=0x7fb43c011ac0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 msgr2=0x7fb44c1f1690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.607+0000 7fb448c00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c0c67d0 0x7fb44c1f1690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.611+0000 7fb451000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb428068280 0x7fb42806a740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b1000 tx=0x7fb4440aa000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 0x7fb44c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0ccb50 con 0x7fb44c1f1bd0 2024-04-26T23:08:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb44be00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 0x7fb44c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb44be00640 1 -- 172.21.15.148:0/1094228673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb44c0cc610 con 0x7fb44c1f1bd0 2024-04-26T23:08:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb44be00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 0x7fb44c14b800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb43c011600 tx=0x7fb43c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c003830 con 0x7fb44c1f1bd0 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4561 (secure 0 0 0) 0x7fb43c003830 con 0x7fb44c1f1bd0 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 msgr2=0x7fb44c14b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 0x7fb44c14b800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb43c011600 tx=0x7fb43c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 msgr2=0x7fb44c14b800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb448c00640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1f1bd0 0x7fb44c14b800 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb43c011600 tx=0x7fb43c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 15239, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 13, 2024-04-26T23:08:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:02.632 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb428068280 msgr2=0x7fb42806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb428068280 0x7fb42806a740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b1000 tx=0x7fb4440aa000 comp rx=0 tx=0).stop 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 msgr2=0x7fb44c14ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 --2- 172.21.15.148:0/1094228673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb44c1593d0 0x7fb44c14ddf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4340010f0 tx=0x7fb43400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb451000640 1 -- 172.21.15.148:0/1094228673 reap_dead start 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb451000640 1 -- 172.21.15.148:0/1094228673 reap_dead start 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 shutdown_connections 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 >> 172.21.15.148:0/1094228673 conn(0x7fb44c070570 msgr2=0x7fb44c1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 shutdown_connections 2024-04-26T23:08:02.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.615+0000 7fb453000640 1 -- 172.21.15.148:0/1094228673 wait complete. 2024-04-26T23:08:02.635 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:02.635 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:08:02.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:08:02.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 Processor -- start 2024-04-26T23:08:02.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 -- start start 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafb0073940 0x7fafb00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb00c4b30 con 0x7fafb0152d00 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb00c6f60 con 0x7fafb015c070 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb7400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fafb00c7240 con 0x7fafb0073940 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb4a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fafb0152d00 0x7fafb0073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52872/0 (socket says 172.21.15.148:52872) 2024-04-26T23:08:02.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.771+0000 7fafb4a00640 1 -- 172.21.15.148:0/2406274358 learned_addr learned my addr 172.21.15.148:0/2406274358 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafa7e00640 1 --2- 172.21.15.148:0/2406274358 >> v2:172.21.15.157:3300/0 conn(0x7fafb0073940 0x7fafb00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919339874 0 0) 0x7fafb00c4b30 con 0x7fafb0152d00 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf94003530 con 0x7fafb0152d00 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1110486103 0 0) 0x7faf94003530 con 0x7fafb0152d00 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 >> v2:172.21.15.157:3300/0 conn(0x7fafb0073940 msgr2=0x7fafb00c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 --2- 172.21.15.148:0/2406274358 >> v2:172.21.15.157:3300/0 conn(0x7fafb0073940 0x7fafb00c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 >> v1:172.21.15.157:6789/0 conn(0x7fafb015c070 legacy=0x7fafb015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb00c7520 con 0x7fafb0152d00 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fafa0001680 con 0x7fafb0152d00 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 >> v1:172.21.15.148:6789/0 conn(0x7fafb0152d00 legacy=0x7fafb0073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 0x7faf94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf94004810 0x7faf94004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940051d0 0x7faf9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafb00c7240 con 0x7faf940039c0 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faf9400c070 con 0x7faf940051d0 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faf9400e480 con 0x7faf94004810 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 0x7faf94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafa7e00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf94004810 0x7faf94004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb5400640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940051d0 0x7faf9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 -- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf94004810 msgr2=0x7faf94004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf94004810 0x7faf94004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 -- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940051d0 msgr2=0x7faf9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940051d0 0x7faf9400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb4a00640 1 -- 172.21.15.148:0/2406274358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf94003530 con 0x7faf940039c0 2024-04-26T23:08:02.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.775+0000 7fafb5400640 1 -- 172.21.15.148:0/2406274358 reap_dead start 2024-04-26T23:08:02.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb4a00640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 0x7faf94003de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c240 tx=0x7fafa001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b467f181d6a41bd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0007d20 con 0x7faf940039c0 2024-04-26T23:08:02.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa00a9070 con 0x7faf940039c0 2024-04-26T23:08:02.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafafe00640 1 -- 172.21.15.148:0/2406274358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0005d80 con 0x7faf940039c0 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 msgr2=0x7faf94003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 0x7faf94003de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c240 tx=0x7fafa001cc80 comp rx=0 tx=0).stop 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- 172.21.15.148:0/2406274358 shutdown_connections 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 --2- 172.21.15.148:0/2406274358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf940039c0 0x7faf94003de0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- 172.21.15.148:0/2406274358 >> 172.21.15.148:0/2406274358 conn(0x7fafb00c9d10 msgr2=0x7fafb00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- 172.21.15.148:0/2406274358 shutdown_connections 2024-04-26T23:08:02.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- 172.21.15.148:0/2406274358 wait complete. 2024-04-26T23:08:02.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 Processor -- start 2024-04-26T23:08:02.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- start start 2024-04-26T23:08:02.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940039c0 0x7fafb015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fafb014df60 0x7fafb0159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafb00c4890 con 0x7fafb014c440 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fafb00c4710 con 0x7faf940039c0 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fafb015cc90 con 0x7fafb014df60 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb5400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb5400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58584/0 (socket says 172.21.15.148:58584) 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.779+0000 7fafb5400640 1 -- 172.21.15.148:0/498553145 learned_addr learned my addr 172.21.15.148:0/498553145 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb4a00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940039c0 0x7fafb015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafa7e00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fafb014df60 0x7fafb0159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fafb014df60 msgr2=0x7fafb0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fafb014df60 0x7fafb0159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940039c0 msgr2=0x7fafb015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf940039c0 0x7fafb015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb014efb0 con 0x7fafb014c440 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb5400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafb0156650 tx=0x7fafa800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8019070 con 0x7fafb014c440 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa8006d70 con 0x7fafb014c440 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8003bc0 con 0x7fafb014c440 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb0150520 con 0x7fafb014c440 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb014f270 con 0x7fafb014c440 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb7400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 0x7fafb0147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fafb014dca0 con 0x7fafb014f470 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb4a00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 0x7fafb0147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb4a00640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafb0077c20 con 0x7fafb014f470 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafa8005110 con 0x7fafb014c440 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafb4a00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 0x7fafb0147db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c210 tx=0x7faf94005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faf8c068380 0x7faf8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.783+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fafa8086380 con 0x7fafb014c440 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa00bd070 con 0x7fafb014f470 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafa7e00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faf8c068380 0x7faf8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fafa00a9040 con 0x7fafb014f470 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 msgr2=0x7fafb0147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 0x7fafb0147db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c210 tx=0x7faf94005840 comp rx=0 tx=0).stop 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 msgr2=0x7fafb0147db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafad600640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb014f470 0x7fafb0147db0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.787+0000 7fafa7e00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faf8c068380 0x7faf8c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafb006f4d0 tx=0x7faf98008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafb7400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 0x7fafb01f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fafb01486d0 con 0x7fafb01482f0 2024-04-26T23:08:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafb4a00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 0x7fafb01f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafb4a00640 1 -- 172.21.15.148:0/498553145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fafb00c3fd0 con 0x7fafb01482f0 2024-04-26T23:08:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafb4a00640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 0x7fafb01f4130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fafa001ccc0 tx=0x7fafa00a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.791+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa00c4070 con 0x7fafb01482f0 2024-04-26T23:08:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7fafa00be040 con 0x7fafb01482f0 2024-04-26T23:08:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 msgr2=0x7fafb01f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafad600640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 0x7fafb01f4130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fafa001ccc0 tx=0x7fafa00a7000 comp rx=0 tx=0).stop 2024-04-26T23:08:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafad600640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 msgr2=0x7fafb01f4130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafad600640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafb01482f0 0x7fafb01f4130 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fafa001ccc0 tx=0x7fafa00a7000 comp rx=0 tx=0).stop 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 225638, 2024-04-26T23:08:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 13, 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:02.810 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faf8c068380 msgr2=0x7faf8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faf8c068380 0x7faf8c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafb006f4d0 tx=0x7faf98008040 comp rx=0 tx=0).stop 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 msgr2=0x7fafb01e7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafb0156650 tx=0x7fafa800e8f0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb5400640 1 -- 172.21.15.148:0/498553145 reap_dead start 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 shutdown_connections 2024-04-26T23:08:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 --2- 172.21.15.148:0/498553145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafb014c440 0x7fafb01e7600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 >> 172.21.15.148:0/498553145 conn(0x7fafb00c9d10 msgr2=0x7fafb00ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 shutdown_connections 2024-04-26T23:08:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.795+0000 7fafb7400640 1 -- 172.21.15.148:0/498553145 wait complete. 2024-04-26T23:08:02.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:02.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:08:02.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:08:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.947+0000 7f9f1cc00640 1 Processor -- start 2024-04-26T23:08:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.947+0000 7f9f1cc00640 1 -- start start 2024-04-26T23:08:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f1cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c6c50 0x7f9f180cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f1cc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f180c7030 0x7f9f181596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f1cc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f180ca6a0 con 0x7f9f180ca0d0 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f1cc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180cac60 con 0x7f9f180c7030 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f1cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9f18073440 con 0x7f9f180c6c50 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f17e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9f180ca0d0 0x7f9f181534b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52876/0 (socket says 172.21.15.148:52876) 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f17e00640 1 -- 172.21.15.148:0/290044335 learned_addr learned my addr 172.21.15.148:0/290044335 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f0ea00640 1 --2- 172.21.15.148:0/290044335 >> v2:172.21.15.157:3300/0 conn(0x7f9f180c7030 0x7f9f181596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f17400640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c6c50 0x7f9f180cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f16a00640 1 -- 172.21.15.148:0/290044335 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215727534 0 0) 0x7f9f180ca6a0 con 0x7f9f180ca0d0 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f16a00640 1 -- 172.21.15.148:0/290044335 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9efc003530 con 0x7f9f180ca0d0 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f0ea00640 1 -- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c6c50 msgr2=0x7f9f180cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f0ea00640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c6c50 0x7f9f180cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f0ea00640 1 -- 172.21.15.148:0/290044335 >> v1:172.21.15.148:6789/0 conn(0x7f9f180ca0d0 legacy=0x7f9f181534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.951+0000 7f9f0ea00640 1 -- 172.21.15.148:0/290044335 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f180ca980 con 0x7f9f180c7030 2024-04-26T23:08:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f0ea00640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c7030 0x7f9f181596d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f000097c0 tx=0x7f9f0001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3460322c5d7d47b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f16a00640 1 -- 172.21.15.148:0/290044335 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000b1070 con 0x7f9f180c7030 2024-04-26T23:08:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f16a00640 1 -- 172.21.15.148:0/290044335 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000ac410 con 0x7f9f180c7030 2024-04-26T23:08:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f16a00640 1 -- 172.21.15.148:0/290044335 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ac7c0 con 0x7f9f180c7030 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c7030 msgr2=0x7f9f181596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c7030 0x7f9f181596d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f000097c0 tx=0x7f9f0001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- 172.21.15.148:0/290044335 shutdown_connections 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c7030 0x7f9f181596d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/290044335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c6c50 0x7f9f180cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- 172.21.15.148:0/290044335 >> 172.21.15.148:0/290044335 conn(0x7f9f1806e0a0 msgr2=0x7f9f1806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- 172.21.15.148:0/290044335 shutdown_connections 2024-04-26T23:08:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- 172.21.15.148:0/290044335 wait complete. 2024-04-26T23:08:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 Processor -- start 2024-04-26T23:08:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.955+0000 7f9f1cc00640 1 -- start start 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c6c50 0x7f9f180cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180ca0d0 0x7f9f1814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 0x7f9f1814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18159c10 con 0x7f9f18143900 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9f180c7ea0 con 0x7f9f180c6c50 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9f18159d90 con 0x7f9f180ca0d0 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 0x7f9f1814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c6c50 0x7f9f180cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f0ea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180ca0d0 0x7f9f1814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 0x7f9f1814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58596/0 (socket says 172.21.15.148:58596) 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 learned_addr learned my addr 172.21.15.148:0/3050484507 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180ca0d0 msgr2=0x7f9f1814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180ca0d0 0x7f9f1814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c6c50 msgr2=0x7f9f180cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f180c6c50 0x7f9f180cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f18144fe0 con 0x7f9f18143900 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17e00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 0x7f9f1814e0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000cb40 tx=0x7f9f1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10017070 con 0x7f9f18143900 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1000aca0 con 0x7f9f18143900 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10012620 con 0x7f9f18143900 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f180cce40 con 0x7f9f18143900 2024-04-26T23:08:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f18145560 con 0x7f9f18143900 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 0x7f9f180cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9f18159450 con 0x7f9f180c7030 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.959+0000 7f9f17400640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 0x7f9f180cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f17400640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f18145840 con 0x7f9f180c7030 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f17400640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 0x7f9f180cbd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011900 tx=0x7f9f08011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f1001a070 con 0x7f9f18143900 2024-04-26T23:08:02.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9ef4068380 0x7f9ef406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9f10086b10 con 0x7f9f18143900 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0ea00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9ef4068380 0x7f9ef406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08019070 con 0x7f9f180c7030 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9f08004300 con 0x7f9f180c7030 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 msgr2=0x7f9f180cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 0x7f9f180cbd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011900 tx=0x7f9f08011dc0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 msgr2=0x7f9f180cbd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0fe00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180c7030 0x7f9f180cbd80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.963+0000 7f9f0ea00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9ef4068380 0x7f9ef406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ae000 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.967+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 0x7f9f181425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.967+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1814e9c0 con 0x7f9f180cc470 2024-04-26T23:08:02.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f17400640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 0x7f9f181425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:02.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f17400640 1 -- 172.21.15.148:0/3050484507 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f180506d0 con 0x7f9f180cc470 2024-04-26T23:08:02.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f17400640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 0x7f9f181425c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011900 tx=0x7f9f080046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:02.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08019040 con 0x7f9f180cc470 2024-04-26T23:08:02.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5070 (secure 0 0 0) 0x7f9f0801e450 con 0x7f9f180cc470 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 msgr2=0x7f9f181425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 0x7f9f181425c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011900 tx=0x7f9f080046d0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 msgr2=0x7f9f181425c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f0fe00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9f180cc470 0x7f9f181425c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 26, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 225818, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:08:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:02.987 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9ef4068380 msgr2=0x7f9ef406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9ef4068380 0x7f9ef406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ae000 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 msgr2=0x7f9f1814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 --2- 172.21.15.148:0/3050484507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f18143900 0x7f9f1814e0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000cb40 tx=0x7f9f1000a060 comp rx=0 tx=0).stop 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 reap_dead start 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f17e00640 1 -- 172.21.15.148:0/3050484507 reap_dead start 2024-04-26T23:08:02.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 shutdown_connections 2024-04-26T23:08:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 >> 172.21.15.148:0/3050484507 conn(0x7f9f1806e0a0 msgr2=0x7f9f18153280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 shutdown_connections 2024-04-26T23:08:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:02.971+0000 7f9f1cc00640 1 -- 172.21.15.148:0/3050484507 wait complete. 2024-04-26T23:08:02.991 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:02.992 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:08:02.992 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:08:02.992 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:08:02.992 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:08:02.992 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:08:02.992 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:08:03.007 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:08:03.008 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:08:03.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:03.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 Processor -- start 2024-04-26T23:08:03.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 -- start start 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46100c6340 0x7f461015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46100cfb50 con 0x7f46100b1d80 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46100cfe10 con 0x7f46100c9e80 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4617a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f46100cce10 con 0x7f46100c6340 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4615000640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f46100b1d80 legacy=0x7f461006feb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4607e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f46100c6340 msgr2=0x7f461015c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4607e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46100c6340 0x7f461015c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4615a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f46100c9e80 0x7f4610166800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:39254/0 (socket says 172.21.15.148:39254) 2024-04-26T23:08:03.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f4615a00640 1 -- 172.21.15.148:0/2494607751 learned_addr learned my addr 172.21.15.148:0/2494607751 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:03.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154900118 0 0) 0x7f46100cfe10 con 0x7f46100c9e80 2024-04-26T23:08:03.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45f4003530 con 0x7f46100c9e80 2024-04-26T23:08:03.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 70740170 0 0) 0x7f45f4003530 con 0x7f46100c9e80 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 >> v2:172.21.15.148:3300/0 conn(0x7f46100c6340 msgr2=0x7f461015c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 --2- 172.21.15.148:0/2494607751 >> v2:172.21.15.148:3300/0 conn(0x7f46100c6340 0x7f461015c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 >> v1:172.21.15.148:6789/0 conn(0x7f46100b1d80 legacy=0x7f461006feb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461006d650 con 0x7f46100c9e80 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.183+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f4608001a00 con 0x7f46100c9e80 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 >> v1:172.21.15.157:6789/0 conn(0x7f46100c9e80 legacy=0x7f4610166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f45f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f4004810 0x7f45f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45f4005220 0x7f45f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46100cce10 con 0x7f45f4005220 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45f400c150 con 0x7f45f4004810 2024-04-26T23:08:03.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45f400c350 con 0x7f45f40039c0 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615a00640 1 -- 172.21.15.148:0/2494607751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45f4005220 msgr2=0x7f45f400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615a00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45f4005220 0x7f45f400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f45f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4607e00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f4004810 0x7f45f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 -- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f4004810 msgr2=0x7f45f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f4004810 0x7f45f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 -- 172.21.15.148:0/2494607751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45f4005220 msgr2=0x7f45f400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45f4005220 0x7f45f400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615000640 1 -- 172.21.15.148:0/2494607751 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f4003530 con 0x7f45f40039c0 2024-04-26T23:08:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.187+0000 7f4615a00640 1 -- 172.21.15.148:0/2494607751 reap_dead start 2024-04-26T23:08:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4615000640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f45f4003dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4600003990 tx=0x7f460001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9782e53f472829d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600009520 con 0x7f45f40039c0 2024-04-26T23:08:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600003bc0 con 0x7f45f40039c0 2024-04-26T23:08:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f460fe00640 1 -- 172.21.15.148:0/2494607751 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600005070 con 0x7f45f40039c0 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 msgr2=0x7f45f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f45f4003dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4600003990 tx=0x7f460001c440 comp rx=0 tx=0).stop 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- 172.21.15.148:0/2494607751 shutdown_connections 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 --2- 172.21.15.148:0/2494607751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f45f4003dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- 172.21.15.148:0/2494607751 >> 172.21.15.148:0/2494607751 conn(0x7f4610071160 msgr2=0x7f4610068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- 172.21.15.148:0/2494607751 shutdown_connections 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- 172.21.15.148:0/2494607751 wait complete. 2024-04-26T23:08:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 Processor -- start 2024-04-26T23:08:03.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- start start 2024-04-26T23:08:03.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 0x7f46101f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46101f3da0 0x7f46100c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b2160 con 0x7f46100c7a60 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f461006dc10 con 0x7f46101f3da0 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4617a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4610071970 con 0x7f45f40039c0 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4607e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 msgr2=0x7f46101f3860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4607e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 0x7f46101f3860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.191+0000 7f4615000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:41480/0 (socket says 172.21.15.148:41480) 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 -- 172.21.15.148:0/2529233777 learned_addr learned my addr 172.21.15.148:0/2529233777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46101f3da0 0x7f46100c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 -- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46101f3da0 msgr2=0x7f46100c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46101f3da0 0x7f46100c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 -- 172.21.15.148:0/2529233777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 msgr2=0x7f46101f3860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 0x7f46101f3860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 -- 172.21.15.148:0/2529233777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101f4220 con 0x7f45f40039c0 2024-04-26T23:08:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4615000640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f460001c270 tx=0x7f45f4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000bc070 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600009500 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000aec90 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46100b23f0 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46100c6ce0 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.195+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610077c20 con 0x7f45f40039c0 2024-04-26T23:08:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.199+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4600005070 con 0x7f45f40039c0 2024-04-26T23:08:03.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.199+0000 7f460d600640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 0x7f45ec06a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:03.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.199+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4600120770 con 0x7f45f40039c0 2024-04-26T23:08:03.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.199+0000 7f4607e00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 0x7f45ec06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:03.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.199+0000 7f4607e00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 0x7f45ec06a820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46100b4c20 tx=0x7f45f80090e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.211+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46000c5020 con 0x7f45f40039c0 2024-04-26T23:08:03.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.423+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46100d0210 con 0x7f45f40039c0 2024-04-26T23:08:03.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f460d600640 1 -- 172.21.15.148:0/2529233777 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f46101f4220 con 0x7f45f40039c0 2024-04-26T23:08:03.427 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 msgr2=0x7f45ec06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 0x7f45ec06a820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46100b4c20 tx=0x7f45f80090e0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 msgr2=0x7f46100c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f460001c270 tx=0x7f45f4005840 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 shutdown_connections 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45ec068360 0x7f45ec06a820 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46101f3da0 0x7f46100c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46100c7a60 0x7f46101f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 --2- 172.21.15.148:0/2529233777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45f40039c0 0x7f46100c7520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 >> 172.21.15.148:0/2529233777 conn(0x7f4610071160 msgr2=0x7f46100cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 shutdown_connections 2024-04-26T23:08:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:03.427+0000 7f4617a00640 1 -- 172.21.15.148:0/2529233777 wait complete. 2024-04-26T23:08:06.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 Processor -- start 2024-04-26T23:08:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 -- start start 2024-04-26T23:08:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 0x7f611806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61180cfb50 con 0x7f611815c7e0 2024-04-26T23:08:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61180cfe10 con 0x7f61180c6340 2024-04-26T23:08:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f611d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f61180cce10 con 0x7f61180b1d80 2024-04-26T23:08:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6117400640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f611815c7e0 legacy=0x7f6118166800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 0x7f611806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f610e000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f61180c6340 0x7f611815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:56576/0 (socket says 172.21.15.148:56576) 2024-04-26T23:08:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f610e000640 1 -- 172.21.15.148:0/3325181572 learned_addr learned my addr 172.21.15.148:0/3325181572 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116000640 1 -- 172.21.15.148:0/3325181572 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024152141 0 0) 0x7f61180cfe10 con 0x7f61180c6340 2024-04-26T23:08:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116000640 1 -- 172.21.15.148:0/3325181572 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60fc003530 con 0x7f61180c6340 2024-04-26T23:08:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116a00640 1 -- 172.21.15.148:0/3325181572 >> v1:172.21.15.157:6789/0 conn(0x7f61180c6340 legacy=0x7f611815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116a00640 1 -- 172.21.15.148:0/3325181572 >> v1:172.21.15.148:6789/0 conn(0x7f611815c7e0 legacy=0x7f6118166800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.595+0000 7f6116a00640 1 -- 172.21.15.148:0/3325181572 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611806d650 con 0x7f61180b1d80 2024-04-26T23:08:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f6116a00640 1 --2- 172.21.15.148:0/3325181572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 0x7f611806feb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61080097f0 tx=0x7f610801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c8747bd78f9156 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f6116000640 1 -- 172.21.15.148:0/3325181572 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080b5070 con 0x7f61180b1d80 2024-04-26T23:08:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f6116000640 1 -- 172.21.15.148:0/3325181572 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61080a8990 con 0x7f61180b1d80 2024-04-26T23:08:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f6116000640 1 -- 172.21.15.148:0/3325181572 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080a8d40 con 0x7f61180b1d80 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 -- 172.21.15.148:0/3325181572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 msgr2=0x7f611806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 --2- 172.21.15.148:0/3325181572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 0x7f611806feb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61080097f0 tx=0x7f610801ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 -- 172.21.15.148:0/3325181572 shutdown_connections 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 --2- 172.21.15.148:0/3325181572 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61180b1d80 0x7f611806feb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 -- 172.21.15.148:0/3325181572 >> 172.21.15.148:0/3325181572 conn(0x7f6118071160 msgr2=0x7f6118068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 -- 172.21.15.148:0/3325181572 shutdown_connections 2024-04-26T23:08:06.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.599+0000 7f611d800640 1 -- 172.21.15.148:0/3325181572 wait complete. 2024-04-26T23:08:06.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 Processor -- start 2024-04-26T23:08:06.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- start start 2024-04-26T23:08:06.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 0x7f61180b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:06.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f611815c7e0 0x7f611814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61180b2160 con 0x7f61180b1d80 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f611806dc10 con 0x7f61180c6340 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6118071970 con 0x7f611815c7e0 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f6116a00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 msgr2=0x7f61180b2e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f6116a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 0x7f61180b2e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:46160/0 (socket says 172.21.15.148:46160) 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 -- 172.21.15.148:0/1602358165 learned_addr learned my addr 172.21.15.148:0/1602358165 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f6117400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f611815c7e0 0x7f611814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:06.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 -- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f611815c7e0 msgr2=0x7f611814ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:06.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f611815c7e0 0x7f611814ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 -- 172.21.15.148:0/1602358165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 msgr2=0x7f61180b2e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:06.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 0x7f61180b2e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 -- 172.21.15.148:0/1602358165 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61180b3890 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610e000640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f610000c450 tx=0x7f610000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100017070 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6100005cf0 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100007290 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61180b1700 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.603+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181f2480 con 0x7f61180c6340 2024-04-26T23:08:06.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6118077c20 con 0x7f61180c6340 2024-04-26T23:08:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f610001a070 con 0x7f61180c6340 2024-04-26T23:08:06.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f610f400640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 0x7f60f406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:06.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f61000864b0 con 0x7f61180c6340 2024-04-26T23:08:06.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f6116a00640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 0x7f60f406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:06.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.607+0000 7f6116a00640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 0x7f60f406a7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61080b2000 tx=0x7f6108008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:06.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.619+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6100021020 con 0x7f61180c6340 2024-04-26T23:08:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.831+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61180d0210 con 0x7f61180c6340 2024-04-26T23:08:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f610f400640 1 -- 172.21.15.148:0/1602358165 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f6100056090 con 0x7f61180c6340 2024-04-26T23:08:06.834 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 msgr2=0x7f60f406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 0x7f60f406a7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61080b2000 tx=0x7f6108008040 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 msgr2=0x7f611814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f610000c450 tx=0x7f610000c910 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 shutdown_connections 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f60f4068330 0x7f60f406a7f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f611815c7e0 0x7f611814ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61180c6340 0x7f611814e8c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 --2- 172.21.15.148:0/1602358165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61180b1d80 0x7f61180b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 >> 172.21.15.148:0/1602358165 conn(0x7f6118071160 msgr2=0x7f61180ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 shutdown_connections 2024-04-26T23:08:06.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:06.835+0000 7f611d800640 1 -- 172.21.15.148:0/1602358165 wait complete. 2024-04-26T23:08:09.856 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:10.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:09.999+0000 7f870a600640 1 Processor -- start 2024-04-26T23:08:10.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:09.999+0000 7f870a600640 1 -- start start 2024-04-26T23:08:10.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f870a600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 0x7f87040cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:10.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f870a600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040ca350 con 0x7f870406e860 2024-04-26T23:08:10.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f870a600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040cb1c0 con 0x7f870415fc80 2024-04-26T23:08:10.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f870a600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f87040cb4a0 con 0x7f8704156320 2024-04-26T23:08:10.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f86fbe00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7f870406e860 legacy=0x7f870415f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 0x7f87040cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f870415fc80 0x7f8704166810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:56582/0 (socket says 172.21.15.148:56582) 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703e00640 1 -- 172.21.15.148:0/3192426861 learned_addr learned my addr 172.21.15.148:0/3192426861 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703400640 1 -- 172.21.15.148:0/3192426861 >> v1:172.21.15.157:6789/0 conn(0x7f870415fc80 legacy=0x7f8704166810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703400640 1 -- 172.21.15.148:0/3192426861 >> v1:172.21.15.148:6789/0 conn(0x7f870406e860 legacy=0x7f870415f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:10.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.003+0000 7f8703400640 1 -- 172.21.15.148:0/3192426861 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040cb780 con 0x7f8704156320 2024-04-26T23:08:10.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f8703400640 1 --2- 172.21.15.148:0/3192426861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 0x7f87040cf480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86f40097f0 tx=0x7f86f401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97638a8db2e4b67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:10.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f8702a00640 1 -- 172.21.15.148:0/3192426861 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40b0070 con 0x7f8704156320 2024-04-26T23:08:10.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f8702a00640 1 -- 172.21.15.148:0/3192426861 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f40ab600 con 0x7f8704156320 2024-04-26T23:08:10.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f8702a00640 1 -- 172.21.15.148:0/3192426861 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40ab9d0 con 0x7f8704156320 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- 172.21.15.148:0/3192426861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 msgr2=0x7f87040cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 --2- 172.21.15.148:0/3192426861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 0x7f87040cf480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86f40097f0 tx=0x7f86f401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- 172.21.15.148:0/3192426861 shutdown_connections 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 --2- 172.21.15.148:0/3192426861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8704156320 0x7f87040cf480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- 172.21.15.148:0/3192426861 >> 172.21.15.148:0/3192426861 conn(0x7f8704071010 msgr2=0x7f8704071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- 172.21.15.148:0/3192426861 shutdown_connections 2024-04-26T23:08:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- 172.21.15.148:0/3192426861 wait complete. 2024-04-26T23:08:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 Processor -- start 2024-04-26T23:08:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.007+0000 7f870a600640 1 -- start start 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 0x7f87041f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 0x7f870414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 0x7f87041573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87040c9ef0 con 0x7f8704156320 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87040ca070 con 0x7f870415fc80 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f870416a750 con 0x7f870406e860 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f86fbe00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 msgr2=0x7f870414b8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f86fbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 0x7f870414b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:10.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 0x7f87041f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 0x7f87041573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 0x7f87041f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:49418/0 (socket says 172.21.15.148:49418) 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703400640 1 -- 172.21.15.148:0/2816444229 learned_addr learned my addr 172.21.15.148:0/2816444229 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 -- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 msgr2=0x7f87041f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 0x7f87041f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 -- 172.21.15.148:0/2816444229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 msgr2=0x7f870414b8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 0x7f870414b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 -- 172.21.15.148:0/2816444229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8704158380 con 0x7f870415fc80 2024-04-26T23:08:10.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f8703e00640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 0x7f87041573a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00cb00 tx=0x7f86fc002190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc017070 con 0x7f870415fc80 2024-04-26T23:08:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc00abd0 con 0x7f870415fc80 2024-04-26T23:08:10.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc012400 con 0x7f870415fc80 2024-04-26T23:08:10.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87041594e0 con 0x7f870415fc80 2024-04-26T23:08:10.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8704156ba0 con 0x7f870415fc80 2024-04-26T23:08:10.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.011+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8704077c20 con 0x7f870415fc80 2024-04-26T23:08:10.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.015+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86fc01a070 con 0x7f870415fc80 2024-04-26T23:08:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.015+0000 7f86fb400640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 0x7f86e006a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.015+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f86fc086900 con 0x7f870415fc80 2024-04-26T23:08:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.015+0000 7f8703400640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 0x7f86e006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.015+0000 7f8703400640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 0x7f86e006a820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86f401ab50 tx=0x7f86f40a6000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.019+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86fc056460 con 0x7f870415fc80 2024-04-26T23:08:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.227+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8704076f90 con 0x7f870415fc80 2024-04-26T23:08:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f86fb400640 1 -- 172.21.15.148:0/2816444229 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f86fc05a760 con 0x7f870415fc80 2024-04-26T23:08:10.231 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 msgr2=0x7f86e006a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 0x7f86e006a820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86f401ab50 tx=0x7f86f40a6000 comp rx=0 tx=0).stop 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 msgr2=0x7f87041573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 0x7f87041573a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00cb00 tx=0x7f86fc002190 comp rx=0 tx=0).stop 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 shutdown_connections 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f86e0068360 0x7f86e006a820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f870415fc80 0x7f87041573a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8704156320 0x7f870414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 --2- 172.21.15.148:0/2816444229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f870406e860 0x7f87041f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 >> 172.21.15.148:0/2816444229 conn(0x7f8704071010 msgr2=0x7f8704155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 shutdown_connections 2024-04-26T23:08:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:10.231+0000 7f870a600640 1 -- 172.21.15.148:0/2816444229 wait complete. 2024-04-26T23:08:13.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:13.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:08:13.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:08:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.407+0000 7f3c5f400640 1 Processor -- start 2024-04-26T23:08:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.407+0000 7f3c5f400640 1 -- start start 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f3c58152fa0 con 0x7f3c580732b0 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3c58073700 con 0x7f3c58152bc0 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5f400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c58159790 con 0x7f3c580c9340 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5d400640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 msgr2=0x7f3c580c9b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:49426/0 (socket says 172.21.15.148:49426) 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 learned_addr learned my addr 172.21.15.148:0/2187763565 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:13.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 msgr2=0x7f3c580c9b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:13.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5d400640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:08:13.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:13.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:13.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:13.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:13.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:08:14.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 msgr2=0x7f3c580c9b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:14.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5d400640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:08:14.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:14.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:14.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:14.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:14.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:08:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:08:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:08:14.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 msgr2=0x7f3c580c9b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:14.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5d400640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:08:14.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:14.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:08:14.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:14.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:08:16.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c58072d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c58072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c580c8e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c580c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 msgr2=0x7f3c580c9b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c580732b0 0x7f3c580c9b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c58158930 con 0x7f3c34003680 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3400c130 con 0x7f3c340073c0 2024-04-26T23:08:16.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:16.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:16.615+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:17.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:17.019+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:17.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:17.823+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.157:6789/0 conn(0x7f3c340073c0 legacy=0x7f3c34009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 reap_dead start 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3400d370 con 0x7f3c34003680 2024-04-26T23:08:19.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3c58152fa0 con 0x7f3c58152bc0 2024-04-26T23:08:19.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c58073700 con 0x7f3c580c9340 2024-04-26T23:08:19.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:19.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:19.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:19.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:08:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:19.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:19.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:19.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:19.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:19.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:08:19.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:19.615+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:08:20.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:20.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:20.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:20.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:08:20.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.019+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:08:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:08:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:08:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:20.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:20.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:08:20.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:20.823+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:08:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3400c4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3400c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 msgr2=0x7f3c3400ca00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.157:3300/0 conn(0x7f3c58152bc0 0x7f3c3400ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.148:6789/0 conn(0x7f3c34003680 legacy=0x7f3c34005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c3400b4c0 0x7f3c3400b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c58158930 con 0x7f3c3400b0e0 2024-04-26T23:08:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c56a00640 1 -- 172.21.15.148:0/2187763565 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f3c58152fa0 con 0x7f3c3400b4c0 2024-04-26T23:08:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c3400b4c0 msgr2=0x7f3c3400b8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c3400b4c0 0x7f3c3400b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149746907 0 0) 0x7f3c58158930 con 0x7f3c3400b0e0 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c3c003530 con 0x7f3c3400b0e0 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 995934043 0 0) 0x7f3c3c003530 con 0x7f3c3400b0e0 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c3400b4c0 msgr2=0x7f3c3400b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 --2- 172.21.15.148:0/2187763565 >> v2:172.21.15.148:3300/0 conn(0x7f3c3400b4c0 0x7f3c3400b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3400d370 con 0x7f3c3400b0e0 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f3c4800f040 con 0x7f3c3400b0e0 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 >> v1:172.21.15.157:6789/0 conn(0x7f3c3400b0e0 legacy=0x7f3c34009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c5d400640 1 -- 172.21.15.148:0/2187763565 reap_dead start 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58152fa0 con 0x7f3c3c0039c0 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c005550 con 0x7f3c3c004810 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3c00bf10 con 0x7f3c580c9340 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c5ca00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 msgr2=0x7f3c3c003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c3c003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.411+0000 7f3c5d400640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:22.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 msgr2=0x7f3c3c003dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c3c003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 -- 172.21.15.148:0/2187763565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c003530 con 0x7f3c3c004810 2024-04-26T23:08:22.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c4fe00640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c3c004c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009100 tx=0x7f3c4001f300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3533555e2586810a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c400b3070 con 0x7f3c3c004810 2024-04-26T23:08:22.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c400ae600 con 0x7f3c3c004810 2024-04-26T23:08:22.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.415+0000 7f3c57e00640 1 -- 172.21.15.148:0/2187763565 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000f040 con 0x7f3c3c004810 2024-04-26T23:08:22.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 msgr2=0x7f3c3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c3c004c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009100 tx=0x7f3c4001f300 comp rx=0 tx=0).stop 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- 172.21.15.148:0/2187763565 shutdown_connections 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c3c004c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c3c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 --2- 172.21.15.148:0/2187763565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- 172.21.15.148:0/2187763565 >> 172.21.15.148:0/2187763565 conn(0x7f3c5806c380 msgr2=0x7f3c5806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- 172.21.15.148:0/2187763565 shutdown_connections 2024-04-26T23:08:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- 172.21.15.148:0/2187763565 wait complete. 2024-04-26T23:08:22.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 Processor -- start 2024-04-26T23:08:22.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.419+0000 7f3c5f400640 1 -- start start 2024-04-26T23:08:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c580cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c581f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c581f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c581591d0 con 0x7f3c3c0039c0 2024-04-26T23:08:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58158ef0 con 0x7f3c3c004810 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c581594b0 con 0x7f3c580c9340 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5ca00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 msgr2=0x7f3c580cc310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c580cc310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c581f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c581f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c581f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:43394/0 (socket says 172.21.15.148:43394) 2024-04-26T23:08:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c4fe00640 1 -- 172.21.15.148:0/3999315275 learned_addr learned my addr 172.21.15.148:0/3999315275 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 -- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 msgr2=0x7f3c581f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c581f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 -- 172.21.15.148:0/3999315275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 msgr2=0x7f3c580cc310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c580cc310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 -- 172.21.15.148:0/3999315275 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c580cc850 con 0x7f3c580c9340 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5d400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c581f0d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c580cacc0 tx=0x7f3c5000d780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000de60 con 0x7f3c580c9340 2024-04-26T23:08:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5000a5c0 con 0x7f3c580c9340 2024-04-26T23:08:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000a9b0 con 0x7f3c580c9340 2024-04-26T23:08:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c581522c0 con 0x7f3c580c9340 2024-04-26T23:08:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c58150c80 con 0x7f3c580c9340 2024-04-26T23:08:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.423+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c58077c20 con 0x7f3c580c9340 2024-04-26T23:08:22.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.427+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c5000b040 con 0x7f3c580c9340 2024-04-26T23:08:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.427+0000 7f3c55600640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 0x7f3c3406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.427+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3c500879b0 con 0x7f3c580c9340 2024-04-26T23:08:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.427+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 0x7f3c3406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.427+0000 7f3c5ca00640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 0x7f3c3406f400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000eb0 tx=0x7f3c48016660 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.439+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3c5001f030 con 0x7f3c580c9340 2024-04-26T23:08:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.655+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c580c9940 con 0x7f3c580c9340 2024-04-26T23:08:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c55600640 1 -- 172.21.15.148:0/3999315275 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f3c50057bc0 con 0x7f3c580c9340 2024-04-26T23:08:22.658 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 msgr2=0x7f3c3406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 0x7f3c3406f400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000eb0 tx=0x7f3c48016660 comp rx=0 tx=0).stop 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 msgr2=0x7f3c581f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c581f0d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c580cacc0 tx=0x7f3c5000d780 comp rx=0 tx=0).stop 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 shutdown_connections 2024-04-26T23:08:22.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3c3406cf40 0x7f3c3406f400 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c580c9340 0x7f3c581f0d70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c3c004810 0x7f3c581f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 --2- 172.21.15.148:0/3999315275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c3c0039c0 0x7f3c580cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 >> 172.21.15.148:0/3999315275 conn(0x7f3c5806c380 msgr2=0x7f3c58146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 shutdown_connections 2024-04-26T23:08:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.659+0000 7f3c5f400640 1 -- 172.21.15.148:0/3999315275 wait complete. 2024-04-26T23:08:22.679 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:08:22.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:08:22.680 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:08:22.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 Processor -- start 2024-04-26T23:08:22.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 -- start start 2024-04-26T23:08:22.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 0x7f5df80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5df8073230 0x7f5df80736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df8073be0 con 0x7f5df8158a80 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80c4b30 con 0x7f5df8152d00 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5dfcc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80c6f60 con 0x7f5df8073230 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5df5e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 msgr2=0x7f5df80c97d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.855+0000 7f5df5e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 0x7f5df80c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5df8073230 0x7f5df80736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df6800640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5df8158a80 0x7f5df8158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:39084/0 (socket says 172.21.15.148:39084) 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df6800640 1 -- 172.21.15.148:0/2947094650 learned_addr learned my addr 172.21.15.148:0/2947094650 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:22.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 -- 172.21.15.148:0/2947094650 >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 msgr2=0x7f5df80c97d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:22.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 --2- 172.21.15.148:0/2947094650 >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 0x7f5df80c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 -- 172.21.15.148:0/2947094650 >> v1:172.21.15.157:6789/0 conn(0x7f5df8158a80 legacy=0x7f5df8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 -- 172.21.15.148:0/2947094650 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80c7240 con 0x7f5df8073230 2024-04-26T23:08:22.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df5400640 1 --2- 172.21.15.148:0/2947094650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8073230 0x7f5df80736a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5df80cad50 tx=0x7f5de801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ab720f7cee9a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df4a00640 1 -- 172.21.15.148:0/2947094650 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de80b0070 con 0x7f5df8073230 2024-04-26T23:08:22.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df4a00640 1 -- 172.21.15.148:0/2947094650 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de80ab600 con 0x7f5df8073230 2024-04-26T23:08:22.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.859+0000 7f5df4a00640 1 -- 172.21.15.148:0/2947094650 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de80ab9d0 con 0x7f5df8073230 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- 172.21.15.148:0/2947094650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8073230 msgr2=0x7f5df80736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/2947094650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8073230 0x7f5df80736a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5df80cad50 tx=0x7f5de801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- 172.21.15.148:0/2947094650 shutdown_connections 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/2947094650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8073230 0x7f5df80736a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/2947094650 >> v2:172.21.15.148:3300/0 conn(0x7f5df8152d00 0x7f5df80c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- 172.21.15.148:0/2947094650 >> 172.21.15.148:0/2947094650 conn(0x7f5df80c9d10 msgr2=0x7f5df80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:22.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- 172.21.15.148:0/2947094650 shutdown_connections 2024-04-26T23:08:22.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- 172.21.15.148:0/2947094650 wait complete. 2024-04-26T23:08:22.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 Processor -- start 2024-04-26T23:08:22.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- start start 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df8073230 0x7f5df8146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5df8152d00 0x7f5df81535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 0x7f5df8151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c4890 con 0x7f5df8073230 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c4710 con 0x7f5df8158a80 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5dfcc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5df806fcf0 con 0x7f5df8152d00 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df5e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df8073230 msgr2=0x7f5df8146710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df8073230 0x7f5df8146710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df5400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5df8152d00 0x7f5df81535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df6800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 0x7f5df8151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df6800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 0x7f5df8151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:43414/0 (socket says 172.21.15.148:43414) 2024-04-26T23:08:22.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.863+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 learned_addr learned my addr 172.21.15.148:0/517221730 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5df8152d00 msgr2=0x7f5df81535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5df8152d00 0x7f5df81535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df8073230 msgr2=0x7f5df8146710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df8073230 0x7f5df8146710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df81554e0 con 0x7f5df8158a80 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df5400640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5df8152d00 0x7f5df81535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df6800640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 0x7f5df8151b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5df000cab0 tx=0x7f5df000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0017070 con 0x7f5df8158a80 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df000ac30 con 0x7f5df8158a80 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012400 con 0x7f5df8158a80 2024-04-26T23:08:22.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df81557c0 con 0x7f5df8158a80 2024-04-26T23:08:22.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df8155d80 con 0x7f5df8158a80 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 0x7f5df8146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5df8077c20 con 0x7f5df81f4be0 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df5e00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 0x7f5df8146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.867+0000 7f5df5e00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5df8147bf0 con 0x7f5df81f4be0 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5df5e00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 0x7f5df8146050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5df001a070 con 0x7f5df8158a80 2024-04-26T23:08:22.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5dd4068330 0x7f5dd406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5df0086b10 con 0x7f5df8158a80 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0003e20 con 0x7f5df81f4be0 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5de0015070 con 0x7f5df81f4be0 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 msgr2=0x7f5df8146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 0x7f5df8146050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de000b910 comp rx=0 tx=0).stop 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 msgr2=0x7f5df8146050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5dee000640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df81f4be0 0x7f5df8146050 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de000b910 comp rx=0 tx=0).stop 2024-04-26T23:08:22.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5df5400640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5dd4068330 0x7f5dd406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.871+0000 7f5df5400640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5dd4068330 0x7f5dd406a7f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ad000 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.875+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 0x7f5df8152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:22.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.875+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80ca4a0 con 0x7f5df8147570 2024-04-26T23:08:22.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.875+0000 7f5df5e00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 0x7f5df8152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:22.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5df5e00640 1 -- 172.21.15.148:0/517221730 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5df80ccfc0 con 0x7f5df8147570 2024-04-26T23:08:22.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5df5e00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 0x7f5df8152090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de0005a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:22.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de001ae00 con 0x7f5df8147570 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5203 (secure 0 0 0) 0x7f5de001ae00 con 0x7f5df8147570 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 msgr2=0x7f5df8152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 0x7f5df8152090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de0005a30 comp rx=0 tx=0).stop 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 msgr2=0x7f5df8152090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dee000640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8147570 0x7f5df8152090 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b450 tx=0x7f5de0005a30 comp rx=0 tx=0).stop 2024-04-26T23:08:22.879 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 30, 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 245730, 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:22.880 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:22.881 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:22.882 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:22.883 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.884 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:22.885 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:22.888 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.890 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:22.892 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:22.893 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5dd4068330 msgr2=0x7f5dd406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5dd4068330 0x7f5dd406a7f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ad000 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 msgr2=0x7f5df8151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 --2- 172.21.15.148:0/517221730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df8158a80 0x7f5df8151b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5df000cab0 tx=0x7f5df000cf70 comp rx=0 tx=0).stop 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 reap_dead start 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5df6800640 1 -- 172.21.15.148:0/517221730 reap_dead start 2024-04-26T23:08:22.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 shutdown_connections 2024-04-26T23:08:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 >> 172.21.15.148:0/517221730 conn(0x7f5df80c9d10 msgr2=0x7f5df8157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 shutdown_connections 2024-04-26T23:08:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:22.879+0000 7f5dfcc00640 1 -- 172.21.15.148:0/517221730 wait complete. 2024-04-26T23:08:22.898 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:08:22.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:08:22.898 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:08:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 Processor -- start 2024-04-26T23:08:23.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 -- start start 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 0x7ff118073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff118158a80 0x7ff118158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7ff118073bb0 con 0x7ff118073230 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff1180c4b30 con 0x7ff118158a80 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11f600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1180c6f60 con 0x7ff118152d00 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff117e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 msgr2=0x7ff118073670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff117e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 0x7ff118073670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11d600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff118158a80 0x7ff118158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:38344/0 (socket says 172.21.15.148:38344) 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 -- 172.21.15.148:0/731394629 learned_addr learned my addr 172.21.15.148:0/731394629 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 -- 172.21.15.148:0/731394629 >> v2:172.21.15.157:3300/0 conn(0x7ff118158a80 msgr2=0x7ff118158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 --2- 172.21.15.148:0/731394629 >> v2:172.21.15.157:3300/0 conn(0x7ff118158a80 0x7ff118158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 -- 172.21.15.148:0/731394629 >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 msgr2=0x7ff118073670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 --2- 172.21.15.148:0/731394629 >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 0x7ff118073670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.035+0000 7ff11cc00640 1 -- 172.21.15.148:0/731394629 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1180c7240 con 0x7ff118152d00 2024-04-26T23:08:23.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11cc00640 1 --2- 172.21.15.148:0/731394629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1180c4540 tx=0x7ff10c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f39c66d77558ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff117400640 1 -- 172.21.15.148:0/731394629 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0a7070 con 0x7ff118152d00 2024-04-26T23:08:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff117400640 1 -- 172.21.15.148:0/731394629 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c0b0070 con 0x7ff118152d00 2024-04-26T23:08:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff117400640 1 -- 172.21.15.148:0/731394629 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0ab890 con 0x7ff118152d00 2024-04-26T23:08:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 -- 172.21.15.148:0/731394629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 msgr2=0x7ff1180c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 --2- 172.21.15.148:0/731394629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1180c4540 tx=0x7ff10c01c510 comp rx=0 tx=0).stop 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 -- 172.21.15.148:0/731394629 shutdown_connections 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 --2- 172.21.15.148:0/731394629 >> v2:172.21.15.148:3300/0 conn(0x7ff118073230 0x7ff118073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 --2- 172.21.15.148:0/731394629 >> v2:172.21.15.157:3300/0 conn(0x7ff118158a80 0x7ff118158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 --2- 172.21.15.148:0/731394629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c97d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 -- 172.21.15.148:0/731394629 >> 172.21.15.148:0/731394629 conn(0x7ff1180c9d10 msgr2=0x7ff1180ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 -- 172.21.15.148:0/731394629 shutdown_connections 2024-04-26T23:08:23.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.039+0000 7ff11f600640 1 -- 172.21.15.148:0/731394629 wait complete. 2024-04-26T23:08:23.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 Processor -- start 2024-04-26T23:08:23.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 -- start start 2024-04-26T23:08:23.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 0x7ff1180cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff118158a80 0x7ff118162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180c4f90 con 0x7ff118158a80 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180c4e10 con 0x7ff118073230 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1180c4710 con 0x7ff118152d00 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11d600640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff118158a80 msgr2=0x7ff118162390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff118158a80 0x7ff118162390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff117e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 0x7ff1180cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 0x7ff1180cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:43444/0 (socket says 172.21.15.148:43444) 2024-04-26T23:08:23.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 -- 172.21.15.148:0/1163198426 learned_addr learned my addr 172.21.15.148:0/1163198426 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 msgr2=0x7ff1180c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff118158a80 msgr2=0x7ff118162390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:23.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff118158a80 0x7ff118162390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1181f8f90 con 0x7ff118073230 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff117e00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff118152d00 0x7ff1180c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11cc00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 0x7ff1180cc180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff10c01abc0 tx=0x7ff10c01ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0be5f0 con 0x7ff118073230 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1181f8410 con 0x7ff118073230 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c0be790 con 0x7ff118073230 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.043+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0beb80 con 0x7ff118073230 2024-04-26T23:08:23.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1181f89d0 con 0x7ff118073230 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff11f600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 0x7ff1181628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff118077c20 con 0x7ff1181f8ba0 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff117e00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 0x7ff1181628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff117e00640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff11814d430 con 0x7ff1181f8ba0 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff117e00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 0x7ff1181628d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff11814d400 tx=0x7ff104005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104016070 con 0x7ff1181f8ba0 2024-04-26T23:08:23.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff10c0b43f0 con 0x7ff118073230 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff0f80682b0 0x7ff0f806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff10c1217c0 con 0x7ff118073230 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff10400ea00 con 0x7ff1181f8ba0 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 msgr2=0x7ff1181628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 0x7ff1181628d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff11814d400 tx=0x7ff104005710 comp rx=0 tx=0).stop 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 msgr2=0x7ff1181628d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff114c00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181f8ba0 0x7ff1181628d0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff11814d400 tx=0x7ff104005710 comp rx=0 tx=0).stop 2024-04-26T23:08:23.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.047+0000 7ff11d600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff0f80682b0 0x7ff0f806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.051+0000 7ff11d600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff0f80682b0 0x7ff0f806a770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff118161eb0 tx=0x7ff11000b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:23.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff11f600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 0x7ff11814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:23.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff11814d150 con 0x7ff1181615d0 2024-04-26T23:08:23.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff117e00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 0x7ff11814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:23.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff117e00640 1 -- 172.21.15.148:0/1163198426 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff11814ce70 con 0x7ff1181615d0 2024-04-26T23:08:23.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff117e00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 0x7ff11814bc70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff104018000 tx=0x7ff1040059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:23.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104026600 con 0x7ff1181615d0 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7ff1040123f0 con 0x7ff1181615d0 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 msgr2=0x7ff11814bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 0x7ff11814bc70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff104018000 tx=0x7ff1040059e0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 msgr2=0x7ff11814bc70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.055+0000 7ff114c00640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1181615d0 0x7ff11814bc70 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff104018000 tx=0x7ff1040059e0 comp rx=0 tx=0).stop 2024-04-26T23:08:23.057 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 30, 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 245906, 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:23.058 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:23.059 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:23.060 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:23.061 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.062 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:23.063 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:23.064 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:23.065 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:23.068 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:23.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff0f80682b0 msgr2=0x7ff0f806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff0f80682b0 0x7ff0f806a770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff118161eb0 tx=0x7ff11000b040 comp rx=0 tx=0).stop 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 msgr2=0x7ff1180cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 --2- 172.21.15.148:0/1163198426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff118073230 0x7ff1180cc180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff10c01abc0 tx=0x7ff10c01ad50 comp rx=0 tx=0).stop 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11d600640 1 -- 172.21.15.148:0/1163198426 reap_dead start 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11d600640 1 -- 172.21.15.148:0/1163198426 reap_dead start 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 shutdown_connections 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 >> 172.21.15.148:0/1163198426 conn(0x7ff1180c9d10 msgr2=0x7ff1181569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:23.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 shutdown_connections 2024-04-26T23:08:23.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:23.059+0000 7ff11f600640 1 -- 172.21.15.148:0/1163198426 wait complete. 2024-04-26T23:08:23.075 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:08:23.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:08:43.077 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:08:43.077 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:08:43.077 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:08:43.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:08:43.085 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:08:43.085 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:08:43.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:43.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 Processor -- start 2024-04-26T23:08:43.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 -- start start 2024-04-26T23:08:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 0x7fe3740c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3740c9d90 con 0x7fe3740c9010 2024-04-26T23:08:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3740ca070 con 0x7fe374153af0 2024-04-26T23:08:43.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe37aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe37415dec0 con 0x7fe3740c7b80 2024-04-26T23:08:43.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe378a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe3740c9010 0x7fe3740c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45210/0 (socket says 172.21.15.148:45210) 2024-04-26T23:08:43.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe378a00640 1 -- 172.21.15.148:0/653474506 learned_addr learned my addr 172.21.15.148:0/653474506 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:43.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe373400640 1 --2- 172.21.15.148:0/653474506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 0x7fe3740c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:43.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe373400640 1 -- 172.21.15.148:0/653474506 >> v1:172.21.15.157:6789/0 conn(0x7fe374153af0 legacy=0x7fe37415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe373400640 1 -- 172.21.15.148:0/653474506 >> v1:172.21.15.148:6789/0 conn(0x7fe3740c9010 legacy=0x7fe3740c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe373400640 1 -- 172.21.15.148:0/653474506 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3740ca350 con 0x7fe3740c7b80 2024-04-26T23:08:43.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.242+0000 7fe372a00640 1 -- 172.21.15.148:0/653474506 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849327156 0 0) 0x7fe3740ca070 con 0x7fe374153af0 2024-04-26T23:08:43.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe373400640 1 --2- 172.21.15.148:0/653474506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 0x7fe3740c7f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097f0 tx=0x7fe36001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7ded1100b90a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:43.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe372a00640 1 -- 172.21.15.148:0/653474506 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600b5070 con 0x7fe3740c7b80 2024-04-26T23:08:43.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe372a00640 1 -- 172.21.15.148:0/653474506 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3600a89d0 con 0x7fe3740c7b80 2024-04-26T23:08:43.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe372a00640 1 -- 172.21.15.148:0/653474506 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600a8da0 con 0x7fe3740c7b80 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 -- 172.21.15.148:0/653474506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 msgr2=0x7fe3740c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 --2- 172.21.15.148:0/653474506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 0x7fe3740c7f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097f0 tx=0x7fe36001ecd0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 -- 172.21.15.148:0/653474506 shutdown_connections 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 --2- 172.21.15.148:0/653474506 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe3740c7b80 0x7fe3740c7f80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 -- 172.21.15.148:0/653474506 >> 172.21.15.148:0/653474506 conn(0x7fe37406c380 msgr2=0x7fe37406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 -- 172.21.15.148:0/653474506 shutdown_connections 2024-04-26T23:08:43.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.246+0000 7fe37aa00640 1 -- 172.21.15.148:0/653474506 wait complete. 2024-04-26T23:08:43.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 Processor -- start 2024-04-26T23:08:43.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- start start 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 0x7fe37415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374153af0 0x7fe3740730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe37415d290 con 0x7fe3740c9010 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3740ca630 con 0x7fe3740c7b80 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe374153ed0 con 0x7fe374153af0 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36892/0 (socket says 172.21.15.148:36892) 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 -- 172.21.15.148:0/206839089 learned_addr learned my addr 172.21.15.148:0/206839089 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 msgr2=0x7fe3740cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 msgr2=0x7fe3740cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:08:43.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:08:43.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 0x7fe37415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:43.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe378a00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374153af0 0x7fe3740730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:43.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373400640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374153af0 msgr2=0x7fe3740730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374153af0 0x7fe3740730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 msgr2=0x7fe3740cd5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 -- 172.21.15.148:0/206839089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37415b880 con 0x7fe3740c7b80 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe373e00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 0x7fe37415b020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c460 tx=0x7fe36400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364017070 con 0x7fe3740c7b80 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe364003600 con 0x7fe3740c7b80 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37415bb20 con 0x7fe3740c7b80 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640039f0 con 0x7fe3740c7b80 2024-04-26T23:08:43.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.250+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3740c2a10 con 0x7fe3740c7b80 2024-04-26T23:08:43.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.254+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374077c20 con 0x7fe3740c7b80 2024-04-26T23:08:43.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.254+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe36401a070 con 0x7fe3740c7b80 2024-04-26T23:08:43.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.254+0000 7fe36be00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 0x7fe35406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:43.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.254+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe3640868b0 con 0x7fe3740c7b80 2024-04-26T23:08:43.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.254+0000 7fe373400640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 0x7fe35406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:43.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.258+0000 7fe373400640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 0x7fe35406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe37414cb10 tx=0x7fe3600aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:43.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.266+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe364056410 con 0x7fe3740c7b80 2024-04-26T23:08:43.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:08:43.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:08:43.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.498+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe3740c8670 con 0x7fe3740c7b80 2024-04-26T23:08:43.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.498+0000 7fe36be00640 1 -- 172.21.15.148:0/206839089 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fe36405a710 con 0x7fe3740c7b80 2024-04-26T23:08:43.500 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 msgr2=0x7fe35406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 0x7fe35406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe37414cb10 tx=0x7fe3600aa070 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 msgr2=0x7fe37415b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 0x7fe37415b020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c460 tx=0x7fe36400c920 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 shutdown_connections 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe354068380 0x7fe35406a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe374153af0 0x7fe3740730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740c9010 0x7fe3740cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 --2- 172.21.15.148:0/206839089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3740c7b80 0x7fe37415b020 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 >> 172.21.15.148:0/206839089 conn(0x7fe37406c380 msgr2=0x7fe3740c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:43.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 shutdown_connections 2024-04-26T23:08:43.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:43.502+0000 7fe37aa00640 1 -- 172.21.15.148:0/206839089 wait complete. 2024-04-26T23:08:46.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:46.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.674+0000 7fa6b9e00640 1 Processor -- start 2024-04-26T23:08:46.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.674+0000 7fa6b9e00640 1 -- start start 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b9e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6b40711b0 0x7fa6b415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b9e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b4153ec0 con 0x7fa6b415d500 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b9e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b4071840 con 0x7fa6b4153ae0 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b9e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b4071620 con 0x7fa6b40711b0 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6b40711b0 0x7fa6b415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa6b4153ae0 0x7fa6b40c8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:35542/0 (socket says 172.21.15.148:35542) 2024-04-26T23:08:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2a00640 1 -- 172.21.15.148:0/3512253838 learned_addr learned my addr 172.21.15.148:0/3512253838 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2000640 1 -- 172.21.15.148:0/3512253838 >> v1:172.21.15.157:6789/0 conn(0x7fa6b4153ae0 legacy=0x7fa6b40c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2000640 1 -- 172.21.15.148:0/3512253838 >> v1:172.21.15.148:6789/0 conn(0x7fa6b415d500 legacy=0x7fa6b40c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b2000640 1 -- 172.21.15.148:0/3512253838 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b4071b20 con 0x7fa6b40711b0 2024-04-26T23:08:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.678+0000 7fa6b1600640 1 -- 172.21.15.148:0/3512253838 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816749526 0 0) 0x7fa6b4153ec0 con 0x7fa6b415d500 2024-04-26T23:08:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b2000640 1 --2- 172.21.15.148:0/3512253838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b40711b0 0x7fa6b415cfc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62977c490464f57a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b1600640 1 -- 172.21.15.148:0/3512253838 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00b5070 con 0x7fa6b40711b0 2024-04-26T23:08:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b1600640 1 -- 172.21.15.148:0/3512253838 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a00a8990 con 0x7fa6b40711b0 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b1600640 1 -- 172.21.15.148:0/3512253838 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00a8d60 con 0x7fa6b40711b0 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3512253838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b40711b0 msgr2=0x7fa6b415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3512253838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b40711b0 0x7fa6b415cfc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3512253838 shutdown_connections 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3512253838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b40711b0 0x7fa6b415cfc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3512253838 >> 172.21.15.148:0/3512253838 conn(0x7fa6b406f160 msgr2=0x7fa6b406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3512253838 shutdown_connections 2024-04-26T23:08:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3512253838 wait complete. 2024-04-26T23:08:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 Processor -- start 2024-04-26T23:08:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.682+0000 7fa6b9e00640 1 -- start start 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 0x7fa6b41e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6b4153ae0 0x7fa6b4148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b406cea0 con 0x7fa6b415d500 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b406c600 con 0x7fa6b40711b0 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b406cb30 con 0x7fa6b4153ae0 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b2a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 0x7fa6b41e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6b4153ae0 0x7fa6b4148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b2a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 0x7fa6b41e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:58454/0 (socket says 172.21.15.148:58454) 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50538/0 (socket says 172.21.15.148:50538) 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b2a00640 1 -- 172.21.15.148:0/3223606864 learned_addr learned my addr 172.21.15.148:0/3223606864 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 -- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6b4153ae0 msgr2=0x7fa6b4148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6b4153ae0 0x7fa6b4148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 -- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 msgr2=0x7fa6b41e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 0x7fa6b41e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 -- 172.21.15.148:0/3223606864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b40cc580 con 0x7fa6b415d500 2024-04-26T23:08:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b3400640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c750 tx=0x7fa6ac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac003b80 con 0x7fa6b415d500 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ac003d20 con 0x7fa6b415d500 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b41498c0 con 0x7fa6b415d500 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0052b0 con 0x7fa6b415d500 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b415ce20 con 0x7fa6b415d500 2024-04-26T23:08:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b4077c20 con 0x7fa6b415d500 2024-04-26T23:08:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.686+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6ac005450 con 0x7fa6b415d500 2024-04-26T23:08:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.690+0000 7fa6ab400640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 0x7fa69406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.690+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6ac086af0 con 0x7fa6b415d500 2024-04-26T23:08:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.690+0000 7fa6b2a00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 0x7fa69406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.690+0000 7fa6b2a00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 0x7fa69406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4005890 tx=0x7fa6a4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:46.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.694+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6b40cc580 con 0x7fa6b415d500 2024-04-26T23:08:46.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.914+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa6b406c3e0 con 0x7fa6b415d500 2024-04-26T23:08:46.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6ab400640 1 -- 172.21.15.148:0/3223606864 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa6ac0565c0 con 0x7fa6b415d500 2024-04-26T23:08:46.918 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 msgr2=0x7fa69406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 0x7fa69406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4005890 tx=0x7fa6a4009040 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 msgr2=0x7fa6b4149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c750 tx=0x7fa6ac00cc10 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 shutdown_connections 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa694068380 0x7fa69406a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6b415d500 0x7fa6b4149380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6b4153ae0 0x7fa6b4148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 --2- 172.21.15.148:0/3223606864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b40711b0 0x7fa6b41e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 >> 172.21.15.148:0/3223606864 conn(0x7fa6b406f160 msgr2=0x7fa6b414dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:46.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 shutdown_connections 2024-04-26T23:08:46.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:46.918+0000 7fa6b9e00640 1 -- 172.21.15.148:0/3223606864 wait complete. 2024-04-26T23:08:46.938 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:08:46.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:08:46.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:08:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 Processor -- start 2024-04-26T23:08:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 -- start start 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea81534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea80ca6a0 con 0x7f2ea80c7030 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea8159de0 con 0x7f2ea80c6c50 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eae600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea80cac60 con 0x7f2ea80ca0d0 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50550/0 (socket says 172.21.15.148:50550) 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 -- 172.21.15.148:0/3161011885 learned_addr learned my addr 172.21.15.148:0/3161011885 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2eadc00640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea81534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 -- 172.21.15.148:0/3161011885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 msgr2=0x7f2ea81534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:47.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea81534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 -- 172.21.15.148:0/3161011885 >> v1:172.21.15.157:6789/0 conn(0x7f2ea80c7030 legacy=0x7f2ea81596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.086+0000 7f2ead200640 1 -- 172.21.15.148:0/3161011885 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea80ca980 con 0x7f2ea80c6c50 2024-04-26T23:08:47.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2ead200640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009870 tx=0x7f2e9001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376bde64b7fcb458 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2ea7400640 1 -- 172.21.15.148:0/3161011885 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e900a7070 con 0x7f2ea80c6c50 2024-04-26T23:08:47.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2ea7400640 1 -- 172.21.15.148:0/3161011885 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900b0070 con 0x7f2ea80c6c50 2024-04-26T23:08:47.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2ea7400640 1 -- 172.21.15.148:0/3161011885 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e900ab890 con 0x7f2ea80c6c50 2024-04-26T23:08:47.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 -- 172.21.15.148:0/3161011885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 msgr2=0x7f2ea80cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009870 tx=0x7f2e9001c560 comp rx=0 tx=0).stop 2024-04-26T23:08:47.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 -- 172.21.15.148:0/3161011885 shutdown_connections 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea81534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 --2- 172.21.15.148:0/3161011885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea80cdaf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 -- 172.21.15.148:0/3161011885 >> 172.21.15.148:0/3161011885 conn(0x7f2ea806e0a0 msgr2=0x7f2ea806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 -- 172.21.15.148:0/3161011885 shutdown_connections 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.090+0000 7f2eae600640 1 -- 172.21.15.148:0/3161011885 wait complete. 2024-04-26T23:08:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 Processor -- start 2024-04-26T23:08:47.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- start start 2024-04-26T23:08:47.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea81f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ea8157f50 0x7f2ea81445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea80ce030 con 0x7f2ea80c6c50 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8073440 con 0x7f2ea8157f50 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea80c7ea0 con 0x7f2ea80ca0d0 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea81f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea81f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50552/0 (socket says 172.21.15.148:50552) 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 -- 172.21.15.148:0/3303940249 learned_addr learned my addr 172.21.15.148:0/3303940249 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ea7e00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eadc00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ea8157f50 0x7f2ea81445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 msgr2=0x7f2ea806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ea80ca0d0 0x7f2ea806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ea8157f50 msgr2=0x7f2ea81445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ea8157f50 0x7f2ea81445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea81f78f0 con 0x7f2ea80c6c50 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ead200640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea81f80b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e900ad040 tx=0x7f2e9001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e900be5f0 con 0x7f2ea80c6c50 2024-04-26T23:08:47.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900be790 con 0x7f2ea80c6c50 2024-04-26T23:08:47.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e900beb80 con 0x7f2ea80c6c50 2024-04-26T23:08:47.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea814f630 con 0x7f2ea80c6c50 2024-04-26T23:08:47.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.094+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea81f7b90 con 0x7f2ea80c6c50 2024-04-26T23:08:47.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2eae600640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 0x7f2ea8144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea814f3e0 con 0x7f2ea80c7030 2024-04-26T23:08:47.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea7e00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 0x7f2ea8144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea7e00640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ea81f7dd0 con 0x7f2ea80c7030 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea7e00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 0x7f2ea8144b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e9800e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98019070 con 0x7f2ea80c7030 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e900b43f0 con 0x7f2ea80c6c50 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2e84068280 0x7f2e8406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2e90121970 con 0x7f2ea80c6c50 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2e980052e0 con 0x7f2ea80c7030 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 msgr2=0x7f2ea8144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 0x7f2ea8144b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e9800e890 comp rx=0 tx=0).stop 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 msgr2=0x7f2ea8144b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2ea4c00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c7030 0x7f2ea8144b20 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e9800e890 comp rx=0 tx=0).stop 2024-04-26T23:08:47.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2eadc00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2e84068280 0x7f2e8406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.098+0000 7f2eadc00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2e84068280 0x7f2e8406a740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00074a0 tx=0x7f2ea000b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 0x7f2ea80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea81f7700 con 0x7f2ea8156d30 2024-04-26T23:08:47.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea7e00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 0x7f2ea80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea7e00640 1 -- 172.21.15.148:0/3303940249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ea8145060 con 0x7f2ea8156d30 2024-04-26T23:08:47.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea7e00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 0x7f2ea80cc0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e98000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9801ce00 con 0x7f2ea8156d30 2024-04-26T23:08:47.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7f2e98007020 con 0x7f2ea8156d30 2024-04-26T23:08:47.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 msgr2=0x7f2ea80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 0x7f2ea80cc0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e98000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 msgr2=0x7f2ea80cc0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2ea4c00640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea8156d30 0x7f2ea80cc0d0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ea81490a0 tx=0x7f2e98000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 3919, 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:47.108 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.109 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.110 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.111 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.112 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.113 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.114 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:47.115 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:47.117 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:47.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:47.120 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:47.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2e84068280 msgr2=0x7f2e8406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2e84068280 0x7f2e8406a740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00074a0 tx=0x7f2ea000b040 comp rx=0 tx=0).stop 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 msgr2=0x7f2ea81f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 --2- 172.21.15.148:0/3303940249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea80c6c50 0x7f2ea81f80b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e900ad040 tx=0x7f2e9001ada0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eadc00640 1 -- 172.21.15.148:0/3303940249 reap_dead start 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eadc00640 1 -- 172.21.15.148:0/3303940249 reap_dead start 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 shutdown_connections 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 >> 172.21.15.148:0/3303940249 conn(0x7f2ea806e0a0 msgr2=0x7f2ea80720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 shutdown_connections 2024-04-26T23:08:47.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.106+0000 7f2eae600640 1 -- 172.21.15.148:0/3303940249 wait complete. 2024-04-26T23:08:47.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:47.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:08:47.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:08:47.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 Processor -- start 2024-04-26T23:08:47.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 -- start start 2024-04-26T23:08:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe32c070330 0x7fe32c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe32c0708a0 0x7fe32c072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c0c96b0 con 0x7fe32c06ff50 2024-04-26T23:08:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe32c0c84e0 con 0x7fe32c070330 2024-04-26T23:08:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe331200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe32c0c93d0 con 0x7fe32c0708a0 2024-04-26T23:08:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe32c070330 0x7fe32c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe32c070330 0x7fe32c0c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50562/0 (socket says 172.21.15.148:50562) 2024-04-26T23:08:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 -- 172.21.15.148:0/2677531591 learned_addr learned my addr 172.21.15.148:0/2677531591 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe32a800640 1 --2- 172.21.15.148:0/2677531591 >> v2:172.21.15.157:3300/0 conn(0x7fe32c0708a0 0x7fe32c072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 -- 172.21.15.148:0/2677531591 >> v2:172.21.15.157:3300/0 conn(0x7fe32c0708a0 msgr2=0x7fe32c072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:47.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 --2- 172.21.15.148:0/2677531591 >> v2:172.21.15.157:3300/0 conn(0x7fe32c0708a0 0x7fe32c072d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 -- 172.21.15.148:0/2677531591 >> v1:172.21.15.157:6789/0 conn(0x7fe32c06ff50 legacy=0x7fe32c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.270+0000 7fe329400640 1 -- 172.21.15.148:0/2677531591 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c0c7bb0 con 0x7fe32c070330 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe329400640 1 --2- 172.21.15.148:0/2677531591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c070330 0x7fe32c0c8970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0c10c0 tx=0x7fe31801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b7d39bb66e674a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe328a00640 1 -- 172.21.15.148:0/2677531591 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180b5070 con 0x7fe32c070330 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe328a00640 1 -- 172.21.15.148:0/2677531591 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3180a8a10 con 0x7fe32c070330 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe328a00640 1 -- 172.21.15.148:0/2677531591 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180a8de0 con 0x7fe32c070330 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 -- 172.21.15.148:0/2677531591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c070330 msgr2=0x7fe32c0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 --2- 172.21.15.148:0/2677531591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c070330 0x7fe32c0c8970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0c10c0 tx=0x7fe31801ed10 comp rx=0 tx=0).stop 2024-04-26T23:08:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 -- 172.21.15.148:0/2677531591 shutdown_connections 2024-04-26T23:08:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 --2- 172.21.15.148:0/2677531591 >> v2:172.21.15.157:3300/0 conn(0x7fe32c0708a0 0x7fe32c072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 --2- 172.21.15.148:0/2677531591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c070330 0x7fe32c0c8970 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 -- 172.21.15.148:0/2677531591 >> 172.21.15.148:0/2677531591 conn(0x7fe32c0c9d10 msgr2=0x7fe32c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 -- 172.21.15.148:0/2677531591 shutdown_connections 2024-04-26T23:08:47.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 -- 172.21.15.148:0/2677531591 wait complete. 2024-04-26T23:08:47.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.274+0000 7fe331200640 1 Processor -- start 2024-04-26T23:08:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- start start 2024-04-26T23:08:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c070330 0x7fe32c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe32c0708a0 0x7fe32c161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c0c8fd0 con 0x7fe32c06ff50 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c0c8170 con 0x7fe32c070330 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c0c9150 con 0x7fe32c0708a0 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50564/0 (socket says 172.21.15.148:50564) 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 -- 172.21.15.148:0/1989558603 learned_addr learned my addr 172.21.15.148:0/1989558603 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe32a800640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe32c0708a0 0x7fe32c161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329400640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c070330 0x7fe32c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe32c0708a0 msgr2=0x7fe32c161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe32c0708a0 0x7fe32c161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c070330 msgr2=0x7fe32c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c070330 0x7fe32c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c14db40 con 0x7fe32c06ff50 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329e00640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c370 tx=0x7fe31c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0052d0 con 0x7fe32c06ff50 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c005470 con 0x7fe32c06ff50 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c007260 con 0x7fe32c06ff50 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c14dde0 con 0x7fe32c06ff50 2024-04-26T23:08:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c14e3a0 con 0x7fe32c06ff50 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 0x7fe32c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1f2410 con 0x7fe32c1625e0 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.278+0000 7fe329400640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 0x7fe32c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe329400640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe32c077c20 con 0x7fe32c1625e0 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe31c007400 con 0x7fe32c06ff50 2024-04-26T23:08:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe329400640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 0x7fe32c15bd30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cad50 tx=0x7fe31801d550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe30c068380 0x7fe30c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe31c0862e0 con 0x7fe32c06ff50 2024-04-26T23:08:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180bf070 con 0x7fe32c1625e0 2024-04-26T23:08:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe32a800640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe30c068380 0x7fe30c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe3180b0640 con 0x7fe32c1625e0 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 msgr2=0x7fe32c15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 0x7fe32c15bd30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cad50 tx=0x7fe31801d550 comp rx=0 tx=0).stop 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 msgr2=0x7fe32c15bd30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe322000640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c1625e0 0x7fe32c15bd30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.282+0000 7fe32a800640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe30c068380 0x7fe30c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3240113e0 tx=0x7fe32400b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.286+0000 7fe331200640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 0x7fe32c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.286+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c15c7b0 con 0x7fe32c161640 2024-04-26T23:08:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.286+0000 7fe329400640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 0x7fe32c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe329400640 1 -- 172.21.15.148:0/1989558603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe32c14e780 con 0x7fe32c161640 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe329400640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 0x7fe32c15c270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe31801c940 tx=0x7fe31801bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180bf040 con 0x7fe32c161640 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7fe3180c4c80 con 0x7fe32c161640 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 msgr2=0x7fe32c15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 0x7fe32c15c270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe31801c940 tx=0x7fe31801bab0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 msgr2=0x7fe32c15c270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe322000640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe32c161640 0x7fe32c15c270 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.296 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:47.296 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:47.297 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:47.297 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:47.297 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:47.297 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 270142, 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.298 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.299 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.300 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.301 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:47.303 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.304 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:47.305 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:47.305 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:47.305 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:47.305 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.307 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.308 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.308 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.308 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.308 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:47.309 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:47.310 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.310 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.310 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.310 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.311 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.312 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.314 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:47.314 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.315 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.315 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:47.315 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.315 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.315 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.316 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.317 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.318 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.319 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.320 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.321 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:08:47.322 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.323 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:47.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.325 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:47.326 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:47.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe30c068380 msgr2=0x7fe30c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe30c068380 0x7fe30c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3240113e0 tx=0x7fe32400b040 comp rx=0 tx=0).stop 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 msgr2=0x7fe32c1f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c370 tx=0x7fe31c00c830 comp rx=0 tx=0).stop 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe32a800640 1 -- 172.21.15.148:0/1989558603 reap_dead start 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 shutdown_connections 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 --2- 172.21.15.148:0/1989558603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c06ff50 0x7fe32c1f1ed0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 >> 172.21.15.148:0/1989558603 conn(0x7fe32c0c9d10 msgr2=0x7fe32c150360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 shutdown_connections 2024-04-26T23:08:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.290+0000 7fe331200640 1 -- 172.21.15.148:0/1989558603 wait complete. 2024-04-26T23:08:47.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:47.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:08:47.329 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:08:47.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 Processor -- start 2024-04-26T23:08:47.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 -- start start 2024-04-26T23:08:47.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe7f006c380 0x7fe7f015f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c7d0 0x7fe7f00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f006ccb0 con 0x7fe7f0155d70 2024-04-26T23:08:47.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f006d730 con 0x7fe7f006c380 2024-04-26T23:08:47.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f5600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f00c8bc0 con 0x7fe7f006c7d0 2024-04-26T23:08:47.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7efe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe7f0155d70 0x7fe7f00c8060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44578/0 (socket says 172.21.15.148:44578) 2024-04-26T23:08:47.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7efe00640 1 -- 172.21.15.148:0/721599173 learned_addr learned my addr 172.21.15.148:0/721599173 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:47.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7ef400640 1 --2- 172.21.15.148:0/721599173 >> v2:172.21.15.157:3300/0 conn(0x7fe7f006c380 0x7fe7f015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7f4c00640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c7d0 0x7fe7f00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7eea00640 1 -- 172.21.15.148:0/721599173 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860002528 0 0) 0x7fe7e0001120 con 0x7fe7f0155d70 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7eea00640 1 -- 172.21.15.148:0/721599173 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7d4003530 con 0x7fe7f0155d70 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7ef400640 1 -- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c7d0 msgr2=0x7fe7f00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7ef400640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c7d0 0x7fe7f00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7ef400640 1 -- 172.21.15.148:0/721599173 >> v1:172.21.15.148:6789/0 conn(0x7fe7f0155d70 legacy=0x7fe7f00c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.474+0000 7fe7ef400640 1 -- 172.21.15.148:0/721599173 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f00c8ea0 con 0x7fe7f006c380 2024-04-26T23:08:47.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7ef400640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f006c380 0x7fe7f015f150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0097c0 tx=0x7fe7dc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6390358b93178b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7eea00640 1 -- 172.21.15.148:0/721599173 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0b5070 con 0x7fe7f006c380 2024-04-26T23:08:47.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7eea00640 1 -- 172.21.15.148:0/721599173 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc0a8990 con 0x7fe7f006c380 2024-04-26T23:08:47.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7eea00640 1 -- 172.21.15.148:0/721599173 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0a8d40 con 0x7fe7f006c380 2024-04-26T23:08:47.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 -- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f006c380 msgr2=0x7fe7f015f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f006c380 0x7fe7f015f150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0097c0 tx=0x7fe7dc01ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:47.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 -- 172.21.15.148:0/721599173 shutdown_connections 2024-04-26T23:08:47.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c7d0 0x7fe7f00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 --2- 172.21.15.148:0/721599173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f006c380 0x7fe7f015f150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 -- 172.21.15.148:0/721599173 >> 172.21.15.148:0/721599173 conn(0x7fe7f00734b0 msgr2=0x7fe7f0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 -- 172.21.15.148:0/721599173 shutdown_connections 2024-04-26T23:08:47.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.478+0000 7fe7f5600640 1 -- 172.21.15.148:0/721599173 wait complete. 2024-04-26T23:08:47.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 Processor -- start 2024-04-26T23:08:47.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- start start 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c380 0x7fe7f00ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 0x7fe7f0145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f0155d70 0x7fe7f00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f006d210 con 0x7fe7f006c7d0 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f006cf30 con 0x7fe7f0155d70 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f0156150 con 0x7fe7f006c380 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 0x7fe7f0145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 0x7fe7f0145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50574/0 (socket says 172.21.15.148:50574) 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 -- 172.21.15.148:0/1835516989 learned_addr learned my addr 172.21.15.148:0/1835516989 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f4c00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f0155d70 0x7fe7f00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7efe00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c380 0x7fe7f00ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c380 msgr2=0x7fe7f00ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f006c380 0x7fe7f00ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f0155d70 msgr2=0x7fe7f00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f0155d70 0x7fe7f00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f0146140 con 0x7fe7f006c7d0 2024-04-26T23:08:47.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f4c00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f0155d70 0x7fe7f00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:08:47.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7ef400640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 0x7fe7f0145c00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc01c8c0 tx=0x7fe7dc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0b5040 con 0x7fe7f006c7d0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc004040 con 0x7fe7f006c7d0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f0159220 con 0x7fe7f006c7d0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0043f0 con 0x7fe7f006c7d0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.482+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f014cf10 con 0x7fe7f006c7d0 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7f5600640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 0x7fe7f00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f00506d0 con 0x7fe7f0156480 2024-04-26T23:08:47.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7efe00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 0x7fe7f00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7dc0c1020 con 0x7fe7f006c7d0 2024-04-26T23:08:47.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7efe00640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7f0069b70 con 0x7fe7f0156480 2024-04-26T23:08:47.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7efe00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 0x7fe7f00c6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e000eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe7d0068380 0x7fe7d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe7dc123bb0 con 0x7fe7f006c7d0 2024-04-26T23:08:47.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00058c0 con 0x7fe7f0156480 2024-04-26T23:08:47.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7f4c00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe7d0068380 0x7fe7d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe7e0018070 con 0x7fe7f0156480 2024-04-26T23:08:47.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 msgr2=0x7fe7f00c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 0x7fe7f00c6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e000eb90 comp rx=0 tx=0).stop 2024-04-26T23:08:47.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 msgr2=0x7fe7f00c6070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7e7e00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f0156480 0x7fe7f00c6070 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e000eb90 comp rx=0 tx=0).stop 2024-04-26T23:08:47.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.486+0000 7fe7f4c00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe7d0068380 0x7fe7d006a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00c57b0 tx=0x7fe7e800b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7f5600640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 0x7fe7f0156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f0146540 con 0x7fe7f00c65b0 2024-04-26T23:08:47.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7efe00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 0x7fe7f0156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7efe00640 1 -- 172.21.15.148:0/1835516989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7f0159580 con 0x7fe7f00c65b0 2024-04-26T23:08:47.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7efe00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 0x7fe7f0156fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e0000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.494+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00075a0 con 0x7fe7f00c65b0 2024-04-26T23:08:47.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5069 (secure 0 0 0) 0x7fe7e00075a0 con 0x7fe7f00c65b0 2024-04-26T23:08:47.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 msgr2=0x7fe7f0156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7e7e00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 0x7fe7f0156fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e0000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7e7e00640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 msgr2=0x7fe7f0156fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:47.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7e7e00640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7f00c65b0 0x7fe7f0156fe0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0000f70 tx=0x7fe7e0000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 270346, 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.498 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.499 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:47.502 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:47.510 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe7d0068380 msgr2=0x7fe7d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe7d0068380 0x7fe7d006a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00c57b0 tx=0x7fe7e800b040 comp rx=0 tx=0).stop 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 msgr2=0x7fe7f0145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 --2- 172.21.15.148:0/1835516989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f006c7d0 0x7fe7f0145c00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc01c8c0 tx=0x7fe7dc01ba30 comp rx=0 tx=0).stop 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f4c00640 1 -- 172.21.15.148:0/1835516989 reap_dead start 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f4c00640 1 -- 172.21.15.148:0/1835516989 reap_dead start 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 shutdown_connections 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 >> 172.21.15.148:0/1835516989 conn(0x7fe7f00734b0 msgr2=0x7fe7f00c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 shutdown_connections 2024-04-26T23:08:47.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.498+0000 7fe7f5600640 1 -- 172.21.15.148:0/1835516989 wait complete. 2024-04-26T23:08:47.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:47.517 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:08:47.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:08:47.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 Processor -- start 2024-04-26T23:08:47.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 -- start start 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6b880ca170 0x7f6b880ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b880c9560 con 0x7f6b8815ca90 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b880cab00 con 0x7f6b881594f0 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b8d200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6b881598d0 con 0x7f6b880ca170 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b86800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6b880ca170 0x7f6b880ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b7d400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6b8815ca90 0x7f6b88070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44580/0 (socket says 172.21.15.148:44580) 2024-04-26T23:08:47.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b7d400640 1 -- 172.21.15.148:0/554357346 learned_addr learned my addr 172.21.15.148:0/554357346 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:47.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b86800640 1 -- 172.21.15.148:0/554357346 >> v1:172.21.15.157:6789/0 conn(0x7f6b881594f0 legacy=0x7f6b880c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b86800640 1 -- 172.21.15.148:0/554357346 >> v1:172.21.15.148:6789/0 conn(0x7f6b8815ca90 legacy=0x7f6b88070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b86800640 1 -- 172.21.15.148:0/554357346 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b88160240 con 0x7f6b880ca170 2024-04-26T23:08:47.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.658+0000 7f6b85400640 1 -- 172.21.15.148:0/554357346 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207276456 0 0) 0x7f6b880c9560 con 0x7f6b8815ca90 2024-04-26T23:08:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b86800640 1 --2- 172.21.15.148:0/554357346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b880ca170 0x7f6b880ca5c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097c0 tx=0x7f6b8001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d926f1dfb30d8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b85400640 1 -- 172.21.15.148:0/554357346 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b800b5070 con 0x7f6b880ca170 2024-04-26T23:08:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b85400640 1 -- 172.21.15.148:0/554357346 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b800a8990 con 0x7f6b880ca170 2024-04-26T23:08:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b85400640 1 -- 172.21.15.148:0/554357346 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b800a8d60 con 0x7f6b880ca170 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 -- 172.21.15.148:0/554357346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b880ca170 msgr2=0x7f6b880ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 --2- 172.21.15.148:0/554357346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b880ca170 0x7f6b880ca5c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097c0 tx=0x7f6b8001ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 -- 172.21.15.148:0/554357346 shutdown_connections 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 --2- 172.21.15.148:0/554357346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b880ca170 0x7f6b880ca5c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 -- 172.21.15.148:0/554357346 >> 172.21.15.148:0/554357346 conn(0x7f6b880ce2c0 msgr2=0x7f6b880ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 -- 172.21.15.148:0/554357346 shutdown_connections 2024-04-26T23:08:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.662+0000 7f6b8d200640 1 -- 172.21.15.148:0/554357346 wait complete. 2024-04-26T23:08:47.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 Processor -- start 2024-04-26T23:08:47.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- start start 2024-04-26T23:08:47.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 0x7f6b880c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b8815ca90 0x7f6b881f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8815fc80 con 0x7f6b881594f0 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8815f9a0 con 0x7f6b8815ca90 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8815ff60 con 0x7f6b880ca170 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50592/0 (socket says 172.21.15.148:50592) 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 -- 172.21.15.148:0/3655076360 learned_addr learned my addr 172.21.15.148:0/3655076360 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b85e00640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 0x7f6b880c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b86800640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b8815ca90 0x7f6b881f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 -- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 msgr2=0x7f6b880c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 0x7f6b880c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 -- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b8815ca90 msgr2=0x7f6b881f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b8815ca90 0x7f6b881f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 -- 172.21.15.148:0/3655076360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8815a240 con 0x7f6b881594f0 2024-04-26T23:08:47.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b85e00640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 0x7f6b880c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:08:47.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7d400640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c440 tx=0x7f6b7000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70018070 con 0x7f6b881594f0 2024-04-26T23:08:47.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b700074e0 con 0x7f6b881594f0 2024-04-26T23:08:47.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70004a10 con 0x7f6b881594f0 2024-04-26T23:08:47.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b881f4ca0 con 0x7f6b881594f0 2024-04-26T23:08:47.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b881f5260 con 0x7f6b881594f0 2024-04-26T23:08:47.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.666+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b88077c20 con 0x7f6b881594f0 2024-04-26T23:08:47.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.670+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b70004bb0 con 0x7f6b881594f0 2024-04-26T23:08:47.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.670+0000 7f6b7ea00640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 0x7f6b6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:47.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.670+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6b70085f70 con 0x7f6b881594f0 2024-04-26T23:08:47.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.670+0000 7f6b85e00640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 0x7f6b6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:47.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.670+0000 7f6b85e00640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 0x7f6b6406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b780012f0 tx=0x7f6b78009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.674+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b700560a0 con 0x7f6b881594f0 2024-04-26T23:08:47.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.890+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f6b880c9990 con 0x7f6b881594f0 2024-04-26T23:08:47.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b7ea00640 1 -- 172.21.15.148:0/3655076360 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f6b700559a0 con 0x7f6b881594f0 2024-04-26T23:08:47.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 msgr2=0x7f6b6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 0x7f6b6406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b780012f0 tx=0x7f6b78009040 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 msgr2=0x7f6b881f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c440 tx=0x7f6b7000c900 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 shutdown_connections 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6b640683b0 0x7f6b6406a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b8815ca90 0x7f6b881f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881594f0 0x7f6b881f1590 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 --2- 172.21.15.148:0/3655076360 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b880ca170 0x7f6b880c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 >> 172.21.15.148:0/3655076360 conn(0x7f6b880ce2c0 msgr2=0x7f6b88157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 shutdown_connections 2024-04-26T23:08:47.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:47.894+0000 7f6b8d200640 1 -- 172.21.15.148:0/3655076360 wait complete. 2024-04-26T23:08:47.916 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:08:48.236 INFO:tasks.workunit.client.0.smithi148.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T23:08:48.237 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T23:08:48.238 INFO:tasks.workunit.client.0.smithi148.stderr:+ make 2024-04-26T23:08:48.503 INFO:tasks.workunit.client.0.smithi148.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T23:08:48.770 INFO:tasks.workunit.client.0.smithi148.stderr:++ readlink -f fsstress 2024-04-26T23:08:48.771 INFO:tasks.workunit.client.0.smithi148.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T23:08:48.771 INFO:tasks.workunit.client.0.smithi148.stderr:+ popd 2024-04-26T23:08:48.771 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T23:08:48.772 INFO:tasks.workunit.client.0.smithi148.stderr:+ popd 2024-04-26T23:08:48.772 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T23:08:48.772 INFO:tasks.workunit.client.0.smithi148.stderr:++ mktemp -d -p . 2024-04-26T23:08:48.775 INFO:tasks.workunit.client.0.smithi148.stderr:+ T=./tmp.ITjUCaDr8p 2024-04-26T23:08:48.775 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ITjUCaDr8p -l 1 -n 1000 -p 10 -v 2024-04-26T23:08:48.778 INFO:tasks.workunit.client.0.smithi148.stdout:seed = 1713887339 2024-04-26T23:08:48.787 INFO:tasks.workunit.client.0.smithi148.stdout:0/0: mkdir d0 0 2024-04-26T23:08:48.788 INFO:tasks.workunit.client.0.smithi148.stdout:2/0: chown . 1 1 2024-04-26T23:08:48.788 INFO:tasks.workunit.client.0.smithi148.stdout:2/1: dread - no filename 2024-04-26T23:08:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/2: dread - no filename 2024-04-26T23:08:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/3: dread - no filename 2024-04-26T23:08:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/4: dwrite - no filename 2024-04-26T23:08:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/5: dread - no filename 2024-04-26T23:08:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/6: truncate - no filename 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/0: symlink l0 0 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/1: readlink l0 0 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/2: read - no filename 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/3: chown l0 83950 1 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/4: stat l0 0 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/5: write - no filename 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/6: write - no filename 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/7: read - no filename 2024-04-26T23:08:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:1/8: readlink l0 0 2024-04-26T23:08:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:1/9: dwrite - no filename 2024-04-26T23:08:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:1/10: truncate - no filename 2024-04-26T23:08:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:0/1: symlink d0/l1 0 2024-04-26T23:08:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:0/2: read - no filename 2024-04-26T23:08:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/7: mknod c0 0 2024-04-26T23:08:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/8: fsync - no filename 2024-04-26T23:08:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/9: dread - no filename 2024-04-26T23:08:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/10: dread - no filename 2024-04-26T23:08:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/11: chown c0 1 1 2024-04-26T23:08:48.795 INFO:tasks.workunit.client.0.smithi148.stdout:1/11: creat f1 x:0 0 0 2024-04-26T23:08:48.796 INFO:tasks.workunit.client.0.smithi148.stdout:4/0: truncate - no filename 2024-04-26T23:08:48.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/0: creat f0 x:0 0 0 2024-04-26T23:08:48.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/1: read - f0 zero size 2024-04-26T23:08:48.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/2: chown f0 25924 1 2024-04-26T23:08:48.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/3: rmdir - no directory 2024-04-26T23:08:48.801 INFO:tasks.workunit.client.0.smithi148.stdout:2/12: rename c0 to c1 0 2024-04-26T23:08:48.807 INFO:tasks.workunit.client.0.smithi148.stdout:1/12: rename f1 to f2 0 2024-04-26T23:08:48.807 INFO:tasks.workunit.client.0.smithi148.stdout:5/0: dread - no filename 2024-04-26T23:08:48.807 INFO:tasks.workunit.client.0.smithi148.stdout:1/13: write f2 [955817,63275] 0 2024-04-26T23:08:48.826 INFO:tasks.workunit.client.0.smithi148.stdout:3/4: creat f1 x:0 0 0 2024-04-26T23:08:48.828 INFO:tasks.workunit.client.0.smithi148.stdout:4/1: mknod c0 0 2024-04-26T23:08:48.828 INFO:tasks.workunit.client.0.smithi148.stdout:4/2: dread - no filename 2024-04-26T23:08:48.845 INFO:tasks.workunit.client.0.smithi148.stdout:6/0: chown . 2090602 1 2024-04-26T23:08:48.845 INFO:tasks.workunit.client.0.smithi148.stdout:6/1: chown . 60260 1 2024-04-26T23:08:48.845 INFO:tasks.workunit.client.0.smithi148.stdout:6/2: dread - no filename 2024-04-26T23:08:48.845 INFO:tasks.workunit.client.0.smithi148.stdout:5/1: creat f0 x:0 0 0 2024-04-26T23:08:49.115 INFO:tasks.workunit.client.0.smithi148.stdout:6/3: symlink l0 0 2024-04-26T23:08:49.118 INFO:tasks.workunit.client.0.smithi148.stdout:2/13: getdents . 0 2024-04-26T23:08:49.121 INFO:tasks.workunit.client.0.smithi148.stdout:1/14: rename f2 to f3 0 2024-04-26T23:08:49.121 INFO:tasks.workunit.client.0.smithi148.stdout:5/2: creat f1 x:0 0 0 2024-04-26T23:08:49.306 INFO:tasks.workunit.client.0.smithi148.stdout:3/5: dwrite f1 [0,4194304] 0 2024-04-26T23:08:49.634 INFO:tasks.workunit.client.0.smithi148.stdout:1/15: fsync f3 0 2024-04-26T23:08:49.680 INFO:tasks.workunit.client.0.smithi148.stdout:7/0: truncate - no filename 2024-04-26T23:08:49.876 INFO:tasks.workunit.client.0.smithi148.stdout:2/14: symlink l2 0 2024-04-26T23:08:50.133 INFO:tasks.workunit.client.0.smithi148.stdout:3/6: symlink l2 0 2024-04-26T23:08:50.933 INFO:tasks.workunit.client.0.smithi148.stdout:1/16: mknod c4 0 2024-04-26T23:08:50.933 INFO:tasks.workunit.client.0.smithi148.stdout:1/17: chown c4 161 1 2024-04-26T23:08:50.933 INFO:tasks.workunit.client.0.smithi148.stdout:7/1: mknod c0 0 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/2: write - no filename 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/3: dwrite - no filename 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/4: dwrite - no filename 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:5/3: mknod c2 0 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:6/4: link l0 l1 0 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:5/4: fsync f0 0 2024-04-26T23:08:50.934 INFO:tasks.workunit.client.0.smithi148.stdout:8/0: mknod c0 0 2024-04-26T23:08:50.935 INFO:tasks.workunit.client.0.smithi148.stdout:8/1: dwrite - no filename 2024-04-26T23:08:50.935 INFO:tasks.workunit.client.0.smithi148.stdout:8/2: readlink - no filename 2024-04-26T23:08:50.935 INFO:tasks.workunit.client.0.smithi148.stdout:8/3: read - no filename 2024-04-26T23:08:50.935 INFO:tasks.workunit.client.0.smithi148.stdout:3/7: rename l2 to l3 0 2024-04-26T23:08:50.935 INFO:tasks.workunit.client.0.smithi148.stdout:3/8: write f0 [477422,23217] 0 2024-04-26T23:08:50.977 INFO:tasks.workunit.client.0.smithi148.stdout:5/5: dwrite f0 [0,4194304] 0 2024-04-26T23:08:50.977 INFO:tasks.workunit.client.0.smithi148.stdout:5/6: dread - f1 zero size 2024-04-26T23:08:50.990 INFO:tasks.workunit.client.0.smithi148.stdout:5/7: write f0 [3330013,100975] 0 2024-04-26T23:08:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:7/5: creat f1 x:0 0 0 2024-04-26T23:08:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:2/15: symlink l3 0 2024-04-26T23:08:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:8/4: creat f1 x:0 0 0 2024-04-26T23:08:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:3/9: symlink l4 0 2024-04-26T23:08:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:1/18: rename f3 to f5 0 2024-04-26T23:08:51.486 INFO:tasks.workunit.client.0.smithi148.stdout:1/19: stat l0 0 2024-04-26T23:08:51.486 INFO:tasks.workunit.client.0.smithi148.stdout:9/0: creat f0 x:0 0 0 2024-04-26T23:08:51.486 INFO:tasks.workunit.client.0.smithi148.stdout:9/1: dread - f0 zero size 2024-04-26T23:08:51.486 INFO:tasks.workunit.client.0.smithi148.stdout:6/5: unlink l1 0 2024-04-26T23:08:51.487 INFO:tasks.workunit.client.0.smithi148.stdout:2/16: chown c1 2463 1 2024-04-26T23:08:51.489 INFO:tasks.workunit.client.0.smithi148.stdout:3/10: rename f1 to f5 0 2024-04-26T23:08:51.489 INFO:tasks.workunit.client.0.smithi148.stdout:6/6: rename l0 to l2 0 2024-04-26T23:08:51.489 INFO:tasks.workunit.client.0.smithi148.stdout:9/2: symlink l1 0 2024-04-26T23:08:51.490 INFO:tasks.workunit.client.0.smithi148.stdout:3/11: mkdir d6 0 2024-04-26T23:08:51.492 INFO:tasks.workunit.client.0.smithi148.stdout:2/17: rename c1 to c4 0 2024-04-26T23:08:51.492 INFO:tasks.workunit.client.0.smithi148.stdout:2/18: dwrite - no filename 2024-04-26T23:08:51.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/12: rmdir d6 0 2024-04-26T23:08:51.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/13: chown l4 7828 1 2024-04-26T23:08:51.499 INFO:tasks.workunit.client.0.smithi148.stdout:2/19: mkdir d5 0 2024-04-26T23:08:51.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/14: mknod c7 0 2024-04-26T23:08:51.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/15: write f0 [549414,124344] 0 2024-04-26T23:08:51.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/16: chown c7 40662 1 2024-04-26T23:08:51.501 INFO:tasks.workunit.client.0.smithi148.stdout:2/20: unlink l2 0 2024-04-26T23:08:51.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/17: link l4 l8 0 2024-04-26T23:08:51.502 INFO:tasks.workunit.client.0.smithi148.stdout:2/21: symlink d5/l6 0 2024-04-26T23:08:51.505 INFO:tasks.workunit.client.0.smithi148.stdout:2/22: mkdir d5/d7 0 2024-04-26T23:08:51.505 INFO:tasks.workunit.client.0.smithi148.stdout:2/23: truncate - no filename 2024-04-26T23:08:51.506 INFO:tasks.workunit.client.0.smithi148.stdout:2/24: chown d5/d7 125 1 2024-04-26T23:08:51.506 INFO:tasks.workunit.client.0.smithi148.stdout:2/25: write - no filename 2024-04-26T23:08:51.506 INFO:tasks.workunit.client.0.smithi148.stdout:2/26: truncate - no filename 2024-04-26T23:08:51.507 INFO:tasks.workunit.client.0.smithi148.stdout:2/27: mkdir d5/d8 0 2024-04-26T23:08:51.507 INFO:tasks.workunit.client.0.smithi148.stdout:2/28: fdatasync - no filename 2024-04-26T23:08:51.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/29: mkdir d5/d8/d9 0 2024-04-26T23:08:51.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/30: chown d5/d7 120 1 2024-04-26T23:08:51.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/31: dread - no filename 2024-04-26T23:08:51.513 INFO:tasks.workunit.client.0.smithi148.stdout:3/18: fsync f0 0 2024-04-26T23:08:51.515 INFO:tasks.workunit.client.0.smithi148.stdout:2/32: rename d5/l6 to d5/la 0 2024-04-26T23:08:51.517 INFO:tasks.workunit.client.0.smithi148.stdout:2/33: creat d5/d7/fb x:0 0 0 2024-04-26T23:08:51.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/34: creat d5/d8/d9/fc x:0 0 0 2024-04-26T23:08:51.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/35: chown d5/d8/d9 998 1 2024-04-26T23:08:51.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/36: read - d5/d7/fb zero size 2024-04-26T23:08:51.519 INFO:tasks.workunit.client.0.smithi148.stdout:2/37: chown d5/d7 1245046 1 2024-04-26T23:08:51.519 INFO:tasks.workunit.client.0.smithi148.stdout:2/38: write d5/d8/d9/fc [202111,126238] 0 2024-04-26T23:08:51.526 INFO:tasks.workunit.client.0.smithi148.stdout:2/39: symlink d5/d8/d9/ld 0 2024-04-26T23:08:51.527 INFO:tasks.workunit.client.0.smithi148.stdout:8/5: dwrite f1 [0,4194304] 0 2024-04-26T23:08:51.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/40: mknod d5/d7/ce 0 2024-04-26T23:08:51.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/41: write d5/d8/d9/fc [267195,102839] 0 2024-04-26T23:08:51.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/42: chown c4 1740944 1 2024-04-26T23:08:51.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/43: readlink d5/d8/d9/ld 0 2024-04-26T23:08:51.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/44: chown d5/d8/d9 31878 1 2024-04-26T23:08:51.530 INFO:tasks.workunit.client.0.smithi148.stdout:2/45: symlink d5/d8/d9/lf 0 2024-04-26T23:08:51.530 INFO:tasks.workunit.client.0.smithi148.stdout:2/46: read d5/d8/d9/fc [309041,27433] 0 2024-04-26T23:08:51.531 INFO:tasks.workunit.client.0.smithi148.stdout:2/47: mkdir d5/d10 0 2024-04-26T23:08:51.531 INFO:tasks.workunit.client.0.smithi148.stdout:2/48: mkdir d5/d8/d11 0 2024-04-26T23:08:51.531 INFO:tasks.workunit.client.0.smithi148.stdout:2/49: fdatasync d5/d7/fb 0 2024-04-26T23:08:51.531 INFO:tasks.workunit.client.0.smithi148.stdout:2/50: mknod d5/d8/d11/c12 0 2024-04-26T23:08:51.532 INFO:tasks.workunit.client.0.smithi148.stdout:2/51: symlink d5/d7/l13 0 2024-04-26T23:08:51.534 INFO:tasks.workunit.client.0.smithi148.stdout:2/52: creat d5/d10/f14 x:0 0 0 2024-04-26T23:08:51.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/53: mkdir d5/d8/d15 0 2024-04-26T23:08:51.536 INFO:tasks.workunit.client.0.smithi148.stdout:2/54: creat d5/f16 x:0 0 0 2024-04-26T23:08:51.536 INFO:tasks.workunit.client.0.smithi148.stdout:2/55: dread - d5/d10/f14 zero size 2024-04-26T23:08:51.537 INFO:tasks.workunit.client.0.smithi148.stdout:2/56: mkdir d5/d17 0 2024-04-26T23:08:51.552 INFO:tasks.workunit.client.0.smithi148.stdout:2/57: dread d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:08:51.552 INFO:tasks.workunit.client.0.smithi148.stdout:2/58: link d5/d8/d9/fc d5/d7/f18 0 2024-04-26T23:08:51.552 INFO:tasks.workunit.client.0.smithi148.stdout:2/59: rmdir d5/d7 39 2024-04-26T23:08:51.553 INFO:tasks.workunit.client.0.smithi148.stdout:2/60: unlink d5/d7/ce 0 2024-04-26T23:08:51.554 INFO:tasks.workunit.client.0.smithi148.stdout:2/61: link d5/d7/f18 d5/d10/f19 0 2024-04-26T23:08:51.572 INFO:tasks.workunit.client.0.smithi148.stdout:1/20: dread f5 [0,4194304] 0 2024-04-26T23:08:51.573 INFO:tasks.workunit.client.0.smithi148.stdout:1/21: write f5 [1309750,45042] 0 2024-04-26T23:08:51.573 INFO:tasks.workunit.client.0.smithi148.stdout:1/22: chown f5 3 1 2024-04-26T23:08:51.573 INFO:tasks.workunit.client.0.smithi148.stdout:7/6: dwrite f1 [0,4194304] 0 2024-04-26T23:08:51.581 INFO:tasks.workunit.client.0.smithi148.stdout:1/23: rename c4 to c6 0 2024-04-26T23:08:51.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/7: creat f2 x:0 0 0 2024-04-26T23:08:51.583 INFO:tasks.workunit.client.0.smithi148.stdout:7/8: mknod c3 0 2024-04-26T23:08:51.586 INFO:tasks.workunit.client.0.smithi148.stdout:2/62: dwrite d5/d10/f14 [0,4194304] 0 2024-04-26T23:08:51.586 INFO:tasks.workunit.client.0.smithi148.stdout:7/9: symlink l4 0 2024-04-26T23:08:51.587 INFO:tasks.workunit.client.0.smithi148.stdout:1/24: write f5 [245515,83431] 0 2024-04-26T23:08:51.595 INFO:tasks.workunit.client.0.smithi148.stdout:2/63: dread d5/d7/f18 [0,4194304] 0 2024-04-26T23:08:51.595 INFO:tasks.workunit.client.0.smithi148.stdout:2/64: getdents d5/d17 0 2024-04-26T23:08:51.596 INFO:tasks.workunit.client.0.smithi148.stdout:3/19: dwrite f5 [0,4194304] 0 2024-04-26T23:08:51.597 INFO:tasks.workunit.client.0.smithi148.stdout:2/65: mknod d5/d17/c1a 0 2024-04-26T23:08:51.629 INFO:tasks.workunit.client.0.smithi148.stdout:1/25: dwrite f5 [0,4194304] 0 2024-04-26T23:08:51.641 INFO:tasks.workunit.client.0.smithi148.stdout:1/26: dread f5 [0,4194304] 0 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/3: fsync f0 0 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/4: fsync f0 0 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/5: dread - f0 zero size 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/6: dread - f0 zero size 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/7: dread - f0 zero size 2024-04-26T23:08:51.802 INFO:tasks.workunit.client.0.smithi148.stdout:9/8: dread - f0 zero size 2024-04-26T23:08:51.803 INFO:tasks.workunit.client.0.smithi148.stdout:3/20: getdents . 0 2024-04-26T23:08:51.803 INFO:tasks.workunit.client.0.smithi148.stdout:5/8: truncate f0 1543105 0 2024-04-26T23:08:51.804 INFO:tasks.workunit.client.0.smithi148.stdout:2/66: fsync d5/d7/f18 0 2024-04-26T23:08:51.804 INFO:tasks.workunit.client.0.smithi148.stdout:8/6: write f1 [4564834,90302] 0 2024-04-26T23:08:51.804 INFO:tasks.workunit.client.0.smithi148.stdout:8/7: readlink - no filename 2024-04-26T23:08:51.804 INFO:tasks.workunit.client.0.smithi148.stdout:8/8: chown c0 14 1 2024-04-26T23:08:51.807 INFO:tasks.workunit.client.0.smithi148.stdout:9/9: creat f2 x:0 0 0 2024-04-26T23:08:51.808 INFO:tasks.workunit.client.0.smithi148.stdout:5/9: getdents . 0 2024-04-26T23:08:51.808 INFO:tasks.workunit.client.0.smithi148.stdout:5/10: fsync f0 0 2024-04-26T23:08:51.808 INFO:tasks.workunit.client.0.smithi148.stdout:2/67: creat d5/d8/f1b x:0 0 0 2024-04-26T23:08:51.810 INFO:tasks.workunit.client.0.smithi148.stdout:2/68: mkdir d5/d1c 0 2024-04-26T23:08:51.812 INFO:tasks.workunit.client.0.smithi148.stdout:2/69: link d5/f16 d5/d1c/f1d 0 2024-04-26T23:08:51.813 INFO:tasks.workunit.client.0.smithi148.stdout:2/70: mknod d5/d8/d9/c1e 0 2024-04-26T23:08:51.816 INFO:tasks.workunit.client.0.smithi148.stdout:2/71: unlink d5/d8/d9/c1e 0 2024-04-26T23:08:51.816 INFO:tasks.workunit.client.0.smithi148.stdout:2/72: stat d5/d17 0 2024-04-26T23:08:51.816 INFO:tasks.workunit.client.0.smithi148.stdout:2/73: chown d5/d7/fb 13003 1 2024-04-26T23:08:51.833 INFO:tasks.workunit.client.0.smithi148.stdout:2/74: dread d5/d10/f14 [0,4194304] 0 2024-04-26T23:08:51.833 INFO:tasks.workunit.client.0.smithi148.stdout:2/75: chown d5/d1c/f1d 3 1 2024-04-26T23:08:51.835 INFO:tasks.workunit.client.0.smithi148.stdout:2/76: mknod d5/d10/c1f 0 2024-04-26T23:08:51.836 INFO:tasks.workunit.client.0.smithi148.stdout:2/77: creat d5/d7/f20 x:0 0 0 2024-04-26T23:08:51.837 INFO:tasks.workunit.client.0.smithi148.stdout:0/3: sync 2024-04-26T23:08:51.837 INFO:tasks.workunit.client.0.smithi148.stdout:0/4: write - no filename 2024-04-26T23:08:51.837 INFO:tasks.workunit.client.0.smithi148.stdout:4/3: sync 2024-04-26T23:08:51.837 INFO:tasks.workunit.client.0.smithi148.stdout:4/4: fsync - no filename 2024-04-26T23:08:51.838 INFO:tasks.workunit.client.0.smithi148.stdout:6/7: sync 2024-04-26T23:08:51.838 INFO:tasks.workunit.client.0.smithi148.stdout:0/5: dwrite - no filename 2024-04-26T23:08:51.839 INFO:tasks.workunit.client.0.smithi148.stdout:2/78: write d5/d8/d9/fc [128354,17608] 0 2024-04-26T23:08:51.839 INFO:tasks.workunit.client.0.smithi148.stdout:4/5: unlink c0 0 2024-04-26T23:08:51.841 INFO:tasks.workunit.client.0.smithi148.stdout:6/8: link l2 l3 0 2024-04-26T23:08:51.841 INFO:tasks.workunit.client.0.smithi148.stdout:6/9: truncate - no filename 2024-04-26T23:08:51.843 INFO:tasks.workunit.client.0.smithi148.stdout:0/6: creat d0/f2 x:0 0 0 2024-04-26T23:08:51.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/6: creat f1 x:0 0 0 2024-04-26T23:08:51.846 INFO:tasks.workunit.client.0.smithi148.stdout:6/10: symlink l4 0 2024-04-26T23:08:51.847 INFO:tasks.workunit.client.0.smithi148.stdout:0/7: symlink d0/l3 0 2024-04-26T23:08:51.847 INFO:tasks.workunit.client.0.smithi148.stdout:0/8: dread - d0/f2 zero size 2024-04-26T23:08:51.850 INFO:tasks.workunit.client.0.smithi148.stdout:4/7: creat f2 x:0 0 0 2024-04-26T23:08:51.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/11: mknod c5 0 2024-04-26T23:08:51.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/12: dread - no filename 2024-04-26T23:08:51.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/13: read - no filename 2024-04-26T23:08:51.854 INFO:tasks.workunit.client.0.smithi148.stdout:8/9: dread f1 [0,4194304] 0 2024-04-26T23:08:51.854 INFO:tasks.workunit.client.0.smithi148.stdout:8/10: truncate f1 4965473 0 2024-04-26T23:08:51.854 INFO:tasks.workunit.client.0.smithi148.stdout:0/9: symlink d0/l4 0 2024-04-26T23:08:51.855 INFO:tasks.workunit.client.0.smithi148.stdout:4/8: rename f2 to f3 0 2024-04-26T23:08:51.857 INFO:tasks.workunit.client.0.smithi148.stdout:6/14: mkdir d6 0 2024-04-26T23:08:51.857 INFO:tasks.workunit.client.0.smithi148.stdout:6/15: dwrite - no filename 2024-04-26T23:08:51.857 INFO:tasks.workunit.client.0.smithi148.stdout:6/16: dwrite - no filename 2024-04-26T23:08:51.858 INFO:tasks.workunit.client.0.smithi148.stdout:5/11: dwrite f0 [0,4194304] 0 2024-04-26T23:08:51.859 INFO:tasks.workunit.client.0.smithi148.stdout:0/10: mkdir d0/d5 0 2024-04-26T23:08:51.861 INFO:tasks.workunit.client.0.smithi148.stdout:4/9: link f1 f4 0 2024-04-26T23:08:51.861 INFO:tasks.workunit.client.0.smithi148.stdout:4/10: fdatasync f3 0 2024-04-26T23:08:51.861 INFO:tasks.workunit.client.0.smithi148.stdout:3/21: dwrite f0 [0,4194304] 0 2024-04-26T23:08:51.868 INFO:tasks.workunit.client.0.smithi148.stdout:6/17: symlink d6/l7 0 2024-04-26T23:08:51.869 INFO:tasks.workunit.client.0.smithi148.stdout:6/18: truncate - no filename 2024-04-26T23:08:51.869 INFO:tasks.workunit.client.0.smithi148.stdout:5/12: link f1 f3 0 2024-04-26T23:08:51.869 INFO:tasks.workunit.client.0.smithi148.stdout:0/11: creat d0/d5/f6 x:0 0 0 2024-04-26T23:08:51.869 INFO:tasks.workunit.client.0.smithi148.stdout:8/11: dread f1 [0,4194304] 0 2024-04-26T23:08:51.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/19: mknod d6/c8 0 2024-04-26T23:08:51.872 INFO:tasks.workunit.client.0.smithi148.stdout:2/79: truncate d5/d10/f19 194332 0 2024-04-26T23:08:51.872 INFO:tasks.workunit.client.0.smithi148.stdout:6/20: mkdir d6/d9 0 2024-04-26T23:08:51.872 INFO:tasks.workunit.client.0.smithi148.stdout:6/21: chown l4 55424 1 2024-04-26T23:08:51.882 INFO:tasks.workunit.client.0.smithi148.stdout:5/13: getdents . 0 2024-04-26T23:08:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/12: truncate f1 3810430 0 2024-04-26T23:08:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/13: write f1 [4530160,91764] 0 2024-04-26T23:08:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:6/22: creat d6/d9/fa x:0 0 0 2024-04-26T23:08:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:6/23: read - d6/d9/fa zero size 2024-04-26T23:08:51.889 INFO:tasks.workunit.client.0.smithi148.stdout:5/14: creat f4 x:0 0 0 2024-04-26T23:08:51.890 INFO:tasks.workunit.client.0.smithi148.stdout:6/24: symlink d6/d9/lb 0 2024-04-26T23:08:51.890 INFO:tasks.workunit.client.0.smithi148.stdout:6/25: chown d6/l7 440 1 2024-04-26T23:08:51.892 INFO:tasks.workunit.client.0.smithi148.stdout:5/15: creat f5 x:0 0 0 2024-04-26T23:08:51.894 INFO:tasks.workunit.client.0.smithi148.stdout:6/26: unlink l3 0 2024-04-26T23:08:51.895 INFO:tasks.workunit.client.0.smithi148.stdout:5/16: rename f4 to f6 0 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/27: unlink l2 0 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/28: dread - d6/d9/fa zero size 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/29: dread - d6/d9/fa zero size 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/30: stat d6/d9 0 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/31: truncate d6/d9/fa 805921 0 2024-04-26T23:08:51.901 INFO:tasks.workunit.client.0.smithi148.stdout:4/11: dwrite f4 [0,4194304] 0 2024-04-26T23:08:51.911 INFO:tasks.workunit.client.0.smithi148.stdout:8/14: dread f1 [0,4194304] 0 2024-04-26T23:08:51.913 INFO:tasks.workunit.client.0.smithi148.stdout:2/80: dwrite d5/f16 [0,4194304] 0 2024-04-26T23:08:51.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/17: link f5 f7 0 2024-04-26T23:08:51.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/15: dread f1 [0,4194304] 0 2024-04-26T23:08:51.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/12: dread f1 [0,4194304] 0 2024-04-26T23:08:51.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/13: rmdir - no directory 2024-04-26T23:08:51.937 INFO:tasks.workunit.client.0.smithi148.stdout:8/16: dread f1 [0,4194304] 0 2024-04-26T23:08:51.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/18: read f0 [490990,128579] 0 2024-04-26T23:08:51.940 INFO:tasks.workunit.client.0.smithi148.stdout:4/14: write f4 [2753749,92659] 0 2024-04-26T23:08:51.946 INFO:tasks.workunit.client.0.smithi148.stdout:5/19: mknod c8 0 2024-04-26T23:08:51.946 INFO:tasks.workunit.client.0.smithi148.stdout:5/20: read - f5 zero size 2024-04-26T23:08:51.946 INFO:tasks.workunit.client.0.smithi148.stdout:5/21: read - f3 zero size 2024-04-26T23:08:51.948 INFO:tasks.workunit.client.0.smithi148.stdout:8/17: dread f1 [0,4194304] 0 2024-04-26T23:08:51.950 INFO:tasks.workunit.client.0.smithi148.stdout:4/15: mkdir d5 0 2024-04-26T23:08:51.950 INFO:tasks.workunit.client.0.smithi148.stdout:5/22: mknod c9 0 2024-04-26T23:08:51.950 INFO:tasks.workunit.client.0.smithi148.stdout:6/32: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T23:08:51.952 INFO:tasks.workunit.client.0.smithi148.stdout:8/18: rename f1 to f2 0 2024-04-26T23:08:51.952 INFO:tasks.workunit.client.0.smithi148.stdout:8/19: chown f2 8069 1 2024-04-26T23:08:51.952 INFO:tasks.workunit.client.0.smithi148.stdout:5/23: mkdir da 0 2024-04-26T23:08:51.952 INFO:tasks.workunit.client.0.smithi148.stdout:5/24: dread - f7 zero size 2024-04-26T23:08:51.952 INFO:tasks.workunit.client.0.smithi148.stdout:5/25: readlink - no filename 2024-04-26T23:08:51.954 INFO:tasks.workunit.client.0.smithi148.stdout:2/81: dwrite d5/d10/f14 [0,4194304] 0 2024-04-26T23:08:51.955 INFO:tasks.workunit.client.0.smithi148.stdout:8/20: mkdir d3 0 2024-04-26T23:08:51.956 INFO:tasks.workunit.client.0.smithi148.stdout:5/26: creat da/fb x:0 0 0 2024-04-26T23:08:51.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/21: symlink d3/l4 0 2024-04-26T23:08:51.960 INFO:tasks.workunit.client.0.smithi148.stdout:4/16: fsync f4 0 2024-04-26T23:08:51.962 INFO:tasks.workunit.client.0.smithi148.stdout:5/27: rename f7 to da/fc 0 2024-04-26T23:08:51.965 INFO:tasks.workunit.client.0.smithi148.stdout:4/17: rmdir d5 0 2024-04-26T23:08:51.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/28: creat da/fd x:0 0 0 2024-04-26T23:08:51.974 INFO:tasks.workunit.client.0.smithi148.stdout:6/33: write d6/d9/fa [3230308,85467] 0 2024-04-26T23:08:51.979 INFO:tasks.workunit.client.0.smithi148.stdout:4/18: getdents . 0 2024-04-26T23:08:51.979 INFO:tasks.workunit.client.0.smithi148.stdout:4/19: write f1 [1469049,6885] 0 2024-04-26T23:08:52.022 INFO:tasks.workunit.client.0.smithi148.stdout:1/27: sync 2024-04-26T23:08:52.022 INFO:tasks.workunit.client.0.smithi148.stdout:7/10: sync 2024-04-26T23:08:52.024 INFO:tasks.workunit.client.0.smithi148.stdout:4/20: symlink l6 0 2024-04-26T23:08:52.027 INFO:tasks.workunit.client.0.smithi148.stdout:7/11: mknod c5 0 2024-04-26T23:08:52.032 INFO:tasks.workunit.client.0.smithi148.stdout:4/21: rename f3 to f7 0 2024-04-26T23:08:52.033 INFO:tasks.workunit.client.0.smithi148.stdout:1/28: dread f5 [0,4194304] 0 2024-04-26T23:08:52.035 INFO:tasks.workunit.client.0.smithi148.stdout:7/12: rename f2 to f6 0 2024-04-26T23:08:52.040 INFO:tasks.workunit.client.0.smithi148.stdout:4/22: unlink f4 0 2024-04-26T23:08:52.040 INFO:tasks.workunit.client.0.smithi148.stdout:4/23: write f7 [376981,36085] 0 2024-04-26T23:08:52.043 INFO:tasks.workunit.client.0.smithi148.stdout:7/13: mkdir d7 0 2024-04-26T23:08:52.043 INFO:tasks.workunit.client.0.smithi148.stdout:7/14: stat f1 0 2024-04-26T23:08:52.043 INFO:tasks.workunit.client.0.smithi148.stdout:7/15: rename d7 to d7/d8 22 2024-04-26T23:08:52.050 INFO:tasks.workunit.client.0.smithi148.stdout:4/24: unlink f1 0 2024-04-26T23:08:52.050 INFO:tasks.workunit.client.0.smithi148.stdout:4/25: truncate f7 1136869 0 2024-04-26T23:08:52.050 INFO:tasks.workunit.client.0.smithi148.stdout:4/26: truncate f7 1302432 0 2024-04-26T23:08:52.052 INFO:tasks.workunit.client.0.smithi148.stdout:7/16: creat d7/f9 x:0 0 0 2024-04-26T23:08:52.052 INFO:tasks.workunit.client.0.smithi148.stdout:7/17: truncate f6 742417 0 2024-04-26T23:08:52.053 INFO:tasks.workunit.client.0.smithi148.stdout:8/22: dwrite f2 [4194304,4194304] 0 2024-04-26T23:08:52.056 INFO:tasks.workunit.client.0.smithi148.stdout:7/18: link c0 d7/ca 0 2024-04-26T23:08:52.057 INFO:tasks.workunit.client.0.smithi148.stdout:7/19: write d7/f9 [138968,16955] 0 2024-04-26T23:08:52.060 INFO:tasks.workunit.client.0.smithi148.stdout:7/20: write d7/f9 [115221,25308] 0 2024-04-26T23:08:52.076 INFO:tasks.workunit.client.0.smithi148.stdout:4/27: truncate f7 897531 0 2024-04-26T23:08:52.079 INFO:tasks.workunit.client.0.smithi148.stdout:8/23: rmdir d3 39 2024-04-26T23:08:52.080 INFO:tasks.workunit.client.0.smithi148.stdout:6/34: dwrite d6/d9/fa [4194304,4194304] 0 2024-04-26T23:08:52.081 INFO:tasks.workunit.client.0.smithi148.stdout:6/35: write d6/d9/fa [1632358,14471] 0 2024-04-26T23:08:52.081 INFO:tasks.workunit.client.0.smithi148.stdout:6/36: stat d6/d9 0 2024-04-26T23:08:52.085 INFO:tasks.workunit.client.0.smithi148.stdout:7/21: creat d7/fb x:0 0 0 2024-04-26T23:08:52.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/82: dwrite d5/d7/f20 [0,4194304] 0 2024-04-26T23:08:52.086 INFO:tasks.workunit.client.0.smithi148.stdout:5/29: dwrite f3 [0,4194304] 0 2024-04-26T23:08:52.086 INFO:tasks.workunit.client.0.smithi148.stdout:3/22: read f0 [3213253,27659] 0 2024-04-26T23:08:52.089 INFO:tasks.workunit.client.0.smithi148.stdout:2/83: dread d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:08:52.089 INFO:tasks.workunit.client.0.smithi148.stdout:2/84: write d5/d10/f19 [116278,64591] 0 2024-04-26T23:08:52.091 INFO:tasks.workunit.client.0.smithi148.stdout:7/22: dread f6 [0,4194304] 0 2024-04-26T23:08:52.091 INFO:tasks.workunit.client.0.smithi148.stdout:8/24: creat d3/f5 x:0 0 0 2024-04-26T23:08:52.091 INFO:tasks.workunit.client.0.smithi148.stdout:8/25: truncate d3/f5 163988 0 2024-04-26T23:08:52.091 INFO:tasks.workunit.client.0.smithi148.stdout:6/37: getdents d6 0 2024-04-26T23:08:52.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/28: truncate f7 1326087 0 2024-04-26T23:08:52.096 INFO:tasks.workunit.client.0.smithi148.stdout:2/85: getdents d5/d1c 0 2024-04-26T23:08:52.096 INFO:tasks.workunit.client.0.smithi148.stdout:2/86: readlink d5/la 0 2024-04-26T23:08:52.108 INFO:tasks.workunit.client.0.smithi148.stdout:6/38: mkdir d6/dc 0 2024-04-26T23:08:52.108 INFO:tasks.workunit.client.0.smithi148.stdout:7/23: rename f1 to d7/fc 0 2024-04-26T23:08:52.108 INFO:tasks.workunit.client.0.smithi148.stdout:7/24: truncate d7/fb 154501 0 2024-04-26T23:08:52.109 INFO:tasks.workunit.client.0.smithi148.stdout:7/25: read d7/f9 [43024,99932] 0 2024-04-26T23:08:52.113 INFO:tasks.workunit.client.0.smithi148.stdout:1/29: dwrite f5 [0,4194304] 0 2024-04-26T23:08:52.113 INFO:tasks.workunit.client.0.smithi148.stdout:4/29: creat f8 x:0 0 0 2024-04-26T23:08:52.113 INFO:tasks.workunit.client.0.smithi148.stdout:2/87: mknod d5/d8/c21 0 2024-04-26T23:08:52.113 INFO:tasks.workunit.client.0.smithi148.stdout:4/30: chown l6 5676 1 2024-04-26T23:08:52.114 INFO:tasks.workunit.client.0.smithi148.stdout:2/88: fsync d5/d8/f1b 0 2024-04-26T23:08:52.131 INFO:tasks.workunit.client.0.smithi148.stdout:0/12: sync 2024-04-26T23:08:52.133 INFO:tasks.workunit.client.0.smithi148.stdout:9/10: sync 2024-04-26T23:08:52.133 INFO:tasks.workunit.client.0.smithi148.stdout:9/11: write f0 [728064,30815] 0 2024-04-26T23:08:52.136 INFO:tasks.workunit.client.0.smithi148.stdout:1/30: creat f7 x:0 0 0 2024-04-26T23:08:52.139 INFO:tasks.workunit.client.0.smithi148.stdout:5/30: dwrite f0 [4194304,4194304] 0 2024-04-26T23:08:52.139 INFO:tasks.workunit.client.0.smithi148.stdout:2/89: dread d5/d1c/f1d [0,4194304] 0 2024-04-26T23:08:52.139 INFO:tasks.workunit.client.0.smithi148.stdout:2/90: chown d5/d8 5628735 1 2024-04-26T23:08:52.139 INFO:tasks.workunit.client.0.smithi148.stdout:9/12: unlink l1 0 2024-04-26T23:08:52.141 INFO:tasks.workunit.client.0.smithi148.stdout:8/26: dwrite f2 [0,4194304] 0 2024-04-26T23:08:52.141 INFO:tasks.workunit.client.0.smithi148.stdout:8/27: write d3/f5 [448039,66198] 0 2024-04-26T23:08:52.141 INFO:tasks.workunit.client.0.smithi148.stdout:1/31: creat f8 x:0 0 0 2024-04-26T23:08:52.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/32: chown l0 469239 1 2024-04-26T23:08:52.145 INFO:tasks.workunit.client.0.smithi148.stdout:2/91: symlink d5/d8/l22 0 2024-04-26T23:08:52.146 INFO:tasks.workunit.client.0.smithi148.stdout:2/92: fdatasync d5/d10/f14 0 2024-04-26T23:08:52.146 INFO:tasks.workunit.client.0.smithi148.stdout:2/93: truncate d5/d10/f19 654068 0 2024-04-26T23:08:52.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/31: symlink da/le 0 2024-04-26T23:08:52.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/32: chown da/fc 6 1 2024-04-26T23:08:52.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/33: dread - da/fd zero size 2024-04-26T23:08:52.150 INFO:tasks.workunit.client.0.smithi148.stdout:5/34: write f5 [842736,38107] 0 2024-04-26T23:08:52.150 INFO:tasks.workunit.client.0.smithi148.stdout:5/35: chown c8 30991 1 2024-04-26T23:08:52.153 INFO:tasks.workunit.client.0.smithi148.stdout:9/13: getdents . 0 2024-04-26T23:08:52.153 INFO:tasks.workunit.client.0.smithi148.stdout:9/14: truncate f2 731619 0 2024-04-26T23:08:52.156 INFO:tasks.workunit.client.0.smithi148.stdout:8/28: creat d3/f6 x:0 0 0 2024-04-26T23:08:52.159 INFO:tasks.workunit.client.0.smithi148.stdout:1/33: symlink l9 0 2024-04-26T23:08:52.159 INFO:tasks.workunit.client.0.smithi148.stdout:1/34: rmdir - no directory 2024-04-26T23:08:52.160 INFO:tasks.workunit.client.0.smithi148.stdout:1/35: chown f8 983 1 2024-04-26T23:08:52.160 INFO:tasks.workunit.client.0.smithi148.stdout:1/36: rmdir - no directory 2024-04-26T23:08:52.160 INFO:tasks.workunit.client.0.smithi148.stdout:2/94: creat d5/d8/d9/f23 x:0 0 0 2024-04-26T23:08:52.160 INFO:tasks.workunit.client.0.smithi148.stdout:2/95: chown d5/d10/f14 170564845 1 2024-04-26T23:08:52.161 INFO:tasks.workunit.client.0.smithi148.stdout:2/96: chown d5/d17 32521529 1 2024-04-26T23:08:52.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/29: unlink f2 0 2024-04-26T23:08:52.164 INFO:tasks.workunit.client.0.smithi148.stdout:1/37: unlink l9 0 2024-04-26T23:08:52.165 INFO:tasks.workunit.client.0.smithi148.stdout:2/97: creat d5/d7/f24 x:0 0 0 2024-04-26T23:08:52.166 INFO:tasks.workunit.client.0.smithi148.stdout:8/30: mkdir d3/d7 0 2024-04-26T23:08:52.169 INFO:tasks.workunit.client.0.smithi148.stdout:2/98: symlink d5/d8/d9/l25 0 2024-04-26T23:08:52.170 INFO:tasks.workunit.client.0.smithi148.stdout:8/31: rmdir d3 39 2024-04-26T23:08:52.170 INFO:tasks.workunit.client.0.smithi148.stdout:8/32: stat d3/l4 0 2024-04-26T23:08:52.172 INFO:tasks.workunit.client.0.smithi148.stdout:2/99: link d5/d8/d9/ld d5/d10/l26 0 2024-04-26T23:08:52.175 INFO:tasks.workunit.client.0.smithi148.stdout:5/36: dread f1 [0,4194304] 0 2024-04-26T23:08:52.175 INFO:tasks.workunit.client.0.smithi148.stdout:5/37: readlink da/le 0 2024-04-26T23:08:52.176 INFO:tasks.workunit.client.0.smithi148.stdout:5/38: write f5 [1303232,117268] 0 2024-04-26T23:08:52.193 INFO:tasks.workunit.client.0.smithi148.stdout:4/31: dwrite f8 [0,4194304] 0 2024-04-26T23:08:52.194 INFO:tasks.workunit.client.0.smithi148.stdout:1/38: write f5 [2870341,123572] 0 2024-04-26T23:08:52.195 INFO:tasks.workunit.client.0.smithi148.stdout:8/33: rename c0 to d3/c8 0 2024-04-26T23:08:52.200 INFO:tasks.workunit.client.0.smithi148.stdout:4/32: rename f7 to f9 0 2024-04-26T23:08:52.201 INFO:tasks.workunit.client.0.smithi148.stdout:5/39: dread f0 [0,4194304] 0 2024-04-26T23:08:52.203 INFO:tasks.workunit.client.0.smithi148.stdout:0/13: dwrite d0/d5/f6 [0,4194304] 0 2024-04-26T23:08:52.206 INFO:tasks.workunit.client.0.smithi148.stdout:1/39: creat fa x:0 0 0 2024-04-26T23:08:52.206 INFO:tasks.workunit.client.0.smithi148.stdout:1/40: readlink l0 0 2024-04-26T23:08:52.206 INFO:tasks.workunit.client.0.smithi148.stdout:9/15: dwrite f0 [0,4194304] 0 2024-04-26T23:08:52.207 INFO:tasks.workunit.client.0.smithi148.stdout:2/100: dread d5/d7/f20 [0,4194304] 0 2024-04-26T23:08:52.210 INFO:tasks.workunit.client.0.smithi148.stdout:0/14: rename d0/d5/f6 to d0/d5/f7 0 2024-04-26T23:08:52.210 INFO:tasks.workunit.client.0.smithi148.stdout:0/15: truncate d0/f2 407865 0 2024-04-26T23:08:52.229 INFO:tasks.workunit.client.0.smithi148.stdout:2/101: write d5/d10/f14 [999314,113613] 0 2024-04-26T23:08:52.229 INFO:tasks.workunit.client.0.smithi148.stdout:2/102: dread - d5/d8/f1b zero size 2024-04-26T23:08:52.232 INFO:tasks.workunit.client.0.smithi148.stdout:1/41: dread f5 [0,4194304] 0 2024-04-26T23:08:52.232 INFO:tasks.workunit.client.0.smithi148.stdout:1/42: write f8 [908146,11406] 0 2024-04-26T23:08:52.243 INFO:tasks.workunit.client.0.smithi148.stdout:4/33: write f8 [126087,71152] 0 2024-04-26T23:08:52.244 INFO:tasks.workunit.client.0.smithi148.stdout:9/16: creat f3 x:0 0 0 2024-04-26T23:08:52.246 INFO:tasks.workunit.client.0.smithi148.stdout:1/43: creat fb x:0 0 0 2024-04-26T23:08:52.246 INFO:tasks.workunit.client.0.smithi148.stdout:1/44: dread - f7 zero size 2024-04-26T23:08:52.246 INFO:tasks.workunit.client.0.smithi148.stdout:1/45: stat fb 0 2024-04-26T23:08:52.246 INFO:tasks.workunit.client.0.smithi148.stdout:4/34: symlink la 0 2024-04-26T23:08:52.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/46: link l0 lc 0 2024-04-26T23:08:52.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/47: dread - fb zero size 2024-04-26T23:08:52.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/48: write fa [484283,35760] 0 2024-04-26T23:08:52.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/49: truncate f8 1954492 0 2024-04-26T23:08:52.259 INFO:tasks.workunit.client.0.smithi148.stdout:4/35: write f9 [155197,54865] 0 2024-04-26T23:08:52.259 INFO:tasks.workunit.client.0.smithi148.stdout:4/36: chown f9 7847653 1 2024-04-26T23:08:52.259 INFO:tasks.workunit.client.0.smithi148.stdout:4/37: truncate f8 4972390 0 2024-04-26T23:08:52.263 INFO:tasks.workunit.client.0.smithi148.stdout:8/34: dwrite d3/f5 [0,4194304] 0 2024-04-26T23:08:52.264 INFO:tasks.workunit.client.0.smithi148.stdout:8/35: stat d3 0 2024-04-26T23:08:52.264 INFO:tasks.workunit.client.0.smithi148.stdout:8/36: fdatasync d3/f6 0 2024-04-26T23:08:52.264 INFO:tasks.workunit.client.0.smithi148.stdout:8/37: write d3/f6 [320622,92518] 0 2024-04-26T23:08:52.274 INFO:tasks.workunit.client.0.smithi148.stdout:0/16: dread d0/d5/f7 [0,4194304] 0 2024-04-26T23:08:52.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/17: mkdir d0/d8 0 2024-04-26T23:08:52.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/18: link d0/l4 d0/d8/l9 0 2024-04-26T23:08:52.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/19: write d0/d5/f7 [4762042,32243] 0 2024-04-26T23:08:52.280 INFO:tasks.workunit.client.0.smithi148.stdout:2/103: dwrite d5/d1c/f1d [0,4194304] 0 2024-04-26T23:08:52.281 INFO:tasks.workunit.client.0.smithi148.stdout:2/104: symlink d5/d7/l27 0 2024-04-26T23:08:52.298 INFO:tasks.workunit.client.0.smithi148.stdout:1/50: dread fa [0,4194304] 0 2024-04-26T23:08:52.298 INFO:tasks.workunit.client.0.smithi148.stdout:1/51: read - fb zero size 2024-04-26T23:08:52.299 INFO:tasks.workunit.client.0.smithi148.stdout:8/38: dwrite d3/f6 [0,4194304] 0 2024-04-26T23:08:52.303 INFO:tasks.workunit.client.0.smithi148.stdout:1/52: rename f8 to fd 0 2024-04-26T23:08:52.305 INFO:tasks.workunit.client.0.smithi148.stdout:1/53: creat fe x:0 0 0 2024-04-26T23:08:52.306 INFO:tasks.workunit.client.0.smithi148.stdout:2/105: write d5/f16 [3524693,2027] 0 2024-04-26T23:08:52.306 INFO:tasks.workunit.client.0.smithi148.stdout:2/106: write d5/d8/d9/f23 [942528,107351] 0 2024-04-26T23:08:52.310 INFO:tasks.workunit.client.0.smithi148.stdout:2/107: creat d5/d8/d9/f28 x:0 0 0 2024-04-26T23:08:52.310 INFO:tasks.workunit.client.0.smithi148.stdout:2/108: chown d5/d8/d9/l25 36017 1 2024-04-26T23:08:52.310 INFO:tasks.workunit.client.0.smithi148.stdout:2/109: truncate d5/d8/d9/f23 2012432 0 2024-04-26T23:08:52.310 INFO:tasks.workunit.client.0.smithi148.stdout:2/110: stat d5/d7/l27 0 2024-04-26T23:08:52.312 INFO:tasks.workunit.client.0.smithi148.stdout:5/40: dwrite da/fb [0,4194304] 0 2024-04-26T23:08:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/111: link d5/d8/d9/ld d5/d8/d11/l29 0 2024-04-26T23:08:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/112: stat d5/d8/d9/lf 0 2024-04-26T23:08:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/113: chown d5/d8/d9/f23 367601 1 2024-04-26T23:08:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:9/17: dwrite f3 [0,4194304] 0 2024-04-26T23:08:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:9/18: readlink - no filename 2024-04-26T23:08:52.314 INFO:tasks.workunit.client.0.smithi148.stdout:9/19: chown f2 5042319 1 2024-04-26T23:08:52.317 INFO:tasks.workunit.client.0.smithi148.stdout:8/39: dread d3/f6 [0,4194304] 0 2024-04-26T23:08:52.317 INFO:tasks.workunit.client.0.smithi148.stdout:1/54: getdents . 0 2024-04-26T23:08:52.317 INFO:tasks.workunit.client.0.smithi148.stdout:1/55: rmdir - no directory 2024-04-26T23:08:52.317 INFO:tasks.workunit.client.0.smithi148.stdout:1/56: dread - f7 zero size 2024-04-26T23:08:52.321 INFO:tasks.workunit.client.0.smithi148.stdout:5/41: unlink f0 0 2024-04-26T23:08:52.324 INFO:tasks.workunit.client.0.smithi148.stdout:4/38: dwrite f9 [0,4194304] 0 2024-04-26T23:08:52.329 INFO:tasks.workunit.client.0.smithi148.stdout:4/39: fdatasync f8 0 2024-04-26T23:08:52.333 INFO:tasks.workunit.client.0.smithi148.stdout:5/42: read f1 [20000,57675] 0 2024-04-26T23:08:52.334 INFO:tasks.workunit.client.0.smithi148.stdout:5/43: readlink da/le 0 2024-04-26T23:08:52.336 INFO:tasks.workunit.client.0.smithi148.stdout:0/20: dread d0/d5/f7 [0,4194304] 0 2024-04-26T23:08:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:2/114: creat d5/d8/d9/f2a x:0 0 0 2024-04-26T23:08:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:8/40: mkdir d3/d9 0 2024-04-26T23:08:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:1/57: stat l0 0 2024-04-26T23:08:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:1/58: truncate fe 522246 0 2024-04-26T23:08:52.343 INFO:tasks.workunit.client.0.smithi148.stdout:4/40: creat fb x:0 0 0 2024-04-26T23:08:52.343 INFO:tasks.workunit.client.0.smithi148.stdout:4/41: dread - fb zero size 2024-04-26T23:08:52.362 INFO:tasks.workunit.client.0.smithi148.stdout:2/115: symlink d5/d8/l2b 0 2024-04-26T23:08:52.362 INFO:tasks.workunit.client.0.smithi148.stdout:4/42: creat fc x:0 0 0 2024-04-26T23:08:52.365 INFO:tasks.workunit.client.0.smithi148.stdout:5/44: dwrite da/fd [0,4194304] 0 2024-04-26T23:08:52.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/116: getdents d5/d8/d11 0 2024-04-26T23:08:52.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/117: chown d5/d7 1889 1 2024-04-26T23:08:52.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/118: write d5/d8/d9/f28 [792320,37272] 0 2024-04-26T23:08:52.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/119: rmdir d5/d8/d11 39 2024-04-26T23:08:52.366 INFO:tasks.workunit.client.0.smithi148.stdout:2/120: mkdir d5/d2c 0 2024-04-26T23:08:52.367 INFO:tasks.workunit.client.0.smithi148.stdout:2/121: rmdir d5 39 2024-04-26T23:08:52.371 INFO:tasks.workunit.client.0.smithi148.stdout:8/41: dread d3/f6 [0,4194304] 0 2024-04-26T23:08:52.377 INFO:tasks.workunit.client.0.smithi148.stdout:8/42: mkdir d3/da 0 2024-04-26T23:08:52.377 INFO:tasks.workunit.client.0.smithi148.stdout:8/43: chown d3 2221189 1 2024-04-26T23:08:52.377 INFO:tasks.workunit.client.0.smithi148.stdout:8/44: rename d3 to d3/db 22 2024-04-26T23:08:52.377 INFO:tasks.workunit.client.0.smithi148.stdout:6/39: sync 2024-04-26T23:08:52.377 INFO:tasks.workunit.client.0.smithi148.stdout:6/40: chown d6/c8 963138 1 2024-04-26T23:08:52.378 INFO:tasks.workunit.client.0.smithi148.stdout:6/41: read d6/d9/fa [3256032,3828] 0 2024-04-26T23:08:52.379 INFO:tasks.workunit.client.0.smithi148.stdout:3/23: sync 2024-04-26T23:08:52.379 INFO:tasks.workunit.client.0.smithi148.stdout:7/26: sync 2024-04-26T23:08:52.379 INFO:tasks.workunit.client.0.smithi148.stdout:7/27: write d7/fb [314020,76951] 0 2024-04-26T23:08:52.385 INFO:tasks.workunit.client.0.smithi148.stdout:6/42: rename d6/l7 to d6/ld 0 2024-04-26T23:08:52.392 INFO:tasks.workunit.client.0.smithi148.stdout:2/122: fdatasync d5/d10/f14 0 2024-04-26T23:08:52.395 INFO:tasks.workunit.client.0.smithi148.stdout:9/20: dwrite f3 [0,4194304] 0 2024-04-26T23:08:52.396 INFO:tasks.workunit.client.0.smithi148.stdout:9/21: mknod c4 0 2024-04-26T23:08:52.400 INFO:tasks.workunit.client.0.smithi148.stdout:9/22: symlink l5 0 2024-04-26T23:08:52.401 INFO:tasks.workunit.client.0.smithi148.stdout:9/23: unlink f0 0 2024-04-26T23:08:52.402 INFO:tasks.workunit.client.0.smithi148.stdout:9/24: symlink l6 0 2024-04-26T23:08:52.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/45: dread da/fc [0,4194304] 0 2024-04-26T23:08:52.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/46: readlink da/le 0 2024-04-26T23:08:52.415 INFO:tasks.workunit.client.0.smithi148.stdout:4/43: read f8 [4759185,69141] 0 2024-04-26T23:08:52.417 INFO:tasks.workunit.client.0.smithi148.stdout:9/25: link f2 f7 0 2024-04-26T23:08:52.423 INFO:tasks.workunit.client.0.smithi148.stdout:5/47: mknod da/cf 0 2024-04-26T23:08:52.426 INFO:tasks.workunit.client.0.smithi148.stdout:9/26: mknod c8 0 2024-04-26T23:08:52.426 INFO:tasks.workunit.client.0.smithi148.stdout:9/27: fdatasync f2 0 2024-04-26T23:08:52.426 INFO:tasks.workunit.client.0.smithi148.stdout:9/28: chown f7 169 1 2024-04-26T23:08:52.438 INFO:tasks.workunit.client.0.smithi148.stdout:8/45: dwrite d3/f6 [0,4194304] 0 2024-04-26T23:08:52.439 INFO:tasks.workunit.client.0.smithi148.stdout:0/21: dwrite d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:08:52.441 INFO:tasks.workunit.client.0.smithi148.stdout:5/48: creat da/f10 x:0 0 0 2024-04-26T23:08:52.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/123: dwrite d5/d1c/f1d [0,4194304] 0 2024-04-26T23:08:52.453 INFO:tasks.workunit.client.0.smithi148.stdout:6/43: dread d6/d9/fa [4194304,4194304] 0 2024-04-26T23:08:52.455 INFO:tasks.workunit.client.0.smithi148.stdout:6/44: creat d6/fe x:0 0 0 2024-04-26T23:08:52.455 INFO:tasks.workunit.client.0.smithi148.stdout:6/45: write d6/fe [547064,94164] 0 2024-04-26T23:08:52.455 INFO:tasks.workunit.client.0.smithi148.stdout:6/46: chown c5 1656675070 1 2024-04-26T23:08:52.459 INFO:tasks.workunit.client.0.smithi148.stdout:6/47: truncate d6/d9/fa 4020151 0 2024-04-26T23:08:52.460 INFO:tasks.workunit.client.0.smithi148.stdout:6/48: rmdir d6/d9 39 2024-04-26T23:08:52.469 INFO:tasks.workunit.client.0.smithi148.stdout:8/46: dread d3/f5 [0,4194304] 0 2024-04-26T23:08:52.470 INFO:tasks.workunit.client.0.smithi148.stdout:5/49: dread f3 [0,4194304] 0 2024-04-26T23:08:52.471 INFO:tasks.workunit.client.0.smithi148.stdout:9/29: dread f2 [0,4194304] 0 2024-04-26T23:08:52.472 INFO:tasks.workunit.client.0.smithi148.stdout:8/47: creat d3/da/fc x:0 0 0 2024-04-26T23:08:52.472 INFO:tasks.workunit.client.0.smithi148.stdout:7/28: dwrite d7/f9 [0,4194304] 0 2024-04-26T23:08:52.474 INFO:tasks.workunit.client.0.smithi148.stdout:9/30: creat f9 x:0 0 0 2024-04-26T23:08:52.483 INFO:tasks.workunit.client.0.smithi148.stdout:0/22: write d0/d5/f7 [1719979,76745] 0 2024-04-26T23:08:52.483 INFO:tasks.workunit.client.0.smithi148.stdout:0/23: truncate d0/d5/f7 8958651 0 2024-04-26T23:08:52.488 INFO:tasks.workunit.client.0.smithi148.stdout:7/29: creat d7/fd x:0 0 0 2024-04-26T23:08:52.492 INFO:tasks.workunit.client.0.smithi148.stdout:0/24: link d0/l3 d0/la 0 2024-04-26T23:08:52.492 INFO:tasks.workunit.client.0.smithi148.stdout:0/25: chown d0/d8/l9 38631045 1 2024-04-26T23:08:52.492 INFO:tasks.workunit.client.0.smithi148.stdout:7/30: truncate d7/fb 324410 0 2024-04-26T23:08:52.503 INFO:tasks.workunit.client.0.smithi148.stdout:5/50: dwrite f6 [0,4194304] 0 2024-04-26T23:08:52.508 INFO:tasks.workunit.client.0.smithi148.stdout:7/31: dread d7/fc [0,4194304] 0 2024-04-26T23:08:52.517 INFO:tasks.workunit.client.0.smithi148.stdout:7/32: write d7/fc [2651187,61142] 0 2024-04-26T23:08:52.560 INFO:tasks.workunit.client.0.smithi148.stdout:0/26: dwrite d0/f2 [0,4194304] 0 2024-04-26T23:08:52.565 INFO:tasks.workunit.client.0.smithi148.stdout:4/44: dwrite fb [0,4194304] 0 2024-04-26T23:08:52.565 INFO:tasks.workunit.client.0.smithi148.stdout:4/45: fdatasync f9 0 2024-04-26T23:08:52.566 INFO:tasks.workunit.client.0.smithi148.stdout:0/27: stat d0/d8/l9 0 2024-04-26T23:08:52.568 INFO:tasks.workunit.client.0.smithi148.stdout:0/28: symlink d0/lb 0 2024-04-26T23:08:52.568 INFO:tasks.workunit.client.0.smithi148.stdout:0/29: creat d0/d5/fc x:0 0 0 2024-04-26T23:08:52.578 INFO:tasks.workunit.client.0.smithi148.stdout:6/49: dread d6/fe [0,4194304] 0 2024-04-26T23:08:52.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/33: getdents d7 0 2024-04-26T23:08:52.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/34: chown d7/ca 68 1 2024-04-26T23:08:52.582 INFO:tasks.workunit.client.0.smithi148.stdout:6/50: dread d6/fe [0,4194304] 0 2024-04-26T23:08:52.583 INFO:tasks.workunit.client.0.smithi148.stdout:7/35: truncate d7/fc 2282562 0 2024-04-26T23:08:52.583 INFO:tasks.workunit.client.0.smithi148.stdout:6/51: creat d6/ff x:0 0 0 2024-04-26T23:08:52.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/52: rename d6/d9/lb to d6/dc/l10 0 2024-04-26T23:08:52.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/53: write d6/d9/fa [738835,5083] 0 2024-04-26T23:08:52.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/54: chown d6/c8 104 1 2024-04-26T23:08:52.588 INFO:tasks.workunit.client.0.smithi148.stdout:6/55: stat d6/ld 0 2024-04-26T23:08:52.591 INFO:tasks.workunit.client.0.smithi148.stdout:5/51: dread da/fd [0,4194304] 0 2024-04-26T23:08:52.593 INFO:tasks.workunit.client.0.smithi148.stdout:6/56: dread d6/fe [0,4194304] 0 2024-04-26T23:08:52.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/57: link c5 d6/c11 0 2024-04-26T23:08:52.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/58: truncate d6/fe 796333 0 2024-04-26T23:08:52.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/59: dread - d6/ff zero size 2024-04-26T23:08:52.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/60: chown c5 394 1 2024-04-26T23:08:52.603 INFO:tasks.workunit.client.0.smithi148.stdout:7/36: dread d7/f9 [0,4194304] 0 2024-04-26T23:08:52.603 INFO:tasks.workunit.client.0.smithi148.stdout:7/37: getdents d7 0 2024-04-26T23:08:52.605 INFO:tasks.workunit.client.0.smithi148.stdout:7/38: creat d7/fe x:0 0 0 2024-04-26T23:08:52.605 INFO:tasks.workunit.client.0.smithi148.stdout:7/39: fdatasync d7/fc 0 2024-04-26T23:08:52.607 INFO:tasks.workunit.client.0.smithi148.stdout:7/40: rename c0 to d7/cf 0 2024-04-26T23:08:52.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/41: fsync d7/fb 0 2024-04-26T23:08:52.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/42: chown d7/fb 20948 1 2024-04-26T23:08:52.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/43: symlink d7/l10 0 2024-04-26T23:08:52.609 INFO:tasks.workunit.client.0.smithi148.stdout:4/46: dwrite fb [0,4194304] 0 2024-04-26T23:08:52.610 INFO:tasks.workunit.client.0.smithi148.stdout:5/52: dread f3 [0,4194304] 0 2024-04-26T23:08:52.610 INFO:tasks.workunit.client.0.smithi148.stdout:7/44: mkdir d7/d11 0 2024-04-26T23:08:52.612 INFO:tasks.workunit.client.0.smithi148.stdout:4/47: creat fd x:0 0 0 2024-04-26T23:08:52.612 INFO:tasks.workunit.client.0.smithi148.stdout:5/53: creat da/f11 x:0 0 0 2024-04-26T23:08:52.625 INFO:tasks.workunit.client.0.smithi148.stdout:4/48: dread fb [0,4194304] 0 2024-04-26T23:08:52.633 INFO:tasks.workunit.client.0.smithi148.stdout:7/45: creat d7/f12 x:0 0 0 2024-04-26T23:08:52.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/46: dread d7/fb [0,4194304] 0 2024-04-26T23:08:52.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/47: fdatasync d7/fc 0 2024-04-26T23:08:52.644 INFO:tasks.workunit.client.0.smithi148.stdout:5/54: dwrite f5 [0,4194304] 0 2024-04-26T23:08:52.645 INFO:tasks.workunit.client.0.smithi148.stdout:4/49: mknod ce 0 2024-04-26T23:08:52.648 INFO:tasks.workunit.client.0.smithi148.stdout:5/55: truncate da/fd 1281406 0 2024-04-26T23:08:52.649 INFO:tasks.workunit.client.0.smithi148.stdout:4/50: creat ff x:0 0 0 2024-04-26T23:08:52.651 INFO:tasks.workunit.client.0.smithi148.stdout:5/56: mkdir da/d12 0 2024-04-26T23:08:52.661 INFO:tasks.workunit.client.0.smithi148.stdout:5/57: dread f3 [0,4194304] 0 2024-04-26T23:08:52.666 INFO:tasks.workunit.client.0.smithi148.stdout:4/51: unlink la 0 2024-04-26T23:08:52.667 INFO:tasks.workunit.client.0.smithi148.stdout:4/52: fsync fd 0 2024-04-26T23:08:52.670 INFO:tasks.workunit.client.0.smithi148.stdout:7/48: dwrite d7/f12 [0,4194304] 0 2024-04-26T23:08:52.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/49: write f6 [1531067,49501] 0 2024-04-26T23:08:52.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/50: write d7/fe [79612,111978] 0 2024-04-26T23:08:52.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/51: write d7/fe [1129122,901] 0 2024-04-26T23:08:52.673 INFO:tasks.workunit.client.0.smithi148.stdout:5/58: creat da/d12/f13 x:0 0 0 2024-04-26T23:08:52.673 INFO:tasks.workunit.client.0.smithi148.stdout:5/59: truncate da/f10 365810 0 2024-04-26T23:08:52.673 INFO:tasks.workunit.client.0.smithi148.stdout:5/60: readlink da/le 0 2024-04-26T23:08:52.673 INFO:tasks.workunit.client.0.smithi148.stdout:5/61: readlink da/le 0 2024-04-26T23:08:52.676 INFO:tasks.workunit.client.0.smithi148.stdout:4/53: dread fb [0,4194304] 0 2024-04-26T23:08:52.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/52: mkdir d7/d11/d13 0 2024-04-26T23:08:52.680 INFO:tasks.workunit.client.0.smithi148.stdout:4/54: creat f10 x:0 0 0 2024-04-26T23:08:52.680 INFO:tasks.workunit.client.0.smithi148.stdout:4/55: readlink l6 0 2024-04-26T23:08:52.681 INFO:tasks.workunit.client.0.smithi148.stdout:7/53: mknod d7/c14 0 2024-04-26T23:08:52.713 INFO:tasks.workunit.client.0.smithi148.stdout:8/48: dwrite d3/da/fc [0,4194304] 0 2024-04-26T23:08:52.713 INFO:tasks.workunit.client.0.smithi148.stdout:1/59: dwrite fd [0,4194304] 0 2024-04-26T23:08:52.719 INFO:tasks.workunit.client.0.smithi148.stdout:4/56: symlink l11 0 2024-04-26T23:08:52.725 INFO:tasks.workunit.client.0.smithi148.stdout:8/49: dread d3/f5 [0,4194304] 0 2024-04-26T23:08:52.726 INFO:tasks.workunit.client.0.smithi148.stdout:6/61: fdatasync d6/d9/fa 0 2024-04-26T23:08:52.726 INFO:tasks.workunit.client.0.smithi148.stdout:6/62: fsync d6/d9/fa 0 2024-04-26T23:08:52.731 INFO:tasks.workunit.client.0.smithi148.stdout:6/63: symlink d6/l12 0 2024-04-26T23:08:52.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/64: mknod d6/d9/c13 0 2024-04-26T23:08:52.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/65: readlink l4 0 2024-04-26T23:08:52.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/66: readlink l4 0 2024-04-26T23:08:52.737 INFO:tasks.workunit.client.0.smithi148.stdout:4/57: getdents . 0 2024-04-26T23:08:52.738 INFO:tasks.workunit.client.0.smithi148.stdout:4/58: dread - ff zero size 2024-04-26T23:08:52.738 INFO:tasks.workunit.client.0.smithi148.stdout:5/62: dwrite da/f11 [0,4194304] 0 2024-04-26T23:08:52.740 INFO:tasks.workunit.client.0.smithi148.stdout:7/54: fdatasync d7/fe 0 2024-04-26T23:08:52.740 INFO:tasks.workunit.client.0.smithi148.stdout:0/30: write d0/d5/f7 [8258197,55817] 0 2024-04-26T23:08:52.740 INFO:tasks.workunit.client.0.smithi148.stdout:9/31: dwrite f7 [0,4194304] 0 2024-04-26T23:08:52.745 INFO:tasks.workunit.client.0.smithi148.stdout:4/59: mkdir d12 0 2024-04-26T23:08:52.747 INFO:tasks.workunit.client.0.smithi148.stdout:5/63: link f6 da/f14 0 2024-04-26T23:08:52.748 INFO:tasks.workunit.client.0.smithi148.stdout:6/67: write d6/fe [781272,87498] 0 2024-04-26T23:08:52.748 INFO:tasks.workunit.client.0.smithi148.stdout:6/68: chown l4 1 1 2024-04-26T23:08:52.754 INFO:tasks.workunit.client.0.smithi148.stdout:1/60: dwrite fb [0,4194304] 0 2024-04-26T23:08:52.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/50: dwrite d3/da/fc [0,4194304] 0 2024-04-26T23:08:52.792 INFO:tasks.workunit.client.0.smithi148.stdout:9/32: write f7 [3811269,75158] 0 2024-04-26T23:08:52.803 INFO:tasks.workunit.client.0.smithi148.stdout:8/51: dread d3/f6 [0,4194304] 0 2024-04-26T23:08:52.803 INFO:tasks.workunit.client.0.smithi148.stdout:8/52: chown d3/f6 52289610 1 2024-04-26T23:08:52.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/53: write d3/f6 [1471481,33667] 0 2024-04-26T23:08:52.999 INFO:tasks.workunit.client.0.smithi148.stdout:3/24: sync 2024-04-26T23:08:53.007 INFO:tasks.workunit.client.0.smithi148.stdout:7/55: creat d7/f15 x:0 0 0 2024-04-26T23:08:53.008 INFO:tasks.workunit.client.0.smithi148.stdout:0/31: getdents d0/d8 0 2024-04-26T23:08:53.010 INFO:tasks.workunit.client.0.smithi148.stdout:4/60: symlink d12/l13 0 2024-04-26T23:08:53.011 INFO:tasks.workunit.client.0.smithi148.stdout:7/56: write d7/fb [173909,92800] 0 2024-04-26T23:08:53.011 INFO:tasks.workunit.client.0.smithi148.stdout:7/57: chown f6 238 1 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/58: readlink d7/l10 0 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/59: chown d7/f15 163394910 1 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/60: fsync d7/f9 0 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/61: chown d7/f15 42344 1 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:5/64: getdents da 0 2024-04-26T23:08:53.012 INFO:tasks.workunit.client.0.smithi148.stdout:5/65: fsync da/f10 0 2024-04-26T23:08:53.014 INFO:tasks.workunit.client.0.smithi148.stdout:6/69: unlink d6/ff 0 2024-04-26T23:08:53.015 INFO:tasks.workunit.client.0.smithi148.stdout:6/70: write d6/fe [640842,91451] 0 2024-04-26T23:08:53.018 INFO:tasks.workunit.client.0.smithi148.stdout:7/62: dread d7/fe [0,4194304] 0 2024-04-26T23:08:53.019 INFO:tasks.workunit.client.0.smithi148.stdout:1/61: mknod cf 0 2024-04-26T23:08:53.019 INFO:tasks.workunit.client.0.smithi148.stdout:1/62: write f5 [1765341,66835] 0 2024-04-26T23:08:53.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/33: mknod ca 0 2024-04-26T23:08:53.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/34: chown l5 385942830 1 2024-04-26T23:08:53.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/35: chown c8 1703 1 2024-04-26T23:08:53.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/36: fdatasync f7 0 2024-04-26T23:08:53.031 INFO:tasks.workunit.client.0.smithi148.stdout:1/63: dread fb [0,4194304] 0 2024-04-26T23:08:53.031 INFO:tasks.workunit.client.0.smithi148.stdout:1/64: dread - f7 zero size 2024-04-26T23:08:53.032 INFO:tasks.workunit.client.0.smithi148.stdout:6/71: dread d6/fe [0,4194304] 0 2024-04-26T23:08:53.032 INFO:tasks.workunit.client.0.smithi148.stdout:6/72: chown d6/dc 20 1 2024-04-26T23:08:53.037 INFO:tasks.workunit.client.0.smithi148.stdout:3/25: truncate f0 2608577 0 2024-04-26T23:08:53.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/32: rename d0/l1 to d0/d5/ld 0 2024-04-26T23:08:53.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/33: truncate d0/d5/fc 219811 0 2024-04-26T23:08:53.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/34: chown d0/d5/fc 0 1 2024-04-26T23:08:53.048 INFO:tasks.workunit.client.0.smithi148.stdout:4/61: link f10 d12/f14 0 2024-04-26T23:08:53.049 INFO:tasks.workunit.client.0.smithi148.stdout:2/124: sync 2024-04-26T23:08:53.049 INFO:tasks.workunit.client.0.smithi148.stdout:2/125: dread - d5/d8/f1b zero size 2024-04-26T23:08:53.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/66: rmdir da/d12 39 2024-04-26T23:08:53.061 INFO:tasks.workunit.client.0.smithi148.stdout:7/63: rename f6 to d7/d11/f16 0 2024-04-26T23:08:53.065 INFO:tasks.workunit.client.0.smithi148.stdout:0/35: creat d0/d5/fe x:0 0 0 2024-04-26T23:08:53.067 INFO:tasks.workunit.client.0.smithi148.stdout:4/62: mknod d12/c15 0 2024-04-26T23:08:53.074 INFO:tasks.workunit.client.0.smithi148.stdout:2/126: creat d5/f2d x:0 0 0 2024-04-26T23:08:53.075 INFO:tasks.workunit.client.0.smithi148.stdout:1/65: dread fd [0,4194304] 0 2024-04-26T23:08:53.076 INFO:tasks.workunit.client.0.smithi148.stdout:7/64: mkdir d7/d11/d17 0 2024-04-26T23:08:53.078 INFO:tasks.workunit.client.0.smithi148.stdout:0/36: truncate d0/d5/f7 6142819 0 2024-04-26T23:08:53.081 INFO:tasks.workunit.client.0.smithi148.stdout:4/63: link f10 d12/f16 0 2024-04-26T23:08:53.084 INFO:tasks.workunit.client.0.smithi148.stdout:7/65: creat d7/d11/f18 x:0 0 0 2024-04-26T23:08:53.088 INFO:tasks.workunit.client.0.smithi148.stdout:0/37: creat d0/d5/ff x:0 0 0 2024-04-26T23:08:53.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/64: unlink d12/f16 0 2024-04-26T23:08:53.092 INFO:tasks.workunit.client.0.smithi148.stdout:7/66: mkdir d7/d19 0 2024-04-26T23:08:53.101 INFO:tasks.workunit.client.0.smithi148.stdout:6/73: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T23:08:53.106 INFO:tasks.workunit.client.0.smithi148.stdout:6/74: mkdir d6/d14 0 2024-04-26T23:08:53.107 INFO:tasks.workunit.client.0.smithi148.stdout:6/75: creat d6/d9/f15 x:0 0 0 2024-04-26T23:08:53.109 INFO:tasks.workunit.client.0.smithi148.stdout:6/76: symlink d6/d9/l16 0 2024-04-26T23:08:53.109 INFO:tasks.workunit.client.0.smithi148.stdout:5/67: dread f6 [0,4194304] 0 2024-04-26T23:08:53.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/26: dwrite f5 [4194304,4194304] 0 2024-04-26T23:08:53.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/27: chown l3 40 1 2024-04-26T23:08:53.110 INFO:tasks.workunit.client.0.smithi148.stdout:4/65: dread fb [0,4194304] 0 2024-04-26T23:08:53.131 INFO:tasks.workunit.client.0.smithi148.stdout:5/68: read f6 [2885710,104869] 0 2024-04-26T23:08:53.131 INFO:tasks.workunit.client.0.smithi148.stdout:1/66: dwrite f7 [0,4194304] 0 2024-04-26T23:08:53.135 INFO:tasks.workunit.client.0.smithi148.stdout:1/67: creat f10 x:0 0 0 2024-04-26T23:08:53.136 INFO:tasks.workunit.client.0.smithi148.stdout:5/69: creat da/d12/f15 x:0 0 0 2024-04-26T23:08:53.137 INFO:tasks.workunit.client.0.smithi148.stdout:1/68: unlink fe 0 2024-04-26T23:08:53.138 INFO:tasks.workunit.client.0.smithi148.stdout:5/70: symlink da/d12/l16 0 2024-04-26T23:08:53.139 INFO:tasks.workunit.client.0.smithi148.stdout:1/69: mknod c11 0 2024-04-26T23:08:53.140 INFO:tasks.workunit.client.0.smithi148.stdout:0/38: dwrite d0/d5/fc [0,4194304] 0 2024-04-26T23:08:53.140 INFO:tasks.workunit.client.0.smithi148.stdout:5/71: creat da/d12/f17 x:0 0 0 2024-04-26T23:08:53.141 INFO:tasks.workunit.client.0.smithi148.stdout:1/70: creat f12 x:0 0 0 2024-04-26T23:08:53.143 INFO:tasks.workunit.client.0.smithi148.stdout:0/39: truncate d0/f2 3147654 0 2024-04-26T23:08:53.144 INFO:tasks.workunit.client.0.smithi148.stdout:1/71: creat f13 x:0 0 0 2024-04-26T23:08:53.144 INFO:tasks.workunit.client.0.smithi148.stdout:1/72: dread - f10 zero size 2024-04-26T23:08:53.146 INFO:tasks.workunit.client.0.smithi148.stdout:2/127: dwrite d5/d7/f18 [0,4194304] 0 2024-04-26T23:08:53.148 INFO:tasks.workunit.client.0.smithi148.stdout:2/128: truncate d5/d1c/f1d 2080740 0 2024-04-26T23:08:53.150 INFO:tasks.workunit.client.0.smithi148.stdout:2/129: creat d5/d7/f2e x:0 0 0 2024-04-26T23:08:53.151 INFO:tasks.workunit.client.0.smithi148.stdout:2/130: creat d5/d1c/f2f x:0 0 0 2024-04-26T23:08:53.152 INFO:tasks.workunit.client.0.smithi148.stdout:3/28: write f5 [3203907,114653] 0 2024-04-26T23:08:53.153 INFO:tasks.workunit.client.0.smithi148.stdout:7/67: dwrite d7/fc [0,4194304] 0 2024-04-26T23:08:53.155 INFO:tasks.workunit.client.0.smithi148.stdout:1/73: dread fa [0,4194304] 0 2024-04-26T23:08:53.155 INFO:tasks.workunit.client.0.smithi148.stdout:5/72: rename da/fd to da/f18 0 2024-04-26T23:08:53.157 INFO:tasks.workunit.client.0.smithi148.stdout:3/29: mkdir d9 0 2024-04-26T23:08:53.162 INFO:tasks.workunit.client.0.smithi148.stdout:1/74: mknod c14 0 2024-04-26T23:08:53.162 INFO:tasks.workunit.client.0.smithi148.stdout:5/73: creat da/f19 x:0 0 0 2024-04-26T23:08:53.162 INFO:tasks.workunit.client.0.smithi148.stdout:1/75: write f12 [640798,109874] 0 2024-04-26T23:08:53.165 INFO:tasks.workunit.client.0.smithi148.stdout:1/76: unlink c14 0 2024-04-26T23:08:53.166 INFO:tasks.workunit.client.0.smithi148.stdout:5/74: mkdir da/d1a 0 2024-04-26T23:08:53.179 INFO:tasks.workunit.client.0.smithi148.stdout:5/75: write da/f18 [52803,7486] 0 2024-04-26T23:08:53.182 INFO:tasks.workunit.client.0.smithi148.stdout:1/77: dread f12 [0,4194304] 0 2024-04-26T23:08:53.189 INFO:tasks.workunit.client.0.smithi148.stdout:1/78: creat f15 x:0 0 0 2024-04-26T23:08:53.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/66: dwrite ff [0,4194304] 0 2024-04-26T23:08:53.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/67: write fc [250513,124604] 0 2024-04-26T23:08:53.200 INFO:tasks.workunit.client.0.smithi148.stdout:3/30: dwrite f5 [4194304,4194304] 0 2024-04-26T23:08:53.200 INFO:tasks.workunit.client.0.smithi148.stdout:3/31: readlink l3 0 2024-04-26T23:08:53.201 INFO:tasks.workunit.client.0.smithi148.stdout:3/32: chown l3 0 1 2024-04-26T23:08:53.201 INFO:tasks.workunit.client.0.smithi148.stdout:0/40: truncate d0/f2 1650257 0 2024-04-26T23:08:53.201 INFO:tasks.workunit.client.0.smithi148.stdout:5/76: mkdir da/d1b 0 2024-04-26T23:08:53.201 INFO:tasks.workunit.client.0.smithi148.stdout:5/77: chown f3 48558551 1 2024-04-26T23:08:53.203 INFO:tasks.workunit.client.0.smithi148.stdout:1/79: mkdir d16 0 2024-04-26T23:08:53.206 INFO:tasks.workunit.client.0.smithi148.stdout:4/68: mkdir d12/d17 0 2024-04-26T23:08:53.206 INFO:tasks.workunit.client.0.smithi148.stdout:4/69: chown l6 92 1 2024-04-26T23:08:53.207 INFO:tasks.workunit.client.0.smithi148.stdout:3/33: link l4 d9/la 0 2024-04-26T23:08:53.209 INFO:tasks.workunit.client.0.smithi148.stdout:6/77: write d6/d9/fa [3672392,97829] 0 2024-04-26T23:08:53.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/41: link d0/l3 d0/d8/l10 0 2024-04-26T23:08:53.209 INFO:tasks.workunit.client.0.smithi148.stdout:6/78: chown d6/c8 8069 1 2024-04-26T23:08:53.209 INFO:tasks.workunit.client.0.smithi148.stdout:6/79: stat d6 0 2024-04-26T23:08:53.210 INFO:tasks.workunit.client.0.smithi148.stdout:6/80: dread - d6/d9/f15 zero size 2024-04-26T23:08:53.210 INFO:tasks.workunit.client.0.smithi148.stdout:2/131: dwrite d5/d1c/f1d [0,4194304] 0 2024-04-26T23:08:53.210 INFO:tasks.workunit.client.0.smithi148.stdout:5/78: mkdir da/d1b/d1c 0 2024-04-26T23:08:53.214 INFO:tasks.workunit.client.0.smithi148.stdout:8/54: sync 2024-04-26T23:08:53.214 INFO:tasks.workunit.client.0.smithi148.stdout:9/37: sync 2024-04-26T23:08:53.214 INFO:tasks.workunit.client.0.smithi148.stdout:9/38: chown l6 51761167 1 2024-04-26T23:08:53.218 INFO:tasks.workunit.client.0.smithi148.stdout:3/34: mknod d9/cb 0 2024-04-26T23:08:53.219 INFO:tasks.workunit.client.0.smithi148.stdout:0/42: symlink d0/l11 0 2024-04-26T23:08:53.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/81: mkdir d6/d14/d17 0 2024-04-26T23:08:53.219 INFO:tasks.workunit.client.0.smithi148.stdout:0/43: truncate d0/d5/ff 747499 0 2024-04-26T23:08:53.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/82: write d6/d9/f15 [507408,128053] 0 2024-04-26T23:08:53.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/83: chown d6/d9/l16 192 1 2024-04-26T23:08:53.220 INFO:tasks.workunit.client.0.smithi148.stdout:1/80: dread f5 [0,4194304] 0 2024-04-26T23:08:53.220 INFO:tasks.workunit.client.0.smithi148.stdout:1/81: readlink l0 0 2024-04-26T23:08:53.221 INFO:tasks.workunit.client.0.smithi148.stdout:2/132: creat d5/d17/f30 x:0 0 0 2024-04-26T23:08:53.222 INFO:tasks.workunit.client.0.smithi148.stdout:7/68: dwrite d7/d11/f16 [0,4194304] 0 2024-04-26T23:08:53.229 INFO:tasks.workunit.client.0.smithi148.stdout:4/70: getdents d12 0 2024-04-26T23:08:53.230 INFO:tasks.workunit.client.0.smithi148.stdout:4/71: chown d12 165511 1 2024-04-26T23:08:53.230 INFO:tasks.workunit.client.0.smithi148.stdout:8/55: mknod d3/da/cd 0 2024-04-26T23:08:53.230 INFO:tasks.workunit.client.0.smithi148.stdout:3/35: mknod d9/cc 0 2024-04-26T23:08:53.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/44: rename d0/d5/fc to d0/f12 0 2024-04-26T23:08:53.230 INFO:tasks.workunit.client.0.smithi148.stdout:6/84: unlink d6/l12 0 2024-04-26T23:08:53.231 INFO:tasks.workunit.client.0.smithi148.stdout:5/79: truncate da/f11 1121019 0 2024-04-26T23:08:53.231 INFO:tasks.workunit.client.0.smithi148.stdout:2/133: getdents d5/d17 0 2024-04-26T23:08:53.235 INFO:tasks.workunit.client.0.smithi148.stdout:4/72: write f10 [346769,99236] 0 2024-04-26T23:08:53.235 INFO:tasks.workunit.client.0.smithi148.stdout:4/73: getdents d12 0 2024-04-26T23:08:53.236 INFO:tasks.workunit.client.0.smithi148.stdout:8/56: rmdir d3/d7 0 2024-04-26T23:08:53.237 INFO:tasks.workunit.client.0.smithi148.stdout:3/36: mknod d9/cd 0 2024-04-26T23:08:53.237 INFO:tasks.workunit.client.0.smithi148.stdout:3/37: write f5 [206706,107639] 0 2024-04-26T23:08:53.241 INFO:tasks.workunit.client.0.smithi148.stdout:6/85: mknod d6/c18 0 2024-04-26T23:08:53.244 INFO:tasks.workunit.client.0.smithi148.stdout:6/86: rmdir d6/d14/d17 0 2024-04-26T23:08:53.246 INFO:tasks.workunit.client.0.smithi148.stdout:5/80: link f1 da/f1d 0 2024-04-26T23:08:53.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/39: dwrite f9 [0,4194304] 0 2024-04-26T23:08:53.284 INFO:tasks.workunit.client.0.smithi148.stdout:6/87: link d6/d9/fa d6/f19 0 2024-04-26T23:08:53.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/57: dread d3/f6 [0,4194304] 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:1/82: dwrite f7 [0,4194304] 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/40: creat fb x:0 0 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/41: readlink l5 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/42: write fb [262111,79441] 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/88: unlink d6/dc/l10 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:8/58: rename d3/c8 to d3/da/ce 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:8/59: fdatasync d3/f6 0 2024-04-26T23:08:53.305 INFO:tasks.workunit.client.0.smithi148.stdout:8/60: stat d3/f6 0 2024-04-26T23:08:53.347 INFO:tasks.workunit.client.0.smithi148.stdout:1/83: write fd [250322,39205] 0 2024-04-26T23:08:53.347 INFO:tasks.workunit.client.0.smithi148.stdout:1/84: write f13 [539933,43485] 0 2024-04-26T23:08:53.356 INFO:tasks.workunit.client.0.smithi148.stdout:0/45: dwrite d0/d5/f7 [0,4194304] 0 2024-04-26T23:08:53.357 INFO:tasks.workunit.client.0.smithi148.stdout:8/61: mknod d3/d9/cf 0 2024-04-26T23:08:53.357 INFO:tasks.workunit.client.0.smithi148.stdout:9/43: dread f7 [0,4194304] 0 2024-04-26T23:08:53.358 INFO:tasks.workunit.client.0.smithi148.stdout:1/85: mkdir d16/d17 0 2024-04-26T23:08:53.360 INFO:tasks.workunit.client.0.smithi148.stdout:6/89: dwrite d6/fe [0,4194304] 0 2024-04-26T23:08:53.361 INFO:tasks.workunit.client.0.smithi148.stdout:0/46: mknod d0/c13 0 2024-04-26T23:08:53.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/47: write d0/d5/f7 [6364992,32829] 0 2024-04-26T23:08:53.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/48: write d0/f2 [2522573,18607] 0 2024-04-26T23:08:53.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/49: write d0/d5/ff [859572,102206] 0 2024-04-26T23:08:53.362 INFO:tasks.workunit.client.0.smithi148.stdout:8/62: mkdir d3/da/d10 0 2024-04-26T23:08:53.364 INFO:tasks.workunit.client.0.smithi148.stdout:9/44: creat fc x:0 0 0 2024-04-26T23:08:53.364 INFO:tasks.workunit.client.0.smithi148.stdout:9/45: write f9 [4802181,16914] 0 2024-04-26T23:08:53.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/90: mknod d6/d9/c1a 0 2024-04-26T23:08:53.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/91: read d6/d9/f15 [587246,60373] 0 2024-04-26T23:08:53.371 INFO:tasks.workunit.client.0.smithi148.stdout:0/50: creat d0/d8/f14 x:0 0 0 2024-04-26T23:08:53.371 INFO:tasks.workunit.client.0.smithi148.stdout:1/86: dread f7 [0,4194304] 0 2024-04-26T23:08:53.376 INFO:tasks.workunit.client.0.smithi148.stdout:8/63: link d3/l4 d3/da/d10/l11 0 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:2/134: dwrite d5/d8/d9/f23 [0,4194304] 0 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:2/135: chown d5/d8/c21 981082 1 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:6/92: truncate d6/d9/fa 283599 0 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:0/51: rename d0/d5/ff to d0/f15 0 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:0/52: dread - d0/d5/fe zero size 2024-04-26T23:08:53.381 INFO:tasks.workunit.client.0.smithi148.stdout:1/87: unlink fb 0 2024-04-26T23:08:53.382 INFO:tasks.workunit.client.0.smithi148.stdout:6/93: symlink d6/d9/l1b 0 2024-04-26T23:08:53.383 INFO:tasks.workunit.client.0.smithi148.stdout:0/53: creat d0/d5/f16 x:0 0 0 2024-04-26T23:08:53.393 INFO:tasks.workunit.client.0.smithi148.stdout:8/64: dread d3/f5 [0,4194304] 0 2024-04-26T23:08:53.396 INFO:tasks.workunit.client.0.smithi148.stdout:2/136: read d5/d10/f19 [3892426,73724] 0 2024-04-26T23:08:53.396 INFO:tasks.workunit.client.0.smithi148.stdout:2/137: fdatasync d5/d8/d9/f2a 0 2024-04-26T23:08:53.403 INFO:tasks.workunit.client.0.smithi148.stdout:5/81: write da/f11 [950275,32396] 0 2024-04-26T23:08:53.403 INFO:tasks.workunit.client.0.smithi148.stdout:5/82: dread - da/d12/f17 zero size 2024-04-26T23:08:53.403 INFO:tasks.workunit.client.0.smithi148.stdout:5/83: chown f6 307 1 2024-04-26T23:08:53.405 INFO:tasks.workunit.client.0.smithi148.stdout:1/88: link f10 d16/d17/f18 0 2024-04-26T23:08:53.408 INFO:tasks.workunit.client.0.smithi148.stdout:2/138: truncate d5/d10/f14 4066893 0 2024-04-26T23:08:53.408 INFO:tasks.workunit.client.0.smithi148.stdout:2/139: stat d5/d8/d15 0 2024-04-26T23:08:53.408 INFO:tasks.workunit.client.0.smithi148.stdout:2/140: dread - d5/d7/f2e zero size 2024-04-26T23:08:53.410 INFO:tasks.workunit.client.0.smithi148.stdout:5/84: link da/d12/f17 da/d1a/f1e 0 2024-04-26T23:08:53.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/74: dread d12/f14 [0,4194304] 0 2024-04-26T23:08:53.411 INFO:tasks.workunit.client.0.smithi148.stdout:1/89: mknod d16/c19 0 2024-04-26T23:08:53.412 INFO:tasks.workunit.client.0.smithi148.stdout:3/38: dwrite f0 [0,4194304] 0 2024-04-26T23:08:53.415 INFO:tasks.workunit.client.0.smithi148.stdout:2/141: link d5/d8/d9/lf d5/d2c/l31 0 2024-04-26T23:08:53.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/75: dread f8 [0,4194304] 0 2024-04-26T23:08:53.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/76: chown d12/d17 888723 1 2024-04-26T23:08:53.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/77: getdents d12 0 2024-04-26T23:08:53.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/142: dwrite d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:08:53.464 INFO:tasks.workunit.client.0.smithi148.stdout:0/54: dwrite d0/f2 [0,4194304] 0 2024-04-26T23:08:53.466 INFO:tasks.workunit.client.0.smithi148.stdout:3/39: unlink d9/cb 0 2024-04-26T23:08:53.476 INFO:tasks.workunit.client.0.smithi148.stdout:6/94: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T23:08:53.478 INFO:tasks.workunit.client.0.smithi148.stdout:2/143: unlink d5/d7/f2e 0 2024-04-26T23:08:53.479 INFO:tasks.workunit.client.0.smithi148.stdout:5/85: mkdir da/d1f 0 2024-04-26T23:08:53.490 INFO:tasks.workunit.client.0.smithi148.stdout:8/65: dwrite d3/da/fc [0,4194304] 0 2024-04-26T23:08:53.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/55: mkdir d0/d8/d17 0 2024-04-26T23:08:53.504 INFO:tasks.workunit.client.0.smithi148.stdout:6/95: dread d6/d9/fa [0,4194304] 0 2024-04-26T23:08:53.505 INFO:tasks.workunit.client.0.smithi148.stdout:3/40: dwrite f5 [4194304,4194304] 0 2024-04-26T23:08:53.506 INFO:tasks.workunit.client.0.smithi148.stdout:2/144: mkdir d5/d2c/d32 0 2024-04-26T23:08:53.514 INFO:tasks.workunit.client.0.smithi148.stdout:6/96: dread d6/f19 [0,4194304] 0 2024-04-26T23:08:53.524 INFO:tasks.workunit.client.0.smithi148.stdout:0/56: dwrite d0/d5/f16 [0,4194304] 0 2024-04-26T23:08:53.526 INFO:tasks.workunit.client.0.smithi148.stdout:8/66: rename d3/da/d10 to d3/d9/d12 0 2024-04-26T23:08:53.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/41: mknod d9/ce 0 2024-04-26T23:08:53.527 INFO:tasks.workunit.client.0.smithi148.stdout:6/97: mkdir d6/d9/d1c 0 2024-04-26T23:08:53.527 INFO:tasks.workunit.client.0.smithi148.stdout:6/98: truncate d6/d9/f15 1610135 0 2024-04-26T23:08:53.528 INFO:tasks.workunit.client.0.smithi148.stdout:5/86: mknod da/c20 0 2024-04-26T23:08:53.528 INFO:tasks.workunit.client.0.smithi148.stdout:5/87: getdents da/d1b/d1c 0 2024-04-26T23:08:53.538 INFO:tasks.workunit.client.0.smithi148.stdout:3/42: dread f5 [4194304,4194304] 0 2024-04-26T23:08:53.560 INFO:tasks.workunit.client.0.smithi148.stdout:0/57: mknod d0/c18 0 2024-04-26T23:08:53.560 INFO:tasks.workunit.client.0.smithi148.stdout:0/58: fdatasync d0/f2 0 2024-04-26T23:08:53.561 INFO:tasks.workunit.client.0.smithi148.stdout:2/145: rename d5/d8/l2b to d5/d2c/d32/l33 0 2024-04-26T23:08:53.562 INFO:tasks.workunit.client.0.smithi148.stdout:6/99: mkdir d6/d9/d1c/d1d 0 2024-04-26T23:08:53.563 INFO:tasks.workunit.client.0.smithi148.stdout:6/100: chown d6/c11 11086317 1 2024-04-26T23:08:53.564 INFO:tasks.workunit.client.0.smithi148.stdout:5/88: truncate f1 1970257 0 2024-04-26T23:08:53.568 INFO:tasks.workunit.client.0.smithi148.stdout:8/67: dwrite d3/f6 [0,4194304] 0 2024-04-26T23:08:53.575 INFO:tasks.workunit.client.0.smithi148.stdout:6/101: dread d6/f19 [0,4194304] 0 2024-04-26T23:08:53.578 INFO:tasks.workunit.client.0.smithi148.stdout:0/59: unlink d0/l3 0 2024-04-26T23:08:53.578 INFO:tasks.workunit.client.0.smithi148.stdout:0/60: chown d0/lb 31784 1 2024-04-26T23:08:53.578 INFO:tasks.workunit.client.0.smithi148.stdout:0/61: fsync d0/d5/f7 0 2024-04-26T23:08:53.616 INFO:tasks.workunit.client.0.smithi148.stdout:5/89: dwrite f1 [0,4194304] 0 2024-04-26T23:08:53.616 INFO:tasks.workunit.client.0.smithi148.stdout:5/90: fdatasync f6 0 2024-04-26T23:08:53.618 INFO:tasks.workunit.client.0.smithi148.stdout:2/146: mknod d5/c34 0 2024-04-26T23:08:53.618 INFO:tasks.workunit.client.0.smithi148.stdout:2/147: write d5/d7/f18 [4972933,94277] 0 2024-04-26T23:08:53.621 INFO:tasks.workunit.client.0.smithi148.stdout:8/68: rename d3/l4 to d3/d9/d12/l13 0 2024-04-26T23:08:53.622 INFO:tasks.workunit.client.0.smithi148.stdout:6/102: mkdir d6/d9/d1e 0 2024-04-26T23:08:53.645 INFO:tasks.workunit.client.0.smithi148.stdout:4/78: dwrite fd [0,4194304] 0 2024-04-26T23:08:53.646 INFO:tasks.workunit.client.0.smithi148.stdout:5/91: chown da/fc 103196267 1 2024-04-26T23:08:53.648 INFO:tasks.workunit.client.0.smithi148.stdout:2/148: truncate d5/d8/d9/f23 347579 0 2024-04-26T23:08:53.648 INFO:tasks.workunit.client.0.smithi148.stdout:2/149: read - d5/d8/f1b zero size 2024-04-26T23:08:53.652 INFO:tasks.workunit.client.0.smithi148.stdout:8/69: rmdir d3 39 2024-04-26T23:08:53.664 INFO:tasks.workunit.client.0.smithi148.stdout:0/62: dwrite d0/f12 [0,4194304] 0 2024-04-26T23:08:53.665 INFO:tasks.workunit.client.0.smithi148.stdout:0/63: write d0/f15 [1847368,120631] 0 2024-04-26T23:08:53.667 INFO:tasks.workunit.client.0.smithi148.stdout:7/69: sync 2024-04-26T23:08:53.669 INFO:tasks.workunit.client.0.smithi148.stdout:4/79: creat d12/d17/f18 x:0 0 0 2024-04-26T23:08:53.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/150: rename d5/d1c/f1d to d5/d8/f35 0 2024-04-26T23:08:53.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/151: truncate d5/d8/d9/f23 420326 0 2024-04-26T23:08:53.673 INFO:tasks.workunit.client.0.smithi148.stdout:8/70: mknod d3/d9/d12/c14 0 2024-04-26T23:08:53.673 INFO:tasks.workunit.client.0.smithi148.stdout:8/71: chown d3/f6 1 1 2024-04-26T23:08:53.674 INFO:tasks.workunit.client.0.smithi148.stdout:8/72: chown d3/da 1 1 2024-04-26T23:08:53.681 INFO:tasks.workunit.client.0.smithi148.stdout:7/70: creat d7/d11/d17/f1a x:0 0 0 2024-04-26T23:08:53.682 INFO:tasks.workunit.client.0.smithi148.stdout:4/80: symlink d12/d17/l19 0 2024-04-26T23:08:53.704 INFO:tasks.workunit.client.0.smithi148.stdout:5/92: mknod da/c21 0 2024-04-26T23:08:53.706 INFO:tasks.workunit.client.0.smithi148.stdout:2/152: rename d5/d17/c1a to d5/c36 0 2024-04-26T23:08:53.789 INFO:tasks.workunit.client.0.smithi148.stdout:6/103: dwrite d6/f19 [0,4194304] 0 2024-04-26T23:08:53.792 INFO:tasks.workunit.client.0.smithi148.stdout:7/71: symlink d7/l1b 0 2024-04-26T23:08:53.792 INFO:tasks.workunit.client.0.smithi148.stdout:7/72: write d7/d11/d17/f1a [466926,115588] 0 2024-04-26T23:08:53.792 INFO:tasks.workunit.client.0.smithi148.stdout:7/73: dread - d7/fd zero size 2024-04-26T23:08:53.794 INFO:tasks.workunit.client.0.smithi148.stdout:5/93: creat da/d1b/d1c/f22 x:0 0 0 2024-04-26T23:08:53.806 INFO:tasks.workunit.client.0.smithi148.stdout:2/153: creat d5/d2c/d32/f37 x:0 0 0 2024-04-26T23:08:53.806 INFO:tasks.workunit.client.0.smithi148.stdout:2/154: write d5/d8/d9/f23 [727728,31084] 0 2024-04-26T23:08:53.810 INFO:tasks.workunit.client.0.smithi148.stdout:6/104: mkdir d6/d9/d1c/d1d/d1f 0 2024-04-26T23:08:53.811 INFO:tasks.workunit.client.0.smithi148.stdout:7/74: getdents d7/d11 0 2024-04-26T23:08:53.811 INFO:tasks.workunit.client.0.smithi148.stdout:7/75: rename d7/d11/d17 to d7/d11/d17/d1c 22 2024-04-26T23:08:53.817 INFO:tasks.workunit.client.0.smithi148.stdout:0/64: dwrite d0/d5/f7 [0,4194304] 0 2024-04-26T23:08:53.824 INFO:tasks.workunit.client.0.smithi148.stdout:6/105: symlink d6/d9/d1c/d1d/l20 0 2024-04-26T23:08:53.825 INFO:tasks.workunit.client.0.smithi148.stdout:7/76: creat d7/d11/d17/f1d x:0 0 0 2024-04-26T23:08:53.825 INFO:tasks.workunit.client.0.smithi148.stdout:7/77: dread - d7/d11/d17/f1d zero size 2024-04-26T23:08:53.831 INFO:tasks.workunit.client.0.smithi148.stdout:2/155: read d5/d8/d9/fc [4796765,12063] 0 2024-04-26T23:08:53.831 INFO:tasks.workunit.client.0.smithi148.stdout:4/81: dwrite d12/d17/f18 [0,4194304] 0 2024-04-26T23:08:53.838 INFO:tasks.workunit.client.0.smithi148.stdout:0/65: dread d0/f12 [0,4194304] 0 2024-04-26T23:08:53.843 INFO:tasks.workunit.client.0.smithi148.stdout:6/106: rename d6/d9/c1a to d6/d9/d1c/c21 0 2024-04-26T23:08:53.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/82: dread fd [0,4194304] 0 2024-04-26T23:08:53.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/83: stat d12/d17 0 2024-04-26T23:08:53.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/84: chown d12/d17 2 1 2024-04-26T23:08:53.849 INFO:tasks.workunit.client.0.smithi148.stdout:6/107: dread d6/d9/f15 [0,4194304] 0 2024-04-26T23:08:53.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/108: read d6/d9/f15 [1492896,25872] 0 2024-04-26T23:08:53.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/109: fsync d6/f19 0 2024-04-26T23:08:53.859 INFO:tasks.workunit.client.0.smithi148.stdout:5/94: dwrite f1 [4194304,4194304] 0 2024-04-26T23:08:53.873 INFO:tasks.workunit.client.0.smithi148.stdout:6/110: read d6/f19 [183943,57030] 0 2024-04-26T23:08:53.882 INFO:tasks.workunit.client.0.smithi148.stdout:9/46: sync 2024-04-26T23:08:53.891 INFO:tasks.workunit.client.0.smithi148.stdout:1/90: sync 2024-04-26T23:08:53.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/78: dwrite d7/f9 [0,4194304] 0 2024-04-26T23:08:53.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/79: getdents d7/d11 0 2024-04-26T23:08:53.898 INFO:tasks.workunit.client.0.smithi148.stdout:7/80: truncate d7/fe 1553460 0 2024-04-26T23:08:53.899 INFO:tasks.workunit.client.0.smithi148.stdout:4/85: dwrite d12/f14 [0,4194304] 0 2024-04-26T23:08:53.899 INFO:tasks.workunit.client.0.smithi148.stdout:4/86: fsync d12/f14 0 2024-04-26T23:08:53.901 INFO:tasks.workunit.client.0.smithi148.stdout:5/95: mknod da/d12/c23 0 2024-04-26T23:08:53.902 INFO:tasks.workunit.client.0.smithi148.stdout:9/47: mknod cd 0 2024-04-26T23:08:53.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/81: mkdir d7/d19/d1e 0 2024-04-26T23:08:53.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/82: fsync d7/fd 0 2024-04-26T23:08:53.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/83: getdents d7/d11 0 2024-04-26T23:08:53.907 INFO:tasks.workunit.client.0.smithi148.stdout:0/66: dread d0/f15 [0,4194304] 0 2024-04-26T23:08:53.907 INFO:tasks.workunit.client.0.smithi148.stdout:0/67: chown d0/d5/fe 1986203 1 2024-04-26T23:08:53.907 INFO:tasks.workunit.client.0.smithi148.stdout:1/91: dread f12 [0,4194304] 0 2024-04-26T23:08:53.907 INFO:tasks.workunit.client.0.smithi148.stdout:1/92: fdatasync f7 0 2024-04-26T23:08:53.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/87: getdents d12/d17 0 2024-04-26T23:08:53.913 INFO:tasks.workunit.client.0.smithi148.stdout:4/88: readlink d12/l13 0 2024-04-26T23:08:53.913 INFO:tasks.workunit.client.0.smithi148.stdout:2/156: dwrite d5/d2c/d32/f37 [0,4194304] 0 2024-04-26T23:08:53.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/96: symlink da/d1f/l24 0 2024-04-26T23:08:53.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/97: write da/f18 [2219513,33647] 0 2024-04-26T23:08:53.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/98: readlink da/d1f/l24 0 2024-04-26T23:08:53.915 INFO:tasks.workunit.client.0.smithi148.stdout:9/48: creat fe x:0 0 0 2024-04-26T23:08:53.916 INFO:tasks.workunit.client.0.smithi148.stdout:6/111: dwrite d6/f19 [0,4194304] 0 2024-04-26T23:08:53.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/84: rename d7/d11/d17/f1a to d7/d11/d13/f1f 0 2024-04-26T23:08:53.921 INFO:tasks.workunit.client.0.smithi148.stdout:0/68: dread d0/d5/f16 [0,4194304] 0 2024-04-26T23:08:53.921 INFO:tasks.workunit.client.0.smithi148.stdout:1/93: creat d16/d17/f1a x:0 0 0 2024-04-26T23:08:53.921 INFO:tasks.workunit.client.0.smithi148.stdout:1/94: write d16/d17/f1a [935333,45816] 0 2024-04-26T23:08:53.921 INFO:tasks.workunit.client.0.smithi148.stdout:6/112: dread d6/d9/f15 [0,4194304] 0 2024-04-26T23:08:53.922 INFO:tasks.workunit.client.0.smithi148.stdout:4/89: mkdir d12/d1a 0 2024-04-26T23:08:53.928 INFO:tasks.workunit.client.0.smithi148.stdout:2/157: mkdir d5/d1c/d38 0 2024-04-26T23:08:53.931 INFO:tasks.workunit.client.0.smithi148.stdout:9/49: rename fb to ff 0 2024-04-26T23:08:53.936 INFO:tasks.workunit.client.0.smithi148.stdout:7/85: rename d7/d11/d17/f1d to d7/d19/f20 0 2024-04-26T23:08:53.938 INFO:tasks.workunit.client.0.smithi148.stdout:0/69: mkdir d0/d5/d19 0 2024-04-26T23:08:53.940 INFO:tasks.workunit.client.0.smithi148.stdout:2/158: creat d5/d17/f39 x:0 0 0 2024-04-26T23:08:53.940 INFO:tasks.workunit.client.0.smithi148.stdout:2/159: dread - d5/d17/f39 zero size 2024-04-26T23:08:53.941 INFO:tasks.workunit.client.0.smithi148.stdout:2/160: readlink d5/d8/d9/lf 0 2024-04-26T23:08:53.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/73: sync 2024-04-26T23:08:53.943 INFO:tasks.workunit.client.0.smithi148.stdout:3/43: sync 2024-04-26T23:08:53.944 INFO:tasks.workunit.client.0.smithi148.stdout:3/44: fsync f0 0 2024-04-26T23:08:53.944 INFO:tasks.workunit.client.0.smithi148.stdout:5/99: dread da/f14 [0,4194304] 0 2024-04-26T23:08:53.945 INFO:tasks.workunit.client.0.smithi148.stdout:4/90: dread d12/f14 [0,4194304] 0 2024-04-26T23:08:53.945 INFO:tasks.workunit.client.0.smithi148.stdout:7/86: creat d7/d11/d13/f21 x:0 0 0 2024-04-26T23:08:53.947 INFO:tasks.workunit.client.0.smithi148.stdout:0/70: unlink d0/la 0 2024-04-26T23:08:53.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/74: mkdir d3/d9/d12/d15 0 2024-04-26T23:08:53.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/75: truncate d3/f5 4715734 0 2024-04-26T23:08:53.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/76: truncate d3/f6 4230470 0 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/45: creat d9/ff x:0 0 0 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/46: fsync f5 0 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/47: chown f5 435161 1 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/48: chown d9/ff 47 1 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/49: truncate d9/ff 179696 0 2024-04-26T23:08:53.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/50: chown d9/cd 136 1 2024-04-26T23:08:53.953 INFO:tasks.workunit.client.0.smithi148.stdout:4/91: truncate f9 3064206 0 2024-04-26T23:08:53.954 INFO:tasks.workunit.client.0.smithi148.stdout:7/87: creat d7/f22 x:0 0 0 2024-04-26T23:08:53.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/71: creat d0/d5/f1a x:0 0 0 2024-04-26T23:08:53.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/72: write d0/d5/f1a [900801,300] 0 2024-04-26T23:08:53.958 INFO:tasks.workunit.client.0.smithi148.stdout:6/113: dwrite d6/d9/f15 [0,4194304] 0 2024-04-26T23:08:53.962 INFO:tasks.workunit.client.0.smithi148.stdout:7/88: creat d7/d19/f23 x:0 0 0 2024-04-26T23:08:53.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/89: stat d7/d19/f20 0 2024-04-26T23:08:53.963 INFO:tasks.workunit.client.0.smithi148.stdout:9/50: dwrite f7 [0,4194304] 0 2024-04-26T23:08:53.965 INFO:tasks.workunit.client.0.smithi148.stdout:5/100: read da/f10 [166861,46517] 0 2024-04-26T23:08:53.966 INFO:tasks.workunit.client.0.smithi148.stdout:6/114: link d6/d9/c13 d6/d9/d1c/c22 0 2024-04-26T23:08:53.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/90: truncate d7/f12 3812389 0 2024-04-26T23:08:53.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/91: chown l4 14 1 2024-04-26T23:08:53.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/161: read d5/d8/f35 [3171585,115524] 0 2024-04-26T23:08:53.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/162: chown d5/d17 488365538 1 2024-04-26T23:08:53.970 INFO:tasks.workunit.client.0.smithi148.stdout:9/51: rename l5 to l10 0 2024-04-26T23:08:53.970 INFO:tasks.workunit.client.0.smithi148.stdout:9/52: read ff [318749,69282] 0 2024-04-26T23:08:53.972 INFO:tasks.workunit.client.0.smithi148.stdout:6/115: mkdir d6/d9/d23 0 2024-04-26T23:08:53.976 INFO:tasks.workunit.client.0.smithi148.stdout:7/92: getdents d7 0 2024-04-26T23:08:53.977 INFO:tasks.workunit.client.0.smithi148.stdout:3/51: dread f0 [0,4194304] 0 2024-04-26T23:08:53.978 INFO:tasks.workunit.client.0.smithi148.stdout:9/53: mknod c11 0 2024-04-26T23:08:53.979 INFO:tasks.workunit.client.0.smithi148.stdout:6/116: mknod d6/d9/d1e/c24 0 2024-04-26T23:08:53.981 INFO:tasks.workunit.client.0.smithi148.stdout:4/92: unlink f9 0 2024-04-26T23:08:53.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/73: write d0/d5/f7 [3294622,72038] 0 2024-04-26T23:08:53.985 INFO:tasks.workunit.client.0.smithi148.stdout:8/77: dwrite d3/da/fc [4194304,4194304] 0 2024-04-26T23:08:53.985 INFO:tasks.workunit.client.0.smithi148.stdout:8/78: chown d3/d9/cf 1 1 2024-04-26T23:08:53.986 INFO:tasks.workunit.client.0.smithi148.stdout:7/93: mknod d7/d11/d17/c24 0 2024-04-26T23:08:53.986 INFO:tasks.workunit.client.0.smithi148.stdout:9/54: dread ff [0,4194304] 0 2024-04-26T23:08:53.993 INFO:tasks.workunit.client.0.smithi148.stdout:5/101: dread f5 [0,4194304] 0 2024-04-26T23:08:53.997 INFO:tasks.workunit.client.0.smithi148.stdout:4/93: dread f10 [0,4194304] 0 2024-04-26T23:08:53.997 INFO:tasks.workunit.client.0.smithi148.stdout:3/52: creat d9/f10 x:0 0 0 2024-04-26T23:08:53.998 INFO:tasks.workunit.client.0.smithi148.stdout:2/163: dread d5/d7/f18 [0,4194304] 0 2024-04-26T23:08:53.999 INFO:tasks.workunit.client.0.smithi148.stdout:7/94: mknod d7/d11/d13/c25 0 2024-04-26T23:08:53.999 INFO:tasks.workunit.client.0.smithi148.stdout:7/95: stat d7/d11/d13/f21 0 2024-04-26T23:08:53.999 INFO:tasks.workunit.client.0.smithi148.stdout:7/96: dread - d7/fd zero size 2024-04-26T23:08:54.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/55: rename l6 to l12 0 2024-04-26T23:08:54.002 INFO:tasks.workunit.client.0.smithi148.stdout:6/117: write d6/d9/f15 [1694168,5741] 0 2024-04-26T23:08:54.003 INFO:tasks.workunit.client.0.smithi148.stdout:2/164: creat d5/d2c/f3a x:0 0 0 2024-04-26T23:08:54.006 INFO:tasks.workunit.client.0.smithi148.stdout:7/97: link d7/fc d7/d19/d1e/f26 0 2024-04-26T23:08:54.006 INFO:tasks.workunit.client.0.smithi148.stdout:7/98: chown d7 322 1 2024-04-26T23:08:54.006 INFO:tasks.workunit.client.0.smithi148.stdout:9/56: creat f13 x:0 0 0 2024-04-26T23:08:54.006 INFO:tasks.workunit.client.0.smithi148.stdout:9/57: rmdir - no directory 2024-04-26T23:08:54.007 INFO:tasks.workunit.client.0.smithi148.stdout:5/102: mkdir da/d25 0 2024-04-26T23:08:54.007 INFO:tasks.workunit.client.0.smithi148.stdout:5/103: read da/f14 [1731024,60838] 0 2024-04-26T23:08:54.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/118: mknod d6/d9/d1e/c25 0 2024-04-26T23:08:54.008 INFO:tasks.workunit.client.0.smithi148.stdout:3/53: rename d9/f10 to d9/f11 0 2024-04-26T23:08:54.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/74: dread d0/f15 [0,4194304] 0 2024-04-26T23:08:54.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/75: truncate d0/d5/fe 640805 0 2024-04-26T23:08:54.021 INFO:tasks.workunit.client.0.smithi148.stdout:2/165: creat d5/d10/f3b x:0 0 0 2024-04-26T23:08:54.021 INFO:tasks.workunit.client.0.smithi148.stdout:9/58: unlink l12 0 2024-04-26T23:08:54.023 INFO:tasks.workunit.client.0.smithi148.stdout:5/104: truncate f1 6964085 0 2024-04-26T23:08:54.024 INFO:tasks.workunit.client.0.smithi148.stdout:6/119: creat d6/d9/d1c/f26 x:0 0 0 2024-04-26T23:08:54.025 INFO:tasks.workunit.client.0.smithi148.stdout:3/54: link d9/ce d9/c12 0 2024-04-26T23:08:54.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/76: write d0/d8/f14 [275913,47454] 0 2024-04-26T23:08:54.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/77: stat d0/f15 0 2024-04-26T23:08:54.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/78: chown d0/f2 273 1 2024-04-26T23:08:54.028 INFO:tasks.workunit.client.0.smithi148.stdout:9/59: symlink l14 0 2024-04-26T23:08:54.028 INFO:tasks.workunit.client.0.smithi148.stdout:9/60: fdatasync f9 0 2024-04-26T23:08:54.029 INFO:tasks.workunit.client.0.smithi148.stdout:8/79: dwrite d3/f6 [0,4194304] 0 2024-04-26T23:08:54.030 INFO:tasks.workunit.client.0.smithi148.stdout:2/166: rename d5/d7/l13 to d5/d2c/d32/l3c 0 2024-04-26T23:08:54.030 INFO:tasks.workunit.client.0.smithi148.stdout:5/105: creat da/d1f/f26 x:0 0 0 2024-04-26T23:08:54.031 INFO:tasks.workunit.client.0.smithi148.stdout:6/120: creat d6/d9/d1e/f27 x:0 0 0 2024-04-26T23:08:54.033 INFO:tasks.workunit.client.0.smithi148.stdout:3/55: unlink f0 0 2024-04-26T23:08:54.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/61: unlink l10 0 2024-04-26T23:08:54.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/62: chown c8 455 1 2024-04-26T23:08:54.047 INFO:tasks.workunit.client.0.smithi148.stdout:8/80: symlink d3/d9/l16 0 2024-04-26T23:08:54.048 INFO:tasks.workunit.client.0.smithi148.stdout:0/79: rename d0/d5/fe to d0/f1b 0 2024-04-26T23:08:54.049 INFO:tasks.workunit.client.0.smithi148.stdout:2/167: mkdir d5/d8/d9/d3d 0 2024-04-26T23:08:54.057 INFO:tasks.workunit.client.0.smithi148.stdout:7/99: dwrite d7/f12 [0,4194304] 0 2024-04-26T23:08:54.057 INFO:tasks.workunit.client.0.smithi148.stdout:7/100: write d7/fe [2380265,19547] 0 2024-04-26T23:08:54.057 INFO:tasks.workunit.client.0.smithi148.stdout:7/101: rename d7/d11/d17 to d7/d11/d17/d27 22 2024-04-26T23:08:54.057 INFO:tasks.workunit.client.0.smithi148.stdout:9/63: rename c8 to c15 0 2024-04-26T23:08:54.057 INFO:tasks.workunit.client.0.smithi148.stdout:9/64: chown f2 748086168 1 2024-04-26T23:08:54.064 INFO:tasks.workunit.client.0.smithi148.stdout:8/81: dread d3/da/fc [4194304,4194304] 0 2024-04-26T23:08:54.085 INFO:tasks.workunit.client.0.smithi148.stdout:2/168: dread d5/d7/f20 [0,4194304] 0 2024-04-26T23:08:54.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/169: write d5/d17/f30 [627427,53682] 0 2024-04-26T23:08:54.086 INFO:tasks.workunit.client.0.smithi148.stdout:3/56: dwrite d9/f11 [0,4194304] 0 2024-04-26T23:08:54.088 INFO:tasks.workunit.client.0.smithi148.stdout:9/65: creat f16 x:0 0 0 2024-04-26T23:08:54.088 INFO:tasks.workunit.client.0.smithi148.stdout:9/66: stat l14 0 2024-04-26T23:08:54.088 INFO:tasks.workunit.client.0.smithi148.stdout:9/67: write fe [916316,21878] 0 2024-04-26T23:08:54.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/170: link d5/d8/d9/fc d5/d8/f3e 0 2024-04-26T23:08:54.096 INFO:tasks.workunit.client.0.smithi148.stdout:7/102: dwrite d7/fc [0,4194304] 0 2024-04-26T23:08:54.105 INFO:tasks.workunit.client.0.smithi148.stdout:6/121: dwrite d6/d9/d1c/f26 [0,4194304] 0 2024-04-26T23:08:54.106 INFO:tasks.workunit.client.0.smithi148.stdout:2/171: dread d5/d10/f14 [0,4194304] 0 2024-04-26T23:08:54.107 INFO:tasks.workunit.client.0.smithi148.stdout:2/172: chown d5/d7/f18 52 1 2024-04-26T23:08:54.108 INFO:tasks.workunit.client.0.smithi148.stdout:3/57: link d9/cc d9/c13 0 2024-04-26T23:08:54.108 INFO:tasks.workunit.client.0.smithi148.stdout:3/58: chown d9/ff 165 1 2024-04-26T23:08:54.109 INFO:tasks.workunit.client.0.smithi148.stdout:9/68: creat f17 x:0 0 0 2024-04-26T23:08:54.110 INFO:tasks.workunit.client.0.smithi148.stdout:7/103: creat d7/d11/d13/f28 x:0 0 0 2024-04-26T23:08:54.110 INFO:tasks.workunit.client.0.smithi148.stdout:7/104: readlink d7/l1b 0 2024-04-26T23:08:54.111 INFO:tasks.workunit.client.0.smithi148.stdout:2/173: dread d5/d8/d9/f23 [0,4194304] 0 2024-04-26T23:08:54.111 INFO:tasks.workunit.client.0.smithi148.stdout:2/174: truncate d5/d17/f39 994769 0 2024-04-26T23:08:54.111 INFO:tasks.workunit.client.0.smithi148.stdout:2/175: fdatasync d5/d2c/f3a 0 2024-04-26T23:08:54.113 INFO:tasks.workunit.client.0.smithi148.stdout:8/82: dwrite d3/f5 [0,4194304] 0 2024-04-26T23:08:54.113 INFO:tasks.workunit.client.0.smithi148.stdout:6/122: mknod d6/d14/c28 0 2024-04-26T23:08:54.113 INFO:tasks.workunit.client.0.smithi148.stdout:6/123: stat d6/d9/d1e/c24 0 2024-04-26T23:08:54.114 INFO:tasks.workunit.client.0.smithi148.stdout:7/105: mkdir d7/d11/d29 0 2024-04-26T23:08:54.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/176: dread d5/d8/f35 [0,4194304] 0 2024-04-26T23:08:54.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/177: write d5/d7/fb [277908,107306] 0 2024-04-26T23:08:54.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/178: chown d5/c36 6 1 2024-04-26T23:08:54.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/179: dread - d5/d7/f24 zero size 2024-04-26T23:08:54.142 INFO:tasks.workunit.client.0.smithi148.stdout:3/59: dwrite d9/ff [0,4194304] 0 2024-04-26T23:08:54.157 INFO:tasks.workunit.client.0.smithi148.stdout:8/83: dwrite d3/f6 [4194304,4194304] 0 2024-04-26T23:08:54.157 INFO:tasks.workunit.client.0.smithi148.stdout:6/124: rename d6/d14/c28 to d6/d9/d23/c29 0 2024-04-26T23:08:54.157 INFO:tasks.workunit.client.0.smithi148.stdout:2/180: mknod d5/d1c/d38/c3f 0 2024-04-26T23:08:54.158 INFO:tasks.workunit.client.0.smithi148.stdout:6/125: write d6/d9/f15 [1221371,82354] 0 2024-04-26T23:08:54.158 INFO:tasks.workunit.client.0.smithi148.stdout:6/126: truncate d6/fe 4734534 0 2024-04-26T23:08:54.159 INFO:tasks.workunit.client.0.smithi148.stdout:3/60: mknod d9/c14 0 2024-04-26T23:08:54.159 INFO:tasks.workunit.client.0.smithi148.stdout:3/61: fsync f5 0 2024-04-26T23:08:54.161 INFO:tasks.workunit.client.0.smithi148.stdout:8/84: creat d3/d9/d12/d15/f17 x:0 0 0 2024-04-26T23:08:54.162 INFO:tasks.workunit.client.0.smithi148.stdout:2/181: rename d5/d8/l22 to d5/d2c/l40 0 2024-04-26T23:08:54.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/85: creat d3/da/f18 x:0 0 0 2024-04-26T23:08:54.164 INFO:tasks.workunit.client.0.smithi148.stdout:2/182: mknod d5/d17/c41 0 2024-04-26T23:08:54.169 INFO:tasks.workunit.client.0.smithi148.stdout:6/127: truncate d6/fe 2206258 0 2024-04-26T23:08:54.169 INFO:tasks.workunit.client.0.smithi148.stdout:2/183: write d5/d8/d9/f23 [38850,114980] 0 2024-04-26T23:08:54.172 INFO:tasks.workunit.client.0.smithi148.stdout:7/106: dwrite d7/d11/d13/f1f [0,4194304] 0 2024-04-26T23:08:54.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/107: fsync d7/f9 0 2024-04-26T23:08:54.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/108: stat d7/d11/f16 0 2024-04-26T23:08:54.173 INFO:tasks.workunit.client.0.smithi148.stdout:8/86: symlink d3/da/l19 0 2024-04-26T23:08:54.173 INFO:tasks.workunit.client.0.smithi148.stdout:8/87: chown d3 115498173 1 2024-04-26T23:08:54.177 INFO:tasks.workunit.client.0.smithi148.stdout:3/62: dread d9/ff [0,4194304] 0 2024-04-26T23:08:54.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/109: creat d7/d11/d29/f2a x:0 0 0 2024-04-26T23:08:54.177 INFO:tasks.workunit.client.0.smithi148.stdout:8/88: symlink d3/d9/l1a 0 2024-04-26T23:08:54.193 INFO:tasks.workunit.client.0.smithi148.stdout:6/128: read d6/d9/d1c/f26 [787986,38655] 0 2024-04-26T23:08:54.193 INFO:tasks.workunit.client.0.smithi148.stdout:1/95: sync 2024-04-26T23:08:54.193 INFO:tasks.workunit.client.0.smithi148.stdout:6/129: write d6/d9/f15 [5086000,126666] 0 2024-04-26T23:08:54.194 INFO:tasks.workunit.client.0.smithi148.stdout:7/110: rename d7/d11/d17/c24 to d7/d11/d13/c2b 0 2024-04-26T23:08:54.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/63: dread d9/ff [0,4194304] 0 2024-04-26T23:08:54.196 INFO:tasks.workunit.client.0.smithi148.stdout:1/96: rmdir d16 39 2024-04-26T23:08:54.198 INFO:tasks.workunit.client.0.smithi148.stdout:6/130: mknod d6/d9/d23/c2a 0 2024-04-26T23:08:54.198 INFO:tasks.workunit.client.0.smithi148.stdout:3/64: mkdir d9/d15 0 2024-04-26T23:08:54.200 INFO:tasks.workunit.client.0.smithi148.stdout:6/131: symlink d6/d9/d1e/l2b 0 2024-04-26T23:08:54.201 INFO:tasks.workunit.client.0.smithi148.stdout:9/69: dwrite fe [0,4194304] 0 2024-04-26T23:08:54.205 INFO:tasks.workunit.client.0.smithi148.stdout:8/89: write d3/f5 [2650585,129936] 0 2024-04-26T23:08:54.205 INFO:tasks.workunit.client.0.smithi148.stdout:8/90: write d3/d9/d12/d15/f17 [121992,130001] 0 2024-04-26T23:08:54.205 INFO:tasks.workunit.client.0.smithi148.stdout:8/91: stat d3/da/f18 0 2024-04-26T23:08:54.206 INFO:tasks.workunit.client.0.smithi148.stdout:3/65: mknod d9/d15/c16 0 2024-04-26T23:08:54.207 INFO:tasks.workunit.client.0.smithi148.stdout:3/66: chown c7 16 1 2024-04-26T23:08:54.220 INFO:tasks.workunit.client.0.smithi148.stdout:1/97: dread fa [0,4194304] 0 2024-04-26T23:08:54.245 INFO:tasks.workunit.client.0.smithi148.stdout:3/67: symlink d9/l17 0 2024-04-26T23:08:54.245 INFO:tasks.workunit.client.0.smithi148.stdout:3/68: fdatasync d9/f11 0 2024-04-26T23:08:54.245 INFO:tasks.workunit.client.0.smithi148.stdout:3/69: stat f5 0 2024-04-26T23:08:54.249 INFO:tasks.workunit.client.0.smithi148.stdout:7/111: dwrite d7/d11/d13/f1f [0,4194304] 0 2024-04-26T23:08:54.252 INFO:tasks.workunit.client.0.smithi148.stdout:1/98: creat d16/d17/f1b x:0 0 0 2024-04-26T23:08:54.252 INFO:tasks.workunit.client.0.smithi148.stdout:8/92: dwrite d3/da/f18 [0,4194304] 0 2024-04-26T23:08:54.257 INFO:tasks.workunit.client.0.smithi148.stdout:7/112: mknod d7/d11/c2c 0 2024-04-26T23:08:54.290 INFO:tasks.workunit.client.0.smithi148.stdout:7/113: link d7/f9 d7/d19/f2d 0 2024-04-26T23:08:54.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/70: dwrite d9/f11 [0,4194304] 0 2024-04-26T23:08:54.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/71: readlink d9/l17 0 2024-04-26T23:08:54.311 INFO:tasks.workunit.client.0.smithi148.stdout:8/93: dwrite d3/da/fc [8388608,4194304] 0 2024-04-26T23:08:54.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/132: fsync d6/d9/f15 0 2024-04-26T23:08:54.342 INFO:tasks.workunit.client.0.smithi148.stdout:2/184: dwrite d5/d10/f19 [4194304,4194304] 0 2024-04-26T23:08:54.343 INFO:tasks.workunit.client.0.smithi148.stdout:8/94: truncate d3/f6 2012822 0 2024-04-26T23:08:54.351 INFO:tasks.workunit.client.0.smithi148.stdout:6/133: rename d6/d9/d1e/c24 to d6/c2c 0 2024-04-26T23:08:54.355 INFO:tasks.workunit.client.0.smithi148.stdout:9/70: dwrite f7 [0,4194304] 0 2024-04-26T23:08:54.356 INFO:tasks.workunit.client.0.smithi148.stdout:8/95: rmdir d3 39 2024-04-26T23:08:54.358 INFO:tasks.workunit.client.0.smithi148.stdout:9/71: creat f18 x:0 0 0 2024-04-26T23:08:54.358 INFO:tasks.workunit.client.0.smithi148.stdout:9/72: rmdir - no directory 2024-04-26T23:08:54.371 INFO:tasks.workunit.client.0.smithi148.stdout:6/134: write d6/f19 [226925,65857] 0 2024-04-26T23:08:54.387 INFO:tasks.workunit.client.0.smithi148.stdout:9/73: dwrite f9 [0,4194304] 0 2024-04-26T23:08:54.388 INFO:tasks.workunit.client.0.smithi148.stdout:8/96: mknod d3/c1b 0 2024-04-26T23:08:54.389 INFO:tasks.workunit.client.0.smithi148.stdout:6/135: mknod d6/d9/d23/c2d 0 2024-04-26T23:08:54.389 INFO:tasks.workunit.client.0.smithi148.stdout:6/136: write d6/d9/fa [1327996,128] 0 2024-04-26T23:08:54.390 INFO:tasks.workunit.client.0.smithi148.stdout:8/97: mkdir d3/da/d1c 0 2024-04-26T23:08:54.390 INFO:tasks.workunit.client.0.smithi148.stdout:8/98: write d3/f5 [1173563,66276] 0 2024-04-26T23:08:54.393 INFO:tasks.workunit.client.0.smithi148.stdout:6/137: unlink d6/d9/d1c/f26 0 2024-04-26T23:08:54.394 INFO:tasks.workunit.client.0.smithi148.stdout:0/80: sync 2024-04-26T23:08:54.409 INFO:tasks.workunit.client.0.smithi148.stdout:4/94: sync 2024-04-26T23:08:54.409 INFO:tasks.workunit.client.0.smithi148.stdout:5/106: sync 2024-04-26T23:08:54.409 INFO:tasks.workunit.client.0.smithi148.stdout:9/74: truncate f7 2097417 0 2024-04-26T23:08:54.409 INFO:tasks.workunit.client.0.smithi148.stdout:4/95: readlink l6 0 2024-04-26T23:08:54.409 INFO:tasks.workunit.client.0.smithi148.stdout:7/114: dwrite d7/d19/f20 [0,4194304] 0 2024-04-26T23:08:54.411 INFO:tasks.workunit.client.0.smithi148.stdout:8/99: link d3/d9/d12/l11 d3/d9/l1d 0 2024-04-26T23:08:54.413 INFO:tasks.workunit.client.0.smithi148.stdout:6/138: creat d6/d9/d1c/f2e x:0 0 0 2024-04-26T23:08:54.414 INFO:tasks.workunit.client.0.smithi148.stdout:9/75: mkdir d19 0 2024-04-26T23:08:54.414 INFO:tasks.workunit.client.0.smithi148.stdout:9/76: chown fe 50 1 2024-04-26T23:08:54.414 INFO:tasks.workunit.client.0.smithi148.stdout:9/77: chown c15 0 1 2024-04-26T23:08:54.415 INFO:tasks.workunit.client.0.smithi148.stdout:9/78: read - f13 zero size 2024-04-26T23:08:54.417 INFO:tasks.workunit.client.0.smithi148.stdout:5/107: rename f1 to da/d1b/d1c/f27 0 2024-04-26T23:08:54.417 INFO:tasks.workunit.client.0.smithi148.stdout:5/108: write da/f19 [296760,71497] 0 2024-04-26T23:08:54.420 INFO:tasks.workunit.client.0.smithi148.stdout:4/96: unlink d12/l13 0 2024-04-26T23:08:54.422 INFO:tasks.workunit.client.0.smithi148.stdout:6/139: mkdir d6/dc/d2f 0 2024-04-26T23:08:54.422 INFO:tasks.workunit.client.0.smithi148.stdout:6/140: fsync d6/fe 0 2024-04-26T23:08:54.422 INFO:tasks.workunit.client.0.smithi148.stdout:6/141: dread - d6/d9/d1c/f2e zero size 2024-04-26T23:08:54.423 INFO:tasks.workunit.client.0.smithi148.stdout:8/100: dread d3/da/fc [4194304,4194304] 0 2024-04-26T23:08:54.429 INFO:tasks.workunit.client.0.smithi148.stdout:7/115: rename d7/d19/d1e to d7/d11/d29/d2e 0 2024-04-26T23:08:54.429 INFO:tasks.workunit.client.0.smithi148.stdout:4/97: mknod d12/c1b 0 2024-04-26T23:08:54.432 INFO:tasks.workunit.client.0.smithi148.stdout:6/142: mknod d6/d9/d23/c30 0 2024-04-26T23:08:54.432 INFO:tasks.workunit.client.0.smithi148.stdout:6/143: write d6/d9/d1e/f27 [990967,77477] 0 2024-04-26T23:08:54.434 INFO:tasks.workunit.client.0.smithi148.stdout:9/79: rename f17 to d19/f1a 0 2024-04-26T23:08:54.436 INFO:tasks.workunit.client.0.smithi148.stdout:7/116: mkdir d7/d11/d17/d2f 0 2024-04-26T23:08:54.436 INFO:tasks.workunit.client.0.smithi148.stdout:0/81: dwrite d0/f15 [0,4194304] 0 2024-04-26T23:08:54.437 INFO:tasks.workunit.client.0.smithi148.stdout:4/98: mkdir d12/d1c 0 2024-04-26T23:08:54.440 INFO:tasks.workunit.client.0.smithi148.stdout:5/109: rename da/d12/f15 to da/d1a/f28 0 2024-04-26T23:08:54.440 INFO:tasks.workunit.client.0.smithi148.stdout:5/110: truncate da/f10 760313 0 2024-04-26T23:08:54.442 INFO:tasks.workunit.client.0.smithi148.stdout:6/144: dread d6/d9/d1e/f27 [0,4194304] 0 2024-04-26T23:08:54.442 INFO:tasks.workunit.client.0.smithi148.stdout:6/145: getdents d6/d9/d1c/d1d/d1f 0 2024-04-26T23:08:54.443 INFO:tasks.workunit.client.0.smithi148.stdout:7/117: link d7/d11/d29/f2a d7/d19/f30 0 2024-04-26T23:08:54.444 INFO:tasks.workunit.client.0.smithi148.stdout:0/82: creat d0/d5/f1c x:0 0 0 2024-04-26T23:08:54.444 INFO:tasks.workunit.client.0.smithi148.stdout:0/83: fsync d0/f2 0 2024-04-26T23:08:54.446 INFO:tasks.workunit.client.0.smithi148.stdout:8/101: rename d3/d9/d12/c14 to d3/c1e 0 2024-04-26T23:08:54.446 INFO:tasks.workunit.client.0.smithi148.stdout:8/102: stat d3/d9/d12/d15 0 2024-04-26T23:08:54.449 INFO:tasks.workunit.client.0.smithi148.stdout:7/118: truncate d7/f9 2362236 0 2024-04-26T23:08:54.449 INFO:tasks.workunit.client.0.smithi148.stdout:6/146: read d6/d9/d1e/f27 [354104,73731] 0 2024-04-26T23:08:54.454 INFO:tasks.workunit.client.0.smithi148.stdout:5/111: truncate da/fb 3777549 0 2024-04-26T23:08:54.454 INFO:tasks.workunit.client.0.smithi148.stdout:8/103: symlink d3/d9/d12/l1f 0 2024-04-26T23:08:54.455 INFO:tasks.workunit.client.0.smithi148.stdout:4/99: dread d12/d17/f18 [0,4194304] 0 2024-04-26T23:08:54.457 INFO:tasks.workunit.client.0.smithi148.stdout:7/119: rename d7/d11/d13/f28 to d7/d11/f31 0 2024-04-26T23:08:54.458 INFO:tasks.workunit.client.0.smithi148.stdout:0/84: dread d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:08:54.459 INFO:tasks.workunit.client.0.smithi148.stdout:5/112: link da/d1b/d1c/f27 da/d25/f29 0 2024-04-26T23:08:54.464 INFO:tasks.workunit.client.0.smithi148.stdout:5/113: link c8 da/d1f/c2a 0 2024-04-26T23:08:54.472 INFO:tasks.workunit.client.0.smithi148.stdout:4/100: dread f10 [0,4194304] 0 2024-04-26T23:08:54.475 INFO:tasks.workunit.client.0.smithi148.stdout:8/104: read d3/da/fc [2372140,75710] 0 2024-04-26T23:08:54.475 INFO:tasks.workunit.client.0.smithi148.stdout:7/120: getdents d7/d11/d17 0 2024-04-26T23:08:54.480 INFO:tasks.workunit.client.0.smithi148.stdout:9/80: dwrite f9 [4194304,4194304] 0 2024-04-26T23:08:54.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/85: mknod d0/d8/d17/c1d 0 2024-04-26T23:08:54.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/86: truncate d0/d8/f14 391426 0 2024-04-26T23:08:54.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/114: dwrite da/f1d [4194304,4194304] 0 2024-04-26T23:08:54.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/115: chown da/d1f/l24 2887 1 2024-04-26T23:08:54.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/101: dread d12/d17/f18 [0,4194304] 0 2024-04-26T23:08:54.513 INFO:tasks.workunit.client.0.smithi148.stdout:8/105: creat d3/d9/d12/d15/f20 x:0 0 0 2024-04-26T23:08:54.513 INFO:tasks.workunit.client.0.smithi148.stdout:9/81: rename c4 to d19/c1b 0 2024-04-26T23:08:54.517 INFO:tasks.workunit.client.0.smithi148.stdout:4/102: mknod d12/c1d 0 2024-04-26T23:08:54.517 INFO:tasks.workunit.client.0.smithi148.stdout:5/116: rename da/f11 to da/d1b/d1c/f2b 0 2024-04-26T23:08:54.517 INFO:tasks.workunit.client.0.smithi148.stdout:9/82: rmdir d19 39 2024-04-26T23:08:54.517 INFO:tasks.workunit.client.0.smithi148.stdout:9/83: stat f9 0 2024-04-26T23:08:54.521 INFO:tasks.workunit.client.0.smithi148.stdout:0/87: mkdir d0/d8/d1e 0 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:8/106: creat d3/d9/d12/f21 x:0 0 0 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/88: write d0/f12 [5032652,125245] 0 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/89: chown d0/d5/ld 152175918 1 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/90: truncate d0/d5/f7 7313810 0 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/91: fsync d0/f2 0 2024-04-26T23:08:54.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/92: truncate d0/f1b 1311136 0 2024-04-26T23:08:54.523 INFO:tasks.workunit.client.0.smithi148.stdout:4/103: link d12/c1b d12/d1c/c1e 0 2024-04-26T23:08:54.523 INFO:tasks.workunit.client.0.smithi148.stdout:4/104: getdents d12/d17 0 2024-04-26T23:08:54.523 INFO:tasks.workunit.client.0.smithi148.stdout:8/107: mknod d3/da/c22 0 2024-04-26T23:08:54.549 INFO:tasks.workunit.client.0.smithi148.stdout:8/108: dread d3/da/f18 [0,4194304] 0 2024-04-26T23:08:54.557 INFO:tasks.workunit.client.0.smithi148.stdout:5/117: dread f3 [4194304,4194304] 0 2024-04-26T23:08:54.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/84: dwrite d19/f1a [0,4194304] 0 2024-04-26T23:08:54.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/85: fdatasync f3 0 2024-04-26T23:08:54.573 INFO:tasks.workunit.client.0.smithi148.stdout:9/86: fdatasync f3 0 2024-04-26T23:08:54.573 INFO:tasks.workunit.client.0.smithi148.stdout:9/87: write fc [611574,68942] 0 2024-04-26T23:08:54.573 INFO:tasks.workunit.client.0.smithi148.stdout:7/121: dwrite d7/d11/d29/f2a [0,4194304] 0 2024-04-26T23:08:54.574 INFO:tasks.workunit.client.0.smithi148.stdout:7/122: read - d7/fd zero size 2024-04-26T23:08:54.574 INFO:tasks.workunit.client.0.smithi148.stdout:7/123: chown d7/fb 147875 1 2024-04-26T23:08:54.574 INFO:tasks.workunit.client.0.smithi148.stdout:8/109: mkdir d3/d9/d12/d23 0 2024-04-26T23:08:54.574 INFO:tasks.workunit.client.0.smithi148.stdout:0/93: write d0/f2 [3084079,124282] 0 2024-04-26T23:08:54.574 INFO:tasks.workunit.client.0.smithi148.stdout:0/94: truncate d0/f12 5605981 0 2024-04-26T23:08:54.576 INFO:tasks.workunit.client.0.smithi148.stdout:9/88: rename fc to d19/f1c 0 2024-04-26T23:08:54.581 INFO:tasks.workunit.client.0.smithi148.stdout:7/124: creat d7/d11/d29/d2e/f32 x:0 0 0 2024-04-26T23:08:54.583 INFO:tasks.workunit.client.0.smithi148.stdout:9/89: mkdir d19/d1d 0 2024-04-26T23:08:54.583 INFO:tasks.workunit.client.0.smithi148.stdout:9/90: stat f16 0 2024-04-26T23:08:54.584 INFO:tasks.workunit.client.0.smithi148.stdout:7/125: creat d7/d11/d13/f33 x:0 0 0 2024-04-26T23:08:54.588 INFO:tasks.workunit.client.0.smithi148.stdout:9/91: rename f16 to d19/f1e 0 2024-04-26T23:08:54.588 INFO:tasks.workunit.client.0.smithi148.stdout:9/92: chown c11 241667 1 2024-04-26T23:08:54.598 INFO:tasks.workunit.client.0.smithi148.stdout:8/110: truncate d3/f5 4366119 0 2024-04-26T23:08:54.599 INFO:tasks.workunit.client.0.smithi148.stdout:7/126: write d7/d19/f30 [4838785,43493] 0 2024-04-26T23:08:54.605 INFO:tasks.workunit.client.0.smithi148.stdout:8/111: dread d3/d9/d12/d15/f17 [0,4194304] 0 2024-04-26T23:08:54.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/93: creat d19/d1d/f1f x:0 0 0 2024-04-26T23:08:54.613 INFO:tasks.workunit.client.0.smithi148.stdout:0/95: write d0/f15 [3165812,32717] 0 2024-04-26T23:08:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:7/127: read d7/d11/f16 [242608,38712] 0 2024-04-26T23:08:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:7/128: dread - d7/d11/d29/d2e/f32 zero size 2024-04-26T23:08:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:6/147: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T23:08:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:7/129: write d7/d11/d13/f21 [417614,20973] 0 2024-04-26T23:08:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:4/105: dwrite f8 [0,4194304] 0 2024-04-26T23:08:54.632 INFO:tasks.workunit.client.0.smithi148.stdout:9/94: creat d19/f20 x:0 0 0 2024-04-26T23:08:54.632 INFO:tasks.workunit.client.0.smithi148.stdout:7/130: rename d7/fd to d7/d11/f34 0 2024-04-26T23:08:54.633 INFO:tasks.workunit.client.0.smithi148.stdout:6/148: mknod d6/d9/d1e/c31 0 2024-04-26T23:08:54.633 INFO:tasks.workunit.client.0.smithi148.stdout:6/149: chown d6/d9/d23/c30 1082699795 1 2024-04-26T23:08:54.633 INFO:tasks.workunit.client.0.smithi148.stdout:6/150: write d6/d9/d1c/f2e [62790,57340] 0 2024-04-26T23:08:54.633 INFO:tasks.workunit.client.0.smithi148.stdout:6/151: chown d6/f19 0 1 2024-04-26T23:08:54.634 INFO:tasks.workunit.client.0.smithi148.stdout:9/95: rmdir d19/d1d 39 2024-04-26T23:08:54.634 INFO:tasks.workunit.client.0.smithi148.stdout:9/96: write f18 [1033185,50948] 0 2024-04-26T23:08:54.636 INFO:tasks.workunit.client.0.smithi148.stdout:7/131: creat d7/d19/f35 x:0 0 0 2024-04-26T23:08:54.636 INFO:tasks.workunit.client.0.smithi148.stdout:7/132: write d7/d11/f16 [4259607,68890] 0 2024-04-26T23:08:54.637 INFO:tasks.workunit.client.0.smithi148.stdout:6/152: mkdir d6/d32 0 2024-04-26T23:08:54.638 INFO:tasks.workunit.client.0.smithi148.stdout:9/97: creat d19/d1d/f21 x:0 0 0 2024-04-26T23:08:54.638 INFO:tasks.workunit.client.0.smithi148.stdout:9/98: fdatasync d19/d1d/f21 0 2024-04-26T23:08:54.638 INFO:tasks.workunit.client.0.smithi148.stdout:9/99: truncate ff 982949 0 2024-04-26T23:08:54.644 INFO:tasks.workunit.client.0.smithi148.stdout:1/99: sync 2024-04-26T23:08:54.644 INFO:tasks.workunit.client.0.smithi148.stdout:3/72: sync 2024-04-26T23:08:54.646 INFO:tasks.workunit.client.0.smithi148.stdout:7/133: fsync d7/d19/f30 0 2024-04-26T23:08:54.646 INFO:tasks.workunit.client.0.smithi148.stdout:9/100: mkdir d19/d22 0 2024-04-26T23:08:54.649 INFO:tasks.workunit.client.0.smithi148.stdout:1/100: mkdir d16/d1c 0 2024-04-26T23:08:54.649 INFO:tasks.workunit.client.0.smithi148.stdout:3/73: rmdir d9 39 2024-04-26T23:08:54.649 INFO:tasks.workunit.client.0.smithi148.stdout:3/74: fsync f5 0 2024-04-26T23:08:54.654 INFO:tasks.workunit.client.0.smithi148.stdout:7/134: rename c3 to d7/d11/d29/c36 0 2024-04-26T23:08:54.654 INFO:tasks.workunit.client.0.smithi148.stdout:7/135: chown d7/fc 1246653958 1 2024-04-26T23:08:54.654 INFO:tasks.workunit.client.0.smithi148.stdout:4/106: dread fb [0,4194304] 0 2024-04-26T23:08:54.655 INFO:tasks.workunit.client.0.smithi148.stdout:8/112: dwrite d3/f5 [0,4194304] 0 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:9/101: truncate f9 3257606 0 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:9/102: fdatasync d19/d1d/f1f 0 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:8/113: chown d3/d9/d12/d15/f20 48155 1 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:8/114: stat d3 0 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:8/115: truncate d3/da/f18 4567805 0 2024-04-26T23:08:54.656 INFO:tasks.workunit.client.0.smithi148.stdout:8/116: chown d3/d9/cf 4 1 2024-04-26T23:08:54.657 INFO:tasks.workunit.client.0.smithi148.stdout:4/107: mkdir d12/d1a/d1f 0 2024-04-26T23:08:54.669 INFO:tasks.workunit.client.0.smithi148.stdout:4/108: dread f8 [0,4194304] 0 2024-04-26T23:08:54.683 INFO:tasks.workunit.client.0.smithi148.stdout:6/153: dwrite d6/fe [0,4194304] 0 2024-04-26T23:08:54.685 INFO:tasks.workunit.client.0.smithi148.stdout:8/117: creat d3/d9/f24 x:0 0 0 2024-04-26T23:08:54.685 INFO:tasks.workunit.client.0.smithi148.stdout:8/118: dread - d3/d9/f24 zero size 2024-04-26T23:08:54.685 INFO:tasks.workunit.client.0.smithi148.stdout:8/119: chown d3/da 4 1 2024-04-26T23:08:54.685 INFO:tasks.workunit.client.0.smithi148.stdout:8/120: write d3/d9/d12/d15/f20 [163665,67547] 0 2024-04-26T23:08:54.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/118: dwrite da/f10 [0,4194304] 0 2024-04-26T23:08:54.690 INFO:tasks.workunit.client.0.smithi148.stdout:5/119: chown da/d12/c23 1 1 2024-04-26T23:08:54.691 INFO:tasks.workunit.client.0.smithi148.stdout:6/154: unlink d6/d9/d1c/c21 0 2024-04-26T23:08:54.697 INFO:tasks.workunit.client.0.smithi148.stdout:8/121: dread d3/f5 [0,4194304] 0 2024-04-26T23:08:54.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/122: truncate d3/f6 2234711 0 2024-04-26T23:08:54.703 INFO:tasks.workunit.client.0.smithi148.stdout:5/120: unlink da/d1b/d1c/f2b 0 2024-04-26T23:08:54.703 INFO:tasks.workunit.client.0.smithi148.stdout:5/121: chown da/d1a/f1e 626154 1 2024-04-26T23:08:54.709 INFO:tasks.workunit.client.0.smithi148.stdout:9/103: dread d19/f1c [0,4194304] 0 2024-04-26T23:08:54.709 INFO:tasks.workunit.client.0.smithi148.stdout:9/104: fdatasync f7 0 2024-04-26T23:08:54.716 INFO:tasks.workunit.client.0.smithi148.stdout:3/75: dread d9/ff [0,4194304] 0 2024-04-26T23:08:54.716 INFO:tasks.workunit.client.0.smithi148.stdout:3/76: chown d9/la 940 1 2024-04-26T23:08:54.716 INFO:tasks.workunit.client.0.smithi148.stdout:5/122: unlink da/f14 0 2024-04-26T23:08:54.716 INFO:tasks.workunit.client.0.smithi148.stdout:0/96: dwrite d0/d8/f14 [0,4194304] 0 2024-04-26T23:08:54.718 INFO:tasks.workunit.client.0.smithi148.stdout:8/123: dread d3/d9/d12/d15/f20 [0,4194304] 0 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:8/124: chown d3/d9/d12/l13 3996383 1 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:8/125: chown d3/da/fc 29 1 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:8/126: chown d3/d9 1019954 1 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:8/127: chown d3/da/ce 4710 1 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:4/109: dwrite d12/f14 [4194304,4194304] 0 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:4/110: chown ce 33100631 1 2024-04-26T23:08:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:5/123: getdents da/d1a 0 2024-04-26T23:08:54.720 INFO:tasks.workunit.client.0.smithi148.stdout:7/136: dread d7/d11/d13/f21 [0,4194304] 0 2024-04-26T23:08:54.720 INFO:tasks.workunit.client.0.smithi148.stdout:7/137: getdents d7/d11/d17 0 2024-04-26T23:08:54.721 INFO:tasks.workunit.client.0.smithi148.stdout:8/128: dread d3/d9/d12/d15/f20 [0,4194304] 0 2024-04-26T23:08:54.721 INFO:tasks.workunit.client.0.smithi148.stdout:8/129: truncate d3/d9/d12/d15/f17 982260 0 2024-04-26T23:08:54.723 INFO:tasks.workunit.client.0.smithi148.stdout:8/130: write d3/d9/d12/d15/f17 [408085,107101] 0 2024-04-26T23:08:54.723 INFO:tasks.workunit.client.0.smithi148.stdout:0/97: readlink d0/d8/l9 0 2024-04-26T23:08:54.723 INFO:tasks.workunit.client.0.smithi148.stdout:0/98: readlink d0/l4 0 2024-04-26T23:08:54.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/124: truncate f3 5364454 0 2024-04-26T23:08:54.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/125: truncate da/d12/f17 162631 0 2024-04-26T23:08:54.724 INFO:tasks.workunit.client.0.smithi148.stdout:7/138: creat d7/d11/d29/f37 x:0 0 0 2024-04-26T23:08:54.727 INFO:tasks.workunit.client.0.smithi148.stdout:8/131: unlink d3/f6 0 2024-04-26T23:08:54.729 INFO:tasks.workunit.client.0.smithi148.stdout:0/99: creat d0/d8/d17/f1f x:0 0 0 2024-04-26T23:08:54.730 INFO:tasks.workunit.client.0.smithi148.stdout:7/139: mknod d7/d19/c38 0 2024-04-26T23:08:54.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/132: creat d3/d9/d12/d23/f25 x:0 0 0 2024-04-26T23:08:54.732 INFO:tasks.workunit.client.0.smithi148.stdout:4/111: dread ff [0,4194304] 0 2024-04-26T23:08:54.733 INFO:tasks.workunit.client.0.smithi148.stdout:4/112: chown d12/f14 5753 1 2024-04-26T23:08:54.739 INFO:tasks.workunit.client.0.smithi148.stdout:2/185: sync 2024-04-26T23:08:54.751 INFO:tasks.workunit.client.0.smithi148.stdout:4/113: read d12/d17/f18 [3816758,126256] 0 2024-04-26T23:08:54.753 INFO:tasks.workunit.client.0.smithi148.stdout:0/100: mkdir d0/d20 0 2024-04-26T23:08:54.753 INFO:tasks.workunit.client.0.smithi148.stdout:0/101: chown d0/d8 1 1 2024-04-26T23:08:54.754 INFO:tasks.workunit.client.0.smithi148.stdout:8/133: rename d3/d9/cf to d3/da/c26 0 2024-04-26T23:08:54.755 INFO:tasks.workunit.client.0.smithi148.stdout:4/114: mknod d12/d1c/c20 0 2024-04-26T23:08:54.755 INFO:tasks.workunit.client.0.smithi148.stdout:4/115: chown d12/d1a 62 1 2024-04-26T23:08:54.759 INFO:tasks.workunit.client.0.smithi148.stdout:4/116: dread fc [0,4194304] 0 2024-04-26T23:08:54.764 INFO:tasks.workunit.client.0.smithi148.stdout:0/102: symlink d0/d8/d1e/l21 0 2024-04-26T23:08:54.766 INFO:tasks.workunit.client.0.smithi148.stdout:0/103: write d0/d5/f7 [6704372,92050] 0 2024-04-26T23:08:54.777 INFO:tasks.workunit.client.0.smithi148.stdout:0/104: write d0/d5/f16 [2043234,31926] 0 2024-04-26T23:08:54.778 INFO:tasks.workunit.client.0.smithi148.stdout:8/134: link d3/d9/d12/d23/f25 d3/da/f27 0 2024-04-26T23:08:54.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/117: unlink fc 0 2024-04-26T23:08:54.781 INFO:tasks.workunit.client.0.smithi148.stdout:0/105: creat d0/d8/d1e/f22 x:0 0 0 2024-04-26T23:08:54.788 INFO:tasks.workunit.client.0.smithi148.stdout:8/135: mkdir d3/da/d28 0 2024-04-26T23:08:54.790 INFO:tasks.workunit.client.0.smithi148.stdout:4/118: mknod d12/d17/c21 0 2024-04-26T23:08:54.813 INFO:tasks.workunit.client.0.smithi148.stdout:7/140: dwrite d7/d19/f2d [0,4194304] 0 2024-04-26T23:08:54.813 INFO:tasks.workunit.client.0.smithi148.stdout:7/141: getdents d7/d11/d17/d2f 0 2024-04-26T23:08:54.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/106: dwrite d0/d5/f16 [0,4194304] 0 2024-04-26T23:08:54.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/107: readlink d0/l11 0 2024-04-26T23:08:54.827 INFO:tasks.workunit.client.0.smithi148.stdout:8/136: truncate d3/da/f18 2601919 0 2024-04-26T23:08:54.843 INFO:tasks.workunit.client.0.smithi148.stdout:2/186: dwrite d5/d2c/d32/f37 [0,4194304] 0 2024-04-26T23:08:54.846 INFO:tasks.workunit.client.0.smithi148.stdout:4/119: dwrite f8 [0,4194304] 0 2024-04-26T23:08:54.846 INFO:tasks.workunit.client.0.smithi148.stdout:0/108: unlink d0/d8/d17/c1d 0 2024-04-26T23:08:54.848 INFO:tasks.workunit.client.0.smithi148.stdout:8/137: mkdir d3/d9/d12/d23/d29 0 2024-04-26T23:08:54.852 INFO:tasks.workunit.client.0.smithi148.stdout:2/187: getdents d5/d8/d9 0 2024-04-26T23:08:54.855 INFO:tasks.workunit.client.0.smithi148.stdout:4/120: creat d12/d17/f22 x:0 0 0 2024-04-26T23:08:54.855 INFO:tasks.workunit.client.0.smithi148.stdout:4/121: fdatasync fb 0 2024-04-26T23:08:54.858 INFO:tasks.workunit.client.0.smithi148.stdout:8/138: symlink d3/l2a 0 2024-04-26T23:08:54.858 INFO:tasks.workunit.client.0.smithi148.stdout:5/126: write f3 [3255460,89807] 0 2024-04-26T23:08:54.858 INFO:tasks.workunit.client.0.smithi148.stdout:8/139: fdatasync d3/d9/d12/f21 0 2024-04-26T23:08:54.858 INFO:tasks.workunit.client.0.smithi148.stdout:5/127: dread - da/d1a/f28 zero size 2024-04-26T23:08:54.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/188: creat d5/d2c/d32/f42 x:0 0 0 2024-04-26T23:08:54.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/189: write d5/d10/f14 [2503969,106028] 0 2024-04-26T23:08:54.864 INFO:tasks.workunit.client.0.smithi148.stdout:4/122: getdents d12 0 2024-04-26T23:08:54.864 INFO:tasks.workunit.client.0.smithi148.stdout:4/123: truncate d12/d17/f22 680601 0 2024-04-26T23:08:54.864 INFO:tasks.workunit.client.0.smithi148.stdout:4/124: write d12/d17/f22 [1481339,46225] 0 2024-04-26T23:08:54.869 INFO:tasks.workunit.client.0.smithi148.stdout:0/109: dread d0/d8/f14 [0,4194304] 0 2024-04-26T23:08:54.870 INFO:tasks.workunit.client.0.smithi148.stdout:0/110: chown d0/d8/d1e/f22 418401596 1 2024-04-26T23:08:54.870 INFO:tasks.workunit.client.0.smithi148.stdout:0/111: write d0/d5/f7 [2097173,76392] 0 2024-04-26T23:08:54.870 INFO:tasks.workunit.client.0.smithi148.stdout:0/112: fdatasync d0/d8/d1e/f22 0 2024-04-26T23:08:54.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/140: symlink d3/da/d28/l2b 0 2024-04-26T23:08:54.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/141: stat d3/d9/d12/l1f 0 2024-04-26T23:08:54.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/142: getdents d3/d9/d12/d23/d29 0 2024-04-26T23:08:54.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/143: dread - d3/d9/d12/f21 zero size 2024-04-26T23:08:54.876 INFO:tasks.workunit.client.0.smithi148.stdout:7/142: write d7/f9 [820224,91864] 0 2024-04-26T23:08:54.876 INFO:tasks.workunit.client.0.smithi148.stdout:7/143: truncate d7/d11/d13/f21 730639 0 2024-04-26T23:08:54.876 INFO:tasks.workunit.client.0.smithi148.stdout:9/105: dwrite f18 [0,4194304] 0 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:2/190: mkdir d5/d8/d15/d43 0 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:2/191: dread - d5/d2c/f3a zero size 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:2/192: chown d5/d1c/f2f 1 1 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/113: creat d0/d8/d1e/f23 x:0 0 0 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/114: write d0/d8/d17/f1f [427996,93011] 0 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/115: chown d0/d5/f1c 766621 1 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/116: chown d0/d8/f14 52 1 2024-04-26T23:08:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:7/144: truncate d7/d11/d29/d2e/f26 3778871 0 2024-04-26T23:08:54.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/125: dread ff [0,4194304] 0 2024-04-26T23:08:54.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/126: write f10 [9341739,128539] 0 2024-04-26T23:08:54.910 INFO:tasks.workunit.client.0.smithi148.stdout:9/106: dread fe [0,4194304] 0 2024-04-26T23:08:54.919 INFO:tasks.workunit.client.0.smithi148.stdout:8/144: write d3/da/f18 [170939,45344] 0 2024-04-26T23:08:54.925 INFO:tasks.workunit.client.0.smithi148.stdout:2/193: dwrite d5/f16 [0,4194304] 0 2024-04-26T23:08:54.930 INFO:tasks.workunit.client.0.smithi148.stdout:0/117: dread d0/f15 [0,4194304] 0 2024-04-26T23:08:54.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/128: dwrite f3 [0,4194304] 0 2024-04-26T23:08:54.943 INFO:tasks.workunit.client.0.smithi148.stdout:9/107: creat d19/f23 x:0 0 0 2024-04-26T23:08:54.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/145: symlink d3/d9/d12/d23/d29/l2c 0 2024-04-26T23:08:54.947 INFO:tasks.workunit.client.0.smithi148.stdout:0/118: creat d0/f24 x:0 0 0 2024-04-26T23:08:54.948 INFO:tasks.workunit.client.0.smithi148.stdout:5/129: symlink da/d1a/l2c 0 2024-04-26T23:08:54.950 INFO:tasks.workunit.client.0.smithi148.stdout:8/146: mknod d3/d9/d12/c2d 0 2024-04-26T23:08:54.950 INFO:tasks.workunit.client.0.smithi148.stdout:8/147: write d3/d9/f24 [254627,102748] 0 2024-04-26T23:08:54.962 INFO:tasks.workunit.client.0.smithi148.stdout:4/127: dwrite f8 [0,4194304] 0 2024-04-26T23:08:54.962 INFO:tasks.workunit.client.0.smithi148.stdout:7/145: dwrite d7/d11/d13/f33 [0,4194304] 0 2024-04-26T23:08:54.968 INFO:tasks.workunit.client.0.smithi148.stdout:9/108: write d19/f1a [2251590,41339] 0 2024-04-26T23:08:54.973 INFO:tasks.workunit.client.0.smithi148.stdout:0/119: mknod d0/d8/d1e/c25 0 2024-04-26T23:08:54.973 INFO:tasks.workunit.client.0.smithi148.stdout:5/130: mkdir da/d1b/d2d 0 2024-04-26T23:08:54.973 INFO:tasks.workunit.client.0.smithi148.stdout:5/131: read da/d12/f17 [22704,57408] 0 2024-04-26T23:08:54.977 INFO:tasks.workunit.client.0.smithi148.stdout:7/146: rename d7/d11/d29/f2a to d7/d11/d17/f39 0 2024-04-26T23:08:54.979 INFO:tasks.workunit.client.0.smithi148.stdout:9/109: symlink d19/d22/l24 0 2024-04-26T23:08:54.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/120: mknod d0/d5/c26 0 2024-04-26T23:08:54.994 INFO:tasks.workunit.client.0.smithi148.stdout:9/110: dread f3 [0,4194304] 0 2024-04-26T23:08:54.995 INFO:tasks.workunit.client.0.smithi148.stdout:7/147: symlink d7/d11/d17/l3a 0 2024-04-26T23:08:54.996 INFO:tasks.workunit.client.0.smithi148.stdout:3/77: sync 2024-04-26T23:08:54.996 INFO:tasks.workunit.client.0.smithi148.stdout:1/101: sync 2024-04-26T23:08:54.996 INFO:tasks.workunit.client.0.smithi148.stdout:9/111: mkdir d19/d1d/d25 0 2024-04-26T23:08:54.996 INFO:tasks.workunit.client.0.smithi148.stdout:0/121: dread d0/f15 [0,4194304] 0 2024-04-26T23:08:54.998 INFO:tasks.workunit.client.0.smithi148.stdout:1/102: rename f12 to d16/f1d 0 2024-04-26T23:08:54.998 INFO:tasks.workunit.client.0.smithi148.stdout:1/103: write f10 [774882,10434] 0 2024-04-26T23:08:54.998 INFO:tasks.workunit.client.0.smithi148.stdout:1/104: fdatasync f7 0 2024-04-26T23:08:54.998 INFO:tasks.workunit.client.0.smithi148.stdout:1/105: write d16/f1d [1294753,81418] 0 2024-04-26T23:08:54.999 INFO:tasks.workunit.client.0.smithi148.stdout:9/112: creat d19/d22/f26 x:0 0 0 2024-04-26T23:08:55.000 INFO:tasks.workunit.client.0.smithi148.stdout:0/122: link d0/d8/d1e/l21 d0/d5/d19/l27 0 2024-04-26T23:08:55.000 INFO:tasks.workunit.client.0.smithi148.stdout:0/123: fdatasync d0/d5/f16 0 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/106: symlink d16/d17/l1e 0 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/107: stat f10 0 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/108: chown d16/d17/f18 47 1 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/109: dread - d16/d17/f1b zero size 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/110: fdatasync f15 0 2024-04-26T23:08:55.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/111: chown d16/d17/l1e 608262 1 2024-04-26T23:08:55.003 INFO:tasks.workunit.client.0.smithi148.stdout:0/124: creat d0/d8/d1e/f28 x:0 0 0 2024-04-26T23:08:55.003 INFO:tasks.workunit.client.0.smithi148.stdout:1/112: symlink d16/d1c/l1f 0 2024-04-26T23:08:55.005 INFO:tasks.workunit.client.0.smithi148.stdout:0/125: mknod d0/d8/d17/c29 0 2024-04-26T23:08:55.005 INFO:tasks.workunit.client.0.smithi148.stdout:0/126: write d0/d5/f1c [535203,108763] 0 2024-04-26T23:08:55.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/113: creat d16/f20 x:0 0 0 2024-04-26T23:08:55.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/114: dread - f15 zero size 2024-04-26T23:08:55.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/115: truncate d16/d17/f1a 2024108 0 2024-04-26T23:08:55.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/116: readlink d16/d17/l1e 0 2024-04-26T23:08:55.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/155: sync 2024-04-26T23:08:55.008 INFO:tasks.workunit.client.0.smithi148.stdout:0/127: rmdir d0/d8/d17 39 2024-04-26T23:08:55.010 INFO:tasks.workunit.client.0.smithi148.stdout:1/117: link l0 d16/d1c/l21 0 2024-04-26T23:08:55.011 INFO:tasks.workunit.client.0.smithi148.stdout:1/118: stat cf 0 2024-04-26T23:08:55.013 INFO:tasks.workunit.client.0.smithi148.stdout:0/128: creat d0/d8/d1e/f2a x:0 0 0 2024-04-26T23:08:55.014 INFO:tasks.workunit.client.0.smithi148.stdout:1/119: dread f13 [0,4194304] 0 2024-04-26T23:08:55.015 INFO:tasks.workunit.client.0.smithi148.stdout:0/129: symlink d0/d5/d19/l2b 0 2024-04-26T23:08:55.015 INFO:tasks.workunit.client.0.smithi148.stdout:0/130: fsync d0/f2 0 2024-04-26T23:08:55.015 INFO:tasks.workunit.client.0.smithi148.stdout:0/131: write d0/d8/d1e/f23 [495395,71522] 0 2024-04-26T23:08:55.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/132: fsync d0/d5/f1c 0 2024-04-26T23:08:55.022 INFO:tasks.workunit.client.0.smithi148.stdout:5/132: dwrite da/f19 [0,4194304] 0 2024-04-26T23:08:55.022 INFO:tasks.workunit.client.0.smithi148.stdout:5/133: chown da/f18 31054184 1 2024-04-26T23:08:55.022 INFO:tasks.workunit.client.0.smithi148.stdout:5/134: read - da/d1f/f26 zero size 2024-04-26T23:08:55.022 INFO:tasks.workunit.client.0.smithi148.stdout:3/78: read d9/f11 [4002226,62680] 0 2024-04-26T23:08:55.022 INFO:tasks.workunit.client.0.smithi148.stdout:0/133: creat d0/d5/f2c x:0 0 0 2024-04-26T23:08:55.025 INFO:tasks.workunit.client.0.smithi148.stdout:5/135: symlink da/d1a/l2e 0 2024-04-26T23:08:55.027 INFO:tasks.workunit.client.0.smithi148.stdout:3/79: rename d9/c14 to d9/d15/c18 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/134: mknod d0/d20/c2d 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/80: creat d9/d15/f19 x:0 0 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/81: write d9/f11 [4620413,902] 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:9/113: getdents d19/d1d 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/82: readlink l8 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/136: stat da/d1f/c2a 0 2024-04-26T23:08:55.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/135: write d0/d8/d17/f1f [1012991,129323] 0 2024-04-26T23:08:55.034 INFO:tasks.workunit.client.0.smithi148.stdout:9/114: symlink d19/d1d/d25/l27 0 2024-04-26T23:08:55.034 INFO:tasks.workunit.client.0.smithi148.stdout:9/115: stat c11 0 2024-04-26T23:08:55.034 INFO:tasks.workunit.client.0.smithi148.stdout:1/120: dread d16/d17/f18 [0,4194304] 0 2024-04-26T23:08:55.034 INFO:tasks.workunit.client.0.smithi148.stdout:5/137: mknod da/d1a/c2f 0 2024-04-26T23:08:55.035 INFO:tasks.workunit.client.0.smithi148.stdout:4/128: dwrite d12/d17/f22 [0,4194304] 0 2024-04-26T23:08:55.039 INFO:tasks.workunit.client.0.smithi148.stdout:0/136: mkdir d0/d2e 0 2024-04-26T23:08:55.039 INFO:tasks.workunit.client.0.smithi148.stdout:1/121: unlink d16/d17/f18 0 2024-04-26T23:08:55.039 INFO:tasks.workunit.client.0.smithi148.stdout:5/138: creat da/d1b/d1c/f30 x:0 0 0 2024-04-26T23:08:55.041 INFO:tasks.workunit.client.0.smithi148.stdout:0/137: symlink d0/d8/d17/l2f 0 2024-04-26T23:08:55.053 INFO:tasks.workunit.client.0.smithi148.stdout:5/139: dread da/d25/f29 [0,4194304] 0 2024-04-26T23:08:55.053 INFO:tasks.workunit.client.0.smithi148.stdout:5/140: stat da/d1f/c2a 0 2024-04-26T23:08:55.055 INFO:tasks.workunit.client.0.smithi148.stdout:1/122: dread f5 [0,4194304] 0 2024-04-26T23:08:55.058 INFO:tasks.workunit.client.0.smithi148.stdout:1/123: creat d16/d1c/f22 x:0 0 0 2024-04-26T23:08:55.060 INFO:tasks.workunit.client.0.smithi148.stdout:5/141: rename da/d1a/l2c to da/l31 0 2024-04-26T23:08:55.062 INFO:tasks.workunit.client.0.smithi148.stdout:5/142: rename da/d1f/c2a to da/d1f/c32 0 2024-04-26T23:08:55.063 INFO:tasks.workunit.client.0.smithi148.stdout:5/143: unlink da/d25/f29 0 2024-04-26T23:08:55.065 INFO:tasks.workunit.client.0.smithi148.stdout:5/144: symlink da/d1a/l33 0 2024-04-26T23:08:55.065 INFO:tasks.workunit.client.0.smithi148.stdout:5/145: truncate da/fc 29096 0 2024-04-26T23:08:55.070 INFO:tasks.workunit.client.0.smithi148.stdout:4/129: write f10 [4164074,115643] 0 2024-04-26T23:08:55.071 INFO:tasks.workunit.client.0.smithi148.stdout:4/130: unlink ce 0 2024-04-26T23:08:55.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/138: dwrite d0/d8/f14 [0,4194304] 0 2024-04-26T23:08:55.099 INFO:tasks.workunit.client.0.smithi148.stdout:4/131: write ff [577377,23900] 0 2024-04-26T23:08:55.104 INFO:tasks.workunit.client.0.smithi148.stdout:4/132: unlink ff 0 2024-04-26T23:08:55.112 INFO:tasks.workunit.client.0.smithi148.stdout:9/116: dwrite d19/d1d/f21 [0,4194304] 0 2024-04-26T23:08:55.114 INFO:tasks.workunit.client.0.smithi148.stdout:0/139: dread d0/d5/f1c [0,4194304] 0 2024-04-26T23:08:55.115 INFO:tasks.workunit.client.0.smithi148.stdout:0/140: write d0/d8/d1e/f2a [173658,16480] 0 2024-04-26T23:08:55.115 INFO:tasks.workunit.client.0.smithi148.stdout:0/141: truncate d0/d8/d17/f1f 1919159 0 2024-04-26T23:08:55.115 INFO:tasks.workunit.client.0.smithi148.stdout:3/83: dwrite f5 [4194304,4194304] 0 2024-04-26T23:08:55.115 INFO:tasks.workunit.client.0.smithi148.stdout:3/84: write d9/d15/f19 [581595,95536] 0 2024-04-26T23:08:55.116 INFO:tasks.workunit.client.0.smithi148.stdout:0/142: unlink d0/d5/d19/l27 0 2024-04-26T23:08:55.120 INFO:tasks.workunit.client.0.smithi148.stdout:3/85: symlink d9/d15/l1a 0 2024-04-26T23:08:55.121 INFO:tasks.workunit.client.0.smithi148.stdout:0/143: creat d0/d8/d17/f30 x:0 0 0 2024-04-26T23:08:55.121 INFO:tasks.workunit.client.0.smithi148.stdout:0/144: readlink d0/l11 0 2024-04-26T23:08:55.124 INFO:tasks.workunit.client.0.smithi148.stdout:4/133: dread d12/d17/f18 [0,4194304] 0 2024-04-26T23:08:55.124 INFO:tasks.workunit.client.0.smithi148.stdout:4/134: readlink l11 0 2024-04-26T23:08:55.125 INFO:tasks.workunit.client.0.smithi148.stdout:9/117: dread f7 [0,4194304] 0 2024-04-26T23:08:55.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/146: dwrite da/d12/f17 [0,4194304] 0 2024-04-26T23:08:55.127 INFO:tasks.workunit.client.0.smithi148.stdout:4/135: truncate d12/d17/f18 2948738 0 2024-04-26T23:08:55.128 INFO:tasks.workunit.client.0.smithi148.stdout:9/118: rmdir d19 39 2024-04-26T23:08:55.130 INFO:tasks.workunit.client.0.smithi148.stdout:5/147: symlink da/d1b/l34 0 2024-04-26T23:08:55.130 INFO:tasks.workunit.client.0.smithi148.stdout:4/136: truncate f8 3622154 0 2024-04-26T23:08:55.135 INFO:tasks.workunit.client.0.smithi148.stdout:3/86: fsync d9/d15/f19 0 2024-04-26T23:08:55.135 INFO:tasks.workunit.client.0.smithi148.stdout:3/87: chown d9/c13 34 1 2024-04-26T23:08:55.135 INFO:tasks.workunit.client.0.smithi148.stdout:3/88: stat d9/d15/c16 0 2024-04-26T23:08:55.135 INFO:tasks.workunit.client.0.smithi148.stdout:9/119: link d19/d1d/d25/l27 d19/d22/l28 0 2024-04-26T23:08:55.136 INFO:tasks.workunit.client.0.smithi148.stdout:5/148: unlink da/d1f/c32 0 2024-04-26T23:08:55.138 INFO:tasks.workunit.client.0.smithi148.stdout:9/120: rmdir d19/d22 39 2024-04-26T23:08:55.138 INFO:tasks.workunit.client.0.smithi148.stdout:9/121: write d19/f1e [288005,89510] 0 2024-04-26T23:08:55.140 INFO:tasks.workunit.client.0.smithi148.stdout:5/149: creat da/d12/f35 x:0 0 0 2024-04-26T23:08:55.140 INFO:tasks.workunit.client.0.smithi148.stdout:5/150: write da/d1b/d1c/f30 [221472,127907] 0 2024-04-26T23:08:55.141 INFO:tasks.workunit.client.0.smithi148.stdout:5/151: fdatasync f5 0 2024-04-26T23:08:55.145 INFO:tasks.workunit.client.0.smithi148.stdout:9/122: rename d19/f1c to d19/d1d/d25/f29 0 2024-04-26T23:08:55.151 INFO:tasks.workunit.client.0.smithi148.stdout:3/89: write f5 [5224144,50638] 0 2024-04-26T23:08:55.151 INFO:tasks.workunit.client.0.smithi148.stdout:3/90: write f5 [3247054,4241] 0 2024-04-26T23:08:55.166 INFO:tasks.workunit.client.0.smithi148.stdout:5/152: write da/d1a/f1e [1757818,88314] 0 2024-04-26T23:08:55.170 INFO:tasks.workunit.client.0.smithi148.stdout:5/153: creat da/d1b/d1c/f36 x:0 0 0 2024-04-26T23:08:55.170 INFO:tasks.workunit.client.0.smithi148.stdout:5/154: chown da/d1b 23 1 2024-04-26T23:08:55.170 INFO:tasks.workunit.client.0.smithi148.stdout:5/155: write da/d1f/f26 [794829,7510] 0 2024-04-26T23:08:55.177 INFO:tasks.workunit.client.0.smithi148.stdout:0/145: dwrite d0/d8/d17/f1f [0,4194304] 0 2024-04-26T23:08:55.177 INFO:tasks.workunit.client.0.smithi148.stdout:0/146: readlink d0/l11 0 2024-04-26T23:08:55.188 INFO:tasks.workunit.client.0.smithi148.stdout:9/123: dwrite d19/d1d/f21 [0,4194304] 0 2024-04-26T23:08:55.188 INFO:tasks.workunit.client.0.smithi148.stdout:9/124: fdatasync f2 0 2024-04-26T23:08:55.188 INFO:tasks.workunit.client.0.smithi148.stdout:9/125: chown fe 3 1 2024-04-26T23:08:55.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/147: rename d0/d8/d17/c29 to d0/d5/d19/c31 0 2024-04-26T23:08:55.191 INFO:tasks.workunit.client.0.smithi148.stdout:9/126: symlink d19/d1d/l2a 0 2024-04-26T23:08:55.191 INFO:tasks.workunit.client.0.smithi148.stdout:9/127: readlink d19/d22/l28 0 2024-04-26T23:08:55.192 INFO:tasks.workunit.client.0.smithi148.stdout:0/148: symlink d0/d8/d1e/l32 0 2024-04-26T23:08:55.194 INFO:tasks.workunit.client.0.smithi148.stdout:0/149: mkdir d0/d8/d33 0 2024-04-26T23:08:55.201 INFO:tasks.workunit.client.0.smithi148.stdout:0/150: rename d0/d5/d19/c31 to d0/d20/c34 0 2024-04-26T23:08:55.201 INFO:tasks.workunit.client.0.smithi148.stdout:3/91: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:08:55.202 INFO:tasks.workunit.client.0.smithi148.stdout:0/151: creat d0/d2e/f35 x:0 0 0 2024-04-26T23:08:55.205 INFO:tasks.workunit.client.0.smithi148.stdout:3/92: creat d9/d15/f1b x:0 0 0 2024-04-26T23:08:55.205 INFO:tasks.workunit.client.0.smithi148.stdout:3/93: truncate d9/d15/f19 4888909 0 2024-04-26T23:08:55.206 INFO:tasks.workunit.client.0.smithi148.stdout:3/94: creat d9/f1c x:0 0 0 2024-04-26T23:08:55.207 INFO:tasks.workunit.client.0.smithi148.stdout:0/152: mknod d0/d8/c36 0 2024-04-26T23:08:55.207 INFO:tasks.workunit.client.0.smithi148.stdout:0/153: chown d0/d8 1948428 1 2024-04-26T23:08:55.207 INFO:tasks.workunit.client.0.smithi148.stdout:0/154: write d0/d8/d1e/f23 [635825,21537] 0 2024-04-26T23:08:55.208 INFO:tasks.workunit.client.0.smithi148.stdout:0/155: write d0/d8/d1e/f22 [64444,17888] 0 2024-04-26T23:08:55.208 INFO:tasks.workunit.client.0.smithi148.stdout:0/156: dread - d0/d5/f2c zero size 2024-04-26T23:08:55.208 INFO:tasks.workunit.client.0.smithi148.stdout:3/95: symlink d9/d15/l1d 0 2024-04-26T23:08:55.208 INFO:tasks.workunit.client.0.smithi148.stdout:3/96: truncate d9/f1c 91041 0 2024-04-26T23:08:55.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/157: stat d0/d5/ld 0 2024-04-26T23:08:55.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/158: dread - d0/d2e/f35 zero size 2024-04-26T23:08:55.210 INFO:tasks.workunit.client.0.smithi148.stdout:3/97: creat d9/d15/f1e x:0 0 0 2024-04-26T23:08:55.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/98: mknod d9/c1f 0 2024-04-26T23:08:55.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/99: write d9/d15/f1b [231939,99771] 0 2024-04-26T23:08:55.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/100: chown d9/d15/f1b 930151 1 2024-04-26T23:08:55.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/159: symlink d0/d8/l37 0 2024-04-26T23:08:55.213 INFO:tasks.workunit.client.0.smithi148.stdout:3/101: truncate d9/ff 47213 0 2024-04-26T23:08:55.213 INFO:tasks.workunit.client.0.smithi148.stdout:0/160: creat d0/d8/f38 x:0 0 0 2024-04-26T23:08:55.214 INFO:tasks.workunit.client.0.smithi148.stdout:3/102: mknod d9/c20 0 2024-04-26T23:08:55.214 INFO:tasks.workunit.client.0.smithi148.stdout:0/161: mknod d0/d8/d17/c39 0 2024-04-26T23:08:55.215 INFO:tasks.workunit.client.0.smithi148.stdout:3/103: read d9/f1c [76009,66948] 0 2024-04-26T23:08:55.218 INFO:tasks.workunit.client.0.smithi148.stdout:0/162: getdents d0/d8 0 2024-04-26T23:08:55.222 INFO:tasks.workunit.client.0.smithi148.stdout:0/163: mkdir d0/d5/d19/d3a 0 2024-04-26T23:08:55.222 INFO:tasks.workunit.client.0.smithi148.stdout:0/164: dread - d0/d8/d17/f30 zero size 2024-04-26T23:08:55.229 INFO:tasks.workunit.client.0.smithi148.stdout:9/128: dwrite f3 [4194304,4194304] 0 2024-04-26T23:08:55.243 INFO:tasks.workunit.client.0.smithi148.stdout:0/165: fdatasync d0/d8/d1e/f23 0 2024-04-26T23:08:55.244 INFO:tasks.workunit.client.0.smithi148.stdout:0/166: mkdir d0/d20/d3b 0 2024-04-26T23:08:55.245 INFO:tasks.workunit.client.0.smithi148.stdout:0/167: getdents d0/d5 0 2024-04-26T23:08:55.246 INFO:tasks.workunit.client.0.smithi148.stdout:0/168: creat d0/d20/d3b/f3c x:0 0 0 2024-04-26T23:08:55.248 INFO:tasks.workunit.client.0.smithi148.stdout:0/169: rename d0/d20/c2d to d0/d8/c3d 0 2024-04-26T23:08:55.248 INFO:tasks.workunit.client.0.smithi148.stdout:0/170: stat d0/d20/d3b/f3c 0 2024-04-26T23:08:55.253 INFO:tasks.workunit.client.0.smithi148.stdout:0/171: dread d0/d5/f1c [0,4194304] 0 2024-04-26T23:08:55.254 INFO:tasks.workunit.client.0.smithi148.stdout:3/104: dwrite d9/f1c [0,4194304] 0 2024-04-26T23:08:55.254 INFO:tasks.workunit.client.0.smithi148.stdout:3/105: stat d9/ff 0 2024-04-26T23:08:55.254 INFO:tasks.workunit.client.0.smithi148.stdout:0/172: mknod d0/c3e 0 2024-04-26T23:08:55.254 INFO:tasks.workunit.client.0.smithi148.stdout:0/173: truncate d0/d8/d1e/f22 307501 0 2024-04-26T23:08:55.254 INFO:tasks.workunit.client.0.smithi148.stdout:0/174: readlink d0/d8/l37 0 2024-04-26T23:08:55.255 INFO:tasks.workunit.client.0.smithi148.stdout:3/106: rmdir d9/d15 39 2024-04-26T23:08:55.256 INFO:tasks.workunit.client.0.smithi148.stdout:0/175: rename d0/d5/f16 to d0/d5/f3f 0 2024-04-26T23:08:55.258 INFO:tasks.workunit.client.0.smithi148.stdout:0/176: unlink d0/d5/f1c 0 2024-04-26T23:08:55.266 INFO:tasks.workunit.client.0.smithi148.stdout:0/177: getdents d0/d20 0 2024-04-26T23:08:55.281 INFO:tasks.workunit.client.0.smithi148.stdout:8/148: sync 2024-04-26T23:08:55.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/129: dwrite f18 [0,4194304] 0 2024-04-26T23:08:55.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/130: readlink l14 0 2024-04-26T23:08:55.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/131: chown d19/d1d 60333 1 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/149: mknod d3/da/c2e 0 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/178: dread d0/d8/f14 [0,4194304] 0 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/179: chown d0/d5/f2c 62224 1 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/150: truncate d3/da/f27 638550 0 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/180: read d0/f2 [3628095,94205] 0 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/181: fsync d0/d8/d1e/f2a 0 2024-04-26T23:08:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:9/132: rename d19/d22/l24 to d19/d22/l2b 0 2024-04-26T23:08:55.289 INFO:tasks.workunit.client.0.smithi148.stdout:0/182: link d0/d8/d1e/f28 d0/d20/f40 0 2024-04-26T23:08:55.290 INFO:tasks.workunit.client.0.smithi148.stdout:0/183: mknod d0/d5/d19/d3a/c41 0 2024-04-26T23:08:55.291 INFO:tasks.workunit.client.0.smithi148.stdout:0/184: creat d0/d8/f42 x:0 0 0 2024-04-26T23:08:55.342 INFO:tasks.workunit.client.0.smithi148.stdout:3/107: dwrite d9/ff [0,4194304] 0 2024-04-26T23:08:55.347 INFO:tasks.workunit.client.0.smithi148.stdout:8/151: dread d3/da/f18 [0,4194304] 0 2024-04-26T23:08:55.358 INFO:tasks.workunit.client.0.smithi148.stdout:8/152: dread d3/f5 [0,4194304] 0 2024-04-26T23:08:55.358 INFO:tasks.workunit.client.0.smithi148.stdout:8/153: readlink d3/d9/d12/l1f 0 2024-04-26T23:08:55.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/154: dread d3/d9/d12/d23/f25 [0,4194304] 0 2024-04-26T23:08:55.363 INFO:tasks.workunit.client.0.smithi148.stdout:0/185: dwrite d0/d8/d1e/f28 [0,4194304] 0 2024-04-26T23:08:55.363 INFO:tasks.workunit.client.0.smithi148.stdout:8/155: unlink d3/d9/d12/d23/d29/l2c 0 2024-04-26T23:08:55.363 INFO:tasks.workunit.client.0.smithi148.stdout:8/156: chown d3/d9/d12/d23/f25 10393 1 2024-04-26T23:08:55.372 INFO:tasks.workunit.client.0.smithi148.stdout:0/186: mkdir d0/d8/d33/d43 0 2024-04-26T23:08:55.373 INFO:tasks.workunit.client.0.smithi148.stdout:8/157: rmdir d3/da/d28 39 2024-04-26T23:08:55.375 INFO:tasks.workunit.client.0.smithi148.stdout:3/108: dwrite d9/ff [0,4194304] 0 2024-04-26T23:08:55.377 INFO:tasks.workunit.client.0.smithi148.stdout:8/158: creat d3/d9/d12/d15/f2f x:0 0 0 2024-04-26T23:08:55.379 INFO:tasks.workunit.client.0.smithi148.stdout:2/194: sync 2024-04-26T23:08:55.379 INFO:tasks.workunit.client.0.smithi148.stdout:2/195: truncate d5/d8/d9/f23 1347454 0 2024-04-26T23:08:55.384 INFO:tasks.workunit.client.0.smithi148.stdout:3/109: rename l3 to d9/d15/l21 0 2024-04-26T23:08:55.385 INFO:tasks.workunit.client.0.smithi148.stdout:2/196: stat d5/d2c/l31 0 2024-04-26T23:08:55.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/197: creat d5/d8/d11/f44 x:0 0 0 2024-04-26T23:08:55.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/198: dread - d5/d1c/f2f zero size 2024-04-26T23:08:55.389 INFO:tasks.workunit.client.0.smithi148.stdout:2/199: creat d5/d8/d15/f45 x:0 0 0 2024-04-26T23:08:55.424 INFO:tasks.workunit.client.0.smithi148.stdout:3/110: dwrite f5 [4194304,4194304] 0 2024-04-26T23:08:55.434 INFO:tasks.workunit.client.0.smithi148.stdout:8/159: write d3/da/f27 [479818,49680] 0 2024-04-26T23:08:55.435 INFO:tasks.workunit.client.0.smithi148.stdout:8/160: dread - d3/d9/d12/f21 zero size 2024-04-26T23:08:55.438 INFO:tasks.workunit.client.0.smithi148.stdout:8/161: creat d3/d9/f30 x:0 0 0 2024-04-26T23:08:55.438 INFO:tasks.workunit.client.0.smithi148.stdout:8/162: write d3/d9/d12/d23/f25 [1261558,113202] 0 2024-04-26T23:08:55.439 INFO:tasks.workunit.client.0.smithi148.stdout:0/187: dwrite d0/d2e/f35 [0,4194304] 0 2024-04-26T23:08:55.439 INFO:tasks.workunit.client.0.smithi148.stdout:0/188: fsync d0/d8/d1e/f23 0 2024-04-26T23:08:55.447 INFO:tasks.workunit.client.0.smithi148.stdout:2/200: dread d5/d7/f18 [4194304,4194304] 0 2024-04-26T23:08:55.452 INFO:tasks.workunit.client.0.smithi148.stdout:2/201: dread d5/d8/d9/f23 [0,4194304] 0 2024-04-26T23:08:55.544 INFO:tasks.workunit.client.0.smithi148.stdout:2/202: dwrite d5/d17/f30 [0,4194304] 0 2024-04-26T23:08:55.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/163: symlink d3/d9/d12/d23/d29/l31 0 2024-04-26T23:08:55.943 INFO:tasks.workunit.client.0.smithi148.stdout:3/111: rename d9/d15/l21 to d9/d15/l22 0 2024-04-26T23:08:55.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/164: truncate d3/d9/f30 439799 0 2024-04-26T23:08:55.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/165: fdatasync d3/da/f18 0 2024-04-26T23:08:55.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/166: chown d3/d9/d12/l11 1654360408 1 2024-04-26T23:08:55.946 INFO:tasks.workunit.client.0.smithi148.stdout:8/167: write d3/d9/d12/d15/f17 [603556,101853] 0 2024-04-26T23:08:55.946 INFO:tasks.workunit.client.0.smithi148.stdout:0/189: symlink d0/d20/l44 0 2024-04-26T23:08:55.949 INFO:tasks.workunit.client.0.smithi148.stdout:8/168: read d3/d9/f24 [207677,54550] 0 2024-04-26T23:08:55.960 INFO:tasks.workunit.client.0.smithi148.stdout:3/112: dread d9/f1c [0,4194304] 0 2024-04-26T23:08:55.961 INFO:tasks.workunit.client.0.smithi148.stdout:3/113: chown d9/d15/l1d 0 1 2024-04-26T23:08:55.962 INFO:tasks.workunit.client.0.smithi148.stdout:2/203: stat d5/la 0 2024-04-26T23:08:55.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/169: symlink d3/d9/d12/d23/l32 0 2024-04-26T23:08:55.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/170: stat d3/d9/d12/f21 0 2024-04-26T23:08:55.969 INFO:tasks.workunit.client.0.smithi148.stdout:3/114: mknod d9/c23 0 2024-04-26T23:08:55.973 INFO:tasks.workunit.client.0.smithi148.stdout:8/171: unlink d3/c1b 0 2024-04-26T23:08:55.974 INFO:tasks.workunit.client.0.smithi148.stdout:8/172: dread d3/d9/f30 [0,4194304] 0 2024-04-26T23:08:55.975 INFO:tasks.workunit.client.0.smithi148.stdout:8/173: write d3/d9/d12/d15/f2f [64591,6315] 0 2024-04-26T23:08:55.975 INFO:tasks.workunit.client.0.smithi148.stdout:8/174: write d3/da/f27 [1295344,88595] 0 2024-04-26T23:08:55.975 INFO:tasks.workunit.client.0.smithi148.stdout:3/115: rmdir d9/d15 39 2024-04-26T23:08:55.975 INFO:tasks.workunit.client.0.smithi148.stdout:8/175: fsync d3/da/fc 0 2024-04-26T23:08:55.977 INFO:tasks.workunit.client.0.smithi148.stdout:3/116: creat d9/d15/f24 x:0 0 0 2024-04-26T23:08:55.985 INFO:tasks.workunit.client.0.smithi148.stdout:7/148: sync 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:1/124: sync 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:6/156: sync 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:4/137: sync 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:5/156: sync 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:4/138: write d12/f14 [380470,117507] 0 2024-04-26T23:08:55.986 INFO:tasks.workunit.client.0.smithi148.stdout:9/133: sync 2024-04-26T23:08:55.993 INFO:tasks.workunit.client.0.smithi148.stdout:7/149: symlink d7/l3b 0 2024-04-26T23:08:55.998 INFO:tasks.workunit.client.0.smithi148.stdout:6/157: rename d6/d9/fa to d6/f33 0 2024-04-26T23:08:56.002 INFO:tasks.workunit.client.0.smithi148.stdout:7/150: dread d7/d11/d13/f21 [0,4194304] 0 2024-04-26T23:08:56.003 INFO:tasks.workunit.client.0.smithi148.stdout:1/125: write f10 [441596,42481] 0 2024-04-26T23:08:56.003 INFO:tasks.workunit.client.0.smithi148.stdout:1/126: write f5 [4596532,100971] 0 2024-04-26T23:08:56.018 INFO:tasks.workunit.client.0.smithi148.stdout:8/176: truncate d3/d9/f30 421437 0 2024-04-26T23:08:56.018 INFO:tasks.workunit.client.0.smithi148.stdout:4/139: creat d12/d1a/f23 x:0 0 0 2024-04-26T23:08:56.023 INFO:tasks.workunit.client.0.smithi148.stdout:2/204: dwrite d5/d8/f3e [0,4194304] 0 2024-04-26T23:08:56.029 INFO:tasks.workunit.client.0.smithi148.stdout:7/151: getdents d7/d19 0 2024-04-26T23:08:56.029 INFO:tasks.workunit.client.0.smithi148.stdout:7/152: dread - d7/d11/f18 zero size 2024-04-26T23:08:56.030 INFO:tasks.workunit.client.0.smithi148.stdout:6/158: write d6/f19 [696943,89931] 0 2024-04-26T23:08:56.039 INFO:tasks.workunit.client.0.smithi148.stdout:0/190: dwrite d0/d5/f1a [0,4194304] 0 2024-04-26T23:08:56.043 INFO:tasks.workunit.client.0.smithi148.stdout:8/177: read d3/da/fc [10172747,34664] 0 2024-04-26T23:08:56.045 INFO:tasks.workunit.client.0.smithi148.stdout:2/205: mknod d5/d1c/c46 0 2024-04-26T23:08:56.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/157: dwrite da/d1b/d1c/f27 [0,4194304] 0 2024-04-26T23:08:56.053 INFO:tasks.workunit.client.0.smithi148.stdout:6/159: creat d6/dc/f34 x:0 0 0 2024-04-26T23:08:56.055 INFO:tasks.workunit.client.0.smithi148.stdout:1/127: dwrite d16/d1c/f22 [0,4194304] 0 2024-04-26T23:08:56.058 INFO:tasks.workunit.client.0.smithi148.stdout:8/178: mknod d3/d9/d12/d15/c33 0 2024-04-26T23:08:56.061 INFO:tasks.workunit.client.0.smithi148.stdout:2/206: link d5/f2d d5/d1c/d38/f47 0 2024-04-26T23:08:56.061 INFO:tasks.workunit.client.0.smithi148.stdout:5/158: creat da/d1b/d2d/f37 x:0 0 0 2024-04-26T23:08:56.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/160: rename d6/d9/d1c/d1d/l20 to d6/l35 0 2024-04-26T23:08:56.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/161: readlink d6/d9/l16 0 2024-04-26T23:08:56.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/162: fsync d6/f33 0 2024-04-26T23:08:56.064 INFO:tasks.workunit.client.0.smithi148.stdout:0/191: write d0/d2e/f35 [2456454,28889] 0 2024-04-26T23:08:56.067 INFO:tasks.workunit.client.0.smithi148.stdout:1/128: symlink d16/l23 0 2024-04-26T23:08:56.069 INFO:tasks.workunit.client.0.smithi148.stdout:2/207: link d5/d8/f1b d5/d10/f48 0 2024-04-26T23:08:56.072 INFO:tasks.workunit.client.0.smithi148.stdout:8/179: rename d3/d9/d12/d23/f25 to d3/d9/d12/d15/f34 0 2024-04-26T23:08:56.072 INFO:tasks.workunit.client.0.smithi148.stdout:8/180: write d3/d9/d12/d15/f2f [426293,71950] 0 2024-04-26T23:08:56.073 INFO:tasks.workunit.client.0.smithi148.stdout:0/192: creat d0/d8/d33/f45 x:0 0 0 2024-04-26T23:08:56.076 INFO:tasks.workunit.client.0.smithi148.stdout:6/163: rename d6/d9/d1e/f27 to d6/d9/d1c/d1d/d1f/f36 0 2024-04-26T23:08:56.077 INFO:tasks.workunit.client.0.smithi148.stdout:6/164: stat d6/d9/f15 0 2024-04-26T23:08:56.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/193: symlink d0/l46 0 2024-04-26T23:08:56.077 INFO:tasks.workunit.client.0.smithi148.stdout:1/129: creat d16/d17/f24 x:0 0 0 2024-04-26T23:08:56.077 INFO:tasks.workunit.client.0.smithi148.stdout:1/130: dread - d16/d17/f1b zero size 2024-04-26T23:08:56.085 INFO:tasks.workunit.client.0.smithi148.stdout:1/131: truncate d16/d17/f1a 1644786 0 2024-04-26T23:08:56.089 INFO:tasks.workunit.client.0.smithi148.stdout:1/132: creat d16/d17/f25 x:0 0 0 2024-04-26T23:08:56.091 INFO:tasks.workunit.client.0.smithi148.stdout:1/133: creat d16/d1c/f26 x:0 0 0 2024-04-26T23:08:56.093 INFO:tasks.workunit.client.0.smithi148.stdout:1/134: mknod d16/c27 0 2024-04-26T23:08:56.093 INFO:tasks.workunit.client.0.smithi148.stdout:1/135: fsync f5 0 2024-04-26T23:08:56.098 INFO:tasks.workunit.client.0.smithi148.stdout:4/140: dwrite fb [0,4194304] 0 2024-04-26T23:08:56.098 INFO:tasks.workunit.client.0.smithi148.stdout:9/134: dwrite fe [4194304,4194304] 0 2024-04-26T23:08:56.104 INFO:tasks.workunit.client.0.smithi148.stdout:9/135: symlink d19/l2c 0 2024-04-26T23:08:56.106 INFO:tasks.workunit.client.0.smithi148.stdout:1/136: dread f5 [0,4194304] 0 2024-04-26T23:08:56.120 INFO:tasks.workunit.client.0.smithi148.stdout:4/141: read fb [1324442,119382] 0 2024-04-26T23:08:56.120 INFO:tasks.workunit.client.0.smithi148.stdout:5/159: dwrite da/d1b/d1c/f36 [0,4194304] 0 2024-04-26T23:08:56.122 INFO:tasks.workunit.client.0.smithi148.stdout:6/165: dwrite d6/d9/d1c/d1d/d1f/f36 [0,4194304] 0 2024-04-26T23:08:56.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/160: dread da/d1b/d1c/f27 [4194304,4194304] 0 2024-04-26T23:08:56.191 INFO:tasks.workunit.client.0.smithi148.stdout:2/208: dwrite d5/d10/f19 [4194304,4194304] 0 2024-04-26T23:08:56.210 INFO:tasks.workunit.client.0.smithi148.stdout:0/194: dread d0/d8/d1e/f28 [0,4194304] 0 2024-04-26T23:08:56.219 INFO:tasks.workunit.client.0.smithi148.stdout:0/195: dread d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:08:56.224 INFO:tasks.workunit.client.0.smithi148.stdout:2/209: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:08:56.224 INFO:tasks.workunit.client.0.smithi148.stdout:6/166: dwrite d6/f19 [0,4194304] 0 2024-04-26T23:08:56.359 INFO:tasks.workunit.client.0.smithi148.stdout:9/136: creat d19/f2d x:0 0 0 2024-04-26T23:08:56.361 INFO:tasks.workunit.client.0.smithi148.stdout:1/137: creat d16/d17/f28 x:0 0 0 2024-04-26T23:08:56.361 INFO:tasks.workunit.client.0.smithi148.stdout:1/138: chown d16/d1c/f26 0 1 2024-04-26T23:08:56.362 INFO:tasks.workunit.client.0.smithi148.stdout:4/142: creat d12/f24 x:0 0 0 2024-04-26T23:08:56.371 INFO:tasks.workunit.client.0.smithi148.stdout:5/161: mknod da/d1b/d1c/c38 0 2024-04-26T23:08:56.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/210: creat d5/d8/d15/d43/f49 x:0 0 0 2024-04-26T23:08:56.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/211: write d5/d8/d15/f45 [570428,95466] 0 2024-04-26T23:08:56.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/212: chown d5/d7/f24 238197 1 2024-04-26T23:08:56.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/213: chown l3 2 1 2024-04-26T23:08:56.387 INFO:tasks.workunit.client.0.smithi148.stdout:2/214: truncate d5/f2d 966499 0 2024-04-26T23:08:56.388 INFO:tasks.workunit.client.0.smithi148.stdout:2/215: write d5/d10/f14 [1076240,32644] 0 2024-04-26T23:08:56.388 INFO:tasks.workunit.client.0.smithi148.stdout:2/216: truncate d5/d1c/f2f 859290 0 2024-04-26T23:08:56.388 INFO:tasks.workunit.client.0.smithi148.stdout:6/167: rmdir d6/d9/d1e 39 2024-04-26T23:08:56.388 INFO:tasks.workunit.client.0.smithi148.stdout:6/168: fsync d6/d9/d1c/f2e 0 2024-04-26T23:08:56.396 INFO:tasks.workunit.client.0.smithi148.stdout:9/137: link d19/d1d/f21 d19/f2e 0 2024-04-26T23:08:56.397 INFO:tasks.workunit.client.0.smithi148.stdout:1/139: rmdir d16/d1c 39 2024-04-26T23:08:56.400 INFO:tasks.workunit.client.0.smithi148.stdout:4/143: symlink d12/d17/l25 0 2024-04-26T23:08:56.400 INFO:tasks.workunit.client.0.smithi148.stdout:4/144: write d12/f24 [1007789,31305] 0 2024-04-26T23:08:56.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/117: sync 2024-04-26T23:08:56.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/118: chown d9/d15/f1b 8608654 1 2024-04-26T23:08:56.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/162: creat da/d25/f39 x:0 0 0 2024-04-26T23:08:56.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/163: fdatasync da/d1b/d2d/f37 0 2024-04-26T23:08:56.405 INFO:tasks.workunit.client.0.smithi148.stdout:8/181: sync 2024-04-26T23:08:56.405 INFO:tasks.workunit.client.0.smithi148.stdout:0/196: sync 2024-04-26T23:08:56.405 INFO:tasks.workunit.client.0.smithi148.stdout:7/153: sync 2024-04-26T23:08:56.405 INFO:tasks.workunit.client.0.smithi148.stdout:7/154: truncate d7/d11/f18 103367 0 2024-04-26T23:08:56.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/217: creat d5/d8/d9/f4a x:0 0 0 2024-04-26T23:08:56.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/218: truncate d5/d1c/d38/f47 1366879 0 2024-04-26T23:08:56.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/219: readlink d5/la 0 2024-04-26T23:08:56.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/220: truncate d5/d1c/f2f 1444781 0 2024-04-26T23:08:56.407 INFO:tasks.workunit.client.0.smithi148.stdout:9/138: mkdir d19/d1d/d25/d2f 0 2024-04-26T23:08:56.410 INFO:tasks.workunit.client.0.smithi148.stdout:1/140: rename fa to d16/d1c/f29 0 2024-04-26T23:08:56.410 INFO:tasks.workunit.client.0.smithi148.stdout:4/145: rmdir d12 39 2024-04-26T23:08:56.412 INFO:tasks.workunit.client.0.smithi148.stdout:3/119: creat d9/d15/f25 x:0 0 0 2024-04-26T23:08:56.413 INFO:tasks.workunit.client.0.smithi148.stdout:3/120: rename d9 to d9/d26 22 2024-04-26T23:08:56.416 INFO:tasks.workunit.client.0.smithi148.stdout:8/182: dread d3/da/f18 [0,4194304] 0 2024-04-26T23:08:56.416 INFO:tasks.workunit.client.0.smithi148.stdout:2/221: mkdir d5/d8/d4b 0 2024-04-26T23:08:56.417 INFO:tasks.workunit.client.0.smithi148.stdout:9/139: mkdir d19/d1d/d30 0 2024-04-26T23:08:56.421 INFO:tasks.workunit.client.0.smithi148.stdout:8/183: dread d3/d9/d12/d15/f2f [0,4194304] 0 2024-04-26T23:08:56.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/222: mkdir d5/d2c/d32/d4c 0 2024-04-26T23:08:56.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/146: creat d12/d1a/d1f/f26 x:0 0 0 2024-04-26T23:08:56.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/223: write d5/f16 [5038157,25332] 0 2024-04-26T23:08:56.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/140: unlink d19/d1d/f1f 0 2024-04-26T23:08:56.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/141: write f2 [2729450,20060] 0 2024-04-26T23:08:56.435 INFO:tasks.workunit.client.0.smithi148.stdout:8/184: mkdir d3/d9/d12/d23/d35 0 2024-04-26T23:08:56.435 INFO:tasks.workunit.client.0.smithi148.stdout:8/185: readlink d3/d9/d12/l1f 0 2024-04-26T23:08:56.441 INFO:tasks.workunit.client.0.smithi148.stdout:0/197: write d0/d20/f40 [205688,6530] 0 2024-04-26T23:08:56.441 INFO:tasks.workunit.client.0.smithi148.stdout:2/224: symlink d5/d8/d15/d43/l4d 0 2024-04-26T23:08:56.442 INFO:tasks.workunit.client.0.smithi148.stdout:4/147: creat d12/d1a/d1f/f27 x:0 0 0 2024-04-26T23:08:56.442 INFO:tasks.workunit.client.0.smithi148.stdout:4/148: readlink l11 0 2024-04-26T23:08:56.442 INFO:tasks.workunit.client.0.smithi148.stdout:4/149: fdatasync d12/d1a/d1f/f27 0 2024-04-26T23:08:56.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/142: mkdir d19/d1d/d25/d31 0 2024-04-26T23:08:56.445 INFO:tasks.workunit.client.0.smithi148.stdout:8/186: truncate d3/da/f27 337226 0 2024-04-26T23:08:56.453 INFO:tasks.workunit.client.0.smithi148.stdout:0/198: mknod d0/d5/c47 0 2024-04-26T23:08:56.453 INFO:tasks.workunit.client.0.smithi148.stdout:8/187: unlink d3/d9/d12/c2d 0 2024-04-26T23:08:56.453 INFO:tasks.workunit.client.0.smithi148.stdout:6/169: dwrite d6/f33 [0,4194304] 0 2024-04-26T23:08:56.455 INFO:tasks.workunit.client.0.smithi148.stdout:8/188: getdents d3/d9/d12/d15 0 2024-04-26T23:08:56.458 INFO:tasks.workunit.client.0.smithi148.stdout:1/141: dwrite f7 [0,4194304] 0 2024-04-26T23:08:56.458 INFO:tasks.workunit.client.0.smithi148.stdout:1/142: chown f5 0 1 2024-04-26T23:08:56.460 INFO:tasks.workunit.client.0.smithi148.stdout:9/143: fsync d19/d1d/f21 0 2024-04-26T23:08:56.460 INFO:tasks.workunit.client.0.smithi148.stdout:6/170: truncate d6/fe 2471018 0 2024-04-26T23:08:56.466 INFO:tasks.workunit.client.0.smithi148.stdout:5/164: dwrite da/d1b/d1c/f36 [0,4194304] 0 2024-04-26T23:08:56.477 INFO:tasks.workunit.client.0.smithi148.stdout:3/121: dread d9/f11 [0,4194304] 0 2024-04-26T23:08:56.484 INFO:tasks.workunit.client.0.smithi148.stdout:7/155: dwrite d7/d11/f34 [0,4194304] 0 2024-04-26T23:08:56.485 INFO:tasks.workunit.client.0.smithi148.stdout:4/150: write d12/f14 [5384851,119584] 0 2024-04-26T23:08:56.711 INFO:tasks.workunit.client.0.smithi148.stdout:8/189: symlink d3/l36 0 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:1/143: mkdir d16/d2a 0 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:0/199: mkdir d0/d8/d33/d43/d48 0 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:2/225: getdents d5/d8/d9 0 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:2/226: chown d5/d1c 3 1 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:9/144: rmdir d19/d1d 39 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:6/171: rename c5 to d6/d9/d1c/d1d/c37 0 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:6/172: chown d6/d9/d1c/d1d/d1f/f36 5693100 1 2024-04-26T23:08:56.712 INFO:tasks.workunit.client.0.smithi148.stdout:9/145: read ff [528809,12189] 0 2024-04-26T23:08:56.723 INFO:tasks.workunit.client.0.smithi148.stdout:5/165: creat da/d25/f3a x:0 0 0 2024-04-26T23:08:56.723 INFO:tasks.workunit.client.0.smithi148.stdout:3/122: creat d9/d15/f27 x:0 0 0 2024-04-26T23:08:56.724 INFO:tasks.workunit.client.0.smithi148.stdout:7/156: creat d7/d11/d17/f3c x:0 0 0 2024-04-26T23:08:56.728 INFO:tasks.workunit.client.0.smithi148.stdout:4/151: creat d12/d1c/f28 x:0 0 0 2024-04-26T23:08:56.728 INFO:tasks.workunit.client.0.smithi148.stdout:4/152: fdatasync f8 0 2024-04-26T23:08:56.730 INFO:tasks.workunit.client.0.smithi148.stdout:2/227: mkdir d5/d8/d4b/d4e 0 2024-04-26T23:08:56.730 INFO:tasks.workunit.client.0.smithi148.stdout:2/228: dread - d5/d2c/f3a zero size 2024-04-26T23:08:56.732 INFO:tasks.workunit.client.0.smithi148.stdout:5/166: rmdir da/d1b/d2d 39 2024-04-26T23:08:56.737 INFO:tasks.workunit.client.0.smithi148.stdout:3/123: creat d9/d15/f28 x:0 0 0 2024-04-26T23:08:56.737 INFO:tasks.workunit.client.0.smithi148.stdout:3/124: read - d9/d15/f25 zero size 2024-04-26T23:08:56.738 INFO:tasks.workunit.client.0.smithi148.stdout:8/190: dread d3/d9/d12/d15/f20 [0,4194304] 0 2024-04-26T23:08:56.751 INFO:tasks.workunit.client.0.smithi148.stdout:2/229: rename d5/d2c/l31 to d5/d1c/l4f 0 2024-04-26T23:08:56.751 INFO:tasks.workunit.client.0.smithi148.stdout:7/157: mknod d7/d19/c3d 0 2024-04-26T23:08:56.751 INFO:tasks.workunit.client.0.smithi148.stdout:2/230: chown d5/d1c 17364 1 2024-04-26T23:08:56.751 INFO:tasks.workunit.client.0.smithi148.stdout:7/158: write d7/f15 [721203,13627] 0 2024-04-26T23:08:56.751 INFO:tasks.workunit.client.0.smithi148.stdout:7/159: fsync d7/d11/f18 0 2024-04-26T23:08:56.752 INFO:tasks.workunit.client.0.smithi148.stdout:5/167: mkdir da/d1b/d3b 0 2024-04-26T23:08:56.752 INFO:tasks.workunit.client.0.smithi148.stdout:5/168: stat da/d12 0 2024-04-26T23:08:56.752 INFO:tasks.workunit.client.0.smithi148.stdout:5/169: chown da/c21 113961 1 2024-04-26T23:08:56.753 INFO:tasks.workunit.client.0.smithi148.stdout:5/170: readlink da/d1a/l2e 0 2024-04-26T23:08:56.754 INFO:tasks.workunit.client.0.smithi148.stdout:3/125: mkdir d9/d15/d29 0 2024-04-26T23:08:56.755 INFO:tasks.workunit.client.0.smithi148.stdout:3/126: chown d9/d15/f19 173405595 1 2024-04-26T23:08:56.764 INFO:tasks.workunit.client.0.smithi148.stdout:7/160: symlink d7/d11/l3e 0 2024-04-26T23:08:56.764 INFO:tasks.workunit.client.0.smithi148.stdout:7/161: getdents d7/d11/d17/d2f 0 2024-04-26T23:08:56.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/127: mknod d9/d15/c2a 0 2024-04-26T23:08:56.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/128: write d9/d15/f1e [371951,28757] 0 2024-04-26T23:08:56.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/129: readlink d9/d15/l1d 0 2024-04-26T23:08:56.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/130: fsync d9/d15/f19 0 2024-04-26T23:08:56.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/131: write d9/d15/f27 [490202,93619] 0 2024-04-26T23:08:56.766 INFO:tasks.workunit.client.0.smithi148.stdout:3/132: chown d9/d15/d29 97 1 2024-04-26T23:08:56.777 INFO:tasks.workunit.client.0.smithi148.stdout:3/133: mknod d9/c2b 0 2024-04-26T23:08:56.777 INFO:tasks.workunit.client.0.smithi148.stdout:3/134: truncate d9/d15/f25 504484 0 2024-04-26T23:08:56.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/153: dwrite d12/d1a/f23 [0,4194304] 0 2024-04-26T23:08:56.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/154: chown fd 263366 1 2024-04-26T23:08:56.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/155: write d12/f14 [3735213,78812] 0 2024-04-26T23:08:56.782 INFO:tasks.workunit.client.0.smithi148.stdout:9/146: dwrite d19/f2d [0,4194304] 0 2024-04-26T23:08:56.782 INFO:tasks.workunit.client.0.smithi148.stdout:9/147: chown d19/d1d/d25/l27 0 1 2024-04-26T23:08:56.786 INFO:tasks.workunit.client.0.smithi148.stdout:3/135: mknod d9/c2c 0 2024-04-26T23:08:56.786 INFO:tasks.workunit.client.0.smithi148.stdout:7/162: dread d7/d11/d13/f1f [0,4194304] 0 2024-04-26T23:08:56.792 INFO:tasks.workunit.client.0.smithi148.stdout:9/148: write ff [40166,27673] 0 2024-04-26T23:08:56.792 INFO:tasks.workunit.client.0.smithi148.stdout:4/156: truncate fd 3791263 0 2024-04-26T23:08:56.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/191: dwrite d3/d9/f30 [0,4194304] 0 2024-04-26T23:08:56.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/192: chown d3/f5 17514 1 2024-04-26T23:08:56.796 INFO:tasks.workunit.client.0.smithi148.stdout:5/171: dread da/fc [0,4194304] 0 2024-04-26T23:08:56.798 INFO:tasks.workunit.client.0.smithi148.stdout:8/193: dread d3/d9/d12/d15/f2f [0,4194304] 0 2024-04-26T23:08:56.801 INFO:tasks.workunit.client.0.smithi148.stdout:3/136: creat d9/f2d x:0 0 0 2024-04-26T23:08:56.801 INFO:tasks.workunit.client.0.smithi148.stdout:2/231: dwrite d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:08:56.801 INFO:tasks.workunit.client.0.smithi148.stdout:9/149: mkdir d19/d1d/d25/d31/d32 0 2024-04-26T23:08:56.805 INFO:tasks.workunit.client.0.smithi148.stdout:1/144: write d16/d17/f1a [1076388,5797] 0 2024-04-26T23:08:56.805 INFO:tasks.workunit.client.0.smithi148.stdout:0/200: dwrite d0/d8/f42 [0,4194304] 0 2024-04-26T23:08:56.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/201: write d0/d8/d1e/f28 [3276567,33054] 0 2024-04-26T23:08:56.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/202: dread - d0/d20/d3b/f3c zero size 2024-04-26T23:08:56.806 INFO:tasks.workunit.client.0.smithi148.stdout:9/150: dread d19/f1e [0,4194304] 0 2024-04-26T23:08:56.806 INFO:tasks.workunit.client.0.smithi148.stdout:8/194: mkdir d3/d9/d12/d23/d29/d37 0 2024-04-26T23:08:56.808 INFO:tasks.workunit.client.0.smithi148.stdout:3/137: creat d9/f2e x:0 0 0 2024-04-26T23:08:56.815 INFO:tasks.workunit.client.0.smithi148.stdout:1/145: mkdir d16/d2a/d2b 0 2024-04-26T23:08:56.817 INFO:tasks.workunit.client.0.smithi148.stdout:0/203: rename d0/d8/d1e/c25 to d0/d8/d33/c49 0 2024-04-26T23:08:56.821 INFO:tasks.workunit.client.0.smithi148.stdout:1/146: creat d16/d1c/f2c x:0 0 0 2024-04-26T23:08:56.823 INFO:tasks.workunit.client.0.smithi148.stdout:0/204: unlink d0/f12 0 2024-04-26T23:08:56.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/205: symlink d0/d8/l4a 0 2024-04-26T23:08:56.829 INFO:tasks.workunit.client.0.smithi148.stdout:0/206: mknod d0/c4b 0 2024-04-26T23:08:56.829 INFO:tasks.workunit.client.0.smithi148.stdout:3/138: dread d9/d15/f19 [0,4194304] 0 2024-04-26T23:08:56.831 INFO:tasks.workunit.client.0.smithi148.stdout:3/139: symlink d9/l2f 0 2024-04-26T23:08:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/140: write d9/f2d [912337,22975] 0 2024-04-26T23:08:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/141: readlink d9/la 0 2024-04-26T23:08:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/142: dread - d9/d15/f24 zero size 2024-04-26T23:08:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/143: dread - d9/d15/f24 zero size 2024-04-26T23:08:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/144: fdatasync d9/f11 0 2024-04-26T23:08:56.844 INFO:tasks.workunit.client.0.smithi148.stdout:7/163: dwrite d7/fb [0,4194304] 0 2024-04-26T23:08:56.846 INFO:tasks.workunit.client.0.smithi148.stdout:7/164: dread d7/d11/d13/f21 [0,4194304] 0 2024-04-26T23:08:56.867 INFO:tasks.workunit.client.0.smithi148.stdout:3/145: fsync d9/d15/f27 0 2024-04-26T23:08:56.867 INFO:tasks.workunit.client.0.smithi148.stdout:3/146: stat d9/l17 0 2024-04-26T23:08:56.869 INFO:tasks.workunit.client.0.smithi148.stdout:4/157: dwrite d12/d1a/d1f/f26 [0,4194304] 0 2024-04-26T23:08:56.870 INFO:tasks.workunit.client.0.smithi148.stdout:5/172: dread f3 [0,4194304] 0 2024-04-26T23:08:56.870 INFO:tasks.workunit.client.0.smithi148.stdout:5/173: write da/d1f/f26 [1367030,53857] 0 2024-04-26T23:08:56.879 INFO:tasks.workunit.client.0.smithi148.stdout:4/158: creat d12/d1a/f29 x:0 0 0 2024-04-26T23:08:56.879 INFO:tasks.workunit.client.0.smithi148.stdout:5/174: rename da/d1b/l34 to da/d1a/l3c 0 2024-04-26T23:08:56.879 INFO:tasks.workunit.client.0.smithi148.stdout:5/175: truncate da/d1b/d1c/f27 1478016 0 2024-04-26T23:08:56.885 INFO:tasks.workunit.client.0.smithi148.stdout:7/165: dread d7/f9 [0,4194304] 0 2024-04-26T23:08:56.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/166: getdents d7/d11/d29/d2e 0 2024-04-26T23:08:56.897 INFO:tasks.workunit.client.0.smithi148.stdout:8/195: dread d3/d9/f30 [0,4194304] 0 2024-04-26T23:08:56.899 INFO:tasks.workunit.client.0.smithi148.stdout:9/151: dread ff [0,4194304] 0 2024-04-26T23:08:56.899 INFO:tasks.workunit.client.0.smithi148.stdout:7/167: symlink d7/l3f 0 2024-04-26T23:08:56.900 INFO:tasks.workunit.client.0.smithi148.stdout:8/196: creat d3/da/d28/f38 x:0 0 0 2024-04-26T23:08:56.901 INFO:tasks.workunit.client.0.smithi148.stdout:9/152: mkdir d19/d1d/d30/d33 0 2024-04-26T23:08:56.903 INFO:tasks.workunit.client.0.smithi148.stdout:8/197: link d3/d9/d12/l11 d3/d9/l39 0 2024-04-26T23:08:56.903 INFO:tasks.workunit.client.0.smithi148.stdout:0/207: dwrite d0/d5/f2c [0,4194304] 0 2024-04-26T23:08:56.903 INFO:tasks.workunit.client.0.smithi148.stdout:9/153: mknod d19/d1d/d25/c34 0 2024-04-26T23:08:56.907 INFO:tasks.workunit.client.0.smithi148.stdout:0/208: rename d0/c18 to d0/d5/c4c 0 2024-04-26T23:08:56.907 INFO:tasks.workunit.client.0.smithi148.stdout:9/154: symlink d19/l35 0 2024-04-26T23:08:56.909 INFO:tasks.workunit.client.0.smithi148.stdout:9/155: mknod d19/d1d/d25/c36 0 2024-04-26T23:08:56.909 INFO:tasks.workunit.client.0.smithi148.stdout:9/156: chown d19/f2d 16083925 1 2024-04-26T23:08:56.913 INFO:tasks.workunit.client.0.smithi148.stdout:9/157: link d19/c1b d19/d1d/d25/d31/d32/c37 0 2024-04-26T23:08:56.914 INFO:tasks.workunit.client.0.smithi148.stdout:9/158: mknod d19/d1d/d30/d33/c38 0 2024-04-26T23:08:56.915 INFO:tasks.workunit.client.0.smithi148.stdout:9/159: mkdir d19/d39 0 2024-04-26T23:08:56.924 INFO:tasks.workunit.client.0.smithi148.stdout:8/198: getdents d3/d9 0 2024-04-26T23:08:56.925 INFO:tasks.workunit.client.0.smithi148.stdout:8/199: chown d3 1236 1 2024-04-26T23:08:56.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/200: symlink d3/da/l3a 0 2024-04-26T23:08:56.928 INFO:tasks.workunit.client.0.smithi148.stdout:8/201: rename d3/da/cd to d3/da/d1c/c3b 0 2024-04-26T23:08:56.931 INFO:tasks.workunit.client.0.smithi148.stdout:4/159: dwrite d12/d1a/d1f/f27 [0,4194304] 0 2024-04-26T23:08:56.941 INFO:tasks.workunit.client.0.smithi148.stdout:8/202: unlink d3/d9/d12/l11 0 2024-04-26T23:08:56.941 INFO:tasks.workunit.client.0.smithi148.stdout:9/160: getdents d19 0 2024-04-26T23:08:56.941 INFO:tasks.workunit.client.0.smithi148.stdout:9/161: read d19/f1a [4056942,118899] 0 2024-04-26T23:08:56.941 INFO:tasks.workunit.client.0.smithi148.stdout:9/162: stat d19/l2c 0 2024-04-26T23:08:56.942 INFO:tasks.workunit.client.0.smithi148.stdout:9/163: write d19/f20 [564446,52130] 0 2024-04-26T23:08:56.942 INFO:tasks.workunit.client.0.smithi148.stdout:9/164: truncate f18 5024532 0 2024-04-26T23:08:56.943 INFO:tasks.workunit.client.0.smithi148.stdout:9/165: write d19/d22/f26 [69929,67636] 0 2024-04-26T23:08:56.944 INFO:tasks.workunit.client.0.smithi148.stdout:5/176: dwrite da/f10 [0,4194304] 0 2024-04-26T23:08:56.946 INFO:tasks.workunit.client.0.smithi148.stdout:4/160: mkdir d12/d17/d2a 0 2024-04-26T23:08:56.946 INFO:tasks.workunit.client.0.smithi148.stdout:8/203: creat d3/f3c x:0 0 0 2024-04-26T23:08:56.951 INFO:tasks.workunit.client.0.smithi148.stdout:5/177: link c9 da/d1f/c3d 0 2024-04-26T23:08:56.951 INFO:tasks.workunit.client.0.smithi148.stdout:5/178: truncate da/d1f/f26 1646747 0 2024-04-26T23:08:56.952 INFO:tasks.workunit.client.0.smithi148.stdout:4/161: truncate d12/d1a/f23 3550260 0 2024-04-26T23:08:56.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/209: dwrite d0/d8/d17/f30 [0,4194304] 0 2024-04-26T23:08:56.957 INFO:tasks.workunit.client.0.smithi148.stdout:5/179: creat da/f3e x:0 0 0 2024-04-26T23:08:56.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/210: mknod d0/d8/d17/c4d 0 2024-04-26T23:08:56.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/211: mkdir d0/d8/d33/d43/d4e 0 2024-04-26T23:08:56.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/212: creat d0/d8/f4f x:0 0 0 2024-04-26T23:08:56.959 INFO:tasks.workunit.client.0.smithi148.stdout:0/213: unlink d0/d8/d1e/l21 0 2024-04-26T23:08:56.969 INFO:tasks.workunit.client.0.smithi148.stdout:5/180: dread da/f18 [0,4194304] 0 2024-04-26T23:08:56.970 INFO:tasks.workunit.client.0.smithi148.stdout:5/181: creat da/f3f x:0 0 0 2024-04-26T23:08:56.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/182: creat da/d25/f40 x:0 0 0 2024-04-26T23:08:56.974 INFO:tasks.workunit.client.0.smithi148.stdout:5/183: rename da/l31 to da/d25/l41 0 2024-04-26T23:08:56.977 INFO:tasks.workunit.client.0.smithi148.stdout:5/184: mknod da/d25/c42 0 2024-04-26T23:08:56.977 INFO:tasks.workunit.client.0.smithi148.stdout:5/185: getdents da/d1b/d3b 0 2024-04-26T23:08:56.980 INFO:tasks.workunit.client.0.smithi148.stdout:5/186: link da/d25/c42 da/d1f/c43 0 2024-04-26T23:08:56.980 INFO:tasks.workunit.client.0.smithi148.stdout:5/187: dread - da/d12/f35 zero size 2024-04-26T23:08:57.008 INFO:tasks.workunit.client.0.smithi148.stdout:1/147: dwrite d16/d17/f1a [0,4194304] 0 2024-04-26T23:08:57.008 INFO:tasks.workunit.client.0.smithi148.stdout:1/148: chown d16/f20 10804 1 2024-04-26T23:08:57.011 INFO:tasks.workunit.client.0.smithi148.stdout:1/149: creat d16/d17/f2d x:0 0 0 2024-04-26T23:08:57.013 INFO:tasks.workunit.client.0.smithi148.stdout:1/150: symlink d16/d1c/l2e 0 2024-04-26T23:08:57.022 INFO:tasks.workunit.client.0.smithi148.stdout:6/173: sync 2024-04-26T23:08:57.023 INFO:tasks.workunit.client.0.smithi148.stdout:6/174: symlink d6/d9/d1c/d1d/d1f/l38 0 2024-04-26T23:08:57.024 INFO:tasks.workunit.client.0.smithi148.stdout:6/175: write d6/d9/f15 [1790981,22585] 0 2024-04-26T23:08:57.024 INFO:tasks.workunit.client.0.smithi148.stdout:6/176: dread - d6/dc/f34 zero size 2024-04-26T23:08:57.024 INFO:tasks.workunit.client.0.smithi148.stdout:6/177: write d6/dc/f34 [518871,114312] 0 2024-04-26T23:08:57.046 INFO:tasks.workunit.client.0.smithi148.stdout:1/151: dwrite d16/d1c/f29 [0,4194304] 0 2024-04-26T23:08:57.049 INFO:tasks.workunit.client.0.smithi148.stdout:7/168: dwrite d7/d11/f16 [0,4194304] 0 2024-04-26T23:08:57.049 INFO:tasks.workunit.client.0.smithi148.stdout:1/152: link d16/d17/f1a d16/d2a/f2f 0 2024-04-26T23:08:57.053 INFO:tasks.workunit.client.0.smithi148.stdout:7/169: creat d7/d11/d17/d2f/f40 x:0 0 0 2024-04-26T23:08:57.054 INFO:tasks.workunit.client.0.smithi148.stdout:1/153: creat d16/f30 x:0 0 0 2024-04-26T23:08:57.054 INFO:tasks.workunit.client.0.smithi148.stdout:1/154: write d16/d1c/f22 [4954180,28855] 0 2024-04-26T23:08:57.055 INFO:tasks.workunit.client.0.smithi148.stdout:1/155: dread - d16/d17/f25 zero size 2024-04-26T23:08:57.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/156: truncate d16/d2a/f2f 1520853 0 2024-04-26T23:08:57.065 INFO:tasks.workunit.client.0.smithi148.stdout:1/157: link d16/f30 d16/d2a/d2b/f31 0 2024-04-26T23:08:57.065 INFO:tasks.workunit.client.0.smithi148.stdout:1/158: dread - d16/f30 zero size 2024-04-26T23:08:57.076 INFO:tasks.workunit.client.0.smithi148.stdout:9/166: dwrite f18 [0,4194304] 0 2024-04-26T23:08:57.076 INFO:tasks.workunit.client.0.smithi148.stdout:4/162: dread d12/d1a/d1f/f26 [0,4194304] 0 2024-04-26T23:08:57.076 INFO:tasks.workunit.client.0.smithi148.stdout:4/163: stat f8 0 2024-04-26T23:08:57.077 INFO:tasks.workunit.client.0.smithi148.stdout:9/167: getdents d19/d1d/d25/d31 0 2024-04-26T23:08:57.077 INFO:tasks.workunit.client.0.smithi148.stdout:9/168: chown c11 0 1 2024-04-26T23:08:57.077 INFO:tasks.workunit.client.0.smithi148.stdout:9/169: chown d19/d1d/d25/c36 49404015 1 2024-04-26T23:08:57.078 INFO:tasks.workunit.client.0.smithi148.stdout:9/170: rename d19/f1a to d19/d1d/f3a 0 2024-04-26T23:08:57.080 INFO:tasks.workunit.client.0.smithi148.stdout:9/171: unlink d19/f20 0 2024-04-26T23:08:57.080 INFO:tasks.workunit.client.0.smithi148.stdout:9/172: readlink d19/l2c 0 2024-04-26T23:08:57.082 INFO:tasks.workunit.client.0.smithi148.stdout:9/173: creat d19/d1d/f3b x:0 0 0 2024-04-26T23:08:57.082 INFO:tasks.workunit.client.0.smithi148.stdout:9/174: chown d19/f2d 25570 1 2024-04-26T23:08:57.082 INFO:tasks.workunit.client.0.smithi148.stdout:9/175: stat d19/d1d/d25/f29 0 2024-04-26T23:08:57.084 INFO:tasks.workunit.client.0.smithi148.stdout:9/176: link c11 d19/d1d/d25/d31/c3c 0 2024-04-26T23:08:57.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/164: read d12/d1a/f23 [144456,34318] 0 2024-04-26T23:08:57.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/177: getdents d19/d1d 0 2024-04-26T23:08:57.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/178: write d19/d1d/f3a [807975,100353] 0 2024-04-26T23:08:57.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/179: fdatasync d19/d22/f26 0 2024-04-26T23:08:57.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/180: dread - d19/d1d/f3b zero size 2024-04-26T23:08:57.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/165: rmdir d12/d1c 39 2024-04-26T23:08:57.093 INFO:tasks.workunit.client.0.smithi148.stdout:9/181: creat d19/d1d/d25/d2f/f3d x:0 0 0 2024-04-26T23:08:57.093 INFO:tasks.workunit.client.0.smithi148.stdout:9/182: stat d19/d1d/d30 0 2024-04-26T23:08:57.093 INFO:tasks.workunit.client.0.smithi148.stdout:9/183: chown d19/d1d/d25/c36 94 1 2024-04-26T23:08:57.104 INFO:tasks.workunit.client.0.smithi148.stdout:9/184: dread d19/d1d/f21 [0,4194304] 0 2024-04-26T23:08:57.104 INFO:tasks.workunit.client.0.smithi148.stdout:9/185: chown d19 112 1 2024-04-26T23:08:57.105 INFO:tasks.workunit.client.0.smithi148.stdout:9/186: link ff d19/d1d/d25/f3e 0 2024-04-26T23:08:57.106 INFO:tasks.workunit.client.0.smithi148.stdout:9/187: write d19/d1d/f3b [48473,111314] 0 2024-04-26T23:08:57.107 INFO:tasks.workunit.client.0.smithi148.stdout:9/188: unlink f7 0 2024-04-26T23:08:57.109 INFO:tasks.workunit.client.0.smithi148.stdout:8/204: dwrite d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:08:57.112 INFO:tasks.workunit.client.0.smithi148.stdout:8/205: link d3/d9/f24 d3/d9/d12/d23/d29/d37/f3d 0 2024-04-26T23:08:57.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/188: dread da/fb [0,4194304] 0 2024-04-26T23:08:57.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/189: fsync da/d1a/f1e 0 2024-04-26T23:08:57.127 INFO:tasks.workunit.client.0.smithi148.stdout:5/190: getdents da/d1a 0 2024-04-26T23:08:57.129 INFO:tasks.workunit.client.0.smithi148.stdout:5/191: link c2 da/d1b/d1c/c44 0 2024-04-26T23:08:57.145 INFO:tasks.workunit.client.0.smithi148.stdout:7/170: dwrite d7/d11/f16 [0,4194304] 0 2024-04-26T23:08:57.159 INFO:tasks.workunit.client.0.smithi148.stdout:9/189: dread f2 [0,4194304] 0 2024-04-26T23:08:57.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/206: dwrite d3/d9/d12/d15/f2f [0,4194304] 0 2024-04-26T23:08:57.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/207: stat d3/da/c2e 0 2024-04-26T23:08:57.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/208: creat d3/d9/d12/d23/d29/d37/f3e x:0 0 0 2024-04-26T23:08:57.165 INFO:tasks.workunit.client.0.smithi148.stdout:8/209: creat d3/d9/d12/f3f x:0 0 0 2024-04-26T23:08:57.165 INFO:tasks.workunit.client.0.smithi148.stdout:4/166: dread d12/d17/f18 [0,4194304] 0 2024-04-26T23:08:57.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/210: unlink d3/d9/d12/d15/f2f 0 2024-04-26T23:08:57.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/211: fsync d3/da/f18 0 2024-04-26T23:08:57.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/212: write d3/d9/d12/f3f [80101,60931] 0 2024-04-26T23:08:57.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/213: chown d3/f3c 5016426 1 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:8/214: rmdir d3/d9 39 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:5/192: write da/fb [1426546,116421] 0 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:5/193: fdatasync da/d12/f17 0 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:6/178: dwrite d6/dc/f34 [0,4194304] 0 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:6/179: chown d6/d9/d1c/d1d 8 1 2024-04-26T23:08:57.174 INFO:tasks.workunit.client.0.smithi148.stdout:5/194: write da/d25/f3a [1029280,58886] 0 2024-04-26T23:08:57.178 INFO:tasks.workunit.client.0.smithi148.stdout:8/215: dread d3/d9/d12/d15/f17 [0,4194304] 0 2024-04-26T23:08:57.182 INFO:tasks.workunit.client.0.smithi148.stdout:9/190: write d19/f2d [1283803,72940] 0 2024-04-26T23:08:57.182 INFO:tasks.workunit.client.0.smithi148.stdout:9/191: dread - f13 zero size 2024-04-26T23:08:57.190 INFO:tasks.workunit.client.0.smithi148.stdout:6/180: dread d6/fe [0,4194304] 0 2024-04-26T23:08:57.193 INFO:tasks.workunit.client.0.smithi148.stdout:5/195: dread da/d1b/d1c/f36 [0,4194304] 0 2024-04-26T23:08:57.193 INFO:tasks.workunit.client.0.smithi148.stdout:5/196: write da/f3f [820403,88644] 0 2024-04-26T23:08:57.197 INFO:tasks.workunit.client.0.smithi148.stdout:9/192: mknod d19/c3f 0 2024-04-26T23:08:57.198 INFO:tasks.workunit.client.0.smithi148.stdout:9/193: symlink d19/l40 0 2024-04-26T23:08:57.199 INFO:tasks.workunit.client.0.smithi148.stdout:9/194: truncate d19/f1e 224702 0 2024-04-26T23:08:57.199 INFO:tasks.workunit.client.0.smithi148.stdout:9/195: chown d19/d1d/d25/d2f 12021560 1 2024-04-26T23:08:57.199 INFO:tasks.workunit.client.0.smithi148.stdout:6/181: rename d6/d9/c13 to d6/d14/c39 0 2024-04-26T23:08:57.199 INFO:tasks.workunit.client.0.smithi148.stdout:6/182: write d6/d9/d1c/f2e [340510,93100] 0 2024-04-26T23:08:57.201 INFO:tasks.workunit.client.0.smithi148.stdout:9/196: link f13 d19/d1d/d25/f41 0 2024-04-26T23:08:57.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/197: dread da/d1b/d1c/f36 [0,4194304] 0 2024-04-26T23:08:57.207 INFO:tasks.workunit.client.0.smithi148.stdout:5/198: symlink da/d1b/l45 0 2024-04-26T23:08:57.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/199: readlink da/d12/l16 0 2024-04-26T23:08:57.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/200: symlink da/d25/l46 0 2024-04-26T23:08:57.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/201: chown da/d1a/c2f 2402 1 2024-04-26T23:08:57.213 INFO:tasks.workunit.client.0.smithi148.stdout:4/167: dwrite f10 [8388608,4194304] 0 2024-04-26T23:08:57.214 INFO:tasks.workunit.client.0.smithi148.stdout:6/183: fsync d6/d9/d1c/f2e 0 2024-04-26T23:08:57.216 INFO:tasks.workunit.client.0.smithi148.stdout:4/168: link d12/c15 d12/d17/d2a/c2b 0 2024-04-26T23:08:57.217 INFO:tasks.workunit.client.0.smithi148.stdout:6/184: dread d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:08:57.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/185: mknod d6/d9/d1c/c3a 0 2024-04-26T23:08:57.221 INFO:tasks.workunit.client.0.smithi148.stdout:6/186: rename d6/c8 to d6/d14/c3b 0 2024-04-26T23:08:57.222 INFO:tasks.workunit.client.0.smithi148.stdout:6/187: mknod d6/d14/c3c 0 2024-04-26T23:08:57.223 INFO:tasks.workunit.client.0.smithi148.stdout:5/202: dread da/d1f/f26 [0,4194304] 0 2024-04-26T23:08:57.232 INFO:tasks.workunit.client.0.smithi148.stdout:8/216: dwrite d3/da/fc [8388608,4194304] 0 2024-04-26T23:08:57.233 INFO:tasks.workunit.client.0.smithi148.stdout:8/217: mkdir d3/d9/d40 0 2024-04-26T23:08:57.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/232: sync 2024-04-26T23:08:57.255 INFO:tasks.workunit.client.0.smithi148.stdout:3/147: sync 2024-04-26T23:08:57.255 INFO:tasks.workunit.client.0.smithi148.stdout:2/233: mknod d5/d8/d4b/d4e/c50 0 2024-04-26T23:08:57.295 INFO:tasks.workunit.client.0.smithi148.stdout:3/148: dwrite d9/f2e [0,4194304] 0 2024-04-26T23:08:57.295 INFO:tasks.workunit.client.0.smithi148.stdout:3/149: fdatasync d9/d15/f28 0 2024-04-26T23:08:57.310 INFO:tasks.workunit.client.0.smithi148.stdout:3/150: dread d9/f1c [0,4194304] 0 2024-04-26T23:08:57.352 INFO:tasks.workunit.client.0.smithi148.stdout:3/151: dwrite d9/f1c [0,4194304] 0 2024-04-26T23:08:57.354 INFO:tasks.workunit.client.0.smithi148.stdout:3/152: rename d9/l2f to d9/d15/d29/l30 0 2024-04-26T23:08:57.356 INFO:tasks.workunit.client.0.smithi148.stdout:3/153: mkdir d9/d31 0 2024-04-26T23:08:57.357 INFO:tasks.workunit.client.0.smithi148.stdout:3/154: link d9/f11 d9/d31/f32 0 2024-04-26T23:08:57.358 INFO:tasks.workunit.client.0.smithi148.stdout:3/155: unlink d9/cc 0 2024-04-26T23:08:57.359 INFO:tasks.workunit.client.0.smithi148.stdout:3/156: symlink d9/d31/l33 0 2024-04-26T23:08:57.386 INFO:tasks.workunit.client.0.smithi148.stdout:9/197: dwrite d19/d1d/d25/f29 [0,4194304] 0 2024-04-26T23:08:57.387 INFO:tasks.workunit.client.0.smithi148.stdout:4/169: dwrite f8 [4194304,4194304] 0 2024-04-26T23:08:57.389 INFO:tasks.workunit.client.0.smithi148.stdout:9/198: symlink d19/d22/l42 0 2024-04-26T23:08:57.391 INFO:tasks.workunit.client.0.smithi148.stdout:9/199: rmdir d19 39 2024-04-26T23:08:57.391 INFO:tasks.workunit.client.0.smithi148.stdout:9/200: fdatasync d19/d1d/d25/f41 0 2024-04-26T23:08:57.393 INFO:tasks.workunit.client.0.smithi148.stdout:5/203: dwrite da/d1b/d1c/f30 [0,4194304] 0 2024-04-26T23:08:57.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/204: truncate da/d1b/d1c/f30 1691093 0 2024-04-26T23:08:57.403 INFO:tasks.workunit.client.0.smithi148.stdout:5/205: mkdir da/d1f/d47 0 2024-04-26T23:08:57.405 INFO:tasks.workunit.client.0.smithi148.stdout:2/234: dwrite d5/d1c/f2f [0,4194304] 0 2024-04-26T23:08:57.405 INFO:tasks.workunit.client.0.smithi148.stdout:2/235: dread - d5/d2c/d32/f42 zero size 2024-04-26T23:08:57.405 INFO:tasks.workunit.client.0.smithi148.stdout:5/206: creat da/d1b/d2d/f48 x:0 0 0 2024-04-26T23:08:57.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/236: stat d5/d2c/d32/l3c 0 2024-04-26T23:08:57.407 INFO:tasks.workunit.client.0.smithi148.stdout:2/237: mknod d5/c51 0 2024-04-26T23:08:57.409 INFO:tasks.workunit.client.0.smithi148.stdout:2/238: rmdir d5/d8/d11 39 2024-04-26T23:08:57.411 INFO:tasks.workunit.client.0.smithi148.stdout:2/239: link d5/d10/f19 d5/d8/d11/f52 0 2024-04-26T23:08:57.411 INFO:tasks.workunit.client.0.smithi148.stdout:2/240: dread - d5/d10/f48 zero size 2024-04-26T23:08:57.411 INFO:tasks.workunit.client.0.smithi148.stdout:2/241: write d5/d8/f1b [405409,81286] 0 2024-04-26T23:08:57.411 INFO:tasks.workunit.client.0.smithi148.stdout:8/218: dwrite d3/da/f18 [0,4194304] 0 2024-04-26T23:08:57.411 INFO:tasks.workunit.client.0.smithi148.stdout:3/157: dread d9/ff [0,4194304] 0 2024-04-26T23:08:57.412 INFO:tasks.workunit.client.0.smithi148.stdout:2/242: symlink d5/d2c/d32/d4c/l53 0 2024-04-26T23:08:57.412 INFO:tasks.workunit.client.0.smithi148.stdout:2/243: write d5/d17/f39 [1419475,50161] 0 2024-04-26T23:08:57.412 INFO:tasks.workunit.client.0.smithi148.stdout:2/244: dread - d5/d8/d9/f2a zero size 2024-04-26T23:08:57.414 INFO:tasks.workunit.client.0.smithi148.stdout:8/219: dread d3/d9/f24 [0,4194304] 0 2024-04-26T23:08:57.415 INFO:tasks.workunit.client.0.smithi148.stdout:3/158: truncate d9/f2d 540084 0 2024-04-26T23:08:57.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/245: unlink d5/d1c/f2f 0 2024-04-26T23:08:57.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/246: chown d5/d17/f39 196 1 2024-04-26T23:08:57.420 INFO:tasks.workunit.client.0.smithi148.stdout:8/220: creat d3/da/d1c/f41 x:0 0 0 2024-04-26T23:08:57.420 INFO:tasks.workunit.client.0.smithi148.stdout:5/207: dread da/d1b/d1c/f30 [0,4194304] 0 2024-04-26T23:08:57.428 INFO:tasks.workunit.client.0.smithi148.stdout:3/159: symlink d9/d15/l34 0 2024-04-26T23:08:57.429 INFO:tasks.workunit.client.0.smithi148.stdout:3/160: readlink d9/l17 0 2024-04-26T23:08:57.434 INFO:tasks.workunit.client.0.smithi148.stdout:5/208: write da/d1b/d1c/f36 [3025437,129898] 0 2024-04-26T23:08:57.435 INFO:tasks.workunit.client.0.smithi148.stdout:2/247: dread d5/d8/d9/fc [4194304,4194304] 0 2024-04-26T23:08:57.442 INFO:tasks.workunit.client.0.smithi148.stdout:5/209: stat c9 0 2024-04-26T23:08:57.443 INFO:tasks.workunit.client.0.smithi148.stdout:5/210: creat da/d1f/f49 x:0 0 0 2024-04-26T23:08:57.444 INFO:tasks.workunit.client.0.smithi148.stdout:5/211: stat c9 0 2024-04-26T23:08:57.444 INFO:tasks.workunit.client.0.smithi148.stdout:2/248: dread d5/d8/f1b [0,4194304] 0 2024-04-26T23:08:57.445 INFO:tasks.workunit.client.0.smithi148.stdout:5/212: unlink da/d1b/d1c/f27 0 2024-04-26T23:08:57.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/249: creat d5/d8/f54 x:0 0 0 2024-04-26T23:08:57.450 INFO:tasks.workunit.client.0.smithi148.stdout:5/213: read da/f3f [550021,58833] 0 2024-04-26T23:08:57.452 INFO:tasks.workunit.client.0.smithi148.stdout:5/214: mknod da/d25/c4a 0 2024-04-26T23:08:57.453 INFO:tasks.workunit.client.0.smithi148.stdout:5/215: mknod da/d1f/d47/c4b 0 2024-04-26T23:08:57.475 INFO:tasks.workunit.client.0.smithi148.stdout:8/221: dwrite d3/d9/d12/d23/d29/d37/f3e [0,4194304] 0 2024-04-26T23:08:57.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/214: sync 2024-04-26T23:08:57.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/215: readlink d0/d8/l9 0 2024-04-26T23:08:57.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/216: dread - d0/f24 zero size 2024-04-26T23:08:57.488 INFO:tasks.workunit.client.0.smithi148.stdout:3/161: dwrite d9/f2e [0,4194304] 0 2024-04-26T23:08:57.494 INFO:tasks.workunit.client.0.smithi148.stdout:8/222: dread d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:08:57.494 INFO:tasks.workunit.client.0.smithi148.stdout:8/223: fsync d3/d9/f30 0 2024-04-26T23:08:57.497 INFO:tasks.workunit.client.0.smithi148.stdout:8/224: creat d3/f42 x:0 0 0 2024-04-26T23:08:57.497 INFO:tasks.workunit.client.0.smithi148.stdout:8/225: chown d3/d9/d12/d15/f34 1427 1 2024-04-26T23:08:57.498 INFO:tasks.workunit.client.0.smithi148.stdout:8/226: rmdir d3/d9 39 2024-04-26T23:08:57.498 INFO:tasks.workunit.client.0.smithi148.stdout:8/227: read d3/da/f27 [152838,25877] 0 2024-04-26T23:08:57.499 INFO:tasks.workunit.client.0.smithi148.stdout:8/228: rename d3/c1e to d3/c43 0 2024-04-26T23:08:57.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/162: dread d9/f11 [0,4194304] 0 2024-04-26T23:08:57.508 INFO:tasks.workunit.client.0.smithi148.stdout:5/216: dwrite da/d12/f17 [0,4194304] 0 2024-04-26T23:08:57.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/163: getdents d9/d31 0 2024-04-26T23:08:57.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/164: rmdir d9/d15 39 2024-04-26T23:08:57.522 INFO:tasks.workunit.client.0.smithi148.stdout:3/165: symlink d9/d15/l35 0 2024-04-26T23:08:57.523 INFO:tasks.workunit.client.0.smithi148.stdout:3/166: rmdir d9/d31 39 2024-04-26T23:08:57.523 INFO:tasks.workunit.client.0.smithi148.stdout:3/167: write d9/f11 [2320905,16064] 0 2024-04-26T23:08:57.524 INFO:tasks.workunit.client.0.smithi148.stdout:3/168: truncate d9/d15/f19 1653003 0 2024-04-26T23:08:57.524 INFO:tasks.workunit.client.0.smithi148.stdout:3/169: stat d9/d15/f19 0 2024-04-26T23:08:57.538 INFO:tasks.workunit.client.0.smithi148.stdout:3/170: dread d9/f11 [0,4194304] 0 2024-04-26T23:08:57.543 INFO:tasks.workunit.client.0.smithi148.stdout:3/171: readlink d9/la 0 2024-04-26T23:08:57.543 INFO:tasks.workunit.client.0.smithi148.stdout:5/217: dread da/f19 [0,4194304] 0 2024-04-26T23:08:57.544 INFO:tasks.workunit.client.0.smithi148.stdout:5/218: getdents da 0 2024-04-26T23:08:57.545 INFO:tasks.workunit.client.0.smithi148.stdout:3/172: creat d9/f36 x:0 0 0 2024-04-26T23:08:57.546 INFO:tasks.workunit.client.0.smithi148.stdout:5/219: mkdir da/d1f/d47/d4c 0 2024-04-26T23:08:57.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/173: creat d9/d15/d29/f37 x:0 0 0 2024-04-26T23:08:57.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/174: read - d9/f36 zero size 2024-04-26T23:08:57.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/175: readlink d9/d15/l1a 0 2024-04-26T23:08:57.549 INFO:tasks.workunit.client.0.smithi148.stdout:3/176: rename d9/d31/l33 to d9/d15/l38 0 2024-04-26T23:08:57.571 INFO:tasks.workunit.client.0.smithi148.stdout:8/229: dwrite d3/d9/d12/f21 [0,4194304] 0 2024-04-26T23:08:57.571 INFO:tasks.workunit.client.0.smithi148.stdout:8/230: chown d3/d9/d12/d23 1044876591 1 2024-04-26T23:08:57.572 INFO:tasks.workunit.client.0.smithi148.stdout:8/231: unlink d3/c43 0 2024-04-26T23:08:57.574 INFO:tasks.workunit.client.0.smithi148.stdout:8/232: rename d3/da/fc to d3/f44 0 2024-04-26T23:08:57.576 INFO:tasks.workunit.client.0.smithi148.stdout:8/233: rename d3/da/f27 to d3/da/d1c/f45 0 2024-04-26T23:08:57.577 INFO:tasks.workunit.client.0.smithi148.stdout:8/234: rmdir d3/d9/d12/d23 39 2024-04-26T23:08:57.590 INFO:tasks.workunit.client.0.smithi148.stdout:5/220: dwrite da/f10 [4194304,4194304] 0 2024-04-26T23:08:57.590 INFO:tasks.workunit.client.0.smithi148.stdout:5/221: chown da/d1b/d1c/f22 0 1 2024-04-26T23:08:57.592 INFO:tasks.workunit.client.0.smithi148.stdout:5/222: creat da/d25/f4d x:0 0 0 2024-04-26T23:08:57.594 INFO:tasks.workunit.client.0.smithi148.stdout:5/223: symlink da/d25/l4e 0 2024-04-26T23:08:57.596 INFO:tasks.workunit.client.0.smithi148.stdout:5/224: mknod da/d1b/d2d/c4f 0 2024-04-26T23:08:57.597 INFO:tasks.workunit.client.0.smithi148.stdout:5/225: getdents da/d1f/d47 0 2024-04-26T23:08:57.598 INFO:tasks.workunit.client.0.smithi148.stdout:5/226: write da/d1b/d2d/f37 [160394,16246] 0 2024-04-26T23:08:57.600 INFO:tasks.workunit.client.0.smithi148.stdout:5/227: link da/d12/l16 da/d1b/l50 0 2024-04-26T23:08:57.601 INFO:tasks.workunit.client.0.smithi148.stdout:5/228: link da/d1b/d1c/c44 da/d1f/c51 0 2024-04-26T23:08:57.603 INFO:tasks.workunit.client.0.smithi148.stdout:3/177: dwrite d9/d15/f24 [0,4194304] 0 2024-04-26T23:08:57.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/171: sync 2024-04-26T23:08:57.605 INFO:tasks.workunit.client.0.smithi148.stdout:1/159: sync 2024-04-26T23:08:57.605 INFO:tasks.workunit.client.0.smithi148.stdout:6/188: sync 2024-04-26T23:08:57.611 INFO:tasks.workunit.client.0.smithi148.stdout:7/172: mkdir d7/d11/d29/d2e/d41 0 2024-04-26T23:08:57.611 INFO:tasks.workunit.client.0.smithi148.stdout:7/173: fsync d7/d11/d13/f21 0 2024-04-26T23:08:57.612 INFO:tasks.workunit.client.0.smithi148.stdout:7/174: mknod d7/d11/d13/c42 0 2024-04-26T23:08:57.612 INFO:tasks.workunit.client.0.smithi148.stdout:7/175: truncate d7/d11/f31 359950 0 2024-04-26T23:08:57.615 INFO:tasks.workunit.client.0.smithi148.stdout:7/176: mkdir d7/d11/d17/d43 0 2024-04-26T23:08:57.618 INFO:tasks.workunit.client.0.smithi148.stdout:7/177: rmdir d7/d11/d29/d2e 39 2024-04-26T23:08:57.618 INFO:tasks.workunit.client.0.smithi148.stdout:7/178: stat d7/d11/d13/c25 0 2024-04-26T23:08:57.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/229: write da/d1a/f1e [1543499,92084] 0 2024-04-26T23:08:57.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/230: read - da/d1f/f49 zero size 2024-04-26T23:08:57.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/231: fdatasync da/d1b/d1c/f22 0 2024-04-26T23:08:57.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/232: getdents da 0 2024-04-26T23:08:57.635 INFO:tasks.workunit.client.0.smithi148.stdout:5/233: write da/d1a/f28 [394132,49769] 0 2024-04-26T23:08:57.635 INFO:tasks.workunit.client.0.smithi148.stdout:5/234: chown da/d1b/l45 1323622335 1 2024-04-26T23:08:57.655 INFO:tasks.workunit.client.0.smithi148.stdout:7/179: write d7/d11/d17/f39 [1375027,123790] 0 2024-04-26T23:08:57.655 INFO:tasks.workunit.client.0.smithi148.stdout:7/180: stat d7/d11/d17/f3c 0 2024-04-26T23:08:57.655 INFO:tasks.workunit.client.0.smithi148.stdout:7/181: write d7/d11/d17/f3c [211476,25481] 0 2024-04-26T23:08:57.655 INFO:tasks.workunit.client.0.smithi148.stdout:7/182: write d7/d11/d29/d2e/f32 [517674,26227] 0 2024-04-26T23:08:57.656 INFO:tasks.workunit.client.0.smithi148.stdout:7/183: mkdir d7/d11/d17/d2f/d44 0 2024-04-26T23:08:57.666 INFO:tasks.workunit.client.0.smithi148.stdout:1/160: dwrite d16/d2a/d2b/f31 [0,4194304] 0 2024-04-26T23:08:57.667 INFO:tasks.workunit.client.0.smithi148.stdout:8/235: dwrite d3/f42 [0,4194304] 0 2024-04-26T23:08:57.670 INFO:tasks.workunit.client.0.smithi148.stdout:1/161: creat d16/d1c/f32 x:0 0 0 2024-04-26T23:08:57.673 INFO:tasks.workunit.client.0.smithi148.stdout:1/162: creat d16/d1c/f33 x:0 0 0 2024-04-26T23:08:57.675 INFO:tasks.workunit.client.0.smithi148.stdout:1/163: truncate d16/d2a/f2f 37794 0 2024-04-26T23:08:57.675 INFO:tasks.workunit.client.0.smithi148.stdout:1/164: write fd [1555428,72352] 0 2024-04-26T23:08:57.675 INFO:tasks.workunit.client.0.smithi148.stdout:1/165: fsync d16/d17/f2d 0 2024-04-26T23:08:57.683 INFO:tasks.workunit.client.0.smithi148.stdout:7/184: read d7/d19/f20 [4118936,81458] 0 2024-04-26T23:08:57.684 INFO:tasks.workunit.client.0.smithi148.stdout:7/185: rmdir d7/d11/d29/d2e 39 2024-04-26T23:08:57.685 INFO:tasks.workunit.client.0.smithi148.stdout:5/235: dwrite f6 [0,4194304] 0 2024-04-26T23:08:57.688 INFO:tasks.workunit.client.0.smithi148.stdout:8/236: dread d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:08:57.688 INFO:tasks.workunit.client.0.smithi148.stdout:8/237: stat d3/d9/d12/f21 0 2024-04-26T23:08:57.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/236: rmdir da/d1f/d47/d4c 0 2024-04-26T23:08:57.689 INFO:tasks.workunit.client.0.smithi148.stdout:3/178: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:08:57.692 INFO:tasks.workunit.client.0.smithi148.stdout:8/238: rename d3/d9/f30 to d3/d9/d12/f46 0 2024-04-26T23:08:57.692 INFO:tasks.workunit.client.0.smithi148.stdout:8/239: chown d3/da/l3a 806 1 2024-04-26T23:08:57.693 INFO:tasks.workunit.client.0.smithi148.stdout:5/237: mknod da/d1b/d2d/c52 0 2024-04-26T23:08:57.694 INFO:tasks.workunit.client.0.smithi148.stdout:3/179: rename d9/d15/c2a to d9/d15/c39 0 2024-04-26T23:08:57.696 INFO:tasks.workunit.client.0.smithi148.stdout:7/186: dread d7/d11/f16 [0,4194304] 0 2024-04-26T23:08:57.696 INFO:tasks.workunit.client.0.smithi148.stdout:8/240: creat d3/d9/d12/d23/d35/f47 x:0 0 0 2024-04-26T23:08:57.697 INFO:tasks.workunit.client.0.smithi148.stdout:5/238: getdents da/d25 0 2024-04-26T23:08:57.698 INFO:tasks.workunit.client.0.smithi148.stdout:3/180: mknod d9/d15/c3a 0 2024-04-26T23:08:57.699 INFO:tasks.workunit.client.0.smithi148.stdout:7/187: mknod d7/d11/d29/c45 0 2024-04-26T23:08:57.700 INFO:tasks.workunit.client.0.smithi148.stdout:1/166: fsync d16/d17/f1a 0 2024-04-26T23:08:57.700 INFO:tasks.workunit.client.0.smithi148.stdout:1/167: truncate d16/d17/f2d 285178 0 2024-04-26T23:08:57.713 INFO:tasks.workunit.client.0.smithi148.stdout:8/241: creat d3/d9/d12/f48 x:0 0 0 2024-04-26T23:08:57.717 INFO:tasks.workunit.client.0.smithi148.stdout:5/239: creat da/d1b/d1c/f53 x:0 0 0 2024-04-26T23:08:57.734 INFO:tasks.workunit.client.0.smithi148.stdout:7/188: dwrite d7/d11/d29/d2e/f26 [0,4194304] 0 2024-04-26T23:08:57.734 INFO:tasks.workunit.client.0.smithi148.stdout:5/240: dread f6 [0,4194304] 0 2024-04-26T23:08:57.736 INFO:tasks.workunit.client.0.smithi148.stdout:7/189: mknod d7/d11/d17/d2f/c46 0 2024-04-26T23:08:57.736 INFO:tasks.workunit.client.0.smithi148.stdout:7/190: dread - d7/f22 zero size 2024-04-26T23:08:57.736 INFO:tasks.workunit.client.0.smithi148.stdout:7/191: getdents d7/d11/d29/d2e/d41 0 2024-04-26T23:08:57.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/192: truncate d7/d19/f2d 4157981 0 2024-04-26T23:08:57.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/193: chown d7/d11/d29/c45 22526 1 2024-04-26T23:08:57.744 INFO:tasks.workunit.client.0.smithi148.stdout:5/241: truncate f6 196172 0 2024-04-26T23:08:57.745 INFO:tasks.workunit.client.0.smithi148.stdout:7/194: rmdir d7/d11/d13 39 2024-04-26T23:08:57.745 INFO:tasks.workunit.client.0.smithi148.stdout:7/195: chown d7/d11/l3e 19 1 2024-04-26T23:08:57.806 INFO:tasks.workunit.client.0.smithi148.stdout:7/196: dread d7/f15 [0,4194304] 0 2024-04-26T23:08:57.816 INFO:tasks.workunit.client.0.smithi148.stdout:7/197: dread d7/d11/d17/f39 [0,4194304] 0 2024-04-26T23:08:57.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/242: dwrite d3/d9/d12/f21 [0,4194304] 0 2024-04-26T23:08:57.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/243: chown d3/f44 220 1 2024-04-26T23:08:57.854 INFO:tasks.workunit.client.0.smithi148.stdout:7/198: dread d7/d11/f31 [0,4194304] 0 2024-04-26T23:08:57.869 INFO:tasks.workunit.client.0.smithi148.stdout:7/199: symlink d7/d11/d17/d2f/d44/l47 0 2024-04-26T23:08:57.875 INFO:tasks.workunit.client.0.smithi148.stdout:4/170: sync 2024-04-26T23:08:57.875 INFO:tasks.workunit.client.0.smithi148.stdout:4/171: truncate fb 5148672 0 2024-04-26T23:08:57.875 INFO:tasks.workunit.client.0.smithi148.stdout:4/172: chown d12/f24 663167217 1 2024-04-26T23:08:57.895 INFO:tasks.workunit.client.0.smithi148.stdout:8/244: dwrite d3/da/d1c/f41 [0,4194304] 0 2024-04-26T23:08:57.913 INFO:tasks.workunit.client.0.smithi148.stdout:5/242: dwrite da/f1d [0,4194304] 0 2024-04-26T23:08:57.916 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:08:57.917 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:08:57.917 INFO:tasks.workunit.client.0.smithi148.stdout:5/243: mkdir da/d1b/d1c/d54 0 2024-04-26T23:08:57.917 INFO:tasks.workunit.client.0.smithi148.stdout:8/245: write d3/da/d1c/f41 [2864699,51182] 0 2024-04-26T23:08:57.921 INFO:tasks.workunit.client.0.smithi148.stdout:5/244: rename da/d1f/l24 to da/d1a/l55 0 2024-04-26T23:08:57.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/173: dwrite d12/d1a/f29 [0,4194304] 0 2024-04-26T23:08:57.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/174: chown d12/d1a 15 1 2024-04-26T23:08:57.922 INFO:tasks.workunit.client.0.smithi148.stdout:8/246: creat d3/d9/f49 x:0 0 0 2024-04-26T23:08:57.924 INFO:tasks.workunit.client.0.smithi148.stdout:1/168: dwrite fd [0,4194304] 0 2024-04-26T23:08:57.925 INFO:tasks.workunit.client.0.smithi148.stdout:5/245: rename da/d1a/l33 to da/d1b/d1c/l56 0 2024-04-26T23:08:57.926 INFO:tasks.workunit.client.0.smithi148.stdout:7/200: dwrite d7/d19/f23 [0,4194304] 0 2024-04-26T23:08:57.927 INFO:tasks.workunit.client.0.smithi148.stdout:8/247: rmdir d3/d9/d12/d23 39 2024-04-26T23:08:57.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/169: symlink d16/d2a/d2b/l34 0 2024-04-26T23:08:57.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/246: creat da/d1a/f57 x:0 0 0 2024-04-26T23:08:57.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/247: write da/d25/f39 [787057,69058] 0 2024-04-26T23:08:57.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/248: fsync da/d1f/f26 0 2024-04-26T23:08:57.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/175: rename d12/d1a/d1f to d12/d2c 0 2024-04-26T23:08:57.942 INFO:tasks.workunit.client.0.smithi148.stdout:7/201: link d7/d11/f31 d7/d11/d29/d2e/d41/f48 0 2024-04-26T23:08:57.944 INFO:tasks.workunit.client.0.smithi148.stdout:1/170: creat d16/d2a/f35 x:0 0 0 2024-04-26T23:08:57.953 INFO:tasks.workunit.client.0.smithi148.stdout:8/248: dwrite d3/d9/d12/f48 [0,4194304] 0 2024-04-26T23:08:57.953 INFO:tasks.workunit.client.0.smithi148.stdout:8/249: fsync d3/da/d1c/f45 0 2024-04-26T23:08:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:5/249: mknod da/d1b/d2d/c58 0 2024-04-26T23:08:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/176: creat d12/d17/d2a/f2d x:0 0 0 2024-04-26T23:08:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/202: getdents d7/d11/d17/d2f/d44 0 2024-04-26T23:08:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/203: chown d7 0 1 2024-04-26T23:08:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:2/250: sync 2024-04-26T23:08:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:0/217: sync 2024-04-26T23:08:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:6/189: sync 2024-04-26T23:08:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:3/181: sync 2024-04-26T23:08:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:9/201: sync 2024-04-26T23:08:57.965 INFO:tasks.workunit.client.0.smithi148.stdout:5/250: rename da/d1f/d47/c4b to da/d1a/c59 0 2024-04-26T23:08:57.965 INFO:tasks.workunit.client.0.smithi148.stdout:7/204: creat d7/d11/d29/d2e/d41/f49 x:0 0 0 2024-04-26T23:08:57.967 INFO:tasks.workunit.client.0.smithi148.stdout:2/251: creat d5/d8/d4b/f55 x:0 0 0 2024-04-26T23:08:57.968 INFO:tasks.workunit.client.0.smithi148.stdout:3/182: rmdir d9/d31 39 2024-04-26T23:08:57.972 INFO:tasks.workunit.client.0.smithi148.stdout:9/202: creat d19/d1d/d30/f43 x:0 0 0 2024-04-26T23:08:57.976 INFO:tasks.workunit.client.0.smithi148.stdout:0/218: rename d0/f15 to d0/d2e/f50 0 2024-04-26T23:08:57.978 INFO:tasks.workunit.client.0.smithi148.stdout:3/183: creat d9/d15/d29/f3b x:0 0 0 2024-04-26T23:08:57.979 INFO:tasks.workunit.client.0.smithi148.stdout:3/184: chown d9/d15/l22 699256 1 2024-04-26T23:08:57.979 INFO:tasks.workunit.client.0.smithi148.stdout:3/185: dread - d9/d15/d29/f37 zero size 2024-04-26T23:08:57.979 INFO:tasks.workunit.client.0.smithi148.stdout:3/186: write d9/f2d [1161821,69725] 0 2024-04-26T23:08:57.980 INFO:tasks.workunit.client.0.smithi148.stdout:9/203: creat d19/d39/f44 x:0 0 0 2024-04-26T23:08:57.983 INFO:tasks.workunit.client.0.smithi148.stdout:6/190: rename d6/d9/d23/c2a to d6/dc/c3d 0 2024-04-26T23:08:57.985 INFO:tasks.workunit.client.0.smithi148.stdout:0/219: mkdir d0/d2e/d51 0 2024-04-26T23:08:57.986 INFO:tasks.workunit.client.0.smithi148.stdout:7/205: dread d7/d11/d13/f33 [0,4194304] 0 2024-04-26T23:08:57.988 INFO:tasks.workunit.client.0.smithi148.stdout:7/206: symlink d7/d11/d13/l4a 0 2024-04-26T23:08:57.990 INFO:tasks.workunit.client.0.smithi148.stdout:7/207: mknod d7/d11/d29/c4b 0 2024-04-26T23:08:57.992 INFO:tasks.workunit.client.0.smithi148.stdout:7/208: truncate d7/d11/d13/f33 2048406 0 2024-04-26T23:08:57.997 INFO:tasks.workunit.client.0.smithi148.stdout:2/252: read d5/d17/f30 [3700093,117127] 0 2024-04-26T23:08:57.997 INFO:tasks.workunit.client.0.smithi148.stdout:2/253: fdatasync d5/d2c/d32/f37 0 2024-04-26T23:08:58.004 INFO:tasks.workunit.client.0.smithi148.stdout:5/251: dread da/d12/f17 [0,4194304] 0 2024-04-26T23:08:58.004 INFO:tasks.workunit.client.0.smithi148.stdout:5/252: chown da/d1b 30942 1 2024-04-26T23:08:58.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/254: getdents d5/d8/d4b 0 2024-04-26T23:08:58.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/255: write d5/d10/f14 [308511,104833] 0 2024-04-26T23:08:58.007 INFO:tasks.workunit.client.0.smithi148.stdout:5/253: symlink da/d1b/d2d/l5a 0 2024-04-26T23:08:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:2/256: symlink d5/d7/l56 0 2024-04-26T23:08:58.013 INFO:tasks.workunit.client.0.smithi148.stdout:2/257: mknod d5/d10/c57 0 2024-04-26T23:08:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:5/254: rename da/d25 to da/d1b/d5b 0 2024-04-26T23:08:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:1/171: dwrite d16/d1c/f26 [0,4194304] 0 2024-04-26T23:08:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:2/258: creat d5/d10/f58 x:0 0 0 2024-04-26T23:08:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:2/259: dread - d5/d2c/f3a zero size 2024-04-26T23:08:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:2/260: stat d5/d8/d9/d3d 0 2024-04-26T23:08:58.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/172: symlink d16/d2a/l36 0 2024-04-26T23:08:58.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/173: fdatasync d16/d17/f2d 0 2024-04-26T23:08:58.033 INFO:tasks.workunit.client.0.smithi148.stdout:5/255: creat da/f5c x:0 0 0 2024-04-26T23:08:58.040 INFO:tasks.workunit.client.0.smithi148.stdout:4/177: dwrite fb [0,4194304] 0 2024-04-26T23:08:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:3/187: dwrite d9/f11 [0,4194304] 0 2024-04-26T23:08:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:3/188: fdatasync d9/d15/f27 0 2024-04-26T23:08:58.054 INFO:tasks.workunit.client.0.smithi148.stdout:9/204: dwrite d19/d1d/f3b [0,4194304] 0 2024-04-26T23:08:58.055 INFO:tasks.workunit.client.0.smithi148.stdout:5/256: mknod da/d1f/d47/c5d 0 2024-04-26T23:08:58.055 INFO:tasks.workunit.client.0.smithi148.stdout:5/257: readlink da/d1b/l45 0 2024-04-26T23:08:58.056 INFO:tasks.workunit.client.0.smithi148.stdout:4/178: creat d12/d17/f2e x:0 0 0 2024-04-26T23:08:58.058 INFO:tasks.workunit.client.0.smithi148.stdout:3/189: creat d9/d31/f3c x:0 0 0 2024-04-26T23:08:58.062 INFO:tasks.workunit.client.0.smithi148.stdout:5/258: mkdir da/d1b/d5b/d5e 0 2024-04-26T23:08:58.065 INFO:tasks.workunit.client.0.smithi148.stdout:4/179: rename fb to d12/d17/d2a/f2f 0 2024-04-26T23:08:58.065 INFO:tasks.workunit.client.0.smithi148.stdout:4/180: fdatasync d12/d17/f2e 0 2024-04-26T23:08:58.067 INFO:tasks.workunit.client.0.smithi148.stdout:3/190: mknod d9/d15/c3d 0 2024-04-26T23:08:58.067 INFO:tasks.workunit.client.0.smithi148.stdout:3/191: fsync d9/d15/f19 0 2024-04-26T23:08:58.068 INFO:tasks.workunit.client.0.smithi148.stdout:3/192: chown d9/f1c 13882595 1 2024-04-26T23:08:58.071 INFO:tasks.workunit.client.0.smithi148.stdout:3/193: symlink d9/l3e 0 2024-04-26T23:08:58.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/194: symlink d9/l3f 0 2024-04-26T23:08:58.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/195: truncate d9/d31/f3c 612327 0 2024-04-26T23:08:58.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/196: rmdir d9 39 2024-04-26T23:08:58.080 INFO:tasks.workunit.client.0.smithi148.stdout:3/197: rename d9/f2e to d9/f40 0 2024-04-26T23:08:58.080 INFO:tasks.workunit.client.0.smithi148.stdout:3/198: chown d9/d15/l34 1 1 2024-04-26T23:08:58.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/261: dwrite d5/d2c/d32/f37 [0,4194304] 0 2024-04-26T23:08:58.093 INFO:tasks.workunit.client.0.smithi148.stdout:3/199: dread d9/ff [0,4194304] 0 2024-04-26T23:08:58.094 INFO:tasks.workunit.client.0.smithi148.stdout:3/200: getdents d9/d31 0 2024-04-26T23:08:58.094 INFO:tasks.workunit.client.0.smithi148.stdout:3/201: mknod d9/d31/c41 0 2024-04-26T23:08:58.100 INFO:tasks.workunit.client.0.smithi148.stdout:3/202: mknod d9/d15/d29/c42 0 2024-04-26T23:08:58.114 INFO:tasks.workunit.client.0.smithi148.stdout:9/205: dwrite d19/d1d/d25/d2f/f3d [0,4194304] 0 2024-04-26T23:08:58.115 INFO:tasks.workunit.client.0.smithi148.stdout:9/206: write d19/d39/f44 [896942,34790] 0 2024-04-26T23:08:58.132 INFO:tasks.workunit.client.0.smithi148.stdout:9/207: read d19/f2e [647008,72491] 0 2024-04-26T23:08:58.135 INFO:tasks.workunit.client.0.smithi148.stdout:9/208: link d19/f1e d19/d1d/d25/d31/f45 0 2024-04-26T23:08:58.136 INFO:tasks.workunit.client.0.smithi148.stdout:9/209: mknod d19/c46 0 2024-04-26T23:08:58.136 INFO:tasks.workunit.client.0.smithi148.stdout:9/210: write d19/d1d/d25/f41 [764632,25163] 0 2024-04-26T23:08:58.141 INFO:tasks.workunit.client.0.smithi148.stdout:3/203: write d9/f1c [729442,61593] 0 2024-04-26T23:08:58.141 INFO:tasks.workunit.client.0.smithi148.stdout:3/204: readlink d9/la 0 2024-04-26T23:08:58.168 INFO:tasks.workunit.client.0.smithi148.stdout:2/262: dwrite d5/d10/f14 [0,4194304] 0 2024-04-26T23:08:58.169 INFO:tasks.workunit.client.0.smithi148.stdout:2/263: truncate d5/d8/d15/f45 56652 0 2024-04-26T23:08:58.175 INFO:tasks.workunit.client.0.smithi148.stdout:8/250: dwrite d3/da/d1c/f41 [0,4194304] 0 2024-04-26T23:08:58.178 INFO:tasks.workunit.client.0.smithi148.stdout:8/251: rmdir d3/d9/d12 39 2024-04-26T23:08:58.178 INFO:tasks.workunit.client.0.smithi148.stdout:8/252: chown d3/d9/l39 0 1 2024-04-26T23:08:58.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.178+0000 7fb5c5c00640 1 Processor -- start 2024-04-26T23:08:58.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.178+0000 7fb5c5c00640 1 -- start start 2024-04-26T23:08:58.181 INFO:tasks.workunit.client.0.smithi148.stdout:8/253: creat d3/d9/d12/d23/d29/f4a x:0 0 0 2024-04-26T23:08:58.181 INFO:tasks.workunit.client.0.smithi148.stdout:8/254: chown d3 40524948 1 2024-04-26T23:08:58.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5c5c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb5c006cea0 0x7fb5c015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5c5c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c00ca620 con 0x7fb5c00c82d0 2024-04-26T23:08:58.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5c5c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c015b820 con 0x7fb5c0151cd0 2024-04-26T23:08:58.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5c5c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c0158c10 con 0x7fb5c006cea0 2024-04-26T23:08:58.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bf400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb5c00c82d0 0x7fb5c00722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49702/0 (socket says 172.21.15.148:49702) 2024-04-26T23:08:58.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bf400640 1 -- 172.21.15.148:0/39932517 learned_addr learned my addr 172.21.15.148:0/39932517 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:58.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bea00640 1 --2- 172.21.15.148:0/39932517 >> v2:172.21.15.157:3300/0 conn(0x7fb5c006cea0 0x7fb5c015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bd600640 1 -- 172.21.15.148:0/39932517 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286317425 0 0) 0x7fb5c00ca620 con 0x7fb5c00c82d0 2024-04-26T23:08:58.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bd600640 1 -- 172.21.15.148:0/39932517 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a4003530 con 0x7fb5c00c82d0 2024-04-26T23:08:58.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bea00640 1 -- 172.21.15.148:0/39932517 >> v1:172.21.15.157:6789/0 conn(0x7fb5c0151cd0 legacy=0x7fb5c0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bea00640 1 -- 172.21.15.148:0/39932517 >> v1:172.21.15.148:6789/0 conn(0x7fb5c00c82d0 legacy=0x7fb5c00722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.182+0000 7fb5bea00640 1 -- 172.21.15.148:0/39932517 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c015bb00 con 0x7fb5c006cea0 2024-04-26T23:08:58.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.186+0000 7fb5bea00640 1 --2- 172.21.15.148:0/39932517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c006cea0 0x7fb5c015b1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097c0 tx=0x7fb5ac01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfd60d6c9ced232 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.186+0000 7fb5bd600640 1 -- 172.21.15.148:0/39932517 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0b5070 con 0x7fb5c006cea0 2024-04-26T23:08:58.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.186+0000 7fb5bd600640 1 -- 172.21.15.148:0/39932517 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0a8990 con 0x7fb5c006cea0 2024-04-26T23:08:58.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.186+0000 7fb5bd600640 1 -- 172.21.15.148:0/39932517 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0a8d60 con 0x7fb5c006cea0 2024-04-26T23:08:58.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- 172.21.15.148:0/39932517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c006cea0 msgr2=0x7fb5c015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/39932517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c006cea0 0x7fb5c015b1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097c0 tx=0x7fb5ac01ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:58.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- 172.21.15.148:0/39932517 shutdown_connections 2024-04-26T23:08:58.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/39932517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c006cea0 0x7fb5c015b1e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- 172.21.15.148:0/39932517 >> 172.21.15.148:0/39932517 conn(0x7fb5c006c380 msgr2=0x7fb5c006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- 172.21.15.148:0/39932517 shutdown_connections 2024-04-26T23:08:58.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- 172.21.15.148:0/39932517 wait complete. 2024-04-26T23:08:58.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 Processor -- start 2024-04-26T23:08:58.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- start start 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5c00c82d0 0x7fb5c00cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c0151cd0 0x7fb5c00cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0157d00 con 0x7fb5c014f780 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c015c0c0 con 0x7fb5c0151cd0 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.190+0000 7fb5c5c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c0157fe0 con 0x7fb5c00c82d0 2024-04-26T23:08:58.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54742/0 (socket says 172.21.15.148:54742) 2024-04-26T23:08:58.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 -- 172.21.15.148:0/1231357982 learned_addr learned my addr 172.21.15.148:0/1231357982 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:58.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bea00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5c00c82d0 0x7fb5c00cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5be000640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c0151cd0 0x7fb5c00cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/211: dwrite fe [4194304,4194304] 0 2024-04-26T23:08:58.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/212: write d19/f1e [240274,16466] 0 2024-04-26T23:08:58.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/213: chown d19/d22/l28 4087 1 2024-04-26T23:08:58.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/214: read - d19/d1d/d30/f43 zero size 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 -- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5c00c82d0 msgr2=0x7fb5c00cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5c00c82d0 0x7fb5c00cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 -- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c0151cd0 msgr2=0x7fb5c00cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c0151cd0 0x7fb5c00cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 -- 172.21.15.148:0/1231357982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c00cd9f0 con 0x7fb5c014f780 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5bf400640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800cb40 tx=0x7fb5b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5c014f780 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b800aca0 con 0x7fb5c014f780 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8012620 con 0x7fb5c014f780 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c00cb3e0 con 0x7fb5c014f780 2024-04-26T23:08:58.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c013bfe0 con 0x7fb5c014f780 2024-04-26T23:08:58.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.194+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c013c1e0 con 0x7fb5c014f780 2024-04-26T23:08:58.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.198+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5b801a070 con 0x7fb5c014f780 2024-04-26T23:08:58.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.198+0000 7fb5b6a00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 0x7fb5a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.198+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb5b8086b20 con 0x7fb5c014f780 2024-04-26T23:08:58.200 INFO:tasks.workunit.client.0.smithi148.stdout:3/205: dwrite d9/d31/f3c [0,4194304] 0 2024-04-26T23:08:58.200 INFO:tasks.workunit.client.0.smithi148.stdout:6/191: dwrite d6/f33 [0,4194304] 0 2024-04-26T23:08:58.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.202+0000 7fb5bea00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 0x7fb5a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.206+0000 7fb5bea00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 0x7fb5a006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0b2000 tx=0x7fb5ac008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.206+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb5c013c1e0 con 0x7fb5c014f780 2024-04-26T23:08:58.212 INFO:tasks.workunit.client.0.smithi148.stdout:6/192: write d6/fe [1717170,48168] 0 2024-04-26T23:08:58.212 INFO:tasks.workunit.client.0.smithi148.stdout:6/193: readlink d6/d9/d1c/d1d/d1f/l38 0 2024-04-26T23:08:58.212 INFO:tasks.workunit.client.0.smithi148.stdout:6/194: write d6/fe [3163297,4599] 0 2024-04-26T23:08:58.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/206: creat d9/f43 x:0 0 0 2024-04-26T23:08:58.220 INFO:tasks.workunit.client.0.smithi148.stdout:3/207: link d9/d15/c18 d9/c44 0 2024-04-26T23:08:58.263 INFO:tasks.workunit.client.0.smithi148.stdout:9/215: dwrite d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:08:58.280 INFO:tasks.workunit.client.0.smithi148.stdout:9/216: dread fe [4194304,4194304] 0 2024-04-26T23:08:58.281 INFO:tasks.workunit.client.0.smithi148.stdout:9/217: symlink d19/l47 0 2024-04-26T23:08:58.283 INFO:tasks.workunit.client.0.smithi148.stdout:9/218: mkdir d19/d1d/d25/d31/d48 0 2024-04-26T23:08:58.284 INFO:tasks.workunit.client.0.smithi148.stdout:9/219: rmdir d19/d1d/d25/d31/d32 39 2024-04-26T23:08:58.284 INFO:tasks.workunit.client.0.smithi148.stdout:9/220: truncate ff 1724225 0 2024-04-26T23:08:58.285 INFO:tasks.workunit.client.0.smithi148.stdout:9/221: mkdir d19/d1d/d49 0 2024-04-26T23:08:58.299 INFO:tasks.workunit.client.0.smithi148.stdout:7/209: dwrite d7/d11/d29/d2e/f32 [0,4194304] 0 2024-04-26T23:08:58.300 INFO:tasks.workunit.client.0.smithi148.stdout:7/210: fsync d7/d11/d29/d2e/f26 0 2024-04-26T23:08:58.308 INFO:tasks.workunit.client.0.smithi148.stdout:9/222: dread d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:08:58.317 INFO:tasks.workunit.client.0.smithi148.stdout:7/211: mknod d7/d11/d29/d2e/d41/c4c 0 2024-04-26T23:08:58.319 INFO:tasks.workunit.client.0.smithi148.stdout:9/223: creat d19/f4a x:0 0 0 2024-04-26T23:08:58.324 INFO:tasks.workunit.client.0.smithi148.stdout:7/212: mknod d7/d11/d17/c4d 0 2024-04-26T23:08:58.325 INFO:tasks.workunit.client.0.smithi148.stdout:9/224: mkdir d19/d4b 0 2024-04-26T23:08:58.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/225: write d19/d1d/f3b [2692875,22165] 0 2024-04-26T23:08:58.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/226: write d19/d1d/d25/f3e [287108,25001] 0 2024-04-26T23:08:58.350 INFO:tasks.workunit.client.0.smithi148.stdout:9/227: symlink d19/d39/l4c 0 2024-04-26T23:08:58.352 INFO:tasks.workunit.client.0.smithi148.stdout:9/228: truncate f13 1192287 0 2024-04-26T23:08:58.362 INFO:tasks.workunit.client.0.smithi148.stdout:9/229: dread d19/d1d/f21 [0,4194304] 0 2024-04-26T23:08:58.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/174: dwrite d16/d17/f1b [0,4194304] 0 2024-04-26T23:08:58.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/175: stat d16/d2a/d2b/l34 0 2024-04-26T23:08:58.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/176: chown l0 101721363 1 2024-04-26T23:08:58.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/177: chown f7 24 1 2024-04-26T23:08:58.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/178: write d16/d1c/f33 [577996,3024] 0 2024-04-26T23:08:58.440 INFO:tasks.workunit.client.0.smithi148.stdout:1/179: chown d16/c27 214094 1 2024-04-26T23:08:58.442 INFO:tasks.workunit.client.0.smithi148.stdout:1/180: rmdir d16/d1c 39 2024-04-26T23:08:58.442 INFO:tasks.workunit.client.0.smithi148.stdout:1/181: chown d16/d2a/d2b/f31 1125619 1 2024-04-26T23:08:58.444 INFO:tasks.workunit.client.0.smithi148.stdout:1/182: creat d16/f37 x:0 0 0 2024-04-26T23:08:58.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.474+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5c0077c20 con 0x7fb5c014f780 2024-04-26T23:08:58.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.474+0000 7fb5b6a00640 1 -- 172.21.15.148:0/1231357982 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb5b8056680 con 0x7fb5c014f780 2024-04-26T23:08:58.475 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 msgr2=0x7fb5a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 0x7fb5a006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0b2000 tx=0x7fb5ac008040 comp rx=0 tx=0).stop 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 msgr2=0x7fb5c01598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800cb40 tx=0x7fb5b800a060 comp rx=0 tx=0).stop 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 shutdown_connections 2024-04-26T23:08:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb5a0068380 0x7fb5a006a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c014f780 0x7fb5c01598c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5c0151cd0 0x7fb5c00cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 --2- 172.21.15.148:0/1231357982 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5c00c82d0 0x7fb5c00cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 >> 172.21.15.148:0/1231357982 conn(0x7fb5c006c380 msgr2=0x7fb5c0147fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 shutdown_connections 2024-04-26T23:08:58.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.478+0000 7fb5c5c00640 1 -- 172.21.15.148:0/1231357982 wait complete. 2024-04-26T23:08:58.503 INFO:tasks.workunit.client.0.smithi148.stdout:4/181: dwrite d12/d17/f22 [0,4194304] 0 2024-04-26T23:08:58.504 INFO:tasks.workunit.client.0.smithi148.stdout:8/255: dwrite d3/da/d1c/f41 [0,4194304] 0 2024-04-26T23:08:58.504 INFO:tasks.workunit.client.0.smithi148.stdout:8/256: readlink d3/d9/d12/d23/d29/l31 0 2024-04-26T23:08:58.505 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:08:58.505 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:08:58.505 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:08:58.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:08:58.506 INFO:tasks.workunit.client.0.smithi148.stdout:5/259: dread da/d1b/d5b/f3a [0,4194304] 0 2024-04-26T23:08:58.509 INFO:tasks.workunit.client.0.smithi148.stdout:8/257: truncate d3/da/f18 512695 0 2024-04-26T23:08:58.509 INFO:tasks.workunit.client.0.smithi148.stdout:8/258: fdatasync d3/d9/d12/d23/d35/f47 0 2024-04-26T23:08:58.514 INFO:tasks.workunit.client.0.smithi148.stdout:8/259: rmdir d3/da/d28 39 2024-04-26T23:08:58.521 INFO:tasks.workunit.client.0.smithi148.stdout:8/260: creat d3/f4b x:0 0 0 2024-04-26T23:08:58.521 INFO:tasks.workunit.client.0.smithi148.stdout:8/261: fdatasync d3/d9/d12/f3f 0 2024-04-26T23:08:58.524 INFO:tasks.workunit.client.0.smithi148.stdout:8/262: rename d3/d9/d12/d15 to d3/da/d28/d4c 0 2024-04-26T23:08:58.563 INFO:tasks.workunit.client.0.smithi148.stdout:4/182: dwrite d12/d2c/f27 [0,4194304] 0 2024-04-26T23:08:58.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/183: getdents d12/d1c 0 2024-04-26T23:08:58.596 INFO:tasks.workunit.client.0.smithi148.stdout:4/184: write d12/d1a/f29 [729282,41961] 0 2024-04-26T23:08:58.597 INFO:tasks.workunit.client.0.smithi148.stdout:4/185: mkdir d12/d17/d2a/d30 0 2024-04-26T23:08:58.627 INFO:tasks.workunit.client.0.smithi148.stdout:6/195: dwrite d6/dc/f34 [0,4194304] 0 2024-04-26T23:08:58.629 INFO:tasks.workunit.client.0.smithi148.stdout:6/196: mknod d6/d32/c3e 0 2024-04-26T23:08:58.629 INFO:tasks.workunit.client.0.smithi148.stdout:6/197: chown d6/d9/d23/c2d 3343 1 2024-04-26T23:08:58.629 INFO:tasks.workunit.client.0.smithi148.stdout:6/198: readlink d6/d9/d1c/d1d/d1f/l38 0 2024-04-26T23:08:58.629 INFO:tasks.workunit.client.0.smithi148.stdout:6/199: fdatasync d6/d9/d1c/d1d/d1f/f36 0 2024-04-26T23:08:58.630 INFO:tasks.workunit.client.0.smithi148.stdout:6/200: creat d6/dc/f3f x:0 0 0 2024-04-26T23:08:58.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 Processor -- start 2024-04-26T23:08:58.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 -- start start 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44c80c4a00 0x7f44c815d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c80c75e0 con 0x7f44c8153b90 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f44c80c5d40 con 0x7f44c80c4a00 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44ce600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f44c8153f70 con 0x7f44c80c8f00 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44cd200640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f44c8153b90 0x7f44c80c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:54976/0 (socket says 172.21.15.148:54976) 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44cd200640 1 -- 172.21.15.148:0/2815318739 learned_addr learned my addr 172.21.15.148:0/2815318739 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:58.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44cdc00640 1 --2- 172.21.15.148:0/2815318739 >> v2:172.21.15.157:3300/0 conn(0x7f44c80c4a00 0x7f44c815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44bfe00640 1 -- 172.21.15.148:0/2815318739 >> v2:172.21.15.157:3300/0 conn(0x7f44c80c4a00 msgr2=0x7f44c815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:58.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44bfe00640 1 --2- 172.21.15.148:0/2815318739 >> v2:172.21.15.157:3300/0 conn(0x7f44c80c4a00 0x7f44c815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44bfe00640 1 -- 172.21.15.148:0/2815318739 >> v1:172.21.15.157:6789/0 conn(0x7f44c8153b90 legacy=0x7f44c80c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44bfe00640 1 -- 172.21.15.148:0/2815318739 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80c78c0 con 0x7f44c80c8f00 2024-04-26T23:08:58.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.690+0000 7f44c7e00640 1 -- 172.21.15.148:0/2815318739 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746290428 0 0) 0x7f44c80c75e0 con 0x7f44c8153b90 2024-04-26T23:08:58.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44bfe00640 1 --2- 172.21.15.148:0/2815318739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c815ce10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44b00097c0 tx=0x7f44b001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4d098f102cc43e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44c7e00640 1 -- 172.21.15.148:0/2815318739 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00b5070 con 0x7f44c80c8f00 2024-04-26T23:08:58.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44c7e00640 1 -- 172.21.15.148:0/2815318739 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b00a8990 con 0x7f44c80c8f00 2024-04-26T23:08:58.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44c7e00640 1 -- 172.21.15.148:0/2815318739 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00a8d60 con 0x7f44c80c8f00 2024-04-26T23:08:58.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 -- 172.21.15.148:0/2815318739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 msgr2=0x7f44c815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 --2- 172.21.15.148:0/2815318739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c815ce10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44b00097c0 tx=0x7f44b001ec90 comp rx=0 tx=0).stop 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 -- 172.21.15.148:0/2815318739 shutdown_connections 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 --2- 172.21.15.148:0/2815318739 >> v2:172.21.15.157:3300/0 conn(0x7f44c80c4a00 0x7f44c815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 --2- 172.21.15.148:0/2815318739 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c815ce10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 -- 172.21.15.148:0/2815318739 >> 172.21.15.148:0/2815318739 conn(0x7f44c8068740 msgr2=0x7f44c806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 -- 172.21.15.148:0/2815318739 shutdown_connections 2024-04-26T23:08:58.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.694+0000 7f44ce600640 1 -- 172.21.15.148:0/2815318739 wait complete. 2024-04-26T23:08:58.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 Processor -- start 2024-04-26T23:08:58.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- start start 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 0x7f44c815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c81e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44c8153b90 0x7f44c81e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80c59d0 con 0x7f44c80c4a00 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80c56f0 con 0x7f44c8153b90 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f44c80c8510 con 0x7f44c80c8f00 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 0x7f44c815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cdc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44c8153b90 0x7f44c81e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 0x7f44c815a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54748/0 (socket says 172.21.15.148:54748) 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 -- 172.21.15.148:0/1233884851 learned_addr learned my addr 172.21.15.148:0/1233884851 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:58.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44bfe00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c81e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 msgr2=0x7f44c81e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f44c80c8f00 0x7f44c81e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44c8153b90 msgr2=0x7f44c81e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44c8153b90 0x7f44c81e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c81f2200 con 0x7f44c80c4a00 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44cd200640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 0x7f44c815a860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c440 tx=0x7f44b800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8018070 con 0x7f44c80c4a00 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b80074e0 con 0x7f44c80c4a00 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8004a10 con 0x7f44c80c4a00 2024-04-26T23:08:58.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c814fcc0 con 0x7f44c80c4a00 2024-04-26T23:08:58.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.698+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c814ff60 con 0x7f44c80c4a00 2024-04-26T23:08:58.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44ce600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 0x7f44c81486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80506d0 con 0x7f44c8145d50 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44bfe00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 0x7f44c81486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44bfe00640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44c80c8790 con 0x7f44c8145d50 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44bfe00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 0x7f44c81486a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44c8077f40 tx=0x7f44b001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00c1030 con 0x7f44c8145d50 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44b8004bb0 con 0x7f44c80c4a00 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f44a4068280 0x7f44a406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f44b8085f40 con 0x7f44c80c4a00 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44cdc00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f44a4068280 0x7f44a406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f44b00b6040 con 0x7f44c8145d50 2024-04-26T23:08:58.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 msgr2=0x7f44c81486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 0x7f44c81486a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44c8077f40 tx=0x7f44b001ba30 comp rx=0 tx=0).stop 2024-04-26T23:08:58.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 msgr2=0x7f44c81486a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:58.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44c5600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8145d50 0x7f44c81486a0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44c8077f40 tx=0x7f44b001ba30 comp rx=0 tx=0).stop 2024-04-26T23:08:58.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.702+0000 7f44cdc00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f44a4068280 0x7f44a406a740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c4e70 tx=0x7f44c000b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.710+0000 7f44ce600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 0x7f44c81e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.710+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8150540 con 0x7f44c8148be0 2024-04-26T23:08:58.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.710+0000 7f44bfe00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 0x7f44c81e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.710+0000 7f44bfe00640 1 -- 172.21.15.148:0/1233884851 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44c80698f0 con 0x7f44c8148be0 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44bfe00640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 0x7f44c81e2ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44b001d340 tx=0x7f44b0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00b5040 con 0x7f44c8148be0 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4561 (secure 0 0 0) 0x7f44b0003da0 con 0x7f44c8148be0 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 msgr2=0x7f44c81e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 0x7f44c81e2ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44b001d340 tx=0x7f44b0009190 comp rx=0 tx=0).stop 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 msgr2=0x7f44c81e2ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:58.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44c5600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c8148be0 0x7f44c81e2ed0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44b001d340 tx=0x7f44b0009190 comp rx=0 tx=0).stop 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 15527, 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:58.715 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.716 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.717 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.718 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:58.719 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.720 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:58.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.724 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:58.725 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.727 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:58.728 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:58.729 INFO:tasks.workunit.client.0.smithi148.stdout:6/201: mkdir d6/d9/d1c/d1d/d1f/d40 0 2024-04-26T23:08:58.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f44a4068280 msgr2=0x7f44a406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f44a4068280 0x7f44a406a740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c4e70 tx=0x7f44c000b040 comp rx=0 tx=0).stop 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 msgr2=0x7f44c815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 --2- 172.21.15.148:0/1233884851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44c80c4a00 0x7f44c815a860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c440 tx=0x7f44b800c900 comp rx=0 tx=0).stop 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44cdc00640 1 -- 172.21.15.148:0/1233884851 reap_dead start 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44cdc00640 1 -- 172.21.15.148:0/1233884851 reap_dead start 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 shutdown_connections 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 >> 172.21.15.148:0/1233884851 conn(0x7f44c8068740 msgr2=0x7f44c8151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 shutdown_connections 2024-04-26T23:08:58.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.714+0000 7f44ce600640 1 -- 172.21.15.148:0/1233884851 wait complete. 2024-04-26T23:08:58.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:58.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:08:58.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:08:58.776 INFO:tasks.workunit.client.0.smithi148.stdout:6/202: dwrite d6/fe [0,4194304] 0 2024-04-26T23:08:58.786 INFO:tasks.workunit.client.0.smithi148.stdout:3/208: dwrite d9/f43 [0,4194304] 0 2024-04-26T23:08:58.786 INFO:tasks.workunit.client.0.smithi148.stdout:3/209: truncate d9/d15/f1e 1132330 0 2024-04-26T23:08:58.790 INFO:tasks.workunit.client.0.smithi148.stdout:6/203: dread d6/fe [0,4194304] 0 2024-04-26T23:08:58.797 INFO:tasks.workunit.client.0.smithi148.stdout:3/210: creat d9/d15/d29/f45 x:0 0 0 2024-04-26T23:08:58.799 INFO:tasks.workunit.client.0.smithi148.stdout:6/204: mknod d6/d14/c41 0 2024-04-26T23:08:58.801 INFO:tasks.workunit.client.0.smithi148.stdout:3/211: link d9/d15/d29/l30 d9/d15/l46 0 2024-04-26T23:08:58.803 INFO:tasks.workunit.client.0.smithi148.stdout:5/260: dwrite da/f19 [0,4194304] 0 2024-04-26T23:08:58.804 INFO:tasks.workunit.client.0.smithi148.stdout:5/261: read - da/d1b/d5b/f40 zero size 2024-04-26T23:08:58.832 INFO:tasks.workunit.client.0.smithi148.stdout:5/262: dwrite da/d12/f13 [0,4194304] 0 2024-04-26T23:08:58.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/183: dwrite f10 [0,4194304] 0 2024-04-26T23:08:58.904 INFO:tasks.workunit.client.0.smithi148.stdout:1/184: dwrite d16/d1c/f2c [0,4194304] 0 2024-04-26T23:08:58.904 INFO:tasks.workunit.client.0.smithi148.stdout:1/185: chown d16/d2a/f35 12034382 1 2024-04-26T23:08:58.914 INFO:tasks.workunit.client.0.smithi148.stdout:4/186: dwrite d12/d17/f22 [4194304,4194304] 0 2024-04-26T23:08:58.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 Processor -- start 2024-04-26T23:08:58.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 -- start start 2024-04-26T23:08:58.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16a4073940 0x7f16a40c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a415c070 0x7f16a415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a40c4b30 con 0x7f16a4152d00 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f16a40c6f60 con 0x7f16a4073940 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16aa200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40c7240 con 0x7f16a415c070 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16a4073940 0x7f16a40c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16a4073940 0x7f16a40c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54774/0 (socket says 172.21.15.148:54774) 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 -- 172.21.15.148:0/138574967 learned_addr learned my addr 172.21.15.148:0/138574967 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16a3400640 1 --1- 172.21.15.148:0/138574967 >> v1:172.21.15.148:6789/0 conn(0x7f16a4152d00 0x7f16a4073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49704/0 (socket says 172.21.15.148:49704) 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f16a3e00640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a415c070 0x7f16a415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 -- 172.21.15.148:0/138574967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a415c070 msgr2=0x7f16a415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:58.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a415c070 0x7f16a415c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 -- 172.21.15.148:0/138574967 >> v1:172.21.15.148:6789/0 conn(0x7f16a4152d00 legacy=0x7f16a4073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.934+0000 7f169aa00640 1 -- 172.21.15.148:0/138574967 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a40c7520 con 0x7f16a4073940 2024-04-26T23:08:58.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f169aa00640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4073940 0x7f16a40c97d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f168c00bb10 tx=0x7f168c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecd5a3d5c8ae5b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16a2a00640 1 -- 172.21.15.148:0/138574967 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0b4070 con 0x7f16a4073940 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16a2a00640 1 -- 172.21.15.148:0/138574967 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c0a7ba0 con 0x7f16a4073940 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16a2a00640 1 -- 172.21.15.148:0/138574967 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0af440 con 0x7f16a4073940 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 -- 172.21.15.148:0/138574967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4073940 msgr2=0x7f16a40c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4073940 0x7f16a40c97d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f168c00bb10 tx=0x7f168c01ec30 comp rx=0 tx=0).stop 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 -- 172.21.15.148:0/138574967 shutdown_connections 2024-04-26T23:08:58.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a415c070 0x7f16a415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 --2- 172.21.15.148:0/138574967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4073940 0x7f16a40c97d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 -- 172.21.15.148:0/138574967 >> 172.21.15.148:0/138574967 conn(0x7f16a40c9d10 msgr2=0x7f16a40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 -- 172.21.15.148:0/138574967 shutdown_connections 2024-04-26T23:08:58.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.938+0000 7f16aa200640 1 -- 172.21.15.148:0/138574967 wait complete. 2024-04-26T23:08:58.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 Processor -- start 2024-04-26T23:08:58.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- start start 2024-04-26T23:08:58.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a4073940 0x7f16a4144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4152d00 0x7f16a41ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 0x7f16a4141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16a415cfb0 con 0x7f16a415c070 2024-04-26T23:08:58.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16a415ce30 con 0x7f16a4152d00 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f16a4070500 con 0x7f16a4073940 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 0x7f16a4141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 0x7f16a4141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54784/0 (socket says 172.21.15.148:54784) 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 learned_addr learned my addr 172.21.15.148:0/165335752 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a4073940 0x7f16a4144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f169aa00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4152d00 0x7f16a41ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a4073940 msgr2=0x7f16a4144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a4073940 0x7f16a4144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4152d00 msgr2=0x7f16a41ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4152d00 0x7f16a41ea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a41452b0 con 0x7f16a415c070 2024-04-26T23:08:58.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16a4073940 0x7f16a4144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16a3e00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 0x7f16a4141100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f169c007e60 tx=0x7f169c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c014420 con 0x7f16a415c070 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169c019070 con 0x7f16a415c070 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a41f0ae0 con 0x7f16a415c070 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c014820 con 0x7f16a415c070 2024-04-26T23:08:58.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.942+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a41f10a0 con 0x7f16a415c070 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f16aa200640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 0x7f16a4141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16a4143ee0 con 0x7f16a4148970 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 0x7f16a4141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f16a3400640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16a4077c20 con 0x7f16a4148970 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f169c0149c0 con 0x7f16a415c070 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 0x7f16a4141640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1694001360 tx=0x7f1694001820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1680068380 0x7f168006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f169c087680 con 0x7f16a415c070 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169aa00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1680068380 0x7f168006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694012590 con 0x7f16a4148970 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1694018070 con 0x7f16a4148970 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 msgr2=0x7f16a4141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 0x7f16a4141640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1694001360 tx=0x7f1694001820 comp rx=0 tx=0).stop 2024-04-26T23:08:58.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 msgr2=0x7f16a4141640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:58.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169be00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4148970 0x7f16a4141640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.946+0000 7f169aa00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1680068380 0x7f168006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f168c0b1000 tx=0x7f168c0a9070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 0x7f16a41f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:58.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16a4159a20 con 0x7f16a4143940 2024-04-26T23:08:58.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 0x7f16a41f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:58.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16a3400640 1 -- 172.21.15.148:0/165335752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16a4144510 con 0x7f16a4143940 2024-04-26T23:08:58.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16a3400640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 0x7f16a41f3f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1694001360 tx=0x7f1694000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:58.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694012cd0 con 0x7f16a4143940 2024-04-26T23:08:58.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7f1694012cd0 con 0x7f16a4143940 2024-04-26T23:08:58.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 msgr2=0x7f16a41f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 0x7f16a41f3f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1694001360 tx=0x7f1694000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 msgr2=0x7f16a41f3f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:58.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f169be00640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a4143940 0x7f16a41f3f40 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1694001360 tx=0x7f1694000ee0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 281805, 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:58.971 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:58.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1680068380 msgr2=0x7f168006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1680068380 0x7f168006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f168c0b1000 tx=0x7f168c0a9070 comp rx=0 tx=0).stop 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 msgr2=0x7f16a4141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16aa200640 1 --2- 172.21.15.148:0/165335752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a415c070 0x7f16a4141100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f169c007e60 tx=0x7f169c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 reap_dead start 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.954+0000 7f16a3e00640 1 -- 172.21.15.148:0/165335752 reap_dead start 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.958+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 shutdown_connections 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.958+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 >> 172.21.15.148:0/165335752 conn(0x7f16a40c9d10 msgr2=0x7f16a40cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.958+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 shutdown_connections 2024-04-26T23:08:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:58.958+0000 7f16aa200640 1 -- 172.21.15.148:0/165335752 wait complete. 2024-04-26T23:08:58.975 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:58.975 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:08:58.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:08:59.063 INFO:tasks.workunit.client.0.smithi148.stdout:6/205: rename d6/dc/f34 to d6/dc/f42 0 2024-04-26T23:08:59.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/212: creat d9/d15/d29/f47 x:0 0 0 2024-04-26T23:08:59.066 INFO:tasks.workunit.client.0.smithi148.stdout:0/220: sync 2024-04-26T23:08:59.103 INFO:tasks.workunit.client.0.smithi148.stdout:0/221: dwrite d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:08:59.115 INFO:tasks.workunit.client.0.smithi148.stdout:3/213: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:08:59.148 INFO:tasks.workunit.client.0.smithi148.stdout:3/214: dwrite d9/d15/f24 [0,4194304] 0 2024-04-26T23:08:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 Processor -- start 2024-04-26T23:08:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 -- start start 2024-04-26T23:08:59.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0074073940 0x7f00740c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f007415c070 0x7f007415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00740c4b30 con 0x7f0074152d00 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f00740c6f60 con 0x7f007415c070 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f007aa00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f00740c7240 con 0x7f0074073940 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f007415c070 0x7f007415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0073e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0074152d00 0x7f0074073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49706/0 (socket says 172.21.15.148:49706) 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f007415c070 0x7f007415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54786/0 (socket says 172.21.15.148:54786) 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0073e00640 1 -- 172.21.15.148:0/3785143688 learned_addr learned my addr 172.21.15.148:0/3785143688 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0073400640 1 --2- 172.21.15.148:0/3785143688 >> v2:172.21.15.157:3300/0 conn(0x7f0074073940 0x7f00740c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 -- 172.21.15.148:0/3785143688 >> v2:172.21.15.157:3300/0 conn(0x7f0074073940 msgr2=0x7f00740c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 --2- 172.21.15.148:0/3785143688 >> v2:172.21.15.157:3300/0 conn(0x7f0074073940 0x7f00740c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 -- 172.21.15.148:0/3785143688 >> v1:172.21.15.148:6789/0 conn(0x7f0074152d00 legacy=0x7f0074073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0078a00640 1 -- 172.21.15.148:0/3785143688 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00740c7520 con 0x7f007415c070 2024-04-26T23:08:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.174+0000 7f0072a00640 1 -- 172.21.15.148:0/3785143688 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975241420 0 0) 0x7f00740c4b30 con 0x7f0074152d00 2024-04-26T23:08:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f0078a00640 1 --2- 172.21.15.148:0/3785143688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f007415c070 0x7f007415c4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00740cad50 tx=0x7f006c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e5a153c3f0ac65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f0072a00640 1 -- 172.21.15.148:0/3785143688 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0b2070 con 0x7f007415c070 2024-04-26T23:08:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f0072a00640 1 -- 172.21.15.148:0/3785143688 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c0a5990 con 0x7f007415c070 2024-04-26T23:08:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f0072a00640 1 -- 172.21.15.148:0/3785143688 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a5d60 con 0x7f007415c070 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 -- 172.21.15.148:0/3785143688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f007415c070 msgr2=0x7f007415c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 --2- 172.21.15.148:0/3785143688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f007415c070 0x7f007415c4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00740cad50 tx=0x7f006c01c930 comp rx=0 tx=0).stop 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 -- 172.21.15.148:0/3785143688 shutdown_connections 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 --2- 172.21.15.148:0/3785143688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f007415c070 0x7f007415c4a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 --2- 172.21.15.148:0/3785143688 >> v2:172.21.15.157:3300/0 conn(0x7f0074073940 0x7f00740c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 -- 172.21.15.148:0/3785143688 >> 172.21.15.148:0/3785143688 conn(0x7f00740c9d10 msgr2=0x7f00740ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 -- 172.21.15.148:0/3785143688 shutdown_connections 2024-04-26T23:08:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.178+0000 7f007aa00640 1 -- 172.21.15.148:0/3785143688 wait complete. 2024-04-26T23:08:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 Processor -- start 2024-04-26T23:08:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- start start 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 0x7f00741f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074152d00 0x7f0074144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f007415c070 0x7f007414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f007415cf70 con 0x7f0074073940 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f007415cdf0 con 0x7f007415c070 2024-04-26T23:08:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0074165c20 con 0x7f0074152d00 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 0x7f00741f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 0x7f00741f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54796/0 (socket says 172.21.15.148:54796) 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 -- 172.21.15.148:0/2436318314 learned_addr learned my addr 172.21.15.148:0/2436318314 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073400640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074152d00 0x7f0074144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0078a00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f007415c070 0x7f007414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074152d00 msgr2=0x7f0074144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074152d00 0x7f0074144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f007415c070 msgr2=0x7f007414c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f007415c070 0x7f007414c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0074162b40 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f0073e00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 0x7f00741f51e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f006400c520 tx=0x7f006400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064018070 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00640074e0 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00640049f0 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0074162e20 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.182+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0074143b60 con 0x7f0074073940 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f007aa00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 0x7f0074147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0074143da0 con 0x7f0074161590 2024-04-26T23:08:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f0073400640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 0x7f0074147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f0073400640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0074077c20 con 0x7f0074161590 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0064004b90 con 0x7f0074073940 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f0073400640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 0x7f0074147200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f006000f480 tx=0x7f006000f940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0054068380 0x7f005406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f00640861c0 con 0x7f0074073940 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060019020 con 0x7f0074161590 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f0078a00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0054068380 0x7f005406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0060014870 con 0x7f0074161590 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 msgr2=0x7f0074147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 0x7f0074147200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f006000f480 tx=0x7f006000f940 comp rx=0 tx=0).stop 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 msgr2=0x7f0074147200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f006be00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074161590 0x7f0074147200 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f006000f480 tx=0x7f006000f940 comp rx=0 tx=0).stop 2024-04-26T23:08:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.186+0000 7f0078a00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0054068380 0x7f005406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f006c0af000 tx=0x7f006c0a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:59.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 0x7f0074147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:08:59.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0074156430 con 0x7f0074143450 2024-04-26T23:08:59.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f0073400640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 0x7f0074147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:08:59.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f0073400640 1 -- 172.21.15.148:0/2436318314 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f00740cc550 con 0x7f0074143450 2024-04-26T23:08:59.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f0073400640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 0x7f0074147740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f006001a000 tx=0x7f00600046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:08:59.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060019070 con 0x7f0074143450 2024-04-26T23:08:59.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5070 (secure 0 0 0) 0x7f0060015410 con 0x7f0074143450 2024-04-26T23:08:59.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 msgr2=0x7f0074147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 0x7f0074147740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f006001a000 tx=0x7f00600046d0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 msgr2=0x7f0074147740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:08:59.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f006be00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0074143450 0x7f0074147740 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f006001a000 tx=0x7f00600046d0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 34, 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 282045, 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:08:59.197 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:59.198 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:08:59.199 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:59.200 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:59.200 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:59.200 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:59.200 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:59.200 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.201 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:08:59.202 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:08:59.203 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:59.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:08:59.206 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:08:59.207 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:08:59.208 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.209 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.210 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:08:59.211 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:08:59.212 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:08:59.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0054068380 msgr2=0x7f005406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0054068380 0x7f005406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f006c0af000 tx=0x7f006c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:08:59.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 msgr2=0x7f00741f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:08:59.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 --2- 172.21.15.148:0/2436318314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0074073940 0x7f00741f51e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f006400c520 tx=0x7f006400c9e0 comp rx=0 tx=0).stop 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f0078a00640 1 -- 172.21.15.148:0/2436318314 reap_dead start 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f0078a00640 1 -- 172.21.15.148:0/2436318314 reap_dead start 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 shutdown_connections 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.194+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 >> 172.21.15.148:0/2436318314 conn(0x7f00740c9d10 msgr2=0x7f007406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.198+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 shutdown_connections 2024-04-26T23:08:59.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:08:59.198+0000 7f007aa00640 1 -- 172.21.15.148:0/2436318314 wait complete. 2024-04-26T23:08:59.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:08:59.215 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-26T23:08:59.215 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-04-26T23:08:59.215 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T23:08:59.215 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:08:59.215 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:08:59.215 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:08:59.249 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:08:59.249 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T23:08:59.249 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T23:08:59.249 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:08:59.315 INFO:tasks.workunit.client.0.smithi148.stdout:5/263: link da/d1b/l45 da/d1a/l5f 0 2024-04-26T23:08:59.315 INFO:tasks.workunit.client.0.smithi148.stdout:1/186: link d16/d1c/l1f d16/d2a/l38 0 2024-04-26T23:08:59.315 INFO:tasks.workunit.client.0.smithi148.stdout:2/264: sync 2024-04-26T23:08:59.315 INFO:tasks.workunit.client.0.smithi148.stdout:4/187: mkdir d12/d31 0 2024-04-26T23:08:59.315 INFO:tasks.workunit.client.0.smithi148.stdout:6/206: creat d6/f43 x:0 0 0 2024-04-26T23:08:59.316 INFO:tasks.workunit.client.0.smithi148.stdout:9/230: sync 2024-04-26T23:08:59.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/213: sync 2024-04-26T23:08:59.316 INFO:tasks.workunit.client.0.smithi148.stdout:6/207: fsync d6/f19 0 2024-04-26T23:08:59.316 INFO:tasks.workunit.client.0.smithi148.stdout:8/263: sync 2024-04-26T23:08:59.320 INFO:tasks.workunit.client.0.smithi148.stdout:0/222: rmdir d0/d8/d33/d43/d48 0 2024-04-26T23:08:59.325 INFO:tasks.workunit.client.0.smithi148.stdout:5/264: creat da/d1b/d2d/f60 x:0 0 0 2024-04-26T23:08:59.326 INFO:tasks.workunit.client.0.smithi148.stdout:9/231: truncate d19/d1d/d25/f29 3367130 0 2024-04-26T23:08:59.326 INFO:tasks.workunit.client.0.smithi148.stdout:8/264: unlink d3/da/d1c/c3b 0 2024-04-26T23:08:59.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/214: dread d7/d11/d29/d2e/d41/f48 [0,4194304] 0 2024-04-26T23:08:59.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/215: chown d7/d11/d13/f33 5516 1 2024-04-26T23:08:59.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/216: write d7/d11/d17/f39 [579406,42238] 0 2024-04-26T23:08:59.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/217: write d7/d19/f35 [227547,125778] 0 2024-04-26T23:08:59.332 INFO:tasks.workunit.client.0.smithi148.stdout:7/218: link d7/l10 d7/d11/d17/d2f/d44/l4e 0 2024-04-26T23:08:59.332 INFO:tasks.workunit.client.0.smithi148.stdout:7/219: write d7/d11/d29/d2e/d41/f49 [220579,124964] 0 2024-04-26T23:08:59.332 INFO:tasks.workunit.client.0.smithi148.stdout:7/220: stat d7/l3b 0 2024-04-26T23:08:59.333 INFO:tasks.workunit.client.0.smithi148.stdout:7/221: fdatasync d7/f15 0 2024-04-26T23:08:59.333 INFO:tasks.workunit.client.0.smithi148.stdout:5/265: dread da/f18 [0,4194304] 0 2024-04-26T23:08:59.334 INFO:tasks.workunit.client.0.smithi148.stdout:7/222: mknod d7/d11/d17/d43/c4f 0 2024-04-26T23:08:59.343 INFO:tasks.workunit.client.0.smithi148.stdout:2/265: write d5/d8/d11/f52 [2148930,83097] 0 2024-04-26T23:08:59.348 INFO:tasks.workunit.client.0.smithi148.stdout:2/266: mkdir d5/d17/d59 0 2024-04-26T23:08:59.351 INFO:tasks.workunit.client.0.smithi148.stdout:5/266: dread da/d12/f13 [0,4194304] 0 2024-04-26T23:08:59.351 INFO:tasks.workunit.client.0.smithi148.stdout:2/267: symlink d5/d17/d59/l5a 0 2024-04-26T23:08:59.351 INFO:tasks.workunit.client.0.smithi148.stdout:2/268: chown d5/d7/f24 1032 1 2024-04-26T23:08:59.352 INFO:tasks.workunit.client.0.smithi148.stdout:2/269: chown d5/d8/f54 6672 1 2024-04-26T23:08:59.357 INFO:tasks.workunit.client.0.smithi148.stdout:5/267: mknod da/d1b/d5b/c61 0 2024-04-26T23:08:59.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/265: rename d3/d9/d12/l13 to d3/d9/d12/l4d 0 2024-04-26T23:08:59.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/266: readlink d3/da/d28/l2b 0 2024-04-26T23:08:59.364 INFO:tasks.workunit.client.0.smithi148.stdout:7/223: dread d7/d19/f2d [0,4194304] 0 2024-04-26T23:08:59.369 INFO:tasks.workunit.client.0.smithi148.stdout:4/188: rmdir d12/d31 0 2024-04-26T23:08:59.370 INFO:tasks.workunit.client.0.smithi148.stdout:1/187: dwrite d16/d17/f28 [0,4194304] 0 2024-04-26T23:08:59.373 INFO:tasks.workunit.client.0.smithi148.stdout:7/224: symlink d7/d11/d29/l50 0 2024-04-26T23:08:59.373 INFO:tasks.workunit.client.0.smithi148.stdout:4/189: creat d12/d17/d2a/f32 x:0 0 0 2024-04-26T23:08:59.380 INFO:tasks.workunit.client.0.smithi148.stdout:7/225: mknod d7/d11/d17/d43/c51 0 2024-04-26T23:08:59.380 INFO:tasks.workunit.client.0.smithi148.stdout:4/190: rename d12/d17/d2a/d30 to d12/d17/d2a/d33 0 2024-04-26T23:08:59.380 INFO:tasks.workunit.client.0.smithi148.stdout:4/191: readlink l6 0 2024-04-26T23:08:59.383 INFO:tasks.workunit.client.0.smithi148.stdout:7/226: creat d7/d11/d17/d43/f52 x:0 0 0 2024-04-26T23:08:59.389 INFO:tasks.workunit.client.0.smithi148.stdout:4/192: unlink d12/d1c/c20 0 2024-04-26T23:08:59.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/227: creat d7/d11/d29/f53 x:0 0 0 2024-04-26T23:08:59.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/228: chown d7/f15 5820 1 2024-04-26T23:08:59.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/229: write d7/d11/d17/d2f/f40 [1041002,43841] 0 2024-04-26T23:08:59.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/230: chown d7/d11/d29/d2e/d41/f48 0 1 2024-04-26T23:08:59.393 INFO:tasks.workunit.client.0.smithi148.stdout:4/193: rmdir d12/d17/d2a 39 2024-04-26T23:08:59.395 INFO:tasks.workunit.client.0.smithi148.stdout:5/268: dwrite f6 [0,4194304] 0 2024-04-26T23:08:59.396 INFO:tasks.workunit.client.0.smithi148.stdout:1/188: write d16/f30 [2185797,70291] 0 2024-04-26T23:08:59.396 INFO:tasks.workunit.client.0.smithi148.stdout:1/189: chown d16/c27 0 1 2024-04-26T23:08:59.397 INFO:tasks.workunit.client.0.smithi148.stdout:3/215: rename d9/c12 to d9/d31/c48 0 2024-04-26T23:08:59.397 INFO:tasks.workunit.client.0.smithi148.stdout:3/216: write d9/d15/d29/f3b [934155,97794] 0 2024-04-26T23:08:59.398 INFO:tasks.workunit.client.0.smithi148.stdout:1/190: creat d16/d17/f39 x:0 0 0 2024-04-26T23:08:59.398 INFO:tasks.workunit.client.0.smithi148.stdout:1/191: dread - d16/d17/f39 zero size 2024-04-26T23:08:59.401 INFO:tasks.workunit.client.0.smithi148.stdout:9/232: rename d19/d1d/d30 to d19/d1d/d25/d2f/d4d 0 2024-04-26T23:08:59.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/217: truncate d9/f40 2786983 0 2024-04-26T23:08:59.408 INFO:tasks.workunit.client.0.smithi148.stdout:1/192: creat d16/f3a x:0 0 0 2024-04-26T23:08:59.408 INFO:tasks.workunit.client.0.smithi148.stdout:1/193: dread - f15 zero size 2024-04-26T23:08:59.408 INFO:tasks.workunit.client.0.smithi148.stdout:9/233: rename d19/l47 to d19/d22/l4e 0 2024-04-26T23:08:59.409 INFO:tasks.workunit.client.0.smithi148.stdout:9/234: chown d19/d1d/f3a 60838182 1 2024-04-26T23:08:59.409 INFO:tasks.workunit.client.0.smithi148.stdout:1/194: creat d16/d17/f3b x:0 0 0 2024-04-26T23:08:59.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/270: rename d5/d2c/d32/f42 to d5/d10/f5b 0 2024-04-26T23:08:59.414 INFO:tasks.workunit.client.0.smithi148.stdout:1/195: truncate d16/d17/f2d 81792 0 2024-04-26T23:08:59.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/271: mknod d5/d8/d4b/d4e/c5c 0 2024-04-26T23:08:59.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/196: creat d16/d1c/f3c x:0 0 0 2024-04-26T23:08:59.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/197: fsync f10 0 2024-04-26T23:08:59.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/198: chown f10 677846256 1 2024-04-26T23:08:59.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/272: mkdir d5/d8/d15/d43/d5d 0 2024-04-26T23:08:59.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/273: write d5/d8/f1b [767576,48540] 0 2024-04-26T23:08:59.421 INFO:tasks.workunit.client.0.smithi148.stdout:1/199: creat d16/d17/f3d x:0 0 0 2024-04-26T23:08:59.421 INFO:tasks.workunit.client.0.smithi148.stdout:1/200: read - f15 zero size 2024-04-26T23:08:59.422 INFO:tasks.workunit.client.0.smithi148.stdout:2/274: creat d5/d8/d11/f5e x:0 0 0 2024-04-26T23:08:59.422 INFO:tasks.workunit.client.0.smithi148.stdout:2/275: fsync d5/d2c/f3a 0 2024-04-26T23:08:59.428 INFO:tasks.workunit.client.0.smithi148.stdout:2/276: creat d5/d8/d15/d43/f5f x:0 0 0 2024-04-26T23:08:59.429 INFO:tasks.workunit.client.0.smithi148.stdout:2/277: creat d5/d2c/d32/d4c/f60 x:0 0 0 2024-04-26T23:08:59.429 INFO:tasks.workunit.client.0.smithi148.stdout:2/278: truncate d5/d10/f5b 82712 0 2024-04-26T23:08:59.429 INFO:tasks.workunit.client.0.smithi148.stdout:2/279: write d5/d7/f24 [780079,91520] 0 2024-04-26T23:08:59.430 INFO:tasks.workunit.client.0.smithi148.stdout:4/194: write d12/d17/f22 [3535631,48260] 0 2024-04-26T23:08:59.430 INFO:tasks.workunit.client.0.smithi148.stdout:8/267: dwrite d3/da/d1c/f41 [0,4194304] 0 2024-04-26T23:08:59.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/280: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:08:59.433 INFO:tasks.workunit.client.0.smithi148.stdout:4/195: rmdir d12/d2c 39 2024-04-26T23:08:59.434 INFO:tasks.workunit.client.0.smithi148.stdout:2/281: rename d5/d2c/f3a to d5/d8/d11/f61 0 2024-04-26T23:08:59.438 INFO:tasks.workunit.client.0.smithi148.stdout:7/231: dread d7/f12 [0,4194304] 0 2024-04-26T23:08:59.439 INFO:tasks.workunit.client.0.smithi148.stdout:7/232: write d7/d11/d17/f3c [1270223,76613] 0 2024-04-26T23:08:59.439 INFO:tasks.workunit.client.0.smithi148.stdout:7/233: readlink d7/d11/l3e 0 2024-04-26T23:08:59.471 INFO:tasks.workunit.client.0.smithi148.stdout:3/218: dwrite d9/d15/f24 [0,4194304] 0 2024-04-26T23:08:59.471 INFO:tasks.workunit.client.0.smithi148.stdout:3/219: truncate d9/d15/f28 562451 0 2024-04-26T23:08:59.471 INFO:tasks.workunit.client.0.smithi148.stdout:3/220: chown d9/d15/d29/f3b 185 1 2024-04-26T23:08:59.477 INFO:tasks.workunit.client.0.smithi148.stdout:1/201: dwrite d16/d17/f24 [0,4194304] 0 2024-04-26T23:08:59.477 INFO:tasks.workunit.client.0.smithi148.stdout:1/202: write f7 [4559258,55021] 0 2024-04-26T23:08:59.477 INFO:tasks.workunit.client.0.smithi148.stdout:1/203: fdatasync d16/d1c/f29 0 2024-04-26T23:08:59.481 INFO:tasks.workunit.client.0.smithi148.stdout:2/282: dwrite d5/d17/f30 [0,4194304] 0 2024-04-26T23:08:59.484 INFO:tasks.workunit.client.0.smithi148.stdout:2/283: dread d5/d8/d15/f45 [0,4194304] 0 2024-04-26T23:08:59.692 INFO:tasks.workunit.client.0.smithi148.stdout:8/268: getdents d3/d9/d12 0 2024-04-26T23:08:59.697 INFO:tasks.workunit.client.0.smithi148.stdout:7/234: link d7/d11/d13/f33 d7/d11/d17/d2f/f54 0 2024-04-26T23:08:59.697 INFO:tasks.workunit.client.0.smithi148.stdout:7/235: read d7/d11/d17/f39 [7887,80526] 0 2024-04-26T23:08:59.718 INFO:tasks.workunit.client.0.smithi148.stdout:1/204: mkdir d16/d2a/d2b/d3e 0 2024-04-26T23:08:59.727 INFO:tasks.workunit.client.0.smithi148.stdout:2/284: creat d5/d8/d11/f62 x:0 0 0 2024-04-26T23:08:59.727 INFO:tasks.workunit.client.0.smithi148.stdout:2/285: write d5/d2c/d32/d4c/f60 [263256,10386] 0 2024-04-26T23:08:59.727 INFO:tasks.workunit.client.0.smithi148.stdout:2/286: chown d5/d8/d9/l25 6821929 1 2024-04-26T23:08:59.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/269: creat d3/d9/d12/d23/d35/f4e x:0 0 0 2024-04-26T23:08:59.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/270: write d3/d9/d12/d23/d29/d37/f3d [494220,20049] 0 2024-04-26T23:08:59.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/271: dread - d3/f3c zero size 2024-04-26T23:08:59.733 INFO:tasks.workunit.client.0.smithi148.stdout:7/236: rmdir d7/d11/d29/d2e 39 2024-04-26T23:08:59.733 INFO:tasks.workunit.client.0.smithi148.stdout:7/237: chown d7/d11/d17 273 1 2024-04-26T23:08:59.737 INFO:tasks.workunit.client.0.smithi148.stdout:3/221: symlink d9/l49 0 2024-04-26T23:08:59.743 INFO:tasks.workunit.client.0.smithi148.stdout:3/222: read d9/d15/d29/f3b [146978,34388] 0 2024-04-26T23:08:59.743 INFO:tasks.workunit.client.0.smithi148.stdout:3/223: stat d9/d15/f25 0 2024-04-26T23:08:59.753 INFO:tasks.workunit.client.0.smithi148.stdout:1/205: link c6 d16/d2a/c3f 0 2024-04-26T23:08:59.753 INFO:tasks.workunit.client.0.smithi148.stdout:1/206: dread - d16/f37 zero size 2024-04-26T23:08:59.753 INFO:tasks.workunit.client.0.smithi148.stdout:1/207: write d16/d1c/f32 [818796,45659] 0 2024-04-26T23:08:59.753 INFO:tasks.workunit.client.0.smithi148.stdout:1/208: chown d16 8 1 2024-04-26T23:08:59.758 INFO:tasks.workunit.client.0.smithi148.stdout:2/287: creat d5/d8/d9/f63 x:0 0 0 2024-04-26T23:08:59.761 INFO:tasks.workunit.client.0.smithi148.stdout:8/272: dread d3/da/d28/d4c/f34 [0,4194304] 0 2024-04-26T23:08:59.766 INFO:tasks.workunit.client.0.smithi148.stdout:2/288: dread d5/d17/f39 [0,4194304] 0 2024-04-26T23:08:59.769 INFO:tasks.workunit.client.0.smithi148.stdout:3/224: rename l4 to d9/d15/l4a 0 2024-04-26T23:08:59.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/225: fdatasync d9/d15/d29/f45 0 2024-04-26T23:08:59.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/226: truncate d9/d15/d29/f37 884001 0 2024-04-26T23:08:59.770 INFO:tasks.workunit.client.0.smithi148.stdout:1/209: symlink d16/d2a/d2b/l40 0 2024-04-26T23:08:59.772 INFO:tasks.workunit.client.0.smithi148.stdout:8/273: mkdir d3/d9/d12/d23/d29/d4f 0 2024-04-26T23:08:59.777 INFO:tasks.workunit.client.0.smithi148.stdout:2/289: getdents d5/d17 0 2024-04-26T23:08:59.777 INFO:tasks.workunit.client.0.smithi148.stdout:2/290: stat d5/d7/f18 0 2024-04-26T23:08:59.778 INFO:tasks.workunit.client.0.smithi148.stdout:3/227: mknod d9/d31/c4b 0 2024-04-26T23:08:59.778 INFO:tasks.workunit.client.0.smithi148.stdout:3/228: write d9/d15/f28 [1290426,48506] 0 2024-04-26T23:08:59.782 INFO:tasks.workunit.client.0.smithi148.stdout:1/210: symlink d16/d2a/d2b/d3e/l41 0 2024-04-26T23:08:59.783 INFO:tasks.workunit.client.0.smithi148.stdout:1/211: dread - d16/d17/f25 zero size 2024-04-26T23:08:59.785 INFO:tasks.workunit.client.0.smithi148.stdout:2/291: getdents d5/d2c/d32 0 2024-04-26T23:08:59.788 INFO:tasks.workunit.client.0.smithi148.stdout:3/229: chown d9/cd 1298128 1 2024-04-26T23:08:59.788 INFO:tasks.workunit.client.0.smithi148.stdout:3/230: fsync d9/d31/f32 0 2024-04-26T23:08:59.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/231: chown d9 717772 1 2024-04-26T23:08:59.793 INFO:tasks.workunit.client.0.smithi148.stdout:7/238: dwrite d7/d11/d17/f3c [0,4194304] 0 2024-04-26T23:08:59.793 INFO:tasks.workunit.client.0.smithi148.stdout:1/212: symlink d16/d2a/d2b/l42 0 2024-04-26T23:08:59.793 INFO:tasks.workunit.client.0.smithi148.stdout:1/213: chown d16 50861335 1 2024-04-26T23:08:59.794 INFO:tasks.workunit.client.0.smithi148.stdout:7/239: write d7/d11/f31 [152278,22333] 0 2024-04-26T23:08:59.797 INFO:tasks.workunit.client.0.smithi148.stdout:2/292: mkdir d5/d17/d64 0 2024-04-26T23:08:59.798 INFO:tasks.workunit.client.0.smithi148.stdout:2/293: dread - d5/d8/d11/f5e zero size 2024-04-26T23:08:59.803 INFO:tasks.workunit.client.0.smithi148.stdout:0/223: sync 2024-04-26T23:08:59.804 INFO:tasks.workunit.client.0.smithi148.stdout:4/196: sync 2024-04-26T23:08:59.804 INFO:tasks.workunit.client.0.smithi148.stdout:6/208: sync 2024-04-26T23:08:59.804 INFO:tasks.workunit.client.0.smithi148.stdout:9/235: sync 2024-04-26T23:08:59.804 INFO:tasks.workunit.client.0.smithi148.stdout:5/269: sync 2024-04-26T23:08:59.804 INFO:tasks.workunit.client.0.smithi148.stdout:1/214: mknod d16/d1c/c43 0 2024-04-26T23:08:59.805 INFO:tasks.workunit.client.0.smithi148.stdout:3/232: mkdir d9/d4c 0 2024-04-26T23:08:59.810 INFO:tasks.workunit.client.0.smithi148.stdout:2/294: dread d5/d8/f35 [0,4194304] 0 2024-04-26T23:08:59.812 INFO:tasks.workunit.client.0.smithi148.stdout:6/209: rmdir d6/dc/d2f 0 2024-04-26T23:08:59.815 INFO:tasks.workunit.client.0.smithi148.stdout:0/224: rename d0/d8/d17 to d0/d8/d52 0 2024-04-26T23:08:59.817 INFO:tasks.workunit.client.0.smithi148.stdout:4/197: mknod d12/d17/d2a/d33/c34 0 2024-04-26T23:08:59.820 INFO:tasks.workunit.client.0.smithi148.stdout:9/236: mknod d19/d1d/d25/d31/d48/c4f 0 2024-04-26T23:08:59.820 INFO:tasks.workunit.client.0.smithi148.stdout:9/237: write d19/f2d [1197203,65149] 0 2024-04-26T23:08:59.821 INFO:tasks.workunit.client.0.smithi148.stdout:5/270: symlink da/d1a/l62 0 2024-04-26T23:08:59.822 INFO:tasks.workunit.client.0.smithi148.stdout:1/215: link d16/d2a/d2b/l42 d16/d2a/l44 0 2024-04-26T23:08:59.824 INFO:tasks.workunit.client.0.smithi148.stdout:3/233: mkdir d9/d15/d29/d4d 0 2024-04-26T23:08:59.826 INFO:tasks.workunit.client.0.smithi148.stdout:0/225: symlink d0/l53 0 2024-04-26T23:08:59.827 INFO:tasks.workunit.client.0.smithi148.stdout:6/210: write d6/fe [1643461,86403] 0 2024-04-26T23:08:59.827 INFO:tasks.workunit.client.0.smithi148.stdout:4/198: creat d12/f35 x:0 0 0 2024-04-26T23:08:59.834 INFO:tasks.workunit.client.0.smithi148.stdout:2/295: read d5/d7/f18 [7748732,3194] 0 2024-04-26T23:08:59.835 INFO:tasks.workunit.client.0.smithi148.stdout:9/238: mkdir d19/d1d/d25/d2f/d4d/d33/d50 0 2024-04-26T23:08:59.835 INFO:tasks.workunit.client.0.smithi148.stdout:7/240: dwrite d7/d11/d29/f37 [0,4194304] 0 2024-04-26T23:08:59.835 INFO:tasks.workunit.client.0.smithi148.stdout:5/271: truncate f5 528082 0 2024-04-26T23:08:59.836 INFO:tasks.workunit.client.0.smithi148.stdout:0/226: mkdir d0/d20/d54 0 2024-04-26T23:08:59.838 INFO:tasks.workunit.client.0.smithi148.stdout:6/211: symlink d6/d32/l44 0 2024-04-26T23:08:59.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/199: truncate d12/d17/f18 449855 0 2024-04-26T23:08:59.848 INFO:tasks.workunit.client.0.smithi148.stdout:2/296: symlink d5/d8/d4b/l65 0 2024-04-26T23:08:59.848 INFO:tasks.workunit.client.0.smithi148.stdout:2/297: truncate d5/d8/d11/f5e 287859 0 2024-04-26T23:08:59.848 INFO:tasks.workunit.client.0.smithi148.stdout:2/298: chown d5/d17/d59 0 1 2024-04-26T23:08:59.849 INFO:tasks.workunit.client.0.smithi148.stdout:7/241: stat d7/l10 0 2024-04-26T23:08:59.852 INFO:tasks.workunit.client.0.smithi148.stdout:1/216: rename d16/d2a to d16/d45 0 2024-04-26T23:08:59.852 INFO:tasks.workunit.client.0.smithi148.stdout:1/217: write d16/f3a [115815,129563] 0 2024-04-26T23:08:59.852 INFO:tasks.workunit.client.0.smithi148.stdout:1/218: write d16/d45/d2b/f31 [5189170,4441] 0 2024-04-26T23:08:59.854 INFO:tasks.workunit.client.0.smithi148.stdout:5/272: symlink da/d1b/d1c/d54/l63 0 2024-04-26T23:08:59.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/234: unlink d9/c23 0 2024-04-26T23:08:59.860 INFO:tasks.workunit.client.0.smithi148.stdout:0/227: truncate d0/d20/f40 2447238 0 2024-04-26T23:08:59.863 INFO:tasks.workunit.client.0.smithi148.stdout:3/235: read d9/f2d [961976,122801] 0 2024-04-26T23:08:59.863 INFO:tasks.workunit.client.0.smithi148.stdout:4/200: truncate fd 1873031 0 2024-04-26T23:08:59.866 INFO:tasks.workunit.client.0.smithi148.stdout:2/299: symlink d5/d1c/l66 0 2024-04-26T23:08:59.867 INFO:tasks.workunit.client.0.smithi148.stdout:7/242: symlink d7/d11/d29/l55 0 2024-04-26T23:08:59.867 INFO:tasks.workunit.client.0.smithi148.stdout:2/300: write d5/d8/d11/f5e [1230679,97614] 0 2024-04-26T23:08:59.869 INFO:tasks.workunit.client.0.smithi148.stdout:5/273: unlink da/d1b/d5b/f40 0 2024-04-26T23:08:59.869 INFO:tasks.workunit.client.0.smithi148.stdout:5/274: dread - da/d1b/d1c/f53 zero size 2024-04-26T23:08:59.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/228: mkdir d0/d8/d55 0 2024-04-26T23:08:59.873 INFO:tasks.workunit.client.0.smithi148.stdout:3/236: rmdir d9/d15/d29 39 2024-04-26T23:08:59.875 INFO:tasks.workunit.client.0.smithi148.stdout:2/301: rmdir d5/d8/d11 39 2024-04-26T23:08:59.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/275: link da/d1b/d5b/c61 da/d1b/d2d/c64 0 2024-04-26T23:08:59.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/276: fdatasync da/f3f 0 2024-04-26T23:08:59.879 INFO:tasks.workunit.client.0.smithi148.stdout:0/229: mknod d0/d5/c56 0 2024-04-26T23:08:59.881 INFO:tasks.workunit.client.0.smithi148.stdout:5/277: creat da/d1b/d5b/f65 x:0 0 0 2024-04-26T23:08:59.885 INFO:tasks.workunit.client.0.smithi148.stdout:5/278: creat da/d1b/d1c/f66 x:0 0 0 2024-04-26T23:08:59.886 INFO:tasks.workunit.client.0.smithi148.stdout:5/279: mkdir da/d1f/d67 0 2024-04-26T23:08:59.887 INFO:tasks.workunit.client.0.smithi148.stdout:3/237: dread d9/f1c [0,4194304] 0 2024-04-26T23:08:59.889 INFO:tasks.workunit.client.0.smithi148.stdout:4/201: write d12/f14 [10532457,5993] 0 2024-04-26T23:08:59.894 INFO:tasks.workunit.client.0.smithi148.stdout:4/202: mknod d12/d1a/c36 0 2024-04-26T23:08:59.905 INFO:tasks.workunit.client.0.smithi148.stdout:3/238: rename d9/c2b to d9/d15/d29/d4d/c4e 0 2024-04-26T23:08:59.905 INFO:tasks.workunit.client.0.smithi148.stdout:3/239: rename d9 to d9/d15/d4f 22 2024-04-26T23:08:59.911 INFO:tasks.workunit.client.0.smithi148.stdout:3/240: fdatasync d9/f2d 0 2024-04-26T23:08:59.913 INFO:tasks.workunit.client.0.smithi148.stdout:2/302: write d5/d17/f39 [822858,66492] 0 2024-04-26T23:08:59.913 INFO:tasks.workunit.client.0.smithi148.stdout:2/303: truncate d5/d8/d11/f62 611314 0 2024-04-26T23:08:59.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/230: write d0/d8/f42 [3670242,79252] 0 2024-04-26T23:08:59.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/231: chown d0/f1b 1911 1 2024-04-26T23:08:59.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/232: write d0/d8/d1e/f28 [2116673,69000] 0 2024-04-26T23:08:59.918 INFO:tasks.workunit.client.0.smithi148.stdout:2/304: unlink d5/d8/f35 0 2024-04-26T23:08:59.918 INFO:tasks.workunit.client.0.smithi148.stdout:7/243: dwrite d7/d11/d13/f33 [0,4194304] 0 2024-04-26T23:08:59.919 INFO:tasks.workunit.client.0.smithi148.stdout:3/241: dread d9/d15/f25 [0,4194304] 0 2024-04-26T23:08:59.919 INFO:tasks.workunit.client.0.smithi148.stdout:7/244: symlink d7/d11/d29/d2e/d41/l56 0 2024-04-26T23:08:59.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/245: mkdir d7/d11/d17/d2f/d57 0 2024-04-26T23:08:59.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/246: write d7/d11/d29/d2e/d41/f48 [1022547,45784] 0 2024-04-26T23:08:59.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/247: rmdir d7/d11/d13 39 2024-04-26T23:08:59.922 INFO:tasks.workunit.client.0.smithi148.stdout:2/305: dread d5/d2c/d32/d4c/f60 [0,4194304] 0 2024-04-26T23:08:59.938 INFO:tasks.workunit.client.0.smithi148.stdout:2/306: truncate d5/d8/d11/f62 98093 0 2024-04-26T23:08:59.948 INFO:tasks.workunit.client.0.smithi148.stdout:2/307: dread d5/d7/f20 [0,4194304] 0 2024-04-26T23:08:59.985 INFO:tasks.workunit.client.0.smithi148.stdout:9/239: dwrite f2 [0,4194304] 0 2024-04-26T23:08:59.992 INFO:tasks.workunit.client.0.smithi148.stdout:9/240: creat d19/d1d/f51 x:0 0 0 2024-04-26T23:08:59.995 INFO:tasks.workunit.client.0.smithi148.stdout:0/233: dread d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:00.004 INFO:tasks.workunit.client.0.smithi148.stdout:4/203: dwrite d12/d17/f2e [0,4194304] 0 2024-04-26T23:09:00.008 INFO:tasks.workunit.client.0.smithi148.stdout:4/204: mkdir d12/d17/d2a/d37 0 2024-04-26T23:09:00.032 INFO:tasks.workunit.client.0.smithi148.stdout:2/308: dwrite d5/d7/f18 [8388608,4194304] 0 2024-04-26T23:09:00.033 INFO:tasks.workunit.client.0.smithi148.stdout:4/205: dread d12/d1a/f23 [0,4194304] 0 2024-04-26T23:09:00.038 INFO:tasks.workunit.client.0.smithi148.stdout:2/309: truncate d5/d7/f18 9335744 0 2024-04-26T23:09:00.038 INFO:tasks.workunit.client.0.smithi148.stdout:5/280: dwrite da/d1b/d2d/f48 [0,4194304] 0 2024-04-26T23:09:00.041 INFO:tasks.workunit.client.0.smithi148.stdout:2/310: mknod d5/d8/d9/c67 0 2024-04-26T23:09:00.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/281: mkdir da/d68 0 2024-04-26T23:09:00.045 INFO:tasks.workunit.client.0.smithi148.stdout:2/311: unlink d5/d2c/d32/d4c/l53 0 2024-04-26T23:09:00.051 INFO:tasks.workunit.client.0.smithi148.stdout:5/282: truncate da/fb 3344761 0 2024-04-26T23:09:00.051 INFO:tasks.workunit.client.0.smithi148.stdout:5/283: write da/d1a/f1e [2215742,94721] 0 2024-04-26T23:09:00.056 INFO:tasks.workunit.client.0.smithi148.stdout:2/312: fsync d5/d8/d11/f52 0 2024-04-26T23:09:00.057 INFO:tasks.workunit.client.0.smithi148.stdout:5/284: mkdir da/d68/d69 0 2024-04-26T23:09:00.057 INFO:tasks.workunit.client.0.smithi148.stdout:5/285: chown da/d12/f17 15 1 2024-04-26T23:09:00.063 INFO:tasks.workunit.client.0.smithi148.stdout:5/286: dread da/d1b/d5b/f3a [0,4194304] 0 2024-04-26T23:09:00.072 INFO:tasks.workunit.client.0.smithi148.stdout:4/206: dread d12/d2c/f27 [0,4194304] 0 2024-04-26T23:09:00.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/242: dwrite d9/d15/f24 [4194304,4194304] 0 2024-04-26T23:09:00.094 INFO:tasks.workunit.client.0.smithi148.stdout:3/243: mknod d9/c50 0 2024-04-26T23:09:00.094 INFO:tasks.workunit.client.0.smithi148.stdout:3/244: chown d9/d15/c16 1008 1 2024-04-26T23:09:00.095 INFO:tasks.workunit.client.0.smithi148.stdout:9/241: dwrite fe [0,4194304] 0 2024-04-26T23:09:00.095 INFO:tasks.workunit.client.0.smithi148.stdout:0/234: dread d0/d8/d52/f30 [0,4194304] 0 2024-04-26T23:09:00.103 INFO:tasks.workunit.client.0.smithi148.stdout:7/248: dwrite d7/fb [0,4194304] 0 2024-04-26T23:09:00.104 INFO:tasks.workunit.client.0.smithi148.stdout:3/245: dread d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:00.106 INFO:tasks.workunit.client.0.smithi148.stdout:5/287: dwrite da/d1b/d1c/f66 [0,4194304] 0 2024-04-26T23:09:00.107 INFO:tasks.workunit.client.0.smithi148.stdout:2/313: dwrite d5/d8/d9/f63 [0,4194304] 0 2024-04-26T23:09:00.107 INFO:tasks.workunit.client.0.smithi148.stdout:2/314: write d5/d2c/d32/d4c/f60 [1001358,107779] 0 2024-04-26T23:09:00.118 INFO:tasks.workunit.client.0.smithi148.stdout:4/207: dwrite d12/d1a/f29 [0,4194304] 0 2024-04-26T23:09:00.118 INFO:tasks.workunit.client.0.smithi148.stdout:4/208: chown f8 185308 1 2024-04-26T23:09:00.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/242: creat d19/d1d/f52 x:0 0 0 2024-04-26T23:09:00.348 INFO:tasks.workunit.client.0.smithi148.stdout:0/235: mknod d0/d8/d52/c57 0 2024-04-26T23:09:00.350 INFO:tasks.workunit.client.0.smithi148.stdout:3/246: symlink d9/d31/l51 0 2024-04-26T23:09:00.356 INFO:tasks.workunit.client.0.smithi148.stdout:5/288: truncate da/fb 2274655 0 2024-04-26T23:09:00.358 INFO:tasks.workunit.client.0.smithi148.stdout:8/274: sync 2024-04-26T23:09:00.358 INFO:tasks.workunit.client.0.smithi148.stdout:8/275: chown d3 232892 1 2024-04-26T23:09:00.364 INFO:tasks.workunit.client.0.smithi148.stdout:2/315: truncate d5/d2c/d32/f37 2180038 0 2024-04-26T23:09:00.368 INFO:tasks.workunit.client.0.smithi148.stdout:4/209: rmdir d12/d2c 39 2024-04-26T23:09:00.376 INFO:tasks.workunit.client.0.smithi148.stdout:9/243: creat d19/d1d/d25/d2f/f53 x:0 0 0 2024-04-26T23:09:00.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/219: sync 2024-04-26T23:09:00.377 INFO:tasks.workunit.client.0.smithi148.stdout:6/212: sync 2024-04-26T23:09:00.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/220: chown d16/d17/f1a 45 1 2024-04-26T23:09:00.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/221: fdatasync d16/d17/f25 0 2024-04-26T23:09:00.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/222: chown d16/d1c/f29 1393 1 2024-04-26T23:09:00.378 INFO:tasks.workunit.client.0.smithi148.stdout:0/236: mknod d0/d8/d52/c58 0 2024-04-26T23:09:00.384 INFO:tasks.workunit.client.0.smithi148.stdout:8/276: creat d3/da/d28/f50 x:0 0 0 2024-04-26T23:09:00.386 INFO:tasks.workunit.client.0.smithi148.stdout:2/316: getdents d5/d1c/d38 0 2024-04-26T23:09:00.387 INFO:tasks.workunit.client.0.smithi148.stdout:7/249: sync 2024-04-26T23:09:00.389 INFO:tasks.workunit.client.0.smithi148.stdout:4/210: symlink d12/d1c/l38 0 2024-04-26T23:09:00.393 INFO:tasks.workunit.client.0.smithi148.stdout:9/244: creat d19/d39/f54 x:0 0 0 2024-04-26T23:09:00.398 INFO:tasks.workunit.client.0.smithi148.stdout:6/213: unlink d6/fe 0 2024-04-26T23:09:00.400 INFO:tasks.workunit.client.0.smithi148.stdout:1/223: creat d16/d45/d2b/f46 x:0 0 0 2024-04-26T23:09:00.400 INFO:tasks.workunit.client.0.smithi148.stdout:1/224: chown d16/d17/f3d 0 1 2024-04-26T23:09:00.406 INFO:tasks.workunit.client.0.smithi148.stdout:0/237: rename d0/c4b to d0/d20/d54/c59 0 2024-04-26T23:09:00.408 INFO:tasks.workunit.client.0.smithi148.stdout:3/247: mkdir d9/d52 0 2024-04-26T23:09:00.408 INFO:tasks.workunit.client.0.smithi148.stdout:3/248: dread - d9/f36 zero size 2024-04-26T23:09:00.409 INFO:tasks.workunit.client.0.smithi148.stdout:5/289: truncate da/fb 2863043 0 2024-04-26T23:09:00.410 INFO:tasks.workunit.client.0.smithi148.stdout:0/238: dread d0/d8/d1e/f23 [0,4194304] 0 2024-04-26T23:09:00.410 INFO:tasks.workunit.client.0.smithi148.stdout:0/239: stat d0/c13 0 2024-04-26T23:09:00.410 INFO:tasks.workunit.client.0.smithi148.stdout:0/240: write d0/d2e/f50 [1093267,105283] 0 2024-04-26T23:09:00.411 INFO:tasks.workunit.client.0.smithi148.stdout:8/277: creat d3/da/d28/d4c/f51 x:0 0 0 2024-04-26T23:09:00.411 INFO:tasks.workunit.client.0.smithi148.stdout:8/278: stat d3/d9/f49 0 2024-04-26T23:09:00.414 INFO:tasks.workunit.client.0.smithi148.stdout:8/279: read d3/d9/d12/f3f [28405,1980] 0 2024-04-26T23:09:00.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/317: mknod d5/c68 0 2024-04-26T23:09:00.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/318: write d5/d8/d15/d43/f49 [62879,71772] 0 2024-04-26T23:09:00.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/319: chown d5/d10/f3b 1892347336 1 2024-04-26T23:09:00.416 INFO:tasks.workunit.client.0.smithi148.stdout:7/250: symlink d7/d11/d29/l58 0 2024-04-26T23:09:00.416 INFO:tasks.workunit.client.0.smithi148.stdout:7/251: getdents d7/d11/d17/d2f/d57 0 2024-04-26T23:09:00.416 INFO:tasks.workunit.client.0.smithi148.stdout:7/252: getdents d7/d11/d17/d2f/d57 0 2024-04-26T23:09:00.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/225: rmdir d16/d45 39 2024-04-26T23:09:00.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/226: readlink d16/d45/d2b/l40 0 2024-04-26T23:09:00.425 INFO:tasks.workunit.client.0.smithi148.stdout:9/245: rename d19/d1d/d25/f29 to d19/d1d/d25/d31/f55 0 2024-04-26T23:09:00.427 INFO:tasks.workunit.client.0.smithi148.stdout:3/249: symlink d9/d15/d29/l53 0 2024-04-26T23:09:00.429 INFO:tasks.workunit.client.0.smithi148.stdout:5/290: mkdir da/d1b/d5b/d5e/d6a 0 2024-04-26T23:09:00.429 INFO:tasks.workunit.client.0.smithi148.stdout:5/291: stat da/d12/c23 0 2024-04-26T23:09:00.432 INFO:tasks.workunit.client.0.smithi148.stdout:0/241: unlink d0/d5/c47 0 2024-04-26T23:09:00.433 INFO:tasks.workunit.client.0.smithi148.stdout:8/280: getdents d3/d9/d12/d23/d35 0 2024-04-26T23:09:00.435 INFO:tasks.workunit.client.0.smithi148.stdout:2/320: creat d5/d8/d9/f69 x:0 0 0 2024-04-26T23:09:00.435 INFO:tasks.workunit.client.0.smithi148.stdout:2/321: readlink d5/d1c/l66 0 2024-04-26T23:09:00.436 INFO:tasks.workunit.client.0.smithi148.stdout:7/253: read d7/d11/f31 [861376,105338] 0 2024-04-26T23:09:00.437 INFO:tasks.workunit.client.0.smithi148.stdout:9/246: rename d19/d1d/f21 to d19/d1d/d25/d31/f56 0 2024-04-26T23:09:00.437 INFO:tasks.workunit.client.0.smithi148.stdout:9/247: read - d19/d1d/f51 zero size 2024-04-26T23:09:00.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/250: rmdir d9/d31 39 2024-04-26T23:09:00.439 INFO:tasks.workunit.client.0.smithi148.stdout:5/292: creat da/d1b/d1c/d54/f6b x:0 0 0 2024-04-26T23:09:00.439 INFO:tasks.workunit.client.0.smithi148.stdout:5/293: fsync da/d1b/d2d/f60 0 2024-04-26T23:09:00.440 INFO:tasks.workunit.client.0.smithi148.stdout:8/281: symlink d3/da/d28/l52 0 2024-04-26T23:09:00.440 INFO:tasks.workunit.client.0.smithi148.stdout:8/282: stat d3/f42 0 2024-04-26T23:09:00.442 INFO:tasks.workunit.client.0.smithi148.stdout:2/322: creat d5/d8/d11/f6a x:0 0 0 2024-04-26T23:09:00.442 INFO:tasks.workunit.client.0.smithi148.stdout:2/323: chown d5/d8/d9/f28 532 1 2024-04-26T23:09:00.442 INFO:tasks.workunit.client.0.smithi148.stdout:2/324: chown d5/d8/c21 290596 1 2024-04-26T23:09:00.443 INFO:tasks.workunit.client.0.smithi148.stdout:7/254: symlink d7/d11/d29/d2e/d41/l59 0 2024-04-26T23:09:00.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/248: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d57 0 2024-04-26T23:09:00.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/249: write d19/d1d/d25/f41 [1498868,47790] 0 2024-04-26T23:09:00.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/250: write d19/d1d/f51 [972647,69069] 0 2024-04-26T23:09:00.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/251: stat ca 0 2024-04-26T23:09:00.446 INFO:tasks.workunit.client.0.smithi148.stdout:3/251: symlink d9/d15/l54 0 2024-04-26T23:09:00.450 INFO:tasks.workunit.client.0.smithi148.stdout:2/325: rename d5/d8/d11/f52 to d5/d17/d64/f6b 0 2024-04-26T23:09:00.451 INFO:tasks.workunit.client.0.smithi148.stdout:9/252: mknod d19/d22/c58 0 2024-04-26T23:09:00.453 INFO:tasks.workunit.client.0.smithi148.stdout:3/252: truncate f5 8110669 0 2024-04-26T23:09:00.453 INFO:tasks.workunit.client.0.smithi148.stdout:3/253: dread - d9/f36 zero size 2024-04-26T23:09:00.454 INFO:tasks.workunit.client.0.smithi148.stdout:2/326: rmdir d5/d8/d9 39 2024-04-26T23:09:00.455 INFO:tasks.workunit.client.0.smithi148.stdout:3/254: creat d9/d31/f55 x:0 0 0 2024-04-26T23:09:00.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/255: chown d9/d31/f32 56150 1 2024-04-26T23:09:00.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/256: readlink d9/d15/d29/l53 0 2024-04-26T23:09:00.456 INFO:tasks.workunit.client.0.smithi148.stdout:2/327: mkdir d5/d8/d6c 0 2024-04-26T23:09:00.458 INFO:tasks.workunit.client.0.smithi148.stdout:2/328: rmdir d5/d17/d59 39 2024-04-26T23:09:00.489 INFO:tasks.workunit.client.0.smithi148.stdout:1/227: dwrite d16/d17/f1b [0,4194304] 0 2024-04-26T23:09:00.489 INFO:tasks.workunit.client.0.smithi148.stdout:3/257: link f5 d9/d15/d29/f56 0 2024-04-26T23:09:00.500 INFO:tasks.workunit.client.0.smithi148.stdout:5/294: dread da/f1d [0,4194304] 0 2024-04-26T23:09:00.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/258: stat d9/c20 0 2024-04-26T23:09:00.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/259: truncate d9/f36 829790 0 2024-04-26T23:09:00.504 INFO:tasks.workunit.client.0.smithi148.stdout:5/295: rename da/d1b/d1c/c44 to da/d1f/d47/c6c 0 2024-04-26T23:09:00.506 INFO:tasks.workunit.client.0.smithi148.stdout:5/296: rmdir da/d68 39 2024-04-26T23:09:00.508 INFO:tasks.workunit.client.0.smithi148.stdout:5/297: creat da/d1b/d2d/f6d x:0 0 0 2024-04-26T23:09:00.508 INFO:tasks.workunit.client.0.smithi148.stdout:5/298: stat da/d12/f17 0 2024-04-26T23:09:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:3/260: dread d9/f1c [0,4194304] 0 2024-04-26T23:09:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:3/261: write d9/d15/d29/f45 [697248,1223] 0 2024-04-26T23:09:00.540 INFO:tasks.workunit.client.0.smithi148.stdout:2/329: dwrite d5/d17/d64/f6b [0,4194304] 0 2024-04-26T23:09:00.542 INFO:tasks.workunit.client.0.smithi148.stdout:2/330: mkdir d5/d8/d4b/d4e/d6d 0 2024-04-26T23:09:00.543 INFO:tasks.workunit.client.0.smithi148.stdout:2/331: readlink d5/d8/d11/l29 0 2024-04-26T23:09:00.548 INFO:tasks.workunit.client.0.smithi148.stdout:0/242: dwrite d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:00.551 INFO:tasks.workunit.client.0.smithi148.stdout:0/243: unlink d0/d8/f38 0 2024-04-26T23:09:00.554 INFO:tasks.workunit.client.0.smithi148.stdout:0/244: symlink d0/d5/d19/l5a 0 2024-04-26T23:09:00.554 INFO:tasks.workunit.client.0.smithi148.stdout:8/283: dwrite d3/da/f18 [0,4194304] 0 2024-04-26T23:09:00.567 INFO:tasks.workunit.client.0.smithi148.stdout:1/228: dread d16/d1c/f26 [0,4194304] 0 2024-04-26T23:09:00.568 INFO:tasks.workunit.client.0.smithi148.stdout:1/229: readlink d16/d1c/l21 0 2024-04-26T23:09:00.572 INFO:tasks.workunit.client.0.smithi148.stdout:1/230: mkdir d16/d47 0 2024-04-26T23:09:00.573 INFO:tasks.workunit.client.0.smithi148.stdout:1/231: symlink d16/d47/l48 0 2024-04-26T23:09:00.581 INFO:tasks.workunit.client.0.smithi148.stdout:1/232: mkdir d16/d47/d49 0 2024-04-26T23:09:00.582 INFO:tasks.workunit.client.0.smithi148.stdout:3/262: write d9/f43 [4061206,112336] 0 2024-04-26T23:09:00.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/255: dwrite d7/d19/f20 [4194304,4194304] 0 2024-04-26T23:09:00.591 INFO:tasks.workunit.client.0.smithi148.stdout:8/284: dread d3/d9/d12/f48 [0,4194304] 0 2024-04-26T23:09:00.595 INFO:tasks.workunit.client.0.smithi148.stdout:9/253: dwrite f9 [0,4194304] 0 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:8/285: dread d3/da/d28/d4c/f17 [0,4194304] 0 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:8/286: read - d3/d9/f49 zero size 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/254: creat d19/d39/f59 x:0 0 0 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/255: write d19/f23 [917856,8521] 0 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/256: write d19/f4a [647364,51288] 0 2024-04-26T23:09:00.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/257: mknod d19/d1d/d25/c5a 0 2024-04-26T23:09:00.602 INFO:tasks.workunit.client.0.smithi148.stdout:9/258: rmdir d19/d39 39 2024-04-26T23:09:00.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/256: write d7/f12 [1451760,62325] 0 2024-04-26T23:09:00.608 INFO:tasks.workunit.client.0.smithi148.stdout:2/332: dwrite d5/d8/d11/f6a [0,4194304] 0 2024-04-26T23:09:00.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/257: chown d7/d11/d29/c4b 1007530 1 2024-04-26T23:09:00.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/258: chown d7/f15 11844467 1 2024-04-26T23:09:00.608 INFO:tasks.workunit.client.0.smithi148.stdout:2/333: write d5/d8/d15/d43/f49 [493218,45899] 0 2024-04-26T23:09:00.611 INFO:tasks.workunit.client.0.smithi148.stdout:3/263: read d9/d15/f25 [78028,67713] 0 2024-04-26T23:09:00.625 INFO:tasks.workunit.client.0.smithi148.stdout:7/259: symlink d7/d11/d17/d2f/l5a 0 2024-04-26T23:09:00.625 INFO:tasks.workunit.client.0.smithi148.stdout:3/264: creat d9/d15/d29/d4d/f57 x:0 0 0 2024-04-26T23:09:00.625 INFO:tasks.workunit.client.0.smithi148.stdout:4/211: sync 2024-04-26T23:09:00.625 INFO:tasks.workunit.client.0.smithi148.stdout:2/334: creat d5/d17/d59/f6e x:0 0 0 2024-04-26T23:09:00.625 INFO:tasks.workunit.client.0.smithi148.stdout:2/335: getdents d5/d8/d9/d3d 0 2024-04-26T23:09:00.627 INFO:tasks.workunit.client.0.smithi148.stdout:4/212: link d12/d2c/f26 d12/d2c/f39 0 2024-04-26T23:09:00.630 INFO:tasks.workunit.client.0.smithi148.stdout:9/259: write f3 [6578850,7316] 0 2024-04-26T23:09:00.630 INFO:tasks.workunit.client.0.smithi148.stdout:1/233: dwrite d16/d45/f35 [0,4194304] 0 2024-04-26T23:09:00.632 INFO:tasks.workunit.client.0.smithi148.stdout:9/260: write d19/d1d/d25/d2f/d4d/f43 [1576,61513] 0 2024-04-26T23:09:00.632 INFO:tasks.workunit.client.0.smithi148.stdout:4/213: rename d12/f24 to d12/d1c/f3a 0 2024-04-26T23:09:00.635 INFO:tasks.workunit.client.0.smithi148.stdout:3/265: dread d9/d15/f28 [0,4194304] 0 2024-04-26T23:09:00.635 INFO:tasks.workunit.client.0.smithi148.stdout:3/266: chown d9/d15/f25 15 1 2024-04-26T23:09:00.637 INFO:tasks.workunit.client.0.smithi148.stdout:3/267: symlink d9/d52/l58 0 2024-04-26T23:09:00.637 INFO:tasks.workunit.client.0.smithi148.stdout:3/268: getdents d9/d4c 0 2024-04-26T23:09:00.637 INFO:tasks.workunit.client.0.smithi148.stdout:0/245: dwrite d0/d8/d1e/f2a [0,4194304] 0 2024-04-26T23:09:00.639 INFO:tasks.workunit.client.0.smithi148.stdout:3/269: rmdir d9/d31 39 2024-04-26T23:09:00.648 INFO:tasks.workunit.client.0.smithi148.stdout:7/260: dread d7/f12 [0,4194304] 0 2024-04-26T23:09:00.648 INFO:tasks.workunit.client.0.smithi148.stdout:0/246: write d0/f1b [1274901,34825] 0 2024-04-26T23:09:00.648 INFO:tasks.workunit.client.0.smithi148.stdout:0/247: fsync d0/d8/d1e/f28 0 2024-04-26T23:09:00.648 INFO:tasks.workunit.client.0.smithi148.stdout:1/234: dread d16/f3a [0,4194304] 0 2024-04-26T23:09:00.648 INFO:tasks.workunit.client.0.smithi148.stdout:1/235: dread - d16/f37 zero size 2024-04-26T23:09:00.649 INFO:tasks.workunit.client.0.smithi148.stdout:1/236: write d16/d17/f1a [989615,114436] 0 2024-04-26T23:09:00.649 INFO:tasks.workunit.client.0.smithi148.stdout:1/237: truncate d16/d17/f3b 87038 0 2024-04-26T23:09:00.655 INFO:tasks.workunit.client.0.smithi148.stdout:9/261: dread f2 [0,4194304] 0 2024-04-26T23:09:00.657 INFO:tasks.workunit.client.0.smithi148.stdout:9/262: mknod d19/d1d/d25/d31/d48/c5b 0 2024-04-26T23:09:00.657 INFO:tasks.workunit.client.0.smithi148.stdout:9/263: read d19/d1d/f3a [1213760,104429] 0 2024-04-26T23:09:00.657 INFO:tasks.workunit.client.0.smithi148.stdout:9/264: chown c15 2998 1 2024-04-26T23:09:00.659 INFO:tasks.workunit.client.0.smithi148.stdout:9/265: creat d19/d1d/d49/f5c x:0 0 0 2024-04-26T23:09:00.660 INFO:tasks.workunit.client.0.smithi148.stdout:4/214: read d12/f14 [7684851,86667] 0 2024-04-26T23:09:00.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/287: dwrite d3/f42 [4194304,4194304] 0 2024-04-26T23:09:00.666 INFO:tasks.workunit.client.0.smithi148.stdout:4/215: mknod d12/d17/d2a/d33/c3b 0 2024-04-26T23:09:00.667 INFO:tasks.workunit.client.0.smithi148.stdout:4/216: unlink d12/d17/d2a/d33/c34 0 2024-04-26T23:09:00.673 INFO:tasks.workunit.client.0.smithi148.stdout:4/217: creat d12/d2c/f3c x:0 0 0 2024-04-26T23:09:00.689 INFO:tasks.workunit.client.0.smithi148.stdout:1/238: write d16/f1d [227872,108828] 0 2024-04-26T23:09:00.689 INFO:tasks.workunit.client.0.smithi148.stdout:8/288: write d3/d9/d12/f21 [3425025,121880] 0 2024-04-26T23:09:00.701 INFO:tasks.workunit.client.0.smithi148.stdout:7/261: write d7/d19/f23 [336111,10065] 0 2024-04-26T23:09:00.703 INFO:tasks.workunit.client.0.smithi148.stdout:1/239: unlink d16/d17/f2d 0 2024-04-26T23:09:00.703 INFO:tasks.workunit.client.0.smithi148.stdout:7/262: read d7/d11/d13/f21 [237064,47445] 0 2024-04-26T23:09:00.707 INFO:tasks.workunit.client.0.smithi148.stdout:1/240: creat d16/f4a x:0 0 0 2024-04-26T23:09:00.707 INFO:tasks.workunit.client.0.smithi148.stdout:1/241: chown d16/f30 167014 1 2024-04-26T23:09:00.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/242: mkdir d16/d17/d4b 0 2024-04-26T23:09:00.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/243: read - d16/d45/d2b/f46 zero size 2024-04-26T23:09:00.710 INFO:tasks.workunit.client.0.smithi148.stdout:2/336: dwrite d5/d8/d9/f63 [0,4194304] 0 2024-04-26T23:09:00.720 INFO:tasks.workunit.client.0.smithi148.stdout:9/266: dwrite d19/d1d/f51 [0,4194304] 0 2024-04-26T23:09:00.720 INFO:tasks.workunit.client.0.smithi148.stdout:9/267: write d19/d1d/d25/d2f/d4d/f43 [405902,107562] 0 2024-04-26T23:09:00.721 INFO:tasks.workunit.client.0.smithi148.stdout:9/268: creat d19/d22/f5d x:0 0 0 2024-04-26T23:09:00.722 INFO:tasks.workunit.client.0.smithi148.stdout:9/269: mknod d19/d1d/d25/d31/d32/c5e 0 2024-04-26T23:09:00.722 INFO:tasks.workunit.client.0.smithi148.stdout:9/270: chown d19/d1d/d25/l27 591 1 2024-04-26T23:09:00.735 INFO:tasks.workunit.client.0.smithi148.stdout:2/337: dread d5/d17/d64/f6b [4194304,4194304] 0 2024-04-26T23:09:00.735 INFO:tasks.workunit.client.0.smithi148.stdout:8/289: dread d3/da/d1c/f45 [0,4194304] 0 2024-04-26T23:09:00.735 INFO:tasks.workunit.client.0.smithi148.stdout:3/270: dwrite d9/f36 [0,4194304] 0 2024-04-26T23:09:00.735 INFO:tasks.workunit.client.0.smithi148.stdout:2/338: truncate d5/d8/d9/f63 4921915 0 2024-04-26T23:09:00.736 INFO:tasks.workunit.client.0.smithi148.stdout:4/218: dwrite d12/d1a/f29 [0,4194304] 0 2024-04-26T23:09:00.737 INFO:tasks.workunit.client.0.smithi148.stdout:3/271: mknod d9/d15/d29/d4d/c59 0 2024-04-26T23:09:00.738 INFO:tasks.workunit.client.0.smithi148.stdout:8/290: symlink d3/d9/l53 0 2024-04-26T23:09:00.738 INFO:tasks.workunit.client.0.smithi148.stdout:8/291: stat d3/da/d28 0 2024-04-26T23:09:00.738 INFO:tasks.workunit.client.0.smithi148.stdout:2/339: creat d5/d1c/d38/f6f x:0 0 0 2024-04-26T23:09:00.747 INFO:tasks.workunit.client.0.smithi148.stdout:4/219: creat d12/d1a/f3d x:0 0 0 2024-04-26T23:09:00.747 INFO:tasks.workunit.client.0.smithi148.stdout:4/220: write d12/d1c/f28 [627216,114064] 0 2024-04-26T23:09:00.749 INFO:tasks.workunit.client.0.smithi148.stdout:7/263: dwrite d7/d11/d29/d2e/f32 [4194304,4194304] 0 2024-04-26T23:09:00.751 INFO:tasks.workunit.client.0.smithi148.stdout:8/292: mkdir d3/d9/d12/d23/d54 0 2024-04-26T23:09:00.753 INFO:tasks.workunit.client.0.smithi148.stdout:6/214: sync 2024-04-26T23:09:00.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/244: dwrite d16/d17/f25 [0,4194304] 0 2024-04-26T23:09:00.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/245: dread - d16/f20 zero size 2024-04-26T23:09:00.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/246: dread - d16/d1c/f3c zero size 2024-04-26T23:09:00.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/247: write d16/f3a [198874,4324] 0 2024-04-26T23:09:00.815 INFO:tasks.workunit.client.0.smithi148.stdout:1/248: write fd [437217,118144] 0 2024-04-26T23:09:00.825 INFO:tasks.workunit.client.0.smithi148.stdout:9/271: dwrite d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:09:00.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/293: dwrite d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:00.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/294: chown d3/d9/f49 39566337 1 2024-04-26T23:09:00.829 INFO:tasks.workunit.client.0.smithi148.stdout:3/272: dwrite d9/d15/f27 [0,4194304] 0 2024-04-26T23:09:00.835 INFO:tasks.workunit.client.0.smithi148.stdout:6/215: dwrite d6/dc/f3f [0,4194304] 0 2024-04-26T23:09:00.835 INFO:tasks.workunit.client.0.smithi148.stdout:6/216: write d6/d9/d1c/f2e [1329365,44965] 0 2024-04-26T23:09:00.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/272: dread d19/d1d/f51 [0,4194304] 0 2024-04-26T23:09:00.866 INFO:tasks.workunit.client.0.smithi148.stdout:1/249: dwrite d16/d1c/f29 [0,4194304] 0 2024-04-26T23:09:00.886 INFO:tasks.workunit.client.0.smithi148.stdout:3/273: dwrite d9/f40 [0,4194304] 0 2024-04-26T23:09:01.015 INFO:tasks.workunit.client.0.smithi148.stdout:2/340: rename d5/d2c to d5/d8/d70 0 2024-04-26T23:09:01.020 INFO:tasks.workunit.client.0.smithi148.stdout:8/295: rmdir d3/da/d28/d4c 39 2024-04-26T23:09:01.020 INFO:tasks.workunit.client.0.smithi148.stdout:8/296: write d3/da/d28/d4c/f34 [241052,71692] 0 2024-04-26T23:09:01.028 INFO:tasks.workunit.client.0.smithi148.stdout:6/217: creat d6/dc/f45 x:0 0 0 2024-04-26T23:09:01.028 INFO:tasks.workunit.client.0.smithi148.stdout:6/218: write d6/f43 [1007842,10824] 0 2024-04-26T23:09:01.031 INFO:tasks.workunit.client.0.smithi148.stdout:9/273: rmdir d19/d1d 39 2024-04-26T23:09:01.040 INFO:tasks.workunit.client.0.smithi148.stdout:2/341: read d5/d17/f30 [3894943,21592] 0 2024-04-26T23:09:01.042 INFO:tasks.workunit.client.0.smithi148.stdout:3/274: link d9/d15/c16 d9/d15/d29/c5a 0 2024-04-26T23:09:01.295 INFO:tasks.workunit.client.0.smithi148.stdout:4/221: rename f10 to d12/d17/f3e 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:8/297: creat d3/d9/d12/d23/d35/f55 x:0 0 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:6/219: mkdir d6/dc/d46 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:9/274: mkdir d19/d39/d5f 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:4/222: getdents d12/d17/d2a/d37 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:4/223: readlink l6 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:2/342: symlink d5/d8/d70/d32/l71 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:3/275: mkdir d9/d15/d29/d4d/d5b 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:2/343: write d5/d8/d9/f4a [610930,83548] 0 2024-04-26T23:09:01.296 INFO:tasks.workunit.client.0.smithi148.stdout:2/344: write d5/d17/f30 [1618533,63292] 0 2024-04-26T23:09:01.297 INFO:tasks.workunit.client.0.smithi148.stdout:2/345: chown d5/d8/d11/f44 324295 1 2024-04-26T23:09:01.300 INFO:tasks.workunit.client.0.smithi148.stdout:7/264: rename d7/d11/f16 to d7/d11/d17/d2f/f5b 0 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/220: creat d6/f47 x:0 0 0 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/221: chown d6/d14/c3b 288865063 1 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/222: fdatasync d6/d9/f15 0 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/223: readlink d6/ld 0 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/224: chown d6/c18 1822845 1 2024-04-26T23:09:01.305 INFO:tasks.workunit.client.0.smithi148.stdout:7/265: dread d7/d11/d13/f21 [0,4194304] 0 2024-04-26T23:09:01.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/224: creat d12/d2c/f3f x:0 0 0 2024-04-26T23:09:01.311 INFO:tasks.workunit.client.0.smithi148.stdout:2/346: truncate d5/f2d 610218 0 2024-04-26T23:09:01.321 INFO:tasks.workunit.client.0.smithi148.stdout:5/299: sync 2024-04-26T23:09:01.322 INFO:tasks.workunit.client.0.smithi148.stdout:0/248: sync 2024-04-26T23:09:01.322 INFO:tasks.workunit.client.0.smithi148.stdout:5/300: write da/d1b/d5b/f4d [603487,71633] 0 2024-04-26T23:09:01.322 INFO:tasks.workunit.client.0.smithi148.stdout:5/301: write da/fb [3559403,69641] 0 2024-04-26T23:09:01.322 INFO:tasks.workunit.client.0.smithi148.stdout:3/276: dread d9/d15/f19 [0,4194304] 0 2024-04-26T23:09:01.324 INFO:tasks.workunit.client.0.smithi148.stdout:1/250: rename f7 to d16/d17/f4c 0 2024-04-26T23:09:01.324 INFO:tasks.workunit.client.0.smithi148.stdout:6/225: getdents d6/d9/d1e 0 2024-04-26T23:09:01.324 INFO:tasks.workunit.client.0.smithi148.stdout:1/251: dread - d16/d17/f39 zero size 2024-04-26T23:09:01.324 INFO:tasks.workunit.client.0.smithi148.stdout:2/347: creat d5/d17/d64/f72 x:0 0 0 2024-04-26T23:09:01.325 INFO:tasks.workunit.client.0.smithi148.stdout:1/252: fsync d16/d1c/f22 0 2024-04-26T23:09:01.325 INFO:tasks.workunit.client.0.smithi148.stdout:6/226: write d6/d9/d1c/f2e [1373843,99410] 0 2024-04-26T23:09:01.325 INFO:tasks.workunit.client.0.smithi148.stdout:6/227: write d6/f43 [1685144,78794] 0 2024-04-26T23:09:01.327 INFO:tasks.workunit.client.0.smithi148.stdout:0/249: truncate d0/d8/f14 1906810 0 2024-04-26T23:09:01.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/250: write d0/d2e/f50 [4553326,18466] 0 2024-04-26T23:09:01.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/251: dread - d0/d8/f4f zero size 2024-04-26T23:09:01.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/252: chown d0/d5/f7 1226029 1 2024-04-26T23:09:01.329 INFO:tasks.workunit.client.0.smithi148.stdout:3/277: rmdir d9/d15/d29 39 2024-04-26T23:09:01.329 INFO:tasks.workunit.client.0.smithi148.stdout:3/278: chown d9/l17 1160 1 2024-04-26T23:09:01.329 INFO:tasks.workunit.client.0.smithi148.stdout:3/279: write d9/d15/d29/d4d/f57 [437157,717] 0 2024-04-26T23:09:01.335 INFO:tasks.workunit.client.0.smithi148.stdout:7/266: rename d7/d11/d17/l3a to d7/d11/d17/d2f/d57/l5c 0 2024-04-26T23:09:01.339 INFO:tasks.workunit.client.0.smithi148.stdout:2/348: mkdir d5/d7/d73 0 2024-04-26T23:09:01.340 INFO:tasks.workunit.client.0.smithi148.stdout:2/349: write d5/d8/d70/d32/d4c/f60 [1994682,114443] 0 2024-04-26T23:09:01.341 INFO:tasks.workunit.client.0.smithi148.stdout:9/275: dwrite d19/d22/f5d [0,4194304] 0 2024-04-26T23:09:01.341 INFO:tasks.workunit.client.0.smithi148.stdout:9/276: chown d19/d1d/d25/d2f/f3d 1 1 2024-04-26T23:09:01.342 INFO:tasks.workunit.client.0.smithi148.stdout:7/267: read d7/d11/d17/d2f/f40 [87839,36777] 0 2024-04-26T23:09:01.346 INFO:tasks.workunit.client.0.smithi148.stdout:6/228: symlink d6/d9/d23/l48 0 2024-04-26T23:09:01.353 INFO:tasks.workunit.client.0.smithi148.stdout:4/225: rename d12/d1a/c36 to d12/c40 0 2024-04-26T23:09:01.353 INFO:tasks.workunit.client.0.smithi148.stdout:4/226: write d12/d1c/f28 [766067,8435] 0 2024-04-26T23:09:01.364 INFO:tasks.workunit.client.0.smithi148.stdout:4/227: creat d12/f41 x:0 0 0 2024-04-26T23:09:01.371 INFO:tasks.workunit.client.0.smithi148.stdout:8/298: dwrite d3/f5 [0,4194304] 0 2024-04-26T23:09:01.371 INFO:tasks.workunit.client.0.smithi148.stdout:8/299: stat d3/d9/d12 0 2024-04-26T23:09:01.372 INFO:tasks.workunit.client.0.smithi148.stdout:5/302: dread da/d12/f17 [0,4194304] 0 2024-04-26T23:09:01.372 INFO:tasks.workunit.client.0.smithi148.stdout:5/303: write da/d1b/d2d/f60 [829624,98979] 0 2024-04-26T23:09:01.374 INFO:tasks.workunit.client.0.smithi148.stdout:8/300: getdents d3/d9/d12/d23/d35 0 2024-04-26T23:09:01.383 INFO:tasks.workunit.client.0.smithi148.stdout:5/304: mknod da/d1b/d5b/c6e 0 2024-04-26T23:09:01.383 INFO:tasks.workunit.client.0.smithi148.stdout:0/253: unlink d0/d8/f14 0 2024-04-26T23:09:01.391 INFO:tasks.workunit.client.0.smithi148.stdout:6/229: dwrite d6/d9/d1c/d1d/d1f/f36 [0,4194304] 0 2024-04-26T23:09:01.397 INFO:tasks.workunit.client.0.smithi148.stdout:5/305: mkdir da/d1b/d5b/d5e/d6a/d6f 0 2024-04-26T23:09:01.397 INFO:tasks.workunit.client.0.smithi148.stdout:7/268: dwrite d7/d11/d17/d2f/f5b [0,4194304] 0 2024-04-26T23:09:01.397 INFO:tasks.workunit.client.0.smithi148.stdout:8/301: dread d3/d9/d12/f21 [0,4194304] 0 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:7/269: chown d7/d11/d29/d2e/d41/l59 2 1 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:7/270: readlink d7/d11/d17/d2f/d44/l47 0 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:8/302: write d3/d9/d12/d23/d35/f47 [910100,70195] 0 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:0/254: mkdir d0/d8/d5b 0 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:6/230: mknod d6/d9/c49 0 2024-04-26T23:09:01.398 INFO:tasks.workunit.client.0.smithi148.stdout:7/271: rename d7/l1b to d7/l5d 0 2024-04-26T23:09:01.399 INFO:tasks.workunit.client.0.smithi148.stdout:8/303: rmdir d3/d9/d12/d23/d35 39 2024-04-26T23:09:01.400 INFO:tasks.workunit.client.0.smithi148.stdout:0/255: creat d0/f5c x:0 0 0 2024-04-26T23:09:01.402 INFO:tasks.workunit.client.0.smithi148.stdout:7/272: unlink d7/d11/d17/d2f/f40 0 2024-04-26T23:09:01.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/304: rename d3/d9/l16 to d3/d9/d40/l56 0 2024-04-26T23:09:01.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/305: readlink d3/d9/d12/d23/d29/l31 0 2024-04-26T23:09:01.404 INFO:tasks.workunit.client.0.smithi148.stdout:0/256: mkdir d0/d20/d54/d5d 0 2024-04-26T23:09:01.405 INFO:tasks.workunit.client.0.smithi148.stdout:8/306: creat d3/d9/d12/d23/d35/f57 x:0 0 0 2024-04-26T23:09:01.407 INFO:tasks.workunit.client.0.smithi148.stdout:0/257: rmdir d0/d8/d5b 0 2024-04-26T23:09:01.407 INFO:tasks.workunit.client.0.smithi148.stdout:0/258: write d0/d2e/f50 [1501575,58225] 0 2024-04-26T23:09:01.407 INFO:tasks.workunit.client.0.smithi148.stdout:8/307: creat d3/d9/f58 x:0 0 0 2024-04-26T23:09:01.408 INFO:tasks.workunit.client.0.smithi148.stdout:0/259: truncate d0/d5/f1a 3055448 0 2024-04-26T23:09:01.409 INFO:tasks.workunit.client.0.smithi148.stdout:0/260: write d0/d8/d1e/f23 [1365422,46000] 0 2024-04-26T23:09:01.431 INFO:tasks.workunit.client.0.smithi148.stdout:9/277: dwrite d19/d1d/d25/d31/f45 [0,4194304] 0 2024-04-26T23:09:01.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/278: readlink d19/l40 0 2024-04-26T23:09:01.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/279: fdatasync d19/d1d/f51 0 2024-04-26T23:09:01.434 INFO:tasks.workunit.client.0.smithi148.stdout:9/280: mkdir d19/d1d/d25/d31/d60 0 2024-04-26T23:09:01.436 INFO:tasks.workunit.client.0.smithi148.stdout:9/281: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d61 0 2024-04-26T23:09:01.436 INFO:tasks.workunit.client.0.smithi148.stdout:9/282: fdatasync d19/d1d/f52 0 2024-04-26T23:09:01.438 INFO:tasks.workunit.client.0.smithi148.stdout:9/283: creat d19/d1d/d25/d31/d60/f62 x:0 0 0 2024-04-26T23:09:01.473 INFO:tasks.workunit.client.0.smithi148.stdout:9/284: dwrite d19/f2e [0,4194304] 0 2024-04-26T23:09:01.473 INFO:tasks.workunit.client.0.smithi148.stdout:9/285: chown d19/d1d/d25/d2f/d4d/f43 16 1 2024-04-26T23:09:01.474 INFO:tasks.workunit.client.0.smithi148.stdout:9/286: creat d19/d1d/d25/f63 x:0 0 0 2024-04-26T23:09:01.475 INFO:tasks.workunit.client.0.smithi148.stdout:9/287: chown d19/d1d/d49 298 1 2024-04-26T23:09:01.502 INFO:tasks.workunit.client.0.smithi148.stdout:9/288: dread d19/d22/f5d [0,4194304] 0 2024-04-26T23:09:01.502 INFO:tasks.workunit.client.0.smithi148.stdout:9/289: fdatasync f9 0 2024-04-26T23:09:01.503 INFO:tasks.workunit.client.0.smithi148.stdout:9/290: creat d19/d1d/d25/d2f/d4d/d33/d50/d61/f64 x:0 0 0 2024-04-26T23:09:01.504 INFO:tasks.workunit.client.0.smithi148.stdout:9/291: getdents d19/d1d/d25/d2f/d4d 0 2024-04-26T23:09:01.506 INFO:tasks.workunit.client.0.smithi148.stdout:9/292: mknod d19/c65 0 2024-04-26T23:09:01.507 INFO:tasks.workunit.client.0.smithi148.stdout:9/293: creat d19/d1d/f66 x:0 0 0 2024-04-26T23:09:01.507 INFO:tasks.workunit.client.0.smithi148.stdout:9/294: truncate d19/d1d/f52 554719 0 2024-04-26T23:09:01.508 INFO:tasks.workunit.client.0.smithi148.stdout:9/295: rmdir d19/d1d/d25/d31/d60 39 2024-04-26T23:09:01.509 INFO:tasks.workunit.client.0.smithi148.stdout:9/296: mknod d19/d1d/d25/d2f/d4d/c67 0 2024-04-26T23:09:01.509 INFO:tasks.workunit.client.0.smithi148.stdout:9/297: dread - d19/d1d/d25/d2f/f53 zero size 2024-04-26T23:09:01.546 INFO:tasks.workunit.client.0.smithi148.stdout:9/298: dwrite d19/d1d/d25/d31/f56 [0,4194304] 0 2024-04-26T23:09:01.546 INFO:tasks.workunit.client.0.smithi148.stdout:9/299: read d19/d1d/d25/f3e [341288,115037] 0 2024-04-26T23:09:01.546 INFO:tasks.workunit.client.0.smithi148.stdout:9/300: chown fe 194111 1 2024-04-26T23:09:01.547 INFO:tasks.workunit.client.0.smithi148.stdout:9/301: symlink d19/d1d/d25/d2f/d4d/d33/d50/d61/l68 0 2024-04-26T23:09:01.547 INFO:tasks.workunit.client.0.smithi148.stdout:9/302: chown d19/d1d/d25/d2f/d4d/f43 639201275 1 2024-04-26T23:09:01.549 INFO:tasks.workunit.client.0.smithi148.stdout:9/303: mkdir d19/d1d/d69 0 2024-04-26T23:09:01.549 INFO:tasks.workunit.client.0.smithi148.stdout:9/304: chown d19/d1d/d49/f5c 26672 1 2024-04-26T23:09:01.552 INFO:tasks.workunit.client.0.smithi148.stdout:9/305: read ff [1112378,103725] 0 2024-04-26T23:09:01.562 INFO:tasks.workunit.client.0.smithi148.stdout:9/306: dread d19/d1d/d25/d2f/f3d [0,4194304] 0 2024-04-26T23:09:01.563 INFO:tasks.workunit.client.0.smithi148.stdout:9/307: symlink d19/d22/l6a 0 2024-04-26T23:09:01.563 INFO:tasks.workunit.client.0.smithi148.stdout:9/308: stat d19/d1d/d25/d2f/d4d/d33 0 2024-04-26T23:09:01.564 INFO:tasks.workunit.client.0.smithi148.stdout:9/309: link d19/d1d/d25/d31/d32/c5e d19/d1d/d25/d2f/d4d/d33/d50/d57/c6b 0 2024-04-26T23:09:01.565 INFO:tasks.workunit.client.0.smithi148.stdout:9/310: write ff [2765818,2598] 0 2024-04-26T23:09:01.565 INFO:tasks.workunit.client.0.smithi148.stdout:9/311: symlink d19/d1d/l6c 0 2024-04-26T23:09:01.566 INFO:tasks.workunit.client.0.smithi148.stdout:9/312: mknod d19/d1d/d69/c6d 0 2024-04-26T23:09:01.567 INFO:tasks.workunit.client.0.smithi148.stdout:9/313: getdents d19/d1d/d25/d31/d48 0 2024-04-26T23:09:01.569 INFO:tasks.workunit.client.0.smithi148.stdout:9/314: rename d19/d1d/d69/c6d to d19/d1d/d25/c6e 0 2024-04-26T23:09:01.569 INFO:tasks.workunit.client.0.smithi148.stdout:9/315: chown d19/d1d/d25/d2f/d4d 1971178 1 2024-04-26T23:09:01.630 INFO:tasks.workunit.client.0.smithi148.stdout:9/316: dwrite f18 [0,4194304] 0 2024-04-26T23:09:01.714 INFO:tasks.workunit.client.0.smithi148.stdout:1/253: dwrite d16/d1c/f2c [4194304,4194304] 0 2024-04-26T23:09:01.721 INFO:tasks.workunit.client.0.smithi148.stdout:1/254: mkdir d16/d17/d4b/d4d 0 2024-04-26T23:09:01.726 INFO:tasks.workunit.client.0.smithi148.stdout:1/255: creat d16/f4e x:0 0 0 2024-04-26T23:09:01.726 INFO:tasks.workunit.client.0.smithi148.stdout:1/256: chown d16/d1c/f32 918 1 2024-04-26T23:09:01.726 INFO:tasks.workunit.client.0.smithi148.stdout:1/257: chown d16/d17/d4b 356270 1 2024-04-26T23:09:01.736 INFO:tasks.workunit.client.0.smithi148.stdout:1/258: dread d16/d17/f25 [0,4194304] 0 2024-04-26T23:09:01.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/259: symlink d16/d45/d2b/d3e/l4f 0 2024-04-26T23:09:01.759 INFO:tasks.workunit.client.0.smithi148.stdout:1/260: dread d16/d45/f35 [0,4194304] 0 2024-04-26T23:09:01.760 INFO:tasks.workunit.client.0.smithi148.stdout:1/261: stat d16/d1c/f29 0 2024-04-26T23:09:01.760 INFO:tasks.workunit.client.0.smithi148.stdout:1/262: truncate d16/f37 921072 0 2024-04-26T23:09:01.762 INFO:tasks.workunit.client.0.smithi148.stdout:1/263: truncate d16/d17/f24 2197891 0 2024-04-26T23:09:01.762 INFO:tasks.workunit.client.0.smithi148.stdout:1/264: chown d16/d45/d2b/d3e/l4f 1 1 2024-04-26T23:09:01.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/280: dwrite d9/d15/f24 [4194304,4194304] 0 2024-04-26T23:09:01.958 INFO:tasks.workunit.client.0.smithi148.stdout:2/350: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:09:01.959 INFO:tasks.workunit.client.0.smithi148.stdout:4/228: dread d12/d17/f18 [0,4194304] 0 2024-04-26T23:09:01.959 INFO:tasks.workunit.client.0.smithi148.stdout:4/229: readlink l6 0 2024-04-26T23:09:01.959 INFO:tasks.workunit.client.0.smithi148.stdout:4/230: readlink l11 0 2024-04-26T23:09:01.960 INFO:tasks.workunit.client.0.smithi148.stdout:5/306: write da/d1b/d5b/f39 [482333,85759] 0 2024-04-26T23:09:01.960 INFO:tasks.workunit.client.0.smithi148.stdout:7/273: dwrite d7/d11/d29/f37 [0,4194304] 0 2024-04-26T23:09:01.960 INFO:tasks.workunit.client.0.smithi148.stdout:6/231: dwrite d6/d9/f15 [0,4194304] 0 2024-04-26T23:09:01.961 INFO:tasks.workunit.client.0.smithi148.stdout:5/307: readlink da/d1a/l2e 0 2024-04-26T23:09:01.961 INFO:tasks.workunit.client.0.smithi148.stdout:6/232: truncate d6/f47 295219 0 2024-04-26T23:09:01.961 INFO:tasks.workunit.client.0.smithi148.stdout:2/351: rmdir d5/d1c/d38 39 2024-04-26T23:09:01.961 INFO:tasks.workunit.client.0.smithi148.stdout:3/281: dwrite d9/d15/f1e [0,4194304] 0 2024-04-26T23:09:01.965 INFO:tasks.workunit.client.0.smithi148.stdout:5/308: mkdir da/d70 0 2024-04-26T23:09:01.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/309: dread f5 [0,4194304] 0 2024-04-26T23:09:01.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/310: dread - da/d1b/d1c/f53 zero size 2024-04-26T23:09:01.968 INFO:tasks.workunit.client.0.smithi148.stdout:6/233: mkdir d6/d9/d23/d4a 0 2024-04-26T23:09:01.972 INFO:tasks.workunit.client.0.smithi148.stdout:2/352: mkdir d5/d8/d15/d43/d5d/d74 0 2024-04-26T23:09:01.982 INFO:tasks.workunit.client.0.smithi148.stdout:5/311: mkdir da/d1f/d67/d71 0 2024-04-26T23:09:01.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/261: dread d0/d2e/f35 [0,4194304] 0 2024-04-26T23:09:01.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/262: truncate d0/f5c 185143 0 2024-04-26T23:09:01.985 INFO:tasks.workunit.client.0.smithi148.stdout:9/317: dread d19/f23 [0,4194304] 0 2024-04-26T23:09:01.985 INFO:tasks.workunit.client.0.smithi148.stdout:9/318: dread - d19/d39/f54 zero size 2024-04-26T23:09:01.986 INFO:tasks.workunit.client.0.smithi148.stdout:0/263: write d0/f5c [110944,61509] 0 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:2/353: mkdir d5/d8/d15/d43/d75 0 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:5/312: mkdir da/d1b/d3b/d72 0 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:4/231: write d12/d17/f2e [846353,53535] 0 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:2/354: chown d5/d8/d70/d32/f37 352 1 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:2/355: write d5/d8/d15/d43/f5f [839759,27188] 0 2024-04-26T23:09:01.991 INFO:tasks.workunit.client.0.smithi148.stdout:2/356: dread - d5/d8/f54 zero size 2024-04-26T23:09:01.993 INFO:tasks.workunit.client.0.smithi148.stdout:9/319: truncate d19/f2d 3092299 0 2024-04-26T23:09:01.993 INFO:tasks.workunit.client.0.smithi148.stdout:9/320: dread - d19/d1d/d25/d2f/d4d/d33/d50/d61/f64 zero size 2024-04-26T23:09:01.998 INFO:tasks.workunit.client.0.smithi148.stdout:2/357: write d5/d8/d70/d32/d4c/f60 [1498733,62231] 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/308: dwrite d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/309: chown d3/d9/f49 650697 1 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/310: truncate d3/f44 12599613 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/313: unlink da/f1d 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/314: dread - da/f5c zero size 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/315: write f5 [313483,47447] 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/316: fsync da/f3f 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:4/232: creat d12/d17/d2a/d37/f42 x:0 0 0 2024-04-26T23:09:02.005 INFO:tasks.workunit.client.0.smithi148.stdout:0/264: truncate d0/d20/f40 1010081 0 2024-04-26T23:09:02.006 INFO:tasks.workunit.client.0.smithi148.stdout:0/265: stat d0/d8 0 2024-04-26T23:09:02.006 INFO:tasks.workunit.client.0.smithi148.stdout:0/266: readlink d0/l11 0 2024-04-26T23:09:02.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/358: link d5/d10/f19 d5/d17/d64/f76 0 2024-04-26T23:09:02.010 INFO:tasks.workunit.client.0.smithi148.stdout:7/274: truncate d7/d11/d17/d2f/f5b 4130981 0 2024-04-26T23:09:02.029 INFO:tasks.workunit.client.0.smithi148.stdout:5/317: mkdir da/d1b/d3b/d73 0 2024-04-26T23:09:02.030 INFO:tasks.workunit.client.0.smithi148.stdout:5/318: chown da/d1b/d2d/c58 81642143 1 2024-04-26T23:09:02.032 INFO:tasks.workunit.client.0.smithi148.stdout:7/275: creat d7/d11/d29/d2e/f5e x:0 0 0 2024-04-26T23:09:02.032 INFO:tasks.workunit.client.0.smithi148.stdout:2/359: truncate d5/d10/f14 1610040 0 2024-04-26T23:09:02.033 INFO:tasks.workunit.client.0.smithi148.stdout:3/282: dwrite d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:02.033 INFO:tasks.workunit.client.0.smithi148.stdout:3/283: truncate d9/f2d 1371272 0 2024-04-26T23:09:02.033 INFO:tasks.workunit.client.0.smithi148.stdout:6/234: dwrite d6/f43 [0,4194304] 0 2024-04-26T23:09:02.034 INFO:tasks.workunit.client.0.smithi148.stdout:5/319: creat da/d1b/d1c/d54/f74 x:0 0 0 2024-04-26T23:09:02.034 INFO:tasks.workunit.client.0.smithi148.stdout:0/267: dwrite d0/d8/d52/f30 [4194304,4194304] 0 2024-04-26T23:09:02.035 INFO:tasks.workunit.client.0.smithi148.stdout:7/276: rename d7/d11/d29/d2e/f5e to d7/d11/d29/f5f 0 2024-04-26T23:09:02.036 INFO:tasks.workunit.client.0.smithi148.stdout:2/360: truncate d5/d7/f24 311088 0 2024-04-26T23:09:02.042 INFO:tasks.workunit.client.0.smithi148.stdout:3/284: rmdir d9/d15/d29/d4d 39 2024-04-26T23:09:02.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/235: symlink d6/d14/l4b 0 2024-04-26T23:09:02.048 INFO:tasks.workunit.client.0.smithi148.stdout:8/311: read d3/d9/d12/f46 [1230517,60019] 0 2024-04-26T23:09:02.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/320: creat da/d1f/d47/f75 x:0 0 0 2024-04-26T23:09:02.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/321: chown da/fc 3 1 2024-04-26T23:09:02.050 INFO:tasks.workunit.client.0.smithi148.stdout:7/277: mkdir d7/d11/d60 0 2024-04-26T23:09:02.051 INFO:tasks.workunit.client.0.smithi148.stdout:0/268: getdents d0/d5 0 2024-04-26T23:09:02.051 INFO:tasks.workunit.client.0.smithi148.stdout:0/269: getdents d0/d2e/d51 0 2024-04-26T23:09:02.052 INFO:tasks.workunit.client.0.smithi148.stdout:2/361: truncate d5/d8/d9/f4a 518388 0 2024-04-26T23:09:02.052 INFO:tasks.workunit.client.0.smithi148.stdout:9/321: dwrite d19/d1d/d25/d31/f45 [4194304,4194304] 0 2024-04-26T23:09:02.054 INFO:tasks.workunit.client.0.smithi148.stdout:3/285: creat d9/d52/f5c x:0 0 0 2024-04-26T23:09:02.054 INFO:tasks.workunit.client.0.smithi148.stdout:3/286: truncate d9/f40 4919143 0 2024-04-26T23:09:02.057 INFO:tasks.workunit.client.0.smithi148.stdout:8/312: rename d3/d9/d12/d23/d29/d37/f3d to d3/d9/d12/d23/d29/d37/f59 0 2024-04-26T23:09:02.057 INFO:tasks.workunit.client.0.smithi148.stdout:8/313: truncate d3/da/d1c/f45 1144750 0 2024-04-26T23:09:02.057 INFO:tasks.workunit.client.0.smithi148.stdout:8/314: write d3/f3c [1037888,18183] 0 2024-04-26T23:09:02.058 INFO:tasks.workunit.client.0.smithi148.stdout:5/322: truncate da/d1b/d1c/f66 708837 0 2024-04-26T23:09:02.060 INFO:tasks.workunit.client.0.smithi148.stdout:7/278: mkdir d7/d11/d60/d61 0 2024-04-26T23:09:02.062 INFO:tasks.workunit.client.0.smithi148.stdout:0/270: rename d0/l46 to d0/d8/d55/l5e 0 2024-04-26T23:09:02.064 INFO:tasks.workunit.client.0.smithi148.stdout:2/362: link d5/d10/f58 d5/d8/d4b/f77 0 2024-04-26T23:09:02.065 INFO:tasks.workunit.client.0.smithi148.stdout:9/322: symlink d19/d39/d5f/l6f 0 2024-04-26T23:09:02.065 INFO:tasks.workunit.client.0.smithi148.stdout:9/323: chown d19/c65 221013 1 2024-04-26T23:09:02.066 INFO:tasks.workunit.client.0.smithi148.stdout:9/324: chown d19/d1d/l2a 4710 1 2024-04-26T23:09:02.067 INFO:tasks.workunit.client.0.smithi148.stdout:3/287: getdents d9 0 2024-04-26T23:09:02.068 INFO:tasks.workunit.client.0.smithi148.stdout:5/323: fsync f3 0 2024-04-26T23:09:02.069 INFO:tasks.workunit.client.0.smithi148.stdout:2/363: mkdir d5/d8/d70/d78 0 2024-04-26T23:09:02.070 INFO:tasks.workunit.client.0.smithi148.stdout:9/325: symlink d19/d1d/l70 0 2024-04-26T23:09:02.070 INFO:tasks.workunit.client.0.smithi148.stdout:9/326: dread - d19/d1d/d25/f63 zero size 2024-04-26T23:09:02.070 INFO:tasks.workunit.client.0.smithi148.stdout:9/327: write d19/d1d/d25/d31/d60/f62 [691419,57504] 0 2024-04-26T23:09:02.072 INFO:tasks.workunit.client.0.smithi148.stdout:3/288: symlink d9/d52/l5d 0 2024-04-26T23:09:02.089 INFO:tasks.workunit.client.0.smithi148.stdout:3/289: creat d9/d15/d29/d4d/d5b/f5e x:0 0 0 2024-04-26T23:09:02.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/233: dwrite d12/d2c/f3f [0,4194304] 0 2024-04-26T23:09:02.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/234: chown d12/d17/f18 4 1 2024-04-26T23:09:02.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/315: dread d3/d9/d12/d23/d35/f47 [0,4194304] 0 2024-04-26T23:09:02.099 INFO:tasks.workunit.client.0.smithi148.stdout:9/328: dread f18 [0,4194304] 0 2024-04-26T23:09:02.101 INFO:tasks.workunit.client.0.smithi148.stdout:3/290: creat d9/d4c/f5f x:0 0 0 2024-04-26T23:09:02.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/235: creat d12/d1c/f43 x:0 0 0 2024-04-26T23:09:02.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/236: dread - d12/f35 zero size 2024-04-26T23:09:02.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/237: write d12/d17/d2a/d37/f42 [208512,58517] 0 2024-04-26T23:09:02.110 INFO:tasks.workunit.client.0.smithi148.stdout:8/316: symlink d3/d9/l5a 0 2024-04-26T23:09:02.110 INFO:tasks.workunit.client.0.smithi148.stdout:8/317: fsync d3/d9/d12/f46 0 2024-04-26T23:09:02.110 INFO:tasks.workunit.client.0.smithi148.stdout:8/318: fsync d3/d9/d12/d23/d35/f57 0 2024-04-26T23:09:02.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/324: write da/d1b/d2d/f48 [219348,70525] 0 2024-04-26T23:09:02.113 INFO:tasks.workunit.client.0.smithi148.stdout:9/329: mknod d19/d22/c71 0 2024-04-26T23:09:02.124 INFO:tasks.workunit.client.0.smithi148.stdout:4/238: creat d12/d17/d2a/d33/f44 x:0 0 0 2024-04-26T23:09:02.126 INFO:tasks.workunit.client.0.smithi148.stdout:8/319: creat d3/d9/d12/d23/d35/f5b x:0 0 0 2024-04-26T23:09:02.127 INFO:tasks.workunit.client.0.smithi148.stdout:9/330: symlink d19/d1d/d25/d2f/d4d/l72 0 2024-04-26T23:09:02.129 INFO:tasks.workunit.client.0.smithi148.stdout:8/320: unlink d3/f5 0 2024-04-26T23:09:02.129 INFO:tasks.workunit.client.0.smithi148.stdout:8/321: write d3/d9/d12/d23/d29/d37/f59 [1406070,23235] 0 2024-04-26T23:09:02.133 INFO:tasks.workunit.client.0.smithi148.stdout:9/331: mkdir d19/d1d/d25/d31/d73 0 2024-04-26T23:09:02.135 INFO:tasks.workunit.client.0.smithi148.stdout:9/332: creat d19/d1d/d25/d31/d32/f74 x:0 0 0 2024-04-26T23:09:02.135 INFO:tasks.workunit.client.0.smithi148.stdout:9/333: fdatasync d19/d1d/d25/d2f/f53 0 2024-04-26T23:09:02.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/334: creat d19/d1d/d25/d2f/d4d/d33/d50/d57/f75 x:0 0 0 2024-04-26T23:09:02.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/335: getdents d19/d1d/d25/d31/d73 0 2024-04-26T23:09:02.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/336: rename d19/f23 to d19/d22/f76 0 2024-04-26T23:09:02.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/337: write d19/d1d/d25/d31/f55 [4122825,24117] 0 2024-04-26T23:09:02.145 INFO:tasks.workunit.client.0.smithi148.stdout:9/338: truncate d19/f4a 647439 0 2024-04-26T23:09:02.145 INFO:tasks.workunit.client.0.smithi148.stdout:0/271: dwrite d0/f5c [0,4194304] 0 2024-04-26T23:09:02.145 INFO:tasks.workunit.client.0.smithi148.stdout:0/272: readlink d0/l4 0 2024-04-26T23:09:02.146 INFO:tasks.workunit.client.0.smithi148.stdout:9/339: symlink d19/d1d/d25/d2f/d4d/d33/d50/d57/l77 0 2024-04-26T23:09:02.149 INFO:tasks.workunit.client.0.smithi148.stdout:9/340: mkdir d19/d1d/d25/d78 0 2024-04-26T23:09:02.150 INFO:tasks.workunit.client.0.smithi148.stdout:9/341: mknod d19/d1d/d25/d2f/c79 0 2024-04-26T23:09:02.151 INFO:tasks.workunit.client.0.smithi148.stdout:9/342: creat d19/d1d/d25/d31/d73/f7a x:0 0 0 2024-04-26T23:09:02.153 INFO:tasks.workunit.client.0.smithi148.stdout:9/343: mkdir d19/d22/d7b 0 2024-04-26T23:09:02.167 INFO:tasks.workunit.client.0.smithi148.stdout:6/236: dwrite d6/f19 [4194304,4194304] 0 2024-04-26T23:09:02.167 INFO:tasks.workunit.client.0.smithi148.stdout:2/364: dwrite d5/d8/d11/f61 [0,4194304] 0 2024-04-26T23:09:02.167 INFO:tasks.workunit.client.0.smithi148.stdout:2/365: truncate d5/d10/f48 1090316 0 2024-04-26T23:09:02.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/273: dread d0/f1b [0,4194304] 0 2024-04-26T23:09:02.219 INFO:tasks.workunit.client.0.smithi148.stdout:2/366: dwrite d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:09:02.219 INFO:tasks.workunit.client.0.smithi148.stdout:3/291: dwrite d9/f11 [0,4194304] 0 2024-04-26T23:09:02.219 INFO:tasks.workunit.client.0.smithi148.stdout:4/239: dread d12/d17/d2a/d37/f42 [0,4194304] 0 2024-04-26T23:09:02.219 INFO:tasks.workunit.client.0.smithi148.stdout:7/279: dwrite d7/d19/f35 [0,4194304] 0 2024-04-26T23:09:02.219 INFO:tasks.workunit.client.0.smithi148.stdout:7/280: readlink l4 0 2024-04-26T23:09:02.221 INFO:tasks.workunit.client.0.smithi148.stdout:3/292: mknod d9/c60 0 2024-04-26T23:09:02.222 INFO:tasks.workunit.client.0.smithi148.stdout:4/240: getdents d12/d1a 0 2024-04-26T23:09:02.226 INFO:tasks.workunit.client.0.smithi148.stdout:7/281: rmdir d7/d11/d60/d61 0 2024-04-26T23:09:02.226 INFO:tasks.workunit.client.0.smithi148.stdout:3/293: symlink d9/d15/d29/d4d/l61 0 2024-04-26T23:09:02.226 INFO:tasks.workunit.client.0.smithi148.stdout:3/294: readlink d9/d15/l54 0 2024-04-26T23:09:02.226 INFO:tasks.workunit.client.0.smithi148.stdout:3/295: stat d9/d31/c41 0 2024-04-26T23:09:02.227 INFO:tasks.workunit.client.0.smithi148.stdout:4/241: mkdir d12/d1c/d45 0 2024-04-26T23:09:02.231 INFO:tasks.workunit.client.0.smithi148.stdout:3/296: truncate d9/f43 827315 0 2024-04-26T23:09:02.231 INFO:tasks.workunit.client.0.smithi148.stdout:4/242: unlink d12/d1a/f29 0 2024-04-26T23:09:02.233 INFO:tasks.workunit.client.0.smithi148.stdout:4/243: truncate d12/d2c/f39 848848 0 2024-04-26T23:09:02.234 INFO:tasks.workunit.client.0.smithi148.stdout:1/265: sync 2024-04-26T23:09:02.237 INFO:tasks.workunit.client.0.smithi148.stdout:4/244: write d12/d1a/f23 [3719175,111811] 0 2024-04-26T23:09:02.241 INFO:tasks.workunit.client.0.smithi148.stdout:2/367: dread d5/d7/f18 [0,4194304] 0 2024-04-26T23:09:02.260 INFO:tasks.workunit.client.0.smithi148.stdout:9/344: dwrite d19/f2e [0,4194304] 0 2024-04-26T23:09:02.260 INFO:tasks.workunit.client.0.smithi148.stdout:0/274: dwrite d0/d8/f4f [0,4194304] 0 2024-04-26T23:09:02.262 INFO:tasks.workunit.client.0.smithi148.stdout:9/345: symlink d19/d1d/l7c 0 2024-04-26T23:09:02.262 INFO:tasks.workunit.client.0.smithi148.stdout:9/346: fsync d19/d1d/d25/f63 0 2024-04-26T23:09:02.264 INFO:tasks.workunit.client.0.smithi148.stdout:0/275: rmdir d0/d5 39 2024-04-26T23:09:02.282 INFO:tasks.workunit.client.0.smithi148.stdout:1/266: dwrite d16/d17/f4c [4194304,4194304] 0 2024-04-26T23:09:02.284 INFO:tasks.workunit.client.0.smithi148.stdout:1/267: symlink d16/d47/l50 0 2024-04-26T23:09:02.288 INFO:tasks.workunit.client.0.smithi148.stdout:0/276: dread d0/d5/f3f [0,4194304] 0 2024-04-26T23:09:02.290 INFO:tasks.workunit.client.0.smithi148.stdout:0/277: mkdir d0/d8/d5f 0 2024-04-26T23:09:02.290 INFO:tasks.workunit.client.0.smithi148.stdout:0/278: chown d0/d8/d1e/f22 421327 1 2024-04-26T23:09:02.297 INFO:tasks.workunit.client.0.smithi148.stdout:0/279: dread d0/f1b [0,4194304] 0 2024-04-26T23:09:02.298 INFO:tasks.workunit.client.0.smithi148.stdout:0/280: read - d0/f24 zero size 2024-04-26T23:09:02.298 INFO:tasks.workunit.client.0.smithi148.stdout:0/281: write d0/d8/d1e/f22 [209521,90210] 0 2024-04-26T23:09:02.317 INFO:tasks.workunit.client.0.smithi148.stdout:9/347: dread d19/d22/f26 [0,4194304] 0 2024-04-26T23:09:02.317 INFO:tasks.workunit.client.0.smithi148.stdout:9/348: chown d19/c46 26351 1 2024-04-26T23:09:02.329 INFO:tasks.workunit.client.0.smithi148.stdout:7/282: dwrite d7/d11/d29/f5f [0,4194304] 0 2024-04-26T23:09:02.332 INFO:tasks.workunit.client.0.smithi148.stdout:5/325: dwrite da/d1b/d5b/f3a [0,4194304] 0 2024-04-26T23:09:02.332 INFO:tasks.workunit.client.0.smithi148.stdout:6/237: write d6/f47 [125652,58687] 0 2024-04-26T23:09:02.338 INFO:tasks.workunit.client.0.smithi148.stdout:7/283: symlink d7/d11/d29/l62 0 2024-04-26T23:09:02.342 INFO:tasks.workunit.client.0.smithi148.stdout:5/326: truncate da/f10 2142193 0 2024-04-26T23:09:02.343 INFO:tasks.workunit.client.0.smithi148.stdout:0/282: dwrite d0/f24 [0,4194304] 0 2024-04-26T23:09:02.344 INFO:tasks.workunit.client.0.smithi148.stdout:6/238: truncate d6/d9/f15 1620438 0 2024-04-26T23:09:02.360 INFO:tasks.workunit.client.0.smithi148.stdout:5/327: write f3 [2985841,83082] 0 2024-04-26T23:09:02.361 INFO:tasks.workunit.client.0.smithi148.stdout:0/283: truncate d0/d8/d1e/f2a 727943 0 2024-04-26T23:09:02.369 INFO:tasks.workunit.client.0.smithi148.stdout:2/368: dwrite d5/f2d [0,4194304] 0 2024-04-26T23:09:02.369 INFO:tasks.workunit.client.0.smithi148.stdout:3/297: dwrite d9/f43 [0,4194304] 0 2024-04-26T23:09:02.372 INFO:tasks.workunit.client.0.smithi148.stdout:5/328: symlink da/d1b/d5b/d5e/d6a/d6f/l76 0 2024-04-26T23:09:02.372 INFO:tasks.workunit.client.0.smithi148.stdout:5/329: fsync da/d1f/d47/f75 0 2024-04-26T23:09:02.375 INFO:tasks.workunit.client.0.smithi148.stdout:5/330: creat da/d70/f77 x:0 0 0 2024-04-26T23:09:02.387 INFO:tasks.workunit.client.0.smithi148.stdout:0/284: dread d0/d5/f3f [0,4194304] 0 2024-04-26T23:09:02.388 INFO:tasks.workunit.client.0.smithi148.stdout:5/331: mkdir da/d12/d78 0 2024-04-26T23:09:02.390 INFO:tasks.workunit.client.0.smithi148.stdout:5/332: symlink da/d1a/l79 0 2024-04-26T23:09:02.408 INFO:tasks.workunit.client.0.smithi148.stdout:3/298: write d9/f40 [3888403,123747] 0 2024-04-26T23:09:02.412 INFO:tasks.workunit.client.0.smithi148.stdout:0/285: rename d0/f24 to d0/d2e/d51/f60 0 2024-04-26T23:09:02.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/369: dwrite d5/d8/d11/f62 [0,4194304] 0 2024-04-26T23:09:02.421 INFO:tasks.workunit.client.0.smithi148.stdout:5/333: rename da/d1b/d5b/d5e/d6a/d6f to da/d68/d7a 0 2024-04-26T23:09:02.421 INFO:tasks.workunit.client.0.smithi148.stdout:5/334: stat da/d1a/f28 0 2024-04-26T23:09:02.424 INFO:tasks.workunit.client.0.smithi148.stdout:4/245: dwrite d12/d2c/f3c [0,4194304] 0 2024-04-26T23:09:02.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/335: creat da/d1b/d2d/f7b x:0 0 0 2024-04-26T23:09:02.435 INFO:tasks.workunit.client.0.smithi148.stdout:2/370: write d5/d1c/d38/f47 [2580771,52959] 0 2024-04-26T23:09:02.436 INFO:tasks.workunit.client.0.smithi148.stdout:2/371: write d5/d7/f18 [5505183,129141] 0 2024-04-26T23:09:02.436 INFO:tasks.workunit.client.0.smithi148.stdout:5/336: rmdir da/d1b/d1c/d54 39 2024-04-26T23:09:02.438 INFO:tasks.workunit.client.0.smithi148.stdout:2/372: rename d5/d7/f18 to d5/d8/d9/f79 0 2024-04-26T23:09:02.439 INFO:tasks.workunit.client.0.smithi148.stdout:5/337: truncate da/d1b/d5b/f39 152212 0 2024-04-26T23:09:02.442 INFO:tasks.workunit.client.0.smithi148.stdout:2/373: creat d5/d8/d4b/f7a x:0 0 0 2024-04-26T23:09:02.474 INFO:tasks.workunit.client.0.smithi148.stdout:2/374: creat d5/d8/f7b x:0 0 0 2024-04-26T23:09:02.513 INFO:tasks.workunit.client.0.smithi148.stdout:6/239: dwrite d6/d9/d1c/d1d/d1f/f36 [0,4194304] 0 2024-04-26T23:09:02.545 INFO:tasks.workunit.client.0.smithi148.stdout:6/240: write d6/f33 [6918466,12350] 0 2024-04-26T23:09:02.546 INFO:tasks.workunit.client.0.smithi148.stdout:2/375: creat d5/d8/d15/d43/d5d/f7c x:0 0 0 2024-04-26T23:09:02.547 INFO:tasks.workunit.client.0.smithi148.stdout:2/376: read d5/d17/f39 [1331556,108346] 0 2024-04-26T23:09:02.547 INFO:tasks.workunit.client.0.smithi148.stdout:1/268: dwrite d16/f4e [0,4194304] 0 2024-04-26T23:09:02.547 INFO:tasks.workunit.client.0.smithi148.stdout:1/269: chown d16/f4a 6788 1 2024-04-26T23:09:02.548 INFO:tasks.workunit.client.0.smithi148.stdout:6/241: creat d6/d9/d1c/d1d/d1f/f4c x:0 0 0 2024-04-26T23:09:02.574 INFO:tasks.workunit.client.0.smithi148.stdout:6/242: read d6/d9/f15 [552419,13835] 0 2024-04-26T23:09:02.574 INFO:tasks.workunit.client.0.smithi148.stdout:6/243: chown d6/d9/d1c/d1d/d1f/f4c 0 1 2024-04-26T23:09:02.574 INFO:tasks.workunit.client.0.smithi148.stdout:6/244: write d6/d9/d1c/f2e [2226507,93006] 0 2024-04-26T23:09:02.576 INFO:tasks.workunit.client.0.smithi148.stdout:1/270: rename d16/d47/l50 to d16/d47/d49/l51 0 2024-04-26T23:09:02.577 INFO:tasks.workunit.client.0.smithi148.stdout:6/245: symlink d6/d9/d23/l4d 0 2024-04-26T23:09:02.578 INFO:tasks.workunit.client.0.smithi148.stdout:0/286: dwrite d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:09:02.580 INFO:tasks.workunit.client.0.smithi148.stdout:1/271: link d16/d1c/f26 d16/d17/d4b/d4d/f52 0 2024-04-26T23:09:02.581 INFO:tasks.workunit.client.0.smithi148.stdout:6/246: rmdir d6/d9/d1c 39 2024-04-26T23:09:02.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/287: mknod d0/d20/d3b/c61 0 2024-04-26T23:09:02.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/288: fdatasync d0/d2e/f35 0 2024-04-26T23:09:02.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/289: chown d0/d8/d52/c39 471751 1 2024-04-26T23:09:02.589 INFO:tasks.workunit.client.0.smithi148.stdout:2/377: dwrite d5/d8/d9/f63 [4194304,4194304] 0 2024-04-26T23:09:02.604 INFO:tasks.workunit.client.0.smithi148.stdout:6/247: mkdir d6/d32/d4e 0 2024-04-26T23:09:02.605 INFO:tasks.workunit.client.0.smithi148.stdout:2/378: mkdir d5/d8/d15/d7d 0 2024-04-26T23:09:02.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/248: dread d6/f47 [0,4194304] 0 2024-04-26T23:09:02.629 INFO:tasks.workunit.client.0.smithi148.stdout:1/272: dwrite d16/d1c/f22 [4194304,4194304] 0 2024-04-26T23:09:02.642 INFO:tasks.workunit.client.0.smithi148.stdout:1/273: write d16/d45/f2f [891050,126423] 0 2024-04-26T23:09:02.642 INFO:tasks.workunit.client.0.smithi148.stdout:1/274: truncate d16/f20 766278 0 2024-04-26T23:09:02.646 INFO:tasks.workunit.client.0.smithi148.stdout:2/379: dwrite d5/f2d [0,4194304] 0 2024-04-26T23:09:02.646 INFO:tasks.workunit.client.0.smithi148.stdout:2/380: chown d5/d7 0 1 2024-04-26T23:09:02.649 INFO:tasks.workunit.client.0.smithi148.stdout:6/249: link d6/d9/l16 d6/d14/l4f 0 2024-04-26T23:09:02.652 INFO:tasks.workunit.client.0.smithi148.stdout:0/290: dwrite d0/d8/d52/f1f [0,4194304] 0 2024-04-26T23:09:02.652 INFO:tasks.workunit.client.0.smithi148.stdout:0/291: chown d0/d5/d19/d3a/c41 18581 1 2024-04-26T23:09:02.705 INFO:tasks.workunit.client.0.smithi148.stdout:1/275: dread d16/d17/f1b [0,4194304] 0 2024-04-26T23:09:02.705 INFO:tasks.workunit.client.0.smithi148.stdout:1/276: dread - f15 zero size 2024-04-26T23:09:02.712 INFO:tasks.workunit.client.0.smithi148.stdout:6/250: dread d6/dc/f42 [0,4194304] 0 2024-04-26T23:09:02.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/292: dwrite d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:02.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/293: write d0/f5c [5089961,97703] 0 2024-04-26T23:09:02.717 INFO:tasks.workunit.client.0.smithi148.stdout:1/277: mkdir d16/d17/d4b/d53 0 2024-04-26T23:09:02.727 INFO:tasks.workunit.client.0.smithi148.stdout:1/278: write d16/d17/f24 [797589,28509] 0 2024-04-26T23:09:02.734 INFO:tasks.workunit.client.0.smithi148.stdout:0/294: creat d0/f62 x:0 0 0 2024-04-26T23:09:02.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/279: write d16/d17/f4c [8351824,83145] 0 2024-04-26T23:09:02.749 INFO:tasks.workunit.client.0.smithi148.stdout:0/295: creat d0/f63 x:0 0 0 2024-04-26T23:09:02.749 INFO:tasks.workunit.client.0.smithi148.stdout:6/251: dwrite d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:02.752 INFO:tasks.workunit.client.0.smithi148.stdout:1/280: mknod d16/d47/d49/c54 0 2024-04-26T23:09:02.756 INFO:tasks.workunit.client.0.smithi148.stdout:0/296: rename d0/d20/l44 to d0/d2e/l64 0 2024-04-26T23:09:02.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/297: dread d0/d8/d1e/f23 [0,4194304] 0 2024-04-26T23:09:02.765 INFO:tasks.workunit.client.0.smithi148.stdout:6/252: mknod d6/d32/d4e/c50 0 2024-04-26T23:09:02.766 INFO:tasks.workunit.client.0.smithi148.stdout:4/246: sync 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:8/322: sync 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:5/338: sync 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:7/284: sync 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:3/299: sync 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:5/339: chown da/d1b/d5b/f65 5879472 1 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:7/285: fsync d7/d11/d29/d2e/f26 0 2024-04-26T23:09:02.767 INFO:tasks.workunit.client.0.smithi148.stdout:3/300: write d9/d15/d29/d4d/d5b/f5e [401368,79877] 0 2024-04-26T23:09:02.769 INFO:tasks.workunit.client.0.smithi148.stdout:0/298: symlink d0/d2e/d51/l65 0 2024-04-26T23:09:02.769 INFO:tasks.workunit.client.0.smithi148.stdout:3/301: write d9/d15/f1b [130547,111523] 0 2024-04-26T23:09:02.774 INFO:tasks.workunit.client.0.smithi148.stdout:5/340: creat da/f7c x:0 0 0 2024-04-26T23:09:02.782 INFO:tasks.workunit.client.0.smithi148.stdout:8/323: read d3/d9/d12/d23/d29/d37/f3e [3247238,14111] 0 2024-04-26T23:09:02.782 INFO:tasks.workunit.client.0.smithi148.stdout:7/286: creat d7/d11/d17/d2f/d57/f63 x:0 0 0 2024-04-26T23:09:02.782 INFO:tasks.workunit.client.0.smithi148.stdout:4/247: getdents d12/d17/d2a/d33 0 2024-04-26T23:09:02.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/299: rename d0/f5c to d0/d8/d55/f66 0 2024-04-26T23:09:02.792 INFO:tasks.workunit.client.0.smithi148.stdout:3/302: creat d9/d52/f62 x:0 0 0 2024-04-26T23:09:02.792 INFO:tasks.workunit.client.0.smithi148.stdout:3/303: chown d9/d31/f55 4237535 1 2024-04-26T23:09:02.793 INFO:tasks.workunit.client.0.smithi148.stdout:8/324: getdents d3/da/d28/d4c 0 2024-04-26T23:09:02.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/287: dread d7/d11/d29/d2e/f32 [4194304,4194304] 0 2024-04-26T23:09:02.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/288: truncate d7/d11/d17/d43/f52 635653 0 2024-04-26T23:09:02.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/289: fdatasync d7/d11/f34 0 2024-04-26T23:09:02.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/290: write d7/d11/d17/f39 [5849785,30246] 0 2024-04-26T23:09:02.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/291: chown d7/d11/d13/f33 514814 1 2024-04-26T23:09:02.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/300: creat d0/d20/d3b/f67 x:0 0 0 2024-04-26T23:09:02.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/301: write d0/d8/f42 [4333206,88718] 0 2024-04-26T23:09:02.800 INFO:tasks.workunit.client.0.smithi148.stdout:8/325: creat d3/da/f5c x:0 0 0 2024-04-26T23:09:02.802 INFO:tasks.workunit.client.0.smithi148.stdout:0/302: truncate d0/d2e/f35 1452959 0 2024-04-26T23:09:02.803 INFO:tasks.workunit.client.0.smithi148.stdout:8/326: write d3/d9/d12/d23/d29/d37/f59 [553710,88362] 0 2024-04-26T23:09:02.803 INFO:tasks.workunit.client.0.smithi148.stdout:8/327: truncate d3/d9/d12/d23/d29/f4a 859419 0 2024-04-26T23:09:02.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/303: mkdir d0/d8/d33/d68 0 2024-04-26T23:09:02.809 INFO:tasks.workunit.client.0.smithi148.stdout:8/328: mknod d3/da/c5d 0 2024-04-26T23:09:02.812 INFO:tasks.workunit.client.0.smithi148.stdout:0/304: truncate d0/d8/d1e/f28 157304 0 2024-04-26T23:09:02.812 INFO:tasks.workunit.client.0.smithi148.stdout:9/349: sync 2024-04-26T23:09:02.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/329: rmdir d3/da 39 2024-04-26T23:09:02.819 INFO:tasks.workunit.client.0.smithi148.stdout:0/305: mknod d0/d2e/c69 0 2024-04-26T23:09:02.819 INFO:tasks.workunit.client.0.smithi148.stdout:8/330: mkdir d3/d9/d12/d23/d29/d37/d5e 0 2024-04-26T23:09:02.820 INFO:tasks.workunit.client.0.smithi148.stdout:0/306: mkdir d0/d8/d33/d6a 0 2024-04-26T23:09:02.821 INFO:tasks.workunit.client.0.smithi148.stdout:0/307: fdatasync d0/d20/d3b/f3c 0 2024-04-26T23:09:02.834 INFO:tasks.workunit.client.0.smithi148.stdout:9/350: dread f9 [0,4194304] 0 2024-04-26T23:09:02.837 INFO:tasks.workunit.client.0.smithi148.stdout:9/351: creat d19/f7d x:0 0 0 2024-04-26T23:09:02.837 INFO:tasks.workunit.client.0.smithi148.stdout:0/308: dread d0/d5/f2c [0,4194304] 0 2024-04-26T23:09:02.839 INFO:tasks.workunit.client.0.smithi148.stdout:0/309: rmdir d0/d5/d19/d3a 39 2024-04-26T23:09:02.853 INFO:tasks.workunit.client.0.smithi148.stdout:7/292: dread d7/f12 [0,4194304] 0 2024-04-26T23:09:02.853 INFO:tasks.workunit.client.0.smithi148.stdout:7/293: write d7/d11/d29/f53 [247049,90894] 0 2024-04-26T23:09:02.856 INFO:tasks.workunit.client.0.smithi148.stdout:7/294: dread d7/d11/f18 [0,4194304] 0 2024-04-26T23:09:02.867 INFO:tasks.workunit.client.0.smithi148.stdout:3/304: dwrite d9/d15/f24 [0,4194304] 0 2024-04-26T23:09:02.869 INFO:tasks.workunit.client.0.smithi148.stdout:3/305: mknod d9/c63 0 2024-04-26T23:09:02.873 INFO:tasks.workunit.client.0.smithi148.stdout:3/306: creat d9/d15/d29/d4d/f64 x:0 0 0 2024-04-26T23:09:02.905 INFO:tasks.workunit.client.0.smithi148.stdout:3/307: mkdir d9/d65 0 2024-04-26T23:09:02.911 INFO:tasks.workunit.client.0.smithi148.stdout:6/253: dwrite d6/f19 [4194304,4194304] 0 2024-04-26T23:09:02.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/308: creat d9/d4c/f66 x:0 0 0 2024-04-26T23:09:02.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/309: truncate d9/d52/f5c 779545 0 2024-04-26T23:09:02.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/310: write d9/d52/f62 [528957,46183] 0 2024-04-26T23:09:02.924 INFO:tasks.workunit.client.0.smithi148.stdout:6/254: dread d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:02.931 INFO:tasks.workunit.client.0.smithi148.stdout:7/295: dwrite d7/d11/d17/d2f/f5b [0,4194304] 0 2024-04-26T23:09:02.933 INFO:tasks.workunit.client.0.smithi148.stdout:7/296: creat d7/d11/d29/d2e/f64 x:0 0 0 2024-04-26T23:09:02.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/297: chown d7/d11/d17/d43/c51 500177 1 2024-04-26T23:09:02.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/298: chown d7/l3f 188094 1 2024-04-26T23:09:02.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/299: readlink d7/d11/d17/d2f/l5a 0 2024-04-26T23:09:02.935 INFO:tasks.workunit.client.0.smithi148.stdout:6/255: dread d6/f43 [0,4194304] 0 2024-04-26T23:09:02.935 INFO:tasks.workunit.client.0.smithi148.stdout:7/300: creat d7/d11/d17/f65 x:0 0 0 2024-04-26T23:09:02.937 INFO:tasks.workunit.client.0.smithi148.stdout:6/256: mkdir d6/d9/d1c/d1d/d51 0 2024-04-26T23:09:02.937 INFO:tasks.workunit.client.0.smithi148.stdout:6/257: chown d6/d14/c3c 13 1 2024-04-26T23:09:02.940 INFO:tasks.workunit.client.0.smithi148.stdout:7/301: rename d7/d11/d17/d2f/l5a to d7/d11/d60/l66 0 2024-04-26T23:09:02.941 INFO:tasks.workunit.client.0.smithi148.stdout:7/302: fsync d7/d19/f2d 0 2024-04-26T23:09:02.942 INFO:tasks.workunit.client.0.smithi148.stdout:6/258: truncate d6/d9/f15 240261 0 2024-04-26T23:09:02.943 INFO:tasks.workunit.client.0.smithi148.stdout:7/303: mkdir d7/d11/d29/d2e/d41/d67 0 2024-04-26T23:09:02.944 INFO:tasks.workunit.client.0.smithi148.stdout:7/304: write d7/d11/f31 [1387777,47876] 0 2024-04-26T23:09:02.945 INFO:tasks.workunit.client.0.smithi148.stdout:6/259: creat d6/d9/f52 x:0 0 0 2024-04-26T23:09:02.945 INFO:tasks.workunit.client.0.smithi148.stdout:6/260: truncate d6/d9/d1c/d1d/d1f/f4c 742551 0 2024-04-26T23:09:02.946 INFO:tasks.workunit.client.0.smithi148.stdout:6/261: readlink d6/d32/l44 0 2024-04-26T23:09:02.965 INFO:tasks.workunit.client.0.smithi148.stdout:7/305: write d7/d11/d29/f5f [1245382,61662] 0 2024-04-26T23:09:02.968 INFO:tasks.workunit.client.0.smithi148.stdout:9/352: dwrite fe [0,4194304] 0 2024-04-26T23:09:02.971 INFO:tasks.workunit.client.0.smithi148.stdout:7/306: mkdir d7/d11/d60/d68 0 2024-04-26T23:09:02.974 INFO:tasks.workunit.client.0.smithi148.stdout:9/353: creat d19/d1d/d25/d31/d73/f7e x:0 0 0 2024-04-26T23:09:02.974 INFO:tasks.workunit.client.0.smithi148.stdout:9/354: chown d19/c1b 176 1 2024-04-26T23:09:02.974 INFO:tasks.workunit.client.0.smithi148.stdout:9/355: write d19/d1d/d49/f5c [902455,74396] 0 2024-04-26T23:09:02.974 INFO:tasks.workunit.client.0.smithi148.stdout:9/356: stat d19/d22/f76 0 2024-04-26T23:09:02.975 INFO:tasks.workunit.client.0.smithi148.stdout:4/248: dwrite d12/d17/f22 [4194304,4194304] 0 2024-04-26T23:09:02.975 INFO:tasks.workunit.client.0.smithi148.stdout:4/249: truncate d12/d17/d2a/d33/f44 1035638 0 2024-04-26T23:09:02.975 INFO:tasks.workunit.client.0.smithi148.stdout:8/331: write d3/da/d28/f38 [1706449,34237] 0 2024-04-26T23:09:02.975 INFO:tasks.workunit.client.0.smithi148.stdout:7/307: mknod d7/d11/c69 0 2024-04-26T23:09:02.976 INFO:tasks.workunit.client.0.smithi148.stdout:9/357: symlink d19/l7f 0 2024-04-26T23:09:02.976 INFO:tasks.workunit.client.0.smithi148.stdout:9/358: readlink d19/l35 0 2024-04-26T23:09:02.977 INFO:tasks.workunit.client.0.smithi148.stdout:9/359: fdatasync d19/f4a 0 2024-04-26T23:09:02.977 INFO:tasks.workunit.client.0.smithi148.stdout:6/262: read d6/d9/d1c/d1d/d1f/f36 [4179435,63481] 0 2024-04-26T23:09:02.977 INFO:tasks.workunit.client.0.smithi148.stdout:6/263: chown d6/d32/d4e 1305 1 2024-04-26T23:09:02.977 INFO:tasks.workunit.client.0.smithi148.stdout:6/264: fdatasync d6/d9/d1c/f2e 0 2024-04-26T23:09:02.983 INFO:tasks.workunit.client.0.smithi148.stdout:3/311: read d9/d31/f3c [2233349,116417] 0 2024-04-26T23:09:02.983 INFO:tasks.workunit.client.0.smithi148.stdout:3/312: chown d9/f11 7 1 2024-04-26T23:09:02.984 INFO:tasks.workunit.client.0.smithi148.stdout:4/250: creat d12/d2c/f46 x:0 0 0 2024-04-26T23:09:02.985 INFO:tasks.workunit.client.0.smithi148.stdout:8/332: truncate d3/d9/d12/f48 1404549 0 2024-04-26T23:09:02.988 INFO:tasks.workunit.client.0.smithi148.stdout:7/308: link c5 d7/d11/d17/d2f/d44/c6a 0 2024-04-26T23:09:02.988 INFO:tasks.workunit.client.0.smithi148.stdout:7/309: getdents d7/d11/d29/d2e/d41/d67 0 2024-04-26T23:09:02.991 INFO:tasks.workunit.client.0.smithi148.stdout:9/360: mkdir d19/d1d/d25/d2f/d4d/d33/d80 0 2024-04-26T23:09:02.991 INFO:tasks.workunit.client.0.smithi148.stdout:4/251: dread d12/d1c/f3a [0,4194304] 0 2024-04-26T23:09:02.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/265: link d6/c11 d6/d9/d1c/d1d/d1f/d40/c53 0 2024-04-26T23:09:02.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/266: truncate d6/dc/f45 752327 0 2024-04-26T23:09:02.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/267: truncate d6/f47 1069678 0 2024-04-26T23:09:02.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/268: stat d6/d32/l44 0 2024-04-26T23:09:02.994 INFO:tasks.workunit.client.0.smithi148.stdout:8/333: symlink d3/da/d28/d4c/l5f 0 2024-04-26T23:09:02.994 INFO:tasks.workunit.client.0.smithi148.stdout:8/334: write d3/da/d1c/f45 [1498311,127847] 0 2024-04-26T23:09:02.995 INFO:tasks.workunit.client.0.smithi148.stdout:7/310: creat d7/d11/d29/d2e/d41/d67/f6b x:0 0 0 2024-04-26T23:09:02.997 INFO:tasks.workunit.client.0.smithi148.stdout:9/361: getdents d19/d1d/d25/d31/d60 0 2024-04-26T23:09:02.997 INFO:tasks.workunit.client.0.smithi148.stdout:9/362: readlink d19/l2c 0 2024-04-26T23:09:02.998 INFO:tasks.workunit.client.0.smithi148.stdout:9/363: readlink d19/d1d/l2a 0 2024-04-26T23:09:02.999 INFO:tasks.workunit.client.0.smithi148.stdout:4/252: link l6 d12/l47 0 2024-04-26T23:09:03.000 INFO:tasks.workunit.client.0.smithi148.stdout:4/253: fdatasync d12/d2c/f3f 0 2024-04-26T23:09:03.002 INFO:tasks.workunit.client.0.smithi148.stdout:6/269: mkdir d6/d32/d54 0 2024-04-26T23:09:03.002 INFO:tasks.workunit.client.0.smithi148.stdout:6/270: readlink d6/d14/l4b 0 2024-04-26T23:09:03.006 INFO:tasks.workunit.client.0.smithi148.stdout:4/254: dread d12/d1c/f28 [0,4194304] 0 2024-04-26T23:09:03.006 INFO:tasks.workunit.client.0.smithi148.stdout:4/255: write d12/d17/d2a/d33/f44 [1243776,73019] 0 2024-04-26T23:09:03.007 INFO:tasks.workunit.client.0.smithi148.stdout:8/335: mkdir d3/d9/d12/d23/d54/d60 0 2024-04-26T23:09:03.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/271: link d6/c18 d6/d9/d23/d4a/c55 0 2024-04-26T23:09:03.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/272: chown d6/d14/c39 26 1 2024-04-26T23:09:03.010 INFO:tasks.workunit.client.0.smithi148.stdout:8/336: getdents d3/da/d1c 0 2024-04-26T23:09:03.010 INFO:tasks.workunit.client.0.smithi148.stdout:8/337: chown d3/da/d28/l52 0 1 2024-04-26T23:09:03.011 INFO:tasks.workunit.client.0.smithi148.stdout:8/338: write d3/da/f5c [279412,111653] 0 2024-04-26T23:09:03.012 INFO:tasks.workunit.client.0.smithi148.stdout:4/256: stat d12/c1b 0 2024-04-26T23:09:03.014 INFO:tasks.workunit.client.0.smithi148.stdout:4/257: symlink d12/d1c/l48 0 2024-04-26T23:09:03.015 INFO:tasks.workunit.client.0.smithi148.stdout:8/339: creat d3/d9/d12/d23/d54/d60/f61 x:0 0 0 2024-04-26T23:09:03.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/313: dwrite d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:03.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/314: dread - d9/d4c/f5f zero size 2024-04-26T23:09:03.020 INFO:tasks.workunit.client.0.smithi148.stdout:2/381: sync 2024-04-26T23:09:03.020 INFO:tasks.workunit.client.0.smithi148.stdout:4/258: mknod d12/d17/d2a/d33/c49 0 2024-04-26T23:09:03.024 INFO:tasks.workunit.client.0.smithi148.stdout:8/340: creat d3/d9/f62 x:0 0 0 2024-04-26T23:09:03.025 INFO:tasks.workunit.client.0.smithi148.stdout:3/315: stat d9/ce 0 2024-04-26T23:09:03.026 INFO:tasks.workunit.client.0.smithi148.stdout:2/382: mknod d5/d8/d4b/d4e/c7e 0 2024-04-26T23:09:03.028 INFO:tasks.workunit.client.0.smithi148.stdout:8/341: link d3/d9/d12/d23/d35/f4e d3/d9/d12/d23/d29/d37/f63 0 2024-04-26T23:09:03.030 INFO:tasks.workunit.client.0.smithi148.stdout:2/383: mkdir d5/d7f 0 2024-04-26T23:09:03.036 INFO:tasks.workunit.client.0.smithi148.stdout:2/384: creat d5/d8/d70/d32/f80 x:0 0 0 2024-04-26T23:09:03.056 INFO:tasks.workunit.client.0.smithi148.stdout:7/311: dwrite d7/d11/d29/d2e/d41/f48 [0,4194304] 0 2024-04-26T23:09:03.056 INFO:tasks.workunit.client.0.smithi148.stdout:4/259: write d12/d2c/f3f [2402757,72565] 0 2024-04-26T23:09:03.056 INFO:tasks.workunit.client.0.smithi148.stdout:4/260: dread - d12/d2c/f46 zero size 2024-04-26T23:09:03.056 INFO:tasks.workunit.client.0.smithi148.stdout:4/261: chown d12/f14 166 1 2024-04-26T23:09:03.056 INFO:tasks.workunit.client.0.smithi148.stdout:3/316: write d9/d15/f24 [1337080,114077] 0 2024-04-26T23:09:03.057 INFO:tasks.workunit.client.0.smithi148.stdout:9/364: dwrite d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:03.058 INFO:tasks.workunit.client.0.smithi148.stdout:6/273: write d6/dc/f42 [2867031,113372] 0 2024-04-26T23:09:03.068 INFO:tasks.workunit.client.0.smithi148.stdout:7/312: write d7/d11/d29/d2e/f26 [2953293,103881] 0 2024-04-26T23:09:03.068 INFO:tasks.workunit.client.0.smithi148.stdout:7/313: write d7/d19/f20 [626293,51114] 0 2024-04-26T23:09:03.068 INFO:tasks.workunit.client.0.smithi148.stdout:7/314: write d7/d11/d29/d2e/d41/d67/f6b [779251,81560] 0 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:9/365: creat d19/d1d/d25/d31/f81 x:0 0 0 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:6/274: getdents d6/d9/d1c 0 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:1/281: sync 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:5/341: sync 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:0/310: sync 2024-04-26T23:09:03.073 INFO:tasks.workunit.client.0.smithi148.stdout:0/311: fsync d0/d5/f2c 0 2024-04-26T23:09:03.074 INFO:tasks.workunit.client.0.smithi148.stdout:1/282: write f15 [252041,106409] 0 2024-04-26T23:09:03.074 INFO:tasks.workunit.client.0.smithi148.stdout:7/315: creat d7/d19/f6c x:0 0 0 2024-04-26T23:09:03.076 INFO:tasks.workunit.client.0.smithi148.stdout:6/275: rmdir d6/d9/d1c/d1d/d51 0 2024-04-26T23:09:03.076 INFO:tasks.workunit.client.0.smithi148.stdout:6/276: fsync d6/d9/d1c/d1d/d1f/f36 0 2024-04-26T23:09:03.076 INFO:tasks.workunit.client.0.smithi148.stdout:6/277: fdatasync d6/f19 0 2024-04-26T23:09:03.076 INFO:tasks.workunit.client.0.smithi148.stdout:9/366: getdents d19/d1d/d25 0 2024-04-26T23:09:03.077 INFO:tasks.workunit.client.0.smithi148.stdout:9/367: stat d19/d1d/d25/d31/d73/f7a 0 2024-04-26T23:09:03.077 INFO:tasks.workunit.client.0.smithi148.stdout:1/283: mkdir d16/d17/d4b/d55 0 2024-04-26T23:09:03.077 INFO:tasks.workunit.client.0.smithi148.stdout:5/342: dread da/fc [0,4194304] 0 2024-04-26T23:09:03.077 INFO:tasks.workunit.client.0.smithi148.stdout:5/343: stat da/d1b/d5b/f39 0 2024-04-26T23:09:03.078 INFO:tasks.workunit.client.0.smithi148.stdout:1/284: link d16/c27 d16/d17/d4b/d55/c56 0 2024-04-26T23:09:03.079 INFO:tasks.workunit.client.0.smithi148.stdout:5/344: creat da/f7d x:0 0 0 2024-04-26T23:09:03.080 INFO:tasks.workunit.client.0.smithi148.stdout:1/285: creat d16/d1c/f57 x:0 0 0 2024-04-26T23:09:03.081 INFO:tasks.workunit.client.0.smithi148.stdout:5/345: symlink da/d1f/d67/d71/l7e 0 2024-04-26T23:09:03.082 INFO:tasks.workunit.client.0.smithi148.stdout:1/286: creat d16/d17/d4b/d55/f58 x:0 0 0 2024-04-26T23:09:03.083 INFO:tasks.workunit.client.0.smithi148.stdout:5/346: mkdir da/d1b/d1c/d7f 0 2024-04-26T23:09:03.083 INFO:tasks.workunit.client.0.smithi148.stdout:5/347: dread - da/f7c zero size 2024-04-26T23:09:03.083 INFO:tasks.workunit.client.0.smithi148.stdout:1/287: mkdir d16/d17/d4b/d59 0 2024-04-26T23:09:03.158 INFO:tasks.workunit.client.0.smithi148.stdout:6/278: dwrite d6/dc/f3f [0,4194304] 0 2024-04-26T23:09:03.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/279: symlink d6/d9/d1c/d1d/d1f/d40/l56 0 2024-04-26T23:09:03.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/280: stat d6/f33 0 2024-04-26T23:09:03.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/281: fdatasync d6/d9/f15 0 2024-04-26T23:09:03.198 INFO:tasks.workunit.client.0.smithi148.stdout:6/282: dwrite d6/d9/d1c/d1d/d1f/f4c [0,4194304] 0 2024-04-26T23:09:03.198 INFO:tasks.workunit.client.0.smithi148.stdout:6/283: chown d6/d14/l4f 0 1 2024-04-26T23:09:03.200 INFO:tasks.workunit.client.0.smithi148.stdout:6/284: creat d6/d9/d23/f57 x:0 0 0 2024-04-26T23:09:03.201 INFO:tasks.workunit.client.0.smithi148.stdout:8/342: dwrite d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:09:03.203 INFO:tasks.workunit.client.0.smithi148.stdout:8/343: rename d3/d9/d12/f48 to d3/da/f64 0 2024-04-26T23:09:03.203 INFO:tasks.workunit.client.0.smithi148.stdout:8/344: getdents d3/da/d1c 0 2024-04-26T23:09:03.203 INFO:tasks.workunit.client.0.smithi148.stdout:8/345: write d3/da/d28/f50 [354749,104429] 0 2024-04-26T23:09:03.206 INFO:tasks.workunit.client.0.smithi148.stdout:8/346: unlink d3/f3c 0 2024-04-26T23:09:03.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/347: mkdir d3/d9/d12/d23/d65 0 2024-04-26T23:09:03.211 INFO:tasks.workunit.client.0.smithi148.stdout:3/317: dwrite d9/d15/d29/f56 [4194304,4194304] 0 2024-04-26T23:09:03.232 INFO:tasks.workunit.client.0.smithi148.stdout:9/368: dwrite d19/d39/f54 [0,4194304] 0 2024-04-26T23:09:03.232 INFO:tasks.workunit.client.0.smithi148.stdout:9/369: fdatasync ff 0 2024-04-26T23:09:03.232 INFO:tasks.workunit.client.0.smithi148.stdout:1/288: dread d16/d1c/f2c [4194304,4194304] 0 2024-04-26T23:09:03.232 INFO:tasks.workunit.client.0.smithi148.stdout:1/289: fdatasync d16/d17/d4b/d4d/f52 0 2024-04-26T23:09:03.249 INFO:tasks.workunit.client.0.smithi148.stdout:1/290: dread f5 [0,4194304] 0 2024-04-26T23:09:03.249 INFO:tasks.workunit.client.0.smithi148.stdout:1/291: write d16/d1c/f33 [736084,67665] 0 2024-04-26T23:09:03.251 INFO:tasks.workunit.client.0.smithi148.stdout:3/318: dwrite d9/d15/f25 [0,4194304] 0 2024-04-26T23:09:03.253 INFO:tasks.workunit.client.0.smithi148.stdout:6/285: dwrite d6/f19 [0,4194304] 0 2024-04-26T23:09:03.311 INFO:tasks.workunit.client.0.smithi148.stdout:8/348: dwrite d3/d9/f62 [0,4194304] 0 2024-04-26T23:09:03.483 INFO:tasks.workunit.client.0.smithi148.stdout:5/348: getdents da/d1b/d1c 0 2024-04-26T23:09:03.483 INFO:tasks.workunit.client.0.smithi148.stdout:9/370: getdents d19/d1d/d25/d2f/d4d 0 2024-04-26T23:09:03.486 INFO:tasks.workunit.client.0.smithi148.stdout:3/319: symlink d9/d15/l67 0 2024-04-26T23:09:03.488 INFO:tasks.workunit.client.0.smithi148.stdout:6/286: rmdir d6/d9/d1c/d1d/d1f/d40 39 2024-04-26T23:09:03.499 INFO:tasks.workunit.client.0.smithi148.stdout:8/349: rename d3/d9/d12/d23/d29/d37/f59 to d3/d9/d12/d23/d35/f66 0 2024-04-26T23:09:03.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/349: dread da/d1b/d2d/f48 [0,4194304] 0 2024-04-26T23:09:03.517 INFO:tasks.workunit.client.0.smithi148.stdout:9/371: mknod d19/d22/c82 0 2024-04-26T23:09:03.517 INFO:tasks.workunit.client.0.smithi148.stdout:3/320: mkdir d9/d15/d29/d4d/d68 0 2024-04-26T23:09:03.517 INFO:tasks.workunit.client.0.smithi148.stdout:9/372: chown d19/d39/f59 3094 1 2024-04-26T23:09:03.517 INFO:tasks.workunit.client.0.smithi148.stdout:3/321: rename d9/d15/d29 to d9/d15/d29/d69 22 2024-04-26T23:09:03.517 INFO:tasks.workunit.client.0.smithi148.stdout:7/316: sync 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/385: sync 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:4/262: sync 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:0/312: sync 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:1/292: sync 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:1/293: dread - d16/d17/f3d zero size 2024-04-26T23:09:03.518 INFO:tasks.workunit.client.0.smithi148.stdout:8/350: truncate d3/d9/d12/f21 1135121 0 2024-04-26T23:09:03.520 INFO:tasks.workunit.client.0.smithi148.stdout:9/373: creat d19/d1d/d69/f83 x:0 0 0 2024-04-26T23:09:03.521 INFO:tasks.workunit.client.0.smithi148.stdout:3/322: rmdir d9/d31 39 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:4/263: link d12/d1a/f23 d12/f4a 0 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/386: creat d5/d8/d15/f81 x:0 0 0 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:7/317: write d7/d11/d17/d43/f52 [26937,111948] 0 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/387: fdatasync d5/d8/d9/f23 0 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:7/318: chown d7/d11/d29/d2e/d41/d67 17502 1 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/388: write d5/d17/d59/f6e [187165,27624] 0 2024-04-26T23:09:03.527 INFO:tasks.workunit.client.0.smithi148.stdout:7/319: write d7/d19/f30 [6480155,101440] 0 2024-04-26T23:09:03.532 INFO:tasks.workunit.client.0.smithi148.stdout:1/294: mkdir d16/d45/d2b/d3e/d5a 0 2024-04-26T23:09:03.532 INFO:tasks.workunit.client.0.smithi148.stdout:1/295: dread - d16/f4a zero size 2024-04-26T23:09:03.535 INFO:tasks.workunit.client.0.smithi148.stdout:8/351: link d3/d9/l5a d3/d9/d12/d23/d29/l67 0 2024-04-26T23:09:03.539 INFO:tasks.workunit.client.0.smithi148.stdout:9/374: mknod d19/d1d/d25/d31/d73/c84 0 2024-04-26T23:09:03.547 INFO:tasks.workunit.client.0.smithi148.stdout:6/287: dwrite d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:03.547 INFO:tasks.workunit.client.0.smithi148.stdout:6/288: chown d6/d9/d23/l48 9406208 1 2024-04-26T23:09:03.550 INFO:tasks.workunit.client.0.smithi148.stdout:3/323: unlink d9/d15/l34 0 2024-04-26T23:09:03.550 INFO:tasks.workunit.client.0.smithi148.stdout:3/324: stat d9/c20 0 2024-04-26T23:09:03.550 INFO:tasks.workunit.client.0.smithi148.stdout:3/325: write d9/d15/d29/d4d/f64 [247260,92737] 0 2024-04-26T23:09:03.552 INFO:tasks.workunit.client.0.smithi148.stdout:4/264: creat d12/d1c/f4b x:0 0 0 2024-04-26T23:09:03.556 INFO:tasks.workunit.client.0.smithi148.stdout:7/320: link d7/d11/d29/d2e/d41/l56 d7/d11/d17/d2f/d57/l6d 0 2024-04-26T23:09:03.556 INFO:tasks.workunit.client.0.smithi148.stdout:7/321: fdatasync d7/d11/d29/f53 0 2024-04-26T23:09:03.560 INFO:tasks.workunit.client.0.smithi148.stdout:1/296: mknod d16/c5b 0 2024-04-26T23:09:03.560 INFO:tasks.workunit.client.0.smithi148.stdout:1/297: readlink d16/d1c/l21 0 2024-04-26T23:09:03.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/265: creat d12/d17/d2a/d33/f4c x:0 0 0 2024-04-26T23:09:03.572 INFO:tasks.workunit.client.0.smithi148.stdout:8/352: dread d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:03.580 INFO:tasks.workunit.client.0.smithi148.stdout:6/289: read d6/f33 [3281949,109747] 0 2024-04-26T23:09:03.581 INFO:tasks.workunit.client.0.smithi148.stdout:7/322: symlink d7/d11/d60/d68/l6e 0 2024-04-26T23:09:03.581 INFO:tasks.workunit.client.0.smithi148.stdout:9/375: dwrite d19/d39/f59 [0,4194304] 0 2024-04-26T23:09:03.581 INFO:tasks.workunit.client.0.smithi148.stdout:1/298: creat d16/d45/d2b/f5c x:0 0 0 2024-04-26T23:09:03.581 INFO:tasks.workunit.client.0.smithi148.stdout:9/376: truncate d19/d1d/d25/d2f/f53 155823 0 2024-04-26T23:09:03.582 INFO:tasks.workunit.client.0.smithi148.stdout:9/377: write d19/d1d/d25/d2f/f3d [4459856,27114] 0 2024-04-26T23:09:03.583 INFO:tasks.workunit.client.0.smithi148.stdout:6/290: unlink d6/d9/l1b 0 2024-04-26T23:09:03.585 INFO:tasks.workunit.client.0.smithi148.stdout:4/266: stat d12/d17/d2a/c2b 0 2024-04-26T23:09:03.585 INFO:tasks.workunit.client.0.smithi148.stdout:1/299: mknod d16/d17/d4b/d59/c5d 0 2024-04-26T23:09:03.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/389: write d5/f16 [1089423,24538] 0 2024-04-26T23:09:03.586 INFO:tasks.workunit.client.0.smithi148.stdout:3/326: dread d9/f36 [0,4194304] 0 2024-04-26T23:09:03.586 INFO:tasks.workunit.client.0.smithi148.stdout:3/327: dread - d9/d15/d29/f47 zero size 2024-04-26T23:09:03.586 INFO:tasks.workunit.client.0.smithi148.stdout:0/313: dwrite d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:03.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/378: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d61/d85 0 2024-04-26T23:09:03.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/379: fdatasync fe 0 2024-04-26T23:09:03.588 INFO:tasks.workunit.client.0.smithi148.stdout:6/291: unlink l4 0 2024-04-26T23:09:03.590 INFO:tasks.workunit.client.0.smithi148.stdout:4/267: creat d12/d1c/f4d x:0 0 0 2024-04-26T23:09:03.595 INFO:tasks.workunit.client.0.smithi148.stdout:1/300: creat d16/d17/d4b/d53/f5e x:0 0 0 2024-04-26T23:09:03.595 INFO:tasks.workunit.client.0.smithi148.stdout:0/314: truncate d0/d8/f42 1971335 0 2024-04-26T23:09:03.597 INFO:tasks.workunit.client.0.smithi148.stdout:4/268: link d12/f35 d12/d17/d2a/d33/f4e 0 2024-04-26T23:09:03.599 INFO:tasks.workunit.client.0.smithi148.stdout:0/315: link d0/d5/c26 d0/d8/c6b 0 2024-04-26T23:09:03.599 INFO:tasks.workunit.client.0.smithi148.stdout:0/316: stat d0/d8/d1e/f2a 0 2024-04-26T23:09:03.599 INFO:tasks.workunit.client.0.smithi148.stdout:0/317: fdatasync d0/d5/f1a 0 2024-04-26T23:09:03.608 INFO:tasks.workunit.client.0.smithi148.stdout:4/269: mknod d12/d17/d2a/c4f 0 2024-04-26T23:09:03.649 INFO:tasks.workunit.client.0.smithi148.stdout:3/328: dread d9/d15/f1b [0,4194304] 0 2024-04-26T23:09:03.661 INFO:tasks.workunit.client.0.smithi148.stdout:3/329: dread d9/ff [0,4194304] 0 2024-04-26T23:09:03.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/323: dwrite d7/f9 [0,4194304] 0 2024-04-26T23:09:03.661 INFO:tasks.workunit.client.0.smithi148.stdout:6/292: dread d6/d9/d1c/d1d/d1f/f4c [0,4194304] 0 2024-04-26T23:09:03.662 INFO:tasks.workunit.client.0.smithi148.stdout:6/293: write d6/d9/f15 [1075816,122209] 0 2024-04-26T23:09:03.662 INFO:tasks.workunit.client.0.smithi148.stdout:1/301: dread d16/f3a [0,4194304] 0 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:3/330: mknod d9/d4c/c6a 0 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/324: rename l4 to d7/d11/d17/d43/l6f 0 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:1/302: symlink d16/d17/d4b/d59/l5f 0 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:6/294: symlink d6/d9/d23/l58 0 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:1/303: rmdir d16/d47 39 2024-04-26T23:09:03.673 INFO:tasks.workunit.client.0.smithi148.stdout:2/390: dwrite d5/d8/d15/d43/f49 [0,4194304] 0 2024-04-26T23:09:03.674 INFO:tasks.workunit.client.0.smithi148.stdout:2/391: dread - d5/d1c/d38/f6f zero size 2024-04-26T23:09:03.674 INFO:tasks.workunit.client.0.smithi148.stdout:6/295: truncate d6/f47 569692 0 2024-04-26T23:09:03.677 INFO:tasks.workunit.client.0.smithi148.stdout:1/304: rmdir d16/d17/d4b/d55 39 2024-04-26T23:09:03.680 INFO:tasks.workunit.client.0.smithi148.stdout:4/270: dwrite d12/d2c/f27 [4194304,4194304] 0 2024-04-26T23:09:03.684 INFO:tasks.workunit.client.0.smithi148.stdout:4/271: write d12/d17/d2a/f2d [641366,109291] 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:9/380: dwrite f3 [0,4194304] 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/392: getdents d5/d8/d70/d32/d4c 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/393: write d5/d8/d15/f45 [847269,3556] 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/394: truncate d5/d8/d9/f28 1530219 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/395: fsync d5/d10/f48 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:1/305: symlink d16/d45/d2b/l60 0 2024-04-26T23:09:03.685 INFO:tasks.workunit.client.0.smithi148.stdout:0/318: dwrite d0/d5/f3f [0,4194304] 0 2024-04-26T23:09:03.688 INFO:tasks.workunit.client.0.smithi148.stdout:2/396: dread d5/d10/f5b [0,4194304] 0 2024-04-26T23:09:03.690 INFO:tasks.workunit.client.0.smithi148.stdout:1/306: symlink d16/d47/l61 0 2024-04-26T23:09:03.691 INFO:tasks.workunit.client.0.smithi148.stdout:0/319: rmdir d0/d5/d19 39 2024-04-26T23:09:03.693 INFO:tasks.workunit.client.0.smithi148.stdout:4/272: unlink d12/d2c/f27 0 2024-04-26T23:09:03.696 INFO:tasks.workunit.client.0.smithi148.stdout:2/397: mknod d5/d8/d15/d43/c82 0 2024-04-26T23:09:03.696 INFO:tasks.workunit.client.0.smithi148.stdout:2/398: chown d5/d7f 4 1 2024-04-26T23:09:03.696 INFO:tasks.workunit.client.0.smithi148.stdout:1/307: mkdir d16/d17/d4b/d59/d62 0 2024-04-26T23:09:03.698 INFO:tasks.workunit.client.0.smithi148.stdout:0/320: mkdir d0/d20/d54/d5d/d6c 0 2024-04-26T23:09:03.698 INFO:tasks.workunit.client.0.smithi148.stdout:0/321: chown d0/d8/l37 105 1 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/353: dwrite d3/da/f18 [4194304,4194304] 0 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:4/273: symlink d12/l50 0 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:4/274: write d12/d17/f2e [771677,59006] 0 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:2/399: unlink d5/d10/f19 0 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:2/400: chown d5/f2d 0 1 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:2/401: readlink d5/d8/d9/lf 0 2024-04-26T23:09:03.701 INFO:tasks.workunit.client.0.smithi148.stdout:2/402: stat d5/d17/d64/f72 0 2024-04-26T23:09:03.702 INFO:tasks.workunit.client.0.smithi148.stdout:1/308: getdents d16/d47/d49 0 2024-04-26T23:09:03.704 INFO:tasks.workunit.client.0.smithi148.stdout:0/322: unlink d0/d8/c3d 0 2024-04-26T23:09:03.710 INFO:tasks.workunit.client.0.smithi148.stdout:9/381: dwrite f9 [0,4194304] 0 2024-04-26T23:09:03.715 INFO:tasks.workunit.client.0.smithi148.stdout:2/403: symlink d5/d8/d9/l83 0 2024-04-26T23:09:03.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/323: mknod d0/d8/c6d 0 2024-04-26T23:09:03.717 INFO:tasks.workunit.client.0.smithi148.stdout:9/382: mknod d19/d1d/d25/d31/c86 0 2024-04-26T23:09:03.717 INFO:tasks.workunit.client.0.smithi148.stdout:9/383: truncate d19/d1d/d25/d31/d73/f7a 402289 0 2024-04-26T23:09:03.717 INFO:tasks.workunit.client.0.smithi148.stdout:9/384: chown d19/d1d/d25/d31/c3c 0 1 2024-04-26T23:09:03.718 INFO:tasks.workunit.client.0.smithi148.stdout:0/324: creat d0/d8/d33/d6a/f6e x:0 0 0 2024-04-26T23:09:03.718 INFO:tasks.workunit.client.0.smithi148.stdout:0/325: fsync d0/d5/f7 0 2024-04-26T23:09:03.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/326: write d0/f2 [2545524,97664] 0 2024-04-26T23:09:03.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/327: write d0/d5/f2c [5050486,34754] 0 2024-04-26T23:09:03.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/328: truncate d0/d2e/f35 2039320 0 2024-04-26T23:09:03.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/329: dread - d0/d8/d33/d6a/f6e zero size 2024-04-26T23:09:03.721 INFO:tasks.workunit.client.0.smithi148.stdout:2/404: write d5/d8/d11/f5e [1057329,26145] 0 2024-04-26T23:09:03.721 INFO:tasks.workunit.client.0.smithi148.stdout:2/405: write d5/d8/d9/f2a [739510,15723] 0 2024-04-26T23:09:03.721 INFO:tasks.workunit.client.0.smithi148.stdout:2/406: chown d5/c68 341 1 2024-04-26T23:09:03.731 INFO:tasks.workunit.client.0.smithi148.stdout:5/350: sync 2024-04-26T23:09:03.732 INFO:tasks.workunit.client.0.smithi148.stdout:5/351: truncate da/d1b/d1c/f22 340295 0 2024-04-26T23:09:03.732 INFO:tasks.workunit.client.0.smithi148.stdout:5/352: write da/f3e [74278,9312] 0 2024-04-26T23:09:03.732 INFO:tasks.workunit.client.0.smithi148.stdout:2/407: creat d5/d8/d15/d7d/f84 x:0 0 0 2024-04-26T23:09:03.732 INFO:tasks.workunit.client.0.smithi148.stdout:2/408: fsync d5/d7/f20 0 2024-04-26T23:09:03.733 INFO:tasks.workunit.client.0.smithi148.stdout:5/353: creat da/d68/f80 x:0 0 0 2024-04-26T23:09:03.733 INFO:tasks.workunit.client.0.smithi148.stdout:5/354: chown da/d1f/f49 857745 1 2024-04-26T23:09:03.733 INFO:tasks.workunit.client.0.smithi148.stdout:5/355: chown da/d1a/l55 475821579 1 2024-04-26T23:09:03.734 INFO:tasks.workunit.client.0.smithi148.stdout:5/356: mknod da/d12/c81 0 2024-04-26T23:09:03.736 INFO:tasks.workunit.client.0.smithi148.stdout:5/357: mkdir da/d1b/d2d/d82 0 2024-04-26T23:09:03.736 INFO:tasks.workunit.client.0.smithi148.stdout:5/358: chown da/d1b/d2d/f6d 467 1 2024-04-26T23:09:03.736 INFO:tasks.workunit.client.0.smithi148.stdout:5/359: fsync da/fc 0 2024-04-26T23:09:03.736 INFO:tasks.workunit.client.0.smithi148.stdout:5/360: chown da/d70 3730248 1 2024-04-26T23:09:03.737 INFO:tasks.workunit.client.0.smithi148.stdout:5/361: truncate da/f3f 573387 0 2024-04-26T23:09:03.739 INFO:tasks.workunit.client.0.smithi148.stdout:5/362: creat da/d1b/d3b/d73/f83 x:0 0 0 2024-04-26T23:09:03.739 INFO:tasks.workunit.client.0.smithi148.stdout:5/363: getdents da/d1b/d2d/d82 0 2024-04-26T23:09:03.742 INFO:tasks.workunit.client.0.smithi148.stdout:5/364: symlink da/d1b/d3b/l84 0 2024-04-26T23:09:03.742 INFO:tasks.workunit.client.0.smithi148.stdout:5/365: readlink da/d1a/l3c 0 2024-04-26T23:09:03.747 INFO:tasks.workunit.client.0.smithi148.stdout:5/366: mknod da/d12/d78/c85 0 2024-04-26T23:09:03.750 INFO:tasks.workunit.client.0.smithi148.stdout:5/367: dread f5 [0,4194304] 0 2024-04-26T23:09:03.753 INFO:tasks.workunit.client.0.smithi148.stdout:9/385: dwrite d19/d1d/d25/d31/f45 [4194304,4194304] 0 2024-04-26T23:09:03.753 INFO:tasks.workunit.client.0.smithi148.stdout:0/330: dread d0/d2e/f50 [0,4194304] 0 2024-04-26T23:09:03.754 INFO:tasks.workunit.client.0.smithi148.stdout:5/368: rename da/d1b/l50 to da/d1b/d3b/d72/l86 0 2024-04-26T23:09:03.754 INFO:tasks.workunit.client.0.smithi148.stdout:5/369: chown da/d1b/d5b 10050623 1 2024-04-26T23:09:03.755 INFO:tasks.workunit.client.0.smithi148.stdout:0/331: link d0/d20/d54/c59 d0/d8/d52/c6f 0 2024-04-26T23:09:03.756 INFO:tasks.workunit.client.0.smithi148.stdout:5/370: link da/d1b/d3b/d73/f83 da/d12/d78/f87 0 2024-04-26T23:09:03.756 INFO:tasks.workunit.client.0.smithi148.stdout:0/332: rmdir d0/d20 39 2024-04-26T23:09:03.756 INFO:tasks.workunit.client.0.smithi148.stdout:5/371: write da/f5c [970999,125853] 0 2024-04-26T23:09:03.759 INFO:tasks.workunit.client.0.smithi148.stdout:5/372: symlink da/d1b/d3b/d72/l88 0 2024-04-26T23:09:03.760 INFO:tasks.workunit.client.0.smithi148.stdout:8/354: dwrite d3/d9/d12/d23/d35/f57 [0,4194304] 0 2024-04-26T23:09:03.760 INFO:tasks.workunit.client.0.smithi148.stdout:5/373: link da/d1f/f26 da/d68/d69/f89 0 2024-04-26T23:09:03.761 INFO:tasks.workunit.client.0.smithi148.stdout:5/374: chown da/d1b/d2d/c64 46831541 1 2024-04-26T23:09:03.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/333: mkdir d0/d8/d33/d6a/d70 0 2024-04-26T23:09:03.761 INFO:tasks.workunit.client.0.smithi148.stdout:5/375: chown da/d1b/d2d 41701644 1 2024-04-26T23:09:03.763 INFO:tasks.workunit.client.0.smithi148.stdout:4/275: write d12/d2c/f3c [1353709,113022] 0 2024-04-26T23:09:03.764 INFO:tasks.workunit.client.0.smithi148.stdout:4/276: write d12/f14 [3465984,89528] 0 2024-04-26T23:09:03.764 INFO:tasks.workunit.client.0.smithi148.stdout:8/355: unlink d3/da/c2e 0 2024-04-26T23:09:03.765 INFO:tasks.workunit.client.0.smithi148.stdout:8/356: write d3/d9/d12/d23/d35/f47 [1072911,50491] 0 2024-04-26T23:09:03.769 INFO:tasks.workunit.client.0.smithi148.stdout:5/376: creat da/d70/f8a x:0 0 0 2024-04-26T23:09:03.769 INFO:tasks.workunit.client.0.smithi148.stdout:4/277: creat d12/d1c/f51 x:0 0 0 2024-04-26T23:09:03.771 INFO:tasks.workunit.client.0.smithi148.stdout:2/409: dwrite d5/d8/d11/f6a [0,4194304] 0 2024-04-26T23:09:03.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/377: rmdir da/d1b/d3b 39 2024-04-26T23:09:03.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/378: dread - da/d70/f77 zero size 2024-04-26T23:09:03.771 INFO:tasks.workunit.client.0.smithi148.stdout:4/278: rmdir d12/d17/d2a 39 2024-04-26T23:09:03.771 INFO:tasks.workunit.client.0.smithi148.stdout:9/386: dread f3 [0,4194304] 0 2024-04-26T23:09:03.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/379: mkdir da/d1b/d8b 0 2024-04-26T23:09:03.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/380: write da/d1b/d1c/f66 [1637377,67732] 0 2024-04-26T23:09:03.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/381: truncate da/d68/f80 1029133 0 2024-04-26T23:09:03.774 INFO:tasks.workunit.client.0.smithi148.stdout:2/410: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:09:03.774 INFO:tasks.workunit.client.0.smithi148.stdout:9/387: mknod d19/d39/c87 0 2024-04-26T23:09:03.774 INFO:tasks.workunit.client.0.smithi148.stdout:4/279: creat d12/d17/d2a/d33/f52 x:0 0 0 2024-04-26T23:09:03.776 INFO:tasks.workunit.client.0.smithi148.stdout:2/411: mknod d5/d17/c85 0 2024-04-26T23:09:03.776 INFO:tasks.workunit.client.0.smithi148.stdout:2/412: chown d5/d17/c41 144004 1 2024-04-26T23:09:03.776 INFO:tasks.workunit.client.0.smithi148.stdout:9/388: getdents d19/d1d/d69 0 2024-04-26T23:09:03.776 INFO:tasks.workunit.client.0.smithi148.stdout:9/389: dread - d19/d1d/d25/d31/f81 zero size 2024-04-26T23:09:03.777 INFO:tasks.workunit.client.0.smithi148.stdout:4/280: mkdir d12/d1a/d53 0 2024-04-26T23:09:03.777 INFO:tasks.workunit.client.0.smithi148.stdout:4/281: write d12/d17/f18 [535685,64740] 0 2024-04-26T23:09:03.777 INFO:tasks.workunit.client.0.smithi148.stdout:2/413: write d5/d8/d9/f79 [4259655,63699] 0 2024-04-26T23:09:03.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/282: mknod d12/d2c/c54 0 2024-04-26T23:09:03.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/283: write d12/d1c/f4d [854652,122650] 0 2024-04-26T23:09:03.783 INFO:tasks.workunit.client.0.smithi148.stdout:0/334: write d0/d8/d52/f1f [925900,76237] 0 2024-04-26T23:09:03.783 INFO:tasks.workunit.client.0.smithi148.stdout:0/335: dread - d0/d8/d33/d6a/f6e zero size 2024-04-26T23:09:03.783 INFO:tasks.workunit.client.0.smithi148.stdout:0/336: readlink d0/d2e/d51/l65 0 2024-04-26T23:09:03.785 INFO:tasks.workunit.client.0.smithi148.stdout:0/337: unlink d0/d8/d55/l5e 0 2024-04-26T23:09:03.785 INFO:tasks.workunit.client.0.smithi148.stdout:0/338: stat d0/d20/d3b/f3c 0 2024-04-26T23:09:03.789 INFO:tasks.workunit.client.0.smithi148.stdout:8/357: write d3/da/d1c/f41 [2107029,42160] 0 2024-04-26T23:09:03.790 INFO:tasks.workunit.client.0.smithi148.stdout:8/358: creat d3/d9/d12/d23/d65/f68 x:0 0 0 2024-04-26T23:09:03.790 INFO:tasks.workunit.client.0.smithi148.stdout:8/359: fdatasync d3/d9/f49 0 2024-04-26T23:09:03.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/360: mkdir d3/d9/d12/d23/d35/d69 0 2024-04-26T23:09:03.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/361: read - d3/f4b zero size 2024-04-26T23:09:03.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/362: fdatasync d3/da/d28/d4c/f20 0 2024-04-26T23:09:03.793 INFO:tasks.workunit.client.0.smithi148.stdout:8/363: symlink d3/d9/d12/d23/d29/d37/l6a 0 2024-04-26T23:09:03.794 INFO:tasks.workunit.client.0.smithi148.stdout:8/364: mknod d3/da/d1c/c6b 0 2024-04-26T23:09:03.796 INFO:tasks.workunit.client.0.smithi148.stdout:8/365: truncate d3/da/f64 718669 0 2024-04-26T23:09:03.796 INFO:tasks.workunit.client.0.smithi148.stdout:9/390: write d19/d1d/d25/d2f/f3d [931343,76158] 0 2024-04-26T23:09:03.797 INFO:tasks.workunit.client.0.smithi148.stdout:8/366: symlink d3/d9/d12/d23/d54/l6c 0 2024-04-26T23:09:03.799 INFO:tasks.workunit.client.0.smithi148.stdout:2/414: write d5/d8/d11/f61 [1211601,46087] 0 2024-04-26T23:09:03.802 INFO:tasks.workunit.client.0.smithi148.stdout:4/284: dread d12/d2c/f3f [0,4194304] 0 2024-04-26T23:09:03.802 INFO:tasks.workunit.client.0.smithi148.stdout:4/285: chown d12/d1c/d45 16 1 2024-04-26T23:09:03.803 INFO:tasks.workunit.client.0.smithi148.stdout:4/286: link d12/d17/d2a/d33/c49 d12/d17/d2a/c55 0 2024-04-26T23:09:03.815 INFO:tasks.workunit.client.0.smithi148.stdout:5/382: dwrite f3 [0,4194304] 0 2024-04-26T23:09:03.818 INFO:tasks.workunit.client.0.smithi148.stdout:5/383: truncate da/d1b/d1c/f36 1826095 0 2024-04-26T23:09:03.818 INFO:tasks.workunit.client.0.smithi148.stdout:5/384: chown da/d1b/d2d/f7b 22 1 2024-04-26T23:09:03.819 INFO:tasks.workunit.client.0.smithi148.stdout:5/385: dread - da/d1b/d2d/f7b zero size 2024-04-26T23:09:03.819 INFO:tasks.workunit.client.0.smithi148.stdout:5/386: truncate da/d1b/d5b/f65 940298 0 2024-04-26T23:09:03.826 INFO:tasks.workunit.client.0.smithi148.stdout:9/391: dread d19/d1d/d25/f3e [0,4194304] 0 2024-04-26T23:09:03.837 INFO:tasks.workunit.client.0.smithi148.stdout:8/367: write d3/d9/f24 [304224,109647] 0 2024-04-26T23:09:03.837 INFO:tasks.workunit.client.0.smithi148.stdout:8/368: truncate d3/da/f18 513833 0 2024-04-26T23:09:03.837 INFO:tasks.workunit.client.0.smithi148.stdout:8/369: stat d3/da/d28/d4c/f17 0 2024-04-26T23:09:03.839 INFO:tasks.workunit.client.0.smithi148.stdout:0/339: dwrite d0/d8/d1e/f22 [0,4194304] 0 2024-04-26T23:09:03.839 INFO:tasks.workunit.client.0.smithi148.stdout:8/370: creat d3/da/d28/d4c/f6d x:0 0 0 2024-04-26T23:09:03.841 INFO:tasks.workunit.client.0.smithi148.stdout:0/340: symlink d0/d8/d33/d43/l71 0 2024-04-26T23:09:03.844 INFO:tasks.workunit.client.0.smithi148.stdout:8/371: creat d3/d9/d12/d23/d35/d69/f6e x:0 0 0 2024-04-26T23:09:03.847 INFO:tasks.workunit.client.0.smithi148.stdout:9/392: dread d19/f1e [0,4194304] 0 2024-04-26T23:09:03.854 INFO:tasks.workunit.client.0.smithi148.stdout:8/372: symlink d3/d9/d12/d23/d65/l6f 0 2024-04-26T23:09:03.856 INFO:tasks.workunit.client.0.smithi148.stdout:9/393: truncate d19/d22/f76 184748 0 2024-04-26T23:09:03.856 INFO:tasks.workunit.client.0.smithi148.stdout:9/394: read - d19/d1d/d25/d2f/d4d/d33/d50/d57/f75 zero size 2024-04-26T23:09:03.856 INFO:tasks.workunit.client.0.smithi148.stdout:2/415: fsync d5/d17/d64/f76 0 2024-04-26T23:09:03.859 INFO:tasks.workunit.client.0.smithi148.stdout:8/373: rmdir d3/da/d28 39 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/416: mkdir d5/d7f/d86 0 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/417: chown d5/d8/d4b 9733 1 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/418: truncate d5/d10/f58 566681 0 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/419: chown d5/d8/d70/d78 64138425 1 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/420: write d5/d17/f30 [1821486,16753] 0 2024-04-26T23:09:03.860 INFO:tasks.workunit.client.0.smithi148.stdout:4/287: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-04-26T23:09:03.866 INFO:tasks.workunit.client.0.smithi148.stdout:8/374: rmdir d3/d9/d12/d23/d35/d69 39 2024-04-26T23:09:03.867 INFO:tasks.workunit.client.0.smithi148.stdout:2/421: mkdir d5/d7f/d86/d87 0 2024-04-26T23:09:03.867 INFO:tasks.workunit.client.0.smithi148.stdout:2/422: truncate d5/d10/f3b 849353 0 2024-04-26T23:09:03.867 INFO:tasks.workunit.client.0.smithi148.stdout:2/423: stat d5/d7/l56 0 2024-04-26T23:09:03.868 INFO:tasks.workunit.client.0.smithi148.stdout:2/424: mkdir d5/d17/d64/d88 0 2024-04-26T23:09:03.869 INFO:tasks.workunit.client.0.smithi148.stdout:2/425: chown d5/d8/d4b/l65 1170 1 2024-04-26T23:09:03.876 INFO:tasks.workunit.client.0.smithi148.stdout:9/395: write d19/d39/f59 [63058,106082] 0 2024-04-26T23:09:03.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/375: write d3/da/f18 [159744,400] 0 2024-04-26T23:09:03.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/376: truncate d3/da/d1c/f45 2238413 0 2024-04-26T23:09:03.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/377: chown d3/l36 0 1 2024-04-26T23:09:03.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/378: fdatasync d3/da/d28/d4c/f51 0 2024-04-26T23:09:03.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/379: chown d3/d9/d12/d23/d35/f4e 2148 1 2024-04-26T23:09:03.887 INFO:tasks.workunit.client.0.smithi148.stdout:9/396: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d61/d88 0 2024-04-26T23:09:03.890 INFO:tasks.workunit.client.0.smithi148.stdout:9/397: getdents d19/d1d 0 2024-04-26T23:09:03.892 INFO:tasks.workunit.client.0.smithi148.stdout:9/398: truncate f18 4027967 0 2024-04-26T23:09:03.905 INFO:tasks.workunit.client.0.smithi148.stdout:2/426: fsync d5/d8/d9/f2a 0 2024-04-26T23:09:03.908 INFO:tasks.workunit.client.0.smithi148.stdout:2/427: write d5/d10/f3b [358216,117844] 0 2024-04-26T23:09:03.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/387: dwrite da/d1b/d1c/f53 [0,4194304] 0 2024-04-26T23:09:03.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/388: readlink da/d1a/l79 0 2024-04-26T23:09:03.918 INFO:tasks.workunit.client.0.smithi148.stdout:4/288: dwrite d12/d1c/f51 [0,4194304] 0 2024-04-26T23:09:03.919 INFO:tasks.workunit.client.0.smithi148.stdout:2/428: truncate d5/d8/d4b/f77 261559 0 2024-04-26T23:09:03.919 INFO:tasks.workunit.client.0.smithi148.stdout:2/429: chown d5/d8/d70/d32 1579 1 2024-04-26T23:09:03.927 INFO:tasks.workunit.client.0.smithi148.stdout:5/389: unlink da/d1b/l45 0 2024-04-26T23:09:03.927 INFO:tasks.workunit.client.0.smithi148.stdout:0/341: dwrite d0/d5/f1a [0,4194304] 0 2024-04-26T23:09:03.927 INFO:tasks.workunit.client.0.smithi148.stdout:5/390: write da/d1a/f57 [479101,101071] 0 2024-04-26T23:09:03.927 INFO:tasks.workunit.client.0.smithi148.stdout:5/391: write da/d12/f35 [495840,70388] 0 2024-04-26T23:09:03.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/289: mkdir d12/d1c/d56 0 2024-04-26T23:09:03.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/290: readlink l6 0 2024-04-26T23:09:03.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/291: readlink l11 0 2024-04-26T23:09:03.928 INFO:tasks.workunit.client.0.smithi148.stdout:2/430: symlink d5/d8/d15/d43/d5d/d74/l89 0 2024-04-26T23:09:03.930 INFO:tasks.workunit.client.0.smithi148.stdout:0/342: mkdir d0/d8/d5f/d72 0 2024-04-26T23:09:03.931 INFO:tasks.workunit.client.0.smithi148.stdout:5/392: creat da/d68/d7a/f8c x:0 0 0 2024-04-26T23:09:03.931 INFO:tasks.workunit.client.0.smithi148.stdout:5/393: dread - da/d70/f77 zero size 2024-04-26T23:09:03.934 INFO:tasks.workunit.client.0.smithi148.stdout:2/431: truncate d5/d8/d70/d32/f37 821457 0 2024-04-26T23:09:03.936 INFO:tasks.workunit.client.0.smithi148.stdout:0/343: unlink d0/lb 0 2024-04-26T23:09:03.936 INFO:tasks.workunit.client.0.smithi148.stdout:0/344: fdatasync d0/d8/f42 0 2024-04-26T23:09:03.936 INFO:tasks.workunit.client.0.smithi148.stdout:0/345: readlink d0/d8/l10 0 2024-04-26T23:09:03.938 INFO:tasks.workunit.client.0.smithi148.stdout:5/394: truncate f3 2473482 0 2024-04-26T23:09:03.941 INFO:tasks.workunit.client.0.smithi148.stdout:5/395: rename da/d1b/d2d/f6d to da/d1b/d1c/f8d 0 2024-04-26T23:09:03.941 INFO:tasks.workunit.client.0.smithi148.stdout:5/396: fdatasync da/d68/d7a/f8c 0 2024-04-26T23:09:03.943 INFO:tasks.workunit.client.0.smithi148.stdout:7/325: sync 2024-04-26T23:09:03.944 INFO:tasks.workunit.client.0.smithi148.stdout:5/397: creat da/d12/f8e x:0 0 0 2024-04-26T23:09:03.945 INFO:tasks.workunit.client.0.smithi148.stdout:7/326: symlink d7/d11/d17/d2f/l70 0 2024-04-26T23:09:03.946 INFO:tasks.workunit.client.0.smithi148.stdout:4/292: dread d12/d1c/f51 [0,4194304] 0 2024-04-26T23:09:03.946 INFO:tasks.workunit.client.0.smithi148.stdout:4/293: write d12/d2c/f3f [3988009,52339] 0 2024-04-26T23:09:03.947 INFO:tasks.workunit.client.0.smithi148.stdout:5/398: creat da/d12/f8f x:0 0 0 2024-04-26T23:09:03.948 INFO:tasks.workunit.client.0.smithi148.stdout:7/327: rmdir d7/d11/d17/d2f 39 2024-04-26T23:09:03.948 INFO:tasks.workunit.client.0.smithi148.stdout:7/328: chown d7/d11/d13/c25 621471 1 2024-04-26T23:09:03.953 INFO:tasks.workunit.client.0.smithi148.stdout:3/331: sync 2024-04-26T23:09:03.956 INFO:tasks.workunit.client.0.smithi148.stdout:6/296: sync 2024-04-26T23:09:03.956 INFO:tasks.workunit.client.0.smithi148.stdout:4/294: unlink d12/d17/f18 0 2024-04-26T23:09:03.956 INFO:tasks.workunit.client.0.smithi148.stdout:5/399: mkdir da/d1b/d1c/d7f/d90 0 2024-04-26T23:09:03.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/329: unlink d7/d11/d29/f37 0 2024-04-26T23:09:03.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/330: truncate d7/d19/f35 4209428 0 2024-04-26T23:09:03.957 INFO:tasks.workunit.client.0.smithi148.stdout:3/332: truncate d9/d15/f1e 506977 0 2024-04-26T23:09:03.958 INFO:tasks.workunit.client.0.smithi148.stdout:6/297: creat d6/d9/d1c/d1d/d1f/f59 x:0 0 0 2024-04-26T23:09:03.959 INFO:tasks.workunit.client.0.smithi148.stdout:2/432: dwrite d5/d8/d9/f63 [0,4194304] 0 2024-04-26T23:09:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:4/295: rmdir d12/d1c 39 2024-04-26T23:09:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:7/331: stat d7/l5d 0 2024-04-26T23:09:03.963 INFO:tasks.workunit.client.0.smithi148.stdout:6/298: mknod d6/d32/c5a 0 2024-04-26T23:09:03.964 INFO:tasks.workunit.client.0.smithi148.stdout:3/333: rename d9/l17 to d9/d31/l6b 0 2024-04-26T23:09:03.966 INFO:tasks.workunit.client.0.smithi148.stdout:2/433: creat d5/d7f/d86/d87/f8a x:0 0 0 2024-04-26T23:09:03.966 INFO:tasks.workunit.client.0.smithi148.stdout:2/434: write d5/d17/d64/f76 [7954879,103916] 0 2024-04-26T23:09:03.968 INFO:tasks.workunit.client.0.smithi148.stdout:4/296: creat d12/d17/d2a/d33/f57 x:0 0 0 2024-04-26T23:09:03.969 INFO:tasks.workunit.client.0.smithi148.stdout:6/299: rename d6/d32/d54 to d6/d9/d1c/d5b 0 2024-04-26T23:09:03.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/435: symlink d5/d17/l8b 0 2024-04-26T23:09:03.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/436: chown d5/d1c/l4f 135670 1 2024-04-26T23:09:03.972 INFO:tasks.workunit.client.0.smithi148.stdout:6/300: creat d6/f5c x:0 0 0 2024-04-26T23:09:03.974 INFO:tasks.workunit.client.0.smithi148.stdout:2/437: rename d5/d8/d15/d43/d5d/d74/l89 to d5/d8/d15/d43/d5d/l8c 0 2024-04-26T23:09:03.974 INFO:tasks.workunit.client.0.smithi148.stdout:2/438: write d5/d10/f5b [695838,116958] 0 2024-04-26T23:09:03.975 INFO:tasks.workunit.client.0.smithi148.stdout:6/301: creat d6/d9/d1c/f5d x:0 0 0 2024-04-26T23:09:03.976 INFO:tasks.workunit.client.0.smithi148.stdout:6/302: write d6/dc/f45 [1720140,106769] 0 2024-04-26T23:09:03.976 INFO:tasks.workunit.client.0.smithi148.stdout:6/303: fsync d6/f47 0 2024-04-26T23:09:03.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/439: unlink d5/d7/l27 0 2024-04-26T23:09:03.979 INFO:tasks.workunit.client.0.smithi148.stdout:6/304: rename d6/d32/c5a to d6/c5e 0 2024-04-26T23:09:03.980 INFO:tasks.workunit.client.0.smithi148.stdout:6/305: fsync d6/f33 0 2024-04-26T23:09:03.980 INFO:tasks.workunit.client.0.smithi148.stdout:6/306: truncate d6/d9/d23/f57 1046644 0 2024-04-26T23:09:03.982 INFO:tasks.workunit.client.0.smithi148.stdout:6/307: stat d6/l35 0 2024-04-26T23:09:03.982 INFO:tasks.workunit.client.0.smithi148.stdout:6/308: dread - d6/d9/d1c/f5d zero size 2024-04-26T23:09:03.982 INFO:tasks.workunit.client.0.smithi148.stdout:6/309: chown d6/dc 31793 1 2024-04-26T23:09:03.983 INFO:tasks.workunit.client.0.smithi148.stdout:6/310: creat d6/d9/d1e/f5f x:0 0 0 2024-04-26T23:09:03.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/311: link d6/d14/c41 d6/d9/d1e/c60 0 2024-04-26T23:09:03.993 INFO:tasks.workunit.client.0.smithi148.stdout:2/440: rename d5/d8/d15/d43/d5d/d74 to d5/d8/d15/d43/d8d 0 2024-04-26T23:09:03.993 INFO:tasks.workunit.client.0.smithi148.stdout:2/441: link d5/d8/d9/fc d5/d8/d4b/d4e/d6d/f8e 0 2024-04-26T23:09:03.993 INFO:tasks.workunit.client.0.smithi148.stdout:2/442: chown d5/d8/d9/f28 5 1 2024-04-26T23:09:03.993 INFO:tasks.workunit.client.0.smithi148.stdout:2/443: mkdir d5/d8/d6c/d8f 0 2024-04-26T23:09:03.994 INFO:tasks.workunit.client.0.smithi148.stdout:2/444: mknod d5/d17/d64/c90 0 2024-04-26T23:09:03.997 INFO:tasks.workunit.client.0.smithi148.stdout:9/399: read d19/d1d/d25/d31/d60/f62 [323511,87144] 0 2024-04-26T23:09:03.998 INFO:tasks.workunit.client.0.smithi148.stdout:9/400: chown d19/l35 40 1 2024-04-26T23:09:04.000 INFO:tasks.workunit.client.0.smithi148.stdout:7/332: dwrite d7/f22 [0,4194304] 0 2024-04-26T23:09:04.001 INFO:tasks.workunit.client.0.smithi148.stdout:8/380: dwrite d3/d9/f49 [0,4194304] 0 2024-04-26T23:09:04.001 INFO:tasks.workunit.client.0.smithi148.stdout:8/381: fdatasync d3/da/d28/f50 0 2024-04-26T23:09:04.006 INFO:tasks.workunit.client.0.smithi148.stdout:2/445: symlink d5/d8/d15/d7d/l91 0 2024-04-26T23:09:04.007 INFO:tasks.workunit.client.0.smithi148.stdout:9/401: creat d19/d1d/d69/f89 x:0 0 0 2024-04-26T23:09:04.007 INFO:tasks.workunit.client.0.smithi148.stdout:8/382: creat d3/da/d28/f70 x:0 0 0 2024-04-26T23:09:04.016 INFO:tasks.workunit.client.0.smithi148.stdout:8/383: truncate d3/d9/d12/d23/d35/f66 647856 0 2024-04-26T23:09:04.016 INFO:tasks.workunit.client.0.smithi148.stdout:3/334: dwrite d9/d31/f55 [0,4194304] 0 2024-04-26T23:09:04.016 INFO:tasks.workunit.client.0.smithi148.stdout:3/335: chown c7 2615255 1 2024-04-26T23:09:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/336: symlink d9/l6c 0 2024-04-26T23:09:04.029 INFO:tasks.workunit.client.0.smithi148.stdout:1/309: sync 2024-04-26T23:09:04.030 INFO:tasks.workunit.client.0.smithi148.stdout:1/310: getdents d16/d45/d2b 0 2024-04-26T23:09:04.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/311: rmdir d16/d17/d4b/d4d 39 2024-04-26T23:09:04.044 INFO:tasks.workunit.client.0.smithi148.stdout:7/333: write d7/f9 [3665672,105643] 0 2024-04-26T23:09:04.045 INFO:tasks.workunit.client.0.smithi148.stdout:7/334: fsync d7/d11/d29/d2e/f64 0 2024-04-26T23:09:04.089 INFO:tasks.workunit.client.0.smithi148.stdout:8/384: dwrite d3/d9/d12/d23/d29/d37/f63 [0,4194304] 0 2024-04-26T23:09:04.090 INFO:tasks.workunit.client.0.smithi148.stdout:0/346: dwrite d0/d8/d1e/f28 [0,4194304] 0 2024-04-26T23:09:04.091 INFO:tasks.workunit.client.0.smithi148.stdout:0/347: getdents d0/d5 0 2024-04-26T23:09:04.092 INFO:tasks.workunit.client.0.smithi148.stdout:0/348: mkdir d0/d20/d54/d5d/d6c/d73 0 2024-04-26T23:09:04.094 INFO:tasks.workunit.client.0.smithi148.stdout:0/349: creat d0/d8/d33/d43/d4e/f74 x:0 0 0 2024-04-26T23:09:04.096 INFO:tasks.workunit.client.0.smithi148.stdout:0/350: symlink d0/d8/d33/d6a/l75 0 2024-04-26T23:09:04.111 INFO:tasks.workunit.client.0.smithi148.stdout:0/351: read d0/d8/d1e/f22 [1189273,22839] 0 2024-04-26T23:09:04.111 INFO:tasks.workunit.client.0.smithi148.stdout:0/352: dread - d0/d8/d33/d6a/f6e zero size 2024-04-26T23:09:04.111 INFO:tasks.workunit.client.0.smithi148.stdout:0/353: fdatasync d0/d8/d1e/f23 0 2024-04-26T23:09:04.129 INFO:tasks.workunit.client.0.smithi148.stdout:5/400: dwrite da/d12/f35 [0,4194304] 0 2024-04-26T23:09:04.135 INFO:tasks.workunit.client.0.smithi148.stdout:5/401: symlink da/d68/d69/l91 0 2024-04-26T23:09:04.138 INFO:tasks.workunit.client.0.smithi148.stdout:6/312: dwrite d6/d9/d1c/d1d/d1f/f59 [0,4194304] 0 2024-04-26T23:09:04.138 INFO:tasks.workunit.client.0.smithi148.stdout:6/313: fdatasync d6/d9/f15 0 2024-04-26T23:09:04.138 INFO:tasks.workunit.client.0.smithi148.stdout:6/314: fsync d6/d9/d1c/f2e 0 2024-04-26T23:09:04.142 INFO:tasks.workunit.client.0.smithi148.stdout:6/315: rename d6/d9/l16 to d6/d32/l61 0 2024-04-26T23:09:04.143 INFO:tasks.workunit.client.0.smithi148.stdout:5/402: dread da/f18 [0,4194304] 0 2024-04-26T23:09:04.143 INFO:tasks.workunit.client.0.smithi148.stdout:5/403: readlink da/d1b/d1c/d54/l63 0 2024-04-26T23:09:04.144 INFO:tasks.workunit.client.0.smithi148.stdout:6/316: creat d6/d32/f62 x:0 0 0 2024-04-26T23:09:04.146 INFO:tasks.workunit.client.0.smithi148.stdout:6/317: creat d6/d32/f63 x:0 0 0 2024-04-26T23:09:04.148 INFO:tasks.workunit.client.0.smithi148.stdout:5/404: link da/d1a/l5f da/d1b/d1c/l92 0 2024-04-26T23:09:04.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/405: rename da/f7d to da/d1b/f93 0 2024-04-26T23:09:04.150 INFO:tasks.workunit.client.0.smithi148.stdout:5/406: link da/d1b/d5b/f4d da/d1b/d3b/d72/f94 0 2024-04-26T23:09:04.155 INFO:tasks.workunit.client.0.smithi148.stdout:6/318: dread d6/d9/d1c/d1d/d1f/f4c [0,4194304] 0 2024-04-26T23:09:04.156 INFO:tasks.workunit.client.0.smithi148.stdout:6/319: getdents d6/dc 0 2024-04-26T23:09:04.156 INFO:tasks.workunit.client.0.smithi148.stdout:6/320: readlink d6/d32/l61 0 2024-04-26T23:09:04.157 INFO:tasks.workunit.client.0.smithi148.stdout:5/407: read da/d1b/d1c/f66 [407650,111385] 0 2024-04-26T23:09:04.157 INFO:tasks.workunit.client.0.smithi148.stdout:6/321: creat d6/d9/f64 x:0 0 0 2024-04-26T23:09:04.158 INFO:tasks.workunit.client.0.smithi148.stdout:3/337: dwrite d9/f36 [0,4194304] 0 2024-04-26T23:09:04.159 INFO:tasks.workunit.client.0.smithi148.stdout:5/408: unlink da/d70/f8a 0 2024-04-26T23:09:04.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/322: creat d6/d9/d1c/d1d/f65 x:0 0 0 2024-04-26T23:09:04.160 INFO:tasks.workunit.client.0.smithi148.stdout:3/338: mknod d9/d31/c6d 0 2024-04-26T23:09:04.160 INFO:tasks.workunit.client.0.smithi148.stdout:3/339: read f5 [1473331,119344] 0 2024-04-26T23:09:04.161 INFO:tasks.workunit.client.0.smithi148.stdout:3/340: write d9/d4c/f5f [1022305,106120] 0 2024-04-26T23:09:04.161 INFO:tasks.workunit.client.0.smithi148.stdout:3/341: fsync d9/d15/f1b 0 2024-04-26T23:09:04.161 INFO:tasks.workunit.client.0.smithi148.stdout:3/342: dread - d9/d4c/f66 zero size 2024-04-26T23:09:04.162 INFO:tasks.workunit.client.0.smithi148.stdout:5/409: creat da/d1b/d1c/d7f/f95 x:0 0 0 2024-04-26T23:09:04.162 INFO:tasks.workunit.client.0.smithi148.stdout:5/410: truncate da/d1b/d1c/d7f/f95 711923 0 2024-04-26T23:09:04.162 INFO:tasks.workunit.client.0.smithi148.stdout:6/323: rename d6/dc/d46 to d6/d32/d66 0 2024-04-26T23:09:04.162 INFO:tasks.workunit.client.0.smithi148.stdout:6/324: fdatasync d6/d9/d1c/f5d 0 2024-04-26T23:09:04.163 INFO:tasks.workunit.client.0.smithi148.stdout:3/343: link d9/d15/d29/d4d/c59 d9/d52/c6e 0 2024-04-26T23:09:04.163 INFO:tasks.workunit.client.0.smithi148.stdout:5/411: creat da/d1f/d67/f96 x:0 0 0 2024-04-26T23:09:04.165 INFO:tasks.workunit.client.0.smithi148.stdout:6/325: creat d6/d9/d23/d4a/f67 x:0 0 0 2024-04-26T23:09:04.166 INFO:tasks.workunit.client.0.smithi148.stdout:5/412: mkdir da/d1b/d3b/d73/d97 0 2024-04-26T23:09:04.173 INFO:tasks.workunit.client.0.smithi148.stdout:5/413: mknod da/d1f/d67/d71/c98 0 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:1/312: dread d16/d1c/f2c [4194304,4194304] 0 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:1/313: chown d16/d1c/f29 24702341 1 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:7/335: dread d7/d11/d29/d2e/d41/d67/f6b [0,4194304] 0 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:7/336: read d7/d11/d17/d43/f52 [400131,58471] 0 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:7/337: chown d7/d19/f30 243766 1 2024-04-26T23:09:04.180 INFO:tasks.workunit.client.0.smithi148.stdout:3/344: dread d9/d15/f27 [0,4194304] 0 2024-04-26T23:09:04.181 INFO:tasks.workunit.client.0.smithi148.stdout:7/338: creat d7/d11/f71 x:0 0 0 2024-04-26T23:09:04.181 INFO:tasks.workunit.client.0.smithi148.stdout:7/339: truncate d7/d11/d17/f65 282921 0 2024-04-26T23:09:04.182 INFO:tasks.workunit.client.0.smithi148.stdout:3/345: mkdir d9/d15/d29/d4d/d6f 0 2024-04-26T23:09:04.185 INFO:tasks.workunit.client.0.smithi148.stdout:3/346: rename d9/d15/l1d to d9/d15/l70 0 2024-04-26T23:09:04.185 INFO:tasks.workunit.client.0.smithi148.stdout:3/347: write d9/d15/f1e [521648,77054] 0 2024-04-26T23:09:04.186 INFO:tasks.workunit.client.0.smithi148.stdout:3/348: truncate d9/d31/f32 2468305 0 2024-04-26T23:09:04.188 INFO:tasks.workunit.client.0.smithi148.stdout:3/349: rmdir d9/d15/d29/d4d/d5b 39 2024-04-26T23:09:04.189 INFO:tasks.workunit.client.0.smithi148.stdout:3/350: mknod d9/d52/c71 0 2024-04-26T23:09:04.193 INFO:tasks.workunit.client.0.smithi148.stdout:4/297: dwrite d12/d2c/f3f [0,4194304] 0 2024-04-26T23:09:04.194 INFO:tasks.workunit.client.0.smithi148.stdout:3/351: dread d9/f2d [0,4194304] 0 2024-04-26T23:09:04.200 INFO:tasks.workunit.client.0.smithi148.stdout:6/326: dwrite d6/d32/f63 [0,4194304] 0 2024-04-26T23:09:04.209 INFO:tasks.workunit.client.0.smithi148.stdout:3/352: mknod d9/d52/c72 0 2024-04-26T23:09:04.209 INFO:tasks.workunit.client.0.smithi148.stdout:7/340: getdents d7/d11 0 2024-04-26T23:09:04.220 INFO:tasks.workunit.client.0.smithi148.stdout:3/353: rename d9/f1c to d9/d15/d29/f73 0 2024-04-26T23:09:04.221 INFO:tasks.workunit.client.0.smithi148.stdout:3/354: chown d9/d15/l70 7 1 2024-04-26T23:09:04.221 INFO:tasks.workunit.client.0.smithi148.stdout:6/327: write d6/f43 [2960638,78993] 0 2024-04-26T23:09:04.221 INFO:tasks.workunit.client.0.smithi148.stdout:7/341: rmdir d7 39 2024-04-26T23:09:04.223 INFO:tasks.workunit.client.0.smithi148.stdout:1/314: dread fd [0,4194304] 0 2024-04-26T23:09:04.234 INFO:tasks.workunit.client.0.smithi148.stdout:5/414: dwrite da/d12/f35 [0,4194304] 0 2024-04-26T23:09:04.235 INFO:tasks.workunit.client.0.smithi148.stdout:1/315: dread d16/d45/d2b/f31 [0,4194304] 0 2024-04-26T23:09:04.242 INFO:tasks.workunit.client.0.smithi148.stdout:4/298: dwrite d12/d1c/f28 [0,4194304] 0 2024-04-26T23:09:04.242 INFO:tasks.workunit.client.0.smithi148.stdout:4/299: truncate d12/d17/d2a/f2d 1033997 0 2024-04-26T23:09:04.247 INFO:tasks.workunit.client.0.smithi148.stdout:5/415: symlink da/d12/d78/l99 0 2024-04-26T23:09:04.259 INFO:tasks.workunit.client.0.smithi148.stdout:1/316: dread fd [0,4194304] 0 2024-04-26T23:09:04.259 INFO:tasks.workunit.client.0.smithi148.stdout:5/416: mknod da/d1b/d8b/c9a 0 2024-04-26T23:09:04.266 INFO:tasks.workunit.client.0.smithi148.stdout:1/317: dread d16/d17/f1a [0,4194304] 0 2024-04-26T23:09:04.267 INFO:tasks.workunit.client.0.smithi148.stdout:6/328: dread d6/d9/d1c/d1d/d1f/f59 [0,4194304] 0 2024-04-26T23:09:04.268 INFO:tasks.workunit.client.0.smithi148.stdout:3/355: dwrite d9/f43 [0,4194304] 0 2024-04-26T23:09:04.269 INFO:tasks.workunit.client.0.smithi148.stdout:5/417: rmdir da/d1b/d1c/d54 39 2024-04-26T23:09:04.277 INFO:tasks.workunit.client.0.smithi148.stdout:1/318: dread d16/d17/f1a [0,4194304] 0 2024-04-26T23:09:04.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/329: mkdir d6/d9/d1c/d1d/d68 0 2024-04-26T23:09:04.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/330: readlink d6/l35 0 2024-04-26T23:09:04.277 INFO:tasks.workunit.client.0.smithi148.stdout:3/356: truncate d9/d52/f62 352713 0 2024-04-26T23:09:04.277 INFO:tasks.workunit.client.0.smithi148.stdout:5/418: rmdir da/d1b 39 2024-04-26T23:09:04.278 INFO:tasks.workunit.client.0.smithi148.stdout:4/300: dwrite d12/f14 [8388608,4194304] 0 2024-04-26T23:09:04.341 INFO:tasks.workunit.client.0.smithi148.stdout:1/319: dwrite d16/d17/f1a [0,4194304] 0 2024-04-26T23:09:04.345 INFO:tasks.workunit.client.0.smithi148.stdout:1/320: write d16/f1d [1161397,72267] 0 2024-04-26T23:09:04.380 INFO:tasks.workunit.client.0.smithi148.stdout:1/321: dwrite d16/d45/d2b/f31 [4194304,4194304] 0 2024-04-26T23:09:04.531 INFO:tasks.workunit.client.0.smithi148.stdout:6/331: mkdir d6/d9/d1e/d69 0 2024-04-26T23:09:04.531 INFO:tasks.workunit.client.0.smithi148.stdout:4/301: rmdir d12/d1a/d53 0 2024-04-26T23:09:04.531 INFO:tasks.workunit.client.0.smithi148.stdout:7/342: creat d7/d11/d29/d2e/f72 x:0 0 0 2024-04-26T23:09:04.531 INFO:tasks.workunit.client.0.smithi148.stdout:5/419: creat da/d1b/d3b/d72/f9b x:0 0 0 2024-04-26T23:09:04.535 INFO:tasks.workunit.client.0.smithi148.stdout:9/402: sync 2024-04-26T23:09:04.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/446: sync 2024-04-26T23:09:04.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/447: write d5/d8/d15/d43/f5f [1478776,28527] 0 2024-04-26T23:09:04.545 INFO:tasks.workunit.client.0.smithi148.stdout:1/322: rename d16/d47/d49/l51 to d16/d47/l63 0 2024-04-26T23:09:04.545 INFO:tasks.workunit.client.0.smithi148.stdout:6/332: mknod d6/dc/c6a 0 2024-04-26T23:09:04.549 INFO:tasks.workunit.client.0.smithi148.stdout:2/448: rename d5/c34 to d5/d8/d4b/c92 0 2024-04-26T23:09:04.549 INFO:tasks.workunit.client.0.smithi148.stdout:1/323: symlink d16/d17/d4b/d53/l64 0 2024-04-26T23:09:04.549 INFO:tasks.workunit.client.0.smithi148.stdout:1/324: write d16/f3a [705023,87088] 0 2024-04-26T23:09:04.549 INFO:tasks.workunit.client.0.smithi148.stdout:6/333: symlink d6/d32/d66/l6b 0 2024-04-26T23:09:04.550 INFO:tasks.workunit.client.0.smithi148.stdout:6/334: fdatasync d6/f33 0 2024-04-26T23:09:04.550 INFO:tasks.workunit.client.0.smithi148.stdout:6/335: chown d6/c5e 95467074 1 2024-04-26T23:09:04.550 INFO:tasks.workunit.client.0.smithi148.stdout:6/336: fsync d6/d9/d23/d4a/f67 0 2024-04-26T23:09:04.551 INFO:tasks.workunit.client.0.smithi148.stdout:1/325: rmdir d16/d17/d4b/d59/d62 0 2024-04-26T23:09:04.552 INFO:tasks.workunit.client.0.smithi148.stdout:1/326: mknod d16/d17/c65 0 2024-04-26T23:09:04.563 INFO:tasks.workunit.client.0.smithi148.stdout:4/302: write d12/d17/d2a/f2f [210768,45253] 0 2024-04-26T23:09:04.577 INFO:tasks.workunit.client.0.smithi148.stdout:2/449: write d5/d8/d9/fc [879579,26803] 0 2024-04-26T23:09:04.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/450: mknod d5/d8/d15/d43/d8d/c93 0 2024-04-26T23:09:04.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/451: chown d5/d1c/d38/c3f 5559843 1 2024-04-26T23:09:04.591 INFO:tasks.workunit.client.0.smithi148.stdout:1/327: dread d16/d1c/f2c [0,4194304] 0 2024-04-26T23:09:04.593 INFO:tasks.workunit.client.0.smithi148.stdout:9/403: dwrite d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:04.594 INFO:tasks.workunit.client.0.smithi148.stdout:6/337: write d6/d9/d23/f57 [176833,91455] 0 2024-04-26T23:09:04.594 INFO:tasks.workunit.client.0.smithi148.stdout:6/338: readlink d6/d9/d23/l48 0 2024-04-26T23:09:04.602 INFO:tasks.workunit.client.0.smithi148.stdout:2/452: dread d5/d8/d15/d43/f49 [0,4194304] 0 2024-04-26T23:09:04.607 INFO:tasks.workunit.client.0.smithi148.stdout:7/343: dwrite d7/d19/f30 [0,4194304] 0 2024-04-26T23:09:04.610 INFO:tasks.workunit.client.0.smithi148.stdout:7/344: mknod d7/d11/d17/c73 0 2024-04-26T23:09:04.618 INFO:tasks.workunit.client.0.smithi148.stdout:8/385: sync 2024-04-26T23:09:04.619 INFO:tasks.workunit.client.0.smithi148.stdout:1/328: dread d16/d17/f1a [0,4194304] 0 2024-04-26T23:09:04.619 INFO:tasks.workunit.client.0.smithi148.stdout:1/329: fdatasync d16/d17/f3b 0 2024-04-26T23:09:04.619 INFO:tasks.workunit.client.0.smithi148.stdout:8/386: rmdir d3/d9/d12/d23/d29 39 2024-04-26T23:09:04.623 INFO:tasks.workunit.client.0.smithi148.stdout:8/387: link d3/f44 d3/d9/d12/d23/d65/f71 0 2024-04-26T23:09:04.623 INFO:tasks.workunit.client.0.smithi148.stdout:8/388: truncate d3/f4b 1009520 0 2024-04-26T23:09:04.623 INFO:tasks.workunit.client.0.smithi148.stdout:8/389: write d3/da/d28/f50 [1368390,120428] 0 2024-04-26T23:09:04.626 INFO:tasks.workunit.client.0.smithi148.stdout:8/390: rmdir d3 39 2024-04-26T23:09:04.626 INFO:tasks.workunit.client.0.smithi148.stdout:8/391: chown d3/da/c26 0 1 2024-04-26T23:09:04.628 INFO:tasks.workunit.client.0.smithi148.stdout:7/345: dread d7/d19/f30 [0,4194304] 0 2024-04-26T23:09:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/420: dwrite da/fb [0,4194304] 0 2024-04-26T23:09:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/421: chown da/d70 0 1 2024-04-26T23:09:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/422: chown da/d70 18 1 2024-04-26T23:09:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/423: fsync da/d12/f35 0 2024-04-26T23:09:04.641 INFO:tasks.workunit.client.0.smithi148.stdout:5/424: mknod da/d1b/d1c/c9c 0 2024-04-26T23:09:04.642 INFO:tasks.workunit.client.0.smithi148.stdout:5/425: mknod da/d68/d69/c9d 0 2024-04-26T23:09:04.644 INFO:tasks.workunit.client.0.smithi148.stdout:5/426: link da/f18 da/d1b/d3b/d72/f9e 0 2024-04-26T23:09:04.644 INFO:tasks.workunit.client.0.smithi148.stdout:5/427: dread - da/d1b/d3b/d72/f9b zero size 2024-04-26T23:09:04.645 INFO:tasks.workunit.client.0.smithi148.stdout:5/428: creat da/d1a/f9f x:0 0 0 2024-04-26T23:09:04.646 INFO:tasks.workunit.client.0.smithi148.stdout:7/346: dread d7/d11/d29/f5f [0,4194304] 0 2024-04-26T23:09:04.646 INFO:tasks.workunit.client.0.smithi148.stdout:7/347: write d7/d19/f6c [165640,52257] 0 2024-04-26T23:09:04.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/392: dwrite d3/da/f18 [0,4194304] 0 2024-04-26T23:09:04.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/393: rename d3 to d3/d9/d12/d23/d29/d37/d72 22 2024-04-26T23:09:04.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/394: write d3/d9/d12/d23/d29/f4a [959551,17242] 0 2024-04-26T23:09:04.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/395: readlink d3/d9/l1a 0 2024-04-26T23:09:04.664 INFO:tasks.workunit.client.0.smithi148.stdout:5/429: creat da/d1b/d8b/fa0 x:0 0 0 2024-04-26T23:09:04.665 INFO:tasks.workunit.client.0.smithi148.stdout:5/430: truncate da/d68/d7a/f8c 14961 0 2024-04-26T23:09:04.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/396: creat d3/d9/d12/d23/f73 x:0 0 0 2024-04-26T23:09:04.667 INFO:tasks.workunit.client.0.smithi148.stdout:5/431: link da/d1b/d5b/l41 da/d1f/d67/la1 0 2024-04-26T23:09:04.668 INFO:tasks.workunit.client.0.smithi148.stdout:8/397: unlink d3/d9/d12/d23/d35/f57 0 2024-04-26T23:09:04.669 INFO:tasks.workunit.client.0.smithi148.stdout:5/432: creat da/d1b/d1c/d54/fa2 x:0 0 0 2024-04-26T23:09:04.670 INFO:tasks.workunit.client.0.smithi148.stdout:8/398: link d3/da/d28/f50 d3/da/f74 0 2024-04-26T23:09:04.670 INFO:tasks.workunit.client.0.smithi148.stdout:8/399: chown d3/l2a 26053000 1 2024-04-26T23:09:04.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/400: write d3/da/f5c [1075676,61276] 0 2024-04-26T23:09:04.671 INFO:tasks.workunit.client.0.smithi148.stdout:6/339: dwrite d6/d9/d23/f57 [0,4194304] 0 2024-04-26T23:09:04.673 INFO:tasks.workunit.client.0.smithi148.stdout:6/340: symlink d6/d9/d1c/d1d/d1f/l6c 0 2024-04-26T23:09:04.673 INFO:tasks.workunit.client.0.smithi148.stdout:6/341: write d6/d32/f62 [306732,47431] 0 2024-04-26T23:09:04.674 INFO:tasks.workunit.client.0.smithi148.stdout:6/342: symlink d6/d9/d1c/d1d/d68/l6d 0 2024-04-26T23:09:04.676 INFO:tasks.workunit.client.0.smithi148.stdout:6/343: truncate d6/dc/f45 1372646 0 2024-04-26T23:09:04.677 INFO:tasks.workunit.client.0.smithi148.stdout:3/357: sync 2024-04-26T23:09:04.677 INFO:tasks.workunit.client.0.smithi148.stdout:0/354: sync 2024-04-26T23:09:04.680 INFO:tasks.workunit.client.0.smithi148.stdout:3/358: creat d9/d15/d29/d4d/d6f/f74 x:0 0 0 2024-04-26T23:09:04.681 INFO:tasks.workunit.client.0.smithi148.stdout:0/355: creat d0/d8/d33/d68/f76 x:0 0 0 2024-04-26T23:09:04.684 INFO:tasks.workunit.client.0.smithi148.stdout:0/356: rename d0/d8/d33/d43/d4e/f74 to d0/d8/d5f/d72/f77 0 2024-04-26T23:09:04.684 INFO:tasks.workunit.client.0.smithi148.stdout:0/357: write d0/d8/d5f/d72/f77 [642475,96026] 0 2024-04-26T23:09:04.685 INFO:tasks.workunit.client.0.smithi148.stdout:3/359: dread d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:04.696 INFO:tasks.workunit.client.0.smithi148.stdout:0/358: rename d0/d8/l4a to d0/d5/l78 0 2024-04-26T23:09:04.701 INFO:tasks.workunit.client.0.smithi148.stdout:0/359: unlink d0/d8/d33/c49 0 2024-04-26T23:09:04.701 INFO:tasks.workunit.client.0.smithi148.stdout:0/360: write d0/d8/d55/f66 [5584509,29390] 0 2024-04-26T23:09:04.703 INFO:tasks.workunit.client.0.smithi148.stdout:0/361: unlink d0/d5/c4c 0 2024-04-26T23:09:04.703 INFO:tasks.workunit.client.0.smithi148.stdout:0/362: read d0/d8/f42 [644880,46569] 0 2024-04-26T23:09:04.705 INFO:tasks.workunit.client.0.smithi148.stdout:0/363: creat d0/d8/d5f/f79 x:0 0 0 2024-04-26T23:09:04.706 INFO:tasks.workunit.client.0.smithi148.stdout:0/364: truncate d0/d8/d52/f30 5246562 0 2024-04-26T23:09:04.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/365: symlink d0/d2e/d51/l7a 0 2024-04-26T23:09:04.710 INFO:tasks.workunit.client.0.smithi148.stdout:0/366: link d0/f63 d0/f7b 0 2024-04-26T23:09:04.710 INFO:tasks.workunit.client.0.smithi148.stdout:0/367: write d0/f1b [476582,92583] 0 2024-04-26T23:09:04.712 INFO:tasks.workunit.client.0.smithi148.stdout:0/368: truncate d0/f2 3159435 0 2024-04-26T23:09:04.713 INFO:tasks.workunit.client.0.smithi148.stdout:0/369: getdents d0/d5/d19 0 2024-04-26T23:09:04.713 INFO:tasks.workunit.client.0.smithi148.stdout:0/370: stat d0/d20/d3b/f3c 0 2024-04-26T23:09:04.714 INFO:tasks.workunit.client.0.smithi148.stdout:0/371: chown d0/d2e/d51 13 1 2024-04-26T23:09:04.719 INFO:tasks.workunit.client.0.smithi148.stdout:7/348: dwrite d7/d11/d13/f21 [0,4194304] 0 2024-04-26T23:09:04.720 INFO:tasks.workunit.client.0.smithi148.stdout:0/372: unlink d0/f63 0 2024-04-26T23:09:04.735 INFO:tasks.workunit.client.0.smithi148.stdout:7/349: link d7/d11/d17/d2f/d44/l47 d7/l74 0 2024-04-26T23:09:04.736 INFO:tasks.workunit.client.0.smithi148.stdout:0/373: creat d0/d20/d54/d5d/f7c x:0 0 0 2024-04-26T23:09:04.744 INFO:tasks.workunit.client.0.smithi148.stdout:7/350: unlink d7/l74 0 2024-04-26T23:09:04.744 INFO:tasks.workunit.client.0.smithi148.stdout:0/374: mknod d0/d20/d54/c7d 0 2024-04-26T23:09:04.745 INFO:tasks.workunit.client.0.smithi148.stdout:3/360: dwrite d9/d15/f1b [0,4194304] 0 2024-04-26T23:09:04.745 INFO:tasks.workunit.client.0.smithi148.stdout:0/375: creat d0/d8/d33/f7e x:0 0 0 2024-04-26T23:09:04.753 INFO:tasks.workunit.client.0.smithi148.stdout:3/361: truncate d9/d15/d29/d4d/f64 38261 0 2024-04-26T23:09:04.754 INFO:tasks.workunit.client.0.smithi148.stdout:0/376: symlink d0/d8/d5f/l7f 0 2024-04-26T23:09:04.759 INFO:tasks.workunit.client.0.smithi148.stdout:5/433: write da/d1b/d1c/f53 [3686310,98713] 0 2024-04-26T23:09:04.759 INFO:tasks.workunit.client.0.smithi148.stdout:6/344: dwrite d6/dc/f3f [0,4194304] 0 2024-04-26T23:09:04.759 INFO:tasks.workunit.client.0.smithi148.stdout:6/345: dread - d6/d9/d1c/f5d zero size 2024-04-26T23:09:04.759 INFO:tasks.workunit.client.0.smithi148.stdout:8/401: dwrite d3/da/d28/d4c/f34 [0,4194304] 0 2024-04-26T23:09:04.759 INFO:tasks.workunit.client.0.smithi148.stdout:0/377: write d0/d8/d1e/f23 [963408,32779] 0 2024-04-26T23:09:04.761 INFO:tasks.workunit.client.0.smithi148.stdout:3/362: dread d9/d15/d29/f3b [0,4194304] 0 2024-04-26T23:09:04.763 INFO:tasks.workunit.client.0.smithi148.stdout:6/346: getdents d6/d9/d1c/d1d/d1f/d40 0 2024-04-26T23:09:04.766 INFO:tasks.workunit.client.0.smithi148.stdout:0/378: fsync d0/d8/d55/f66 0 2024-04-26T23:09:04.767 INFO:tasks.workunit.client.0.smithi148.stdout:3/363: rmdir d9/d15 39 2024-04-26T23:09:04.767 INFO:tasks.workunit.client.0.smithi148.stdout:3/364: truncate d9/d4c/f5f 1198067 0 2024-04-26T23:09:04.768 INFO:tasks.workunit.client.0.smithi148.stdout:5/434: dread da/d1b/d1c/f30 [0,4194304] 0 2024-04-26T23:09:04.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/365: readlink d9/d15/l46 0 2024-04-26T23:09:04.768 INFO:tasks.workunit.client.0.smithi148.stdout:8/402: read d3/d9/d12/d23/d29/f4a [235806,54866] 0 2024-04-26T23:09:04.773 INFO:tasks.workunit.client.0.smithi148.stdout:6/347: mknod d6/d9/d1e/c6e 0 2024-04-26T23:09:04.774 INFO:tasks.workunit.client.0.smithi148.stdout:6/348: fdatasync d6/f19 0 2024-04-26T23:09:04.774 INFO:tasks.workunit.client.0.smithi148.stdout:3/366: mknod d9/d15/d29/d4d/d6f/c75 0 2024-04-26T23:09:04.774 INFO:tasks.workunit.client.0.smithi148.stdout:3/367: symlink d9/d52/l76 0 2024-04-26T23:09:04.781 INFO:tasks.workunit.client.0.smithi148.stdout:7/351: write d7/d11/d29/d2e/f32 [2184153,30068] 0 2024-04-26T23:09:04.782 INFO:tasks.workunit.client.0.smithi148.stdout:9/404: sync 2024-04-26T23:09:04.782 INFO:tasks.workunit.client.0.smithi148.stdout:4/303: sync 2024-04-26T23:09:04.782 INFO:tasks.workunit.client.0.smithi148.stdout:2/453: sync 2024-04-26T23:09:04.783 INFO:tasks.workunit.client.0.smithi148.stdout:1/330: sync 2024-04-26T23:09:04.783 INFO:tasks.workunit.client.0.smithi148.stdout:1/331: stat d16/d17/d4b/d53/l64 0 2024-04-26T23:09:04.785 INFO:tasks.workunit.client.0.smithi148.stdout:7/352: rename d7/d11/d13 to d7/d75 0 2024-04-26T23:09:04.785 INFO:tasks.workunit.client.0.smithi148.stdout:4/304: mknod d12/c58 0 2024-04-26T23:09:04.785 INFO:tasks.workunit.client.0.smithi148.stdout:9/405: unlink d19/f4a 0 2024-04-26T23:09:04.786 INFO:tasks.workunit.client.0.smithi148.stdout:9/406: chown d19/f7d 0 1 2024-04-26T23:09:04.786 INFO:tasks.workunit.client.0.smithi148.stdout:9/407: truncate d19/d1d/d25/d31/d32/f74 570720 0 2024-04-26T23:09:04.786 INFO:tasks.workunit.client.0.smithi148.stdout:9/408: chown d19/d1d/d25/d31/d48 2076536 1 2024-04-26T23:09:04.789 INFO:tasks.workunit.client.0.smithi148.stdout:1/332: mknod d16/d47/c66 0 2024-04-26T23:09:04.790 INFO:tasks.workunit.client.0.smithi148.stdout:7/353: dread d7/d11/d17/f65 [0,4194304] 0 2024-04-26T23:09:04.791 INFO:tasks.workunit.client.0.smithi148.stdout:7/354: link d7/d11/d29/d2e/d41/c4c d7/d11/d17/c76 0 2024-04-26T23:09:04.792 INFO:tasks.workunit.client.0.smithi148.stdout:7/355: creat d7/d75/f77 x:0 0 0 2024-04-26T23:09:04.804 INFO:tasks.workunit.client.0.smithi148.stdout:5/435: dwrite da/d1b/d3b/d73/f83 [0,4194304] 0 2024-04-26T23:09:04.806 INFO:tasks.workunit.client.0.smithi148.stdout:5/436: symlink da/d1b/d5b/la3 0 2024-04-26T23:09:04.807 INFO:tasks.workunit.client.0.smithi148.stdout:5/437: write da/d1f/f26 [1507053,73087] 0 2024-04-26T23:09:04.808 INFO:tasks.workunit.client.0.smithi148.stdout:5/438: rename da/d1b/d1c/l92 to da/d68/d69/la4 0 2024-04-26T23:09:04.809 INFO:tasks.workunit.client.0.smithi148.stdout:5/439: creat da/d1b/d5b/d5e/fa5 x:0 0 0 2024-04-26T23:09:04.833 INFO:tasks.workunit.client.0.smithi148.stdout:8/403: dwrite d3/d9/d12/d23/d29/f4a [0,4194304] 0 2024-04-26T23:09:04.836 INFO:tasks.workunit.client.0.smithi148.stdout:8/404: mknod d3/d9/d12/d23/d54/c75 0 2024-04-26T23:09:04.838 INFO:tasks.workunit.client.0.smithi148.stdout:8/405: rmdir d3/d9/d12/d23/d35/d69 39 2024-04-26T23:09:04.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/406: rename d3/d9/f24 to d3/f76 0 2024-04-26T23:09:04.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/407: fdatasync d3/d9/f49 0 2024-04-26T23:09:04.846 INFO:tasks.workunit.client.0.smithi148.stdout:8/408: mkdir d3/d9/d12/d23/d29/d77 0 2024-04-26T23:09:04.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/333: write d16/d17/f4c [3561772,103829] 0 2024-04-26T23:09:04.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/454: dwrite d5/d8/d9/f63 [4194304,4194304] 0 2024-04-26T23:09:04.861 INFO:tasks.workunit.client.0.smithi148.stdout:1/334: mkdir d16/d17/d4b/d53/d67 0 2024-04-26T23:09:04.861 INFO:tasks.workunit.client.0.smithi148.stdout:1/335: chown d16/l23 202760418 1 2024-04-26T23:09:04.862 INFO:tasks.workunit.client.0.smithi148.stdout:1/336: mkdir d16/d17/d68 0 2024-04-26T23:09:04.863 INFO:tasks.workunit.client.0.smithi148.stdout:1/337: creat d16/d17/d4b/d55/f69 x:0 0 0 2024-04-26T23:09:04.865 INFO:tasks.workunit.client.0.smithi148.stdout:2/455: dread d5/d8/d11/f5e [0,4194304] 0 2024-04-26T23:09:04.866 INFO:tasks.workunit.client.0.smithi148.stdout:2/456: rename d5/d17/c85 to d5/d8/d70/d78/c94 0 2024-04-26T23:09:04.921 INFO:tasks.workunit.client.0.smithi148.stdout:8/409: dwrite d3/d9/d12/d23/d35/f47 [0,4194304] 0 2024-04-26T23:09:04.928 INFO:tasks.workunit.client.0.smithi148.stdout:6/349: dwrite d6/f33 [4194304,4194304] 0 2024-04-26T23:09:04.928 INFO:tasks.workunit.client.0.smithi148.stdout:6/350: truncate d6/d9/d1c/d1d/d1f/f59 4570492 0 2024-04-26T23:09:04.931 INFO:tasks.workunit.client.0.smithi148.stdout:8/410: creat d3/d9/d12/f78 x:0 0 0 2024-04-26T23:09:04.938 INFO:tasks.workunit.client.0.smithi148.stdout:2/457: dwrite d5/d8/d15/d43/f5f [0,4194304] 0 2024-04-26T23:09:04.939 INFO:tasks.workunit.client.0.smithi148.stdout:6/351: creat d6/f6f x:0 0 0 2024-04-26T23:09:04.941 INFO:tasks.workunit.client.0.smithi148.stdout:1/338: dwrite d16/d17/f24 [0,4194304] 0 2024-04-26T23:09:04.945 INFO:tasks.workunit.client.0.smithi148.stdout:2/458: link d5/d8/d9/l25 d5/d8/d70/d32/d4c/l95 0 2024-04-26T23:09:04.953 INFO:tasks.workunit.client.0.smithi148.stdout:6/352: read d6/d9/d1c/d1d/d1f/f4c [3605079,98959] 0 2024-04-26T23:09:04.954 INFO:tasks.workunit.client.0.smithi148.stdout:6/353: chown d6/dc/f45 26765148 1 2024-04-26T23:09:04.954 INFO:tasks.workunit.client.0.smithi148.stdout:6/354: chown d6/d32/d66/l6b 1 1 2024-04-26T23:09:04.957 INFO:tasks.workunit.client.0.smithi148.stdout:1/339: unlink d16/d17/l1e 0 2024-04-26T23:09:04.961 INFO:tasks.workunit.client.0.smithi148.stdout:2/459: rename d5/d17/f39 to d5/d8/d15/f96 0 2024-04-26T23:09:04.963 INFO:tasks.workunit.client.0.smithi148.stdout:6/355: truncate d6/dc/f3f 1711325 0 2024-04-26T23:09:04.966 INFO:tasks.workunit.client.0.smithi148.stdout:1/340: link d16/d17/d4b/d59/l5f d16/d17/d4b/d55/l6a 0 2024-04-26T23:09:04.968 INFO:tasks.workunit.client.0.smithi148.stdout:1/341: write d16/d17/f3b [938938,108794] 0 2024-04-26T23:09:04.971 INFO:tasks.workunit.client.0.smithi148.stdout:2/460: rename d5/d8/d15/d43/d75 to d5/d97 0 2024-04-26T23:09:04.973 INFO:tasks.workunit.client.0.smithi148.stdout:6/356: link d6/d9/d1e/f5f d6/d9/d23/d4a/f70 0 2024-04-26T23:09:04.974 INFO:tasks.workunit.client.0.smithi148.stdout:1/342: mkdir d16/d17/d68/d6b 0 2024-04-26T23:09:04.974 INFO:tasks.workunit.client.0.smithi148.stdout:3/368: read d9/f36 [3408137,82922] 0 2024-04-26T23:09:04.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/461: creat d5/d1c/d38/f98 x:0 0 0 2024-04-26T23:09:04.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/462: write d5/d8/d4b/f7a [889459,110223] 0 2024-04-26T23:09:04.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/463: chown d5/d17/d64/f72 1 1 2024-04-26T23:09:04.979 INFO:tasks.workunit.client.0.smithi148.stdout:6/357: symlink d6/d9/d1c/d1d/d1f/l71 0 2024-04-26T23:09:04.982 INFO:tasks.workunit.client.0.smithi148.stdout:4/305: dread d12/d2c/f3f [0,4194304] 0 2024-04-26T23:09:04.982 INFO:tasks.workunit.client.0.smithi148.stdout:4/306: dread - d12/d17/d2a/d33/f4e zero size 2024-04-26T23:09:04.982 INFO:tasks.workunit.client.0.smithi148.stdout:4/307: write d12/d1a/f23 [1018038,126677] 0 2024-04-26T23:09:04.983 INFO:tasks.workunit.client.0.smithi148.stdout:5/440: dread da/f3f [0,4194304] 0 2024-04-26T23:09:04.986 INFO:tasks.workunit.client.0.smithi148.stdout:2/464: mknod d5/d8/d11/c99 0 2024-04-26T23:09:04.991 INFO:tasks.workunit.client.0.smithi148.stdout:3/369: dread d9/d15/f1b [0,4194304] 0 2024-04-26T23:09:04.992 INFO:tasks.workunit.client.0.smithi148.stdout:8/411: dread d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:04.992 INFO:tasks.workunit.client.0.smithi148.stdout:0/379: dwrite d0/d2e/f35 [0,4194304] 0 2024-04-26T23:09:04.992 INFO:tasks.workunit.client.0.smithi148.stdout:4/308: symlink d12/d2c/l59 0 2024-04-26T23:09:04.993 INFO:tasks.workunit.client.0.smithi148.stdout:3/370: creat d9/d65/f77 x:0 0 0 2024-04-26T23:09:05.001 INFO:tasks.workunit.client.0.smithi148.stdout:8/412: getdents d3/d9/d12/d23/d65 0 2024-04-26T23:09:05.002 INFO:tasks.workunit.client.0.smithi148.stdout:8/413: chown d3/d9/d12/d23/d35/f5b 462174 1 2024-04-26T23:09:05.002 INFO:tasks.workunit.client.0.smithi148.stdout:3/371: mkdir d9/d15/d29/d4d/d78 0 2024-04-26T23:09:05.003 INFO:tasks.workunit.client.0.smithi148.stdout:5/441: write da/d1b/d2d/f60 [451708,9730] 0 2024-04-26T23:09:05.003 INFO:tasks.workunit.client.0.smithi148.stdout:2/465: dread d5/f2d [0,4194304] 0 2024-04-26T23:09:05.004 INFO:tasks.workunit.client.0.smithi148.stdout:0/380: creat d0/d5/d19/f80 x:0 0 0 2024-04-26T23:09:05.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/414: mkdir d3/d9/d40/d79 0 2024-04-26T23:09:05.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/415: chown d3/da/d1c/f45 439 1 2024-04-26T23:09:05.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/416: chown d3/l36 183543058 1 2024-04-26T23:09:05.006 INFO:tasks.workunit.client.0.smithi148.stdout:5/442: symlink da/d1b/d2d/la6 0 2024-04-26T23:09:05.008 INFO:tasks.workunit.client.0.smithi148.stdout:0/381: fsync d0/f62 0 2024-04-26T23:09:05.009 INFO:tasks.workunit.client.0.smithi148.stdout:0/382: dread - d0/d5/d19/f80 zero size 2024-04-26T23:09:05.009 INFO:tasks.workunit.client.0.smithi148.stdout:8/417: mkdir d3/da/d1c/d7a 0 2024-04-26T23:09:05.012 INFO:tasks.workunit.client.0.smithi148.stdout:1/343: getdents d16/d17/d68 0 2024-04-26T23:09:05.067 INFO:tasks.workunit.client.0.smithi148.stdout:3/372: dwrite d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:05.068 INFO:tasks.workunit.client.0.smithi148.stdout:3/373: chown d9/c13 0 1 2024-04-26T23:09:05.069 INFO:tasks.workunit.client.0.smithi148.stdout:5/443: truncate da/f3f 468406 0 2024-04-26T23:09:05.095 INFO:tasks.workunit.client.0.smithi148.stdout:2/466: dwrite d5/d8/d4b/d4e/d6d/f8e [4194304,4194304] 0 2024-04-26T23:09:05.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/418: dwrite d3/da/d28/d4c/f17 [0,4194304] 0 2024-04-26T23:09:05.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/419: write d3/da/d28/f50 [1938189,74251] 0 2024-04-26T23:09:05.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/344: dwrite d16/d45/d2b/f31 [0,4194304] 0 2024-04-26T23:09:05.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/345: fdatasync d16/d17/d4b/d53/f5e 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:5/444: link da/d1b/d2d/f60 da/d68/d69/fa7 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:3/374: mknod d9/d15/c79 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:0/383: symlink d0/d20/d3b/l81 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:3/375: fsync d9/d15/d29/f47 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:3/376: fsync d9/ff 0 2024-04-26T23:09:05.327 INFO:tasks.workunit.client.0.smithi148.stdout:3/377: dread - d9/d15/d29/d4d/d6f/f74 zero size 2024-04-26T23:09:05.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/467: rmdir d5/d17/d59 39 2024-04-26T23:09:05.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/468: write d5/d7/fb [293952,27141] 0 2024-04-26T23:09:05.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/469: fdatasync d5/d17/d59/f6e 0 2024-04-26T23:09:05.335 INFO:tasks.workunit.client.0.smithi148.stdout:8/420: truncate d3/d9/f62 3621219 0 2024-04-26T23:09:05.339 INFO:tasks.workunit.client.0.smithi148.stdout:1/346: symlink d16/d17/d4b/d4d/l6c 0 2024-04-26T23:09:05.339 INFO:tasks.workunit.client.0.smithi148.stdout:0/384: dread d0/d8/d55/f66 [0,4194304] 0 2024-04-26T23:09:05.342 INFO:tasks.workunit.client.0.smithi148.stdout:0/385: read d0/d8/d1e/f23 [1189100,44170] 0 2024-04-26T23:09:05.352 INFO:tasks.workunit.client.0.smithi148.stdout:3/378: mkdir d9/d15/d7a 0 2024-04-26T23:09:05.353 INFO:tasks.workunit.client.0.smithi148.stdout:8/421: rmdir d3/da/d28/d4c 39 2024-04-26T23:09:05.357 INFO:tasks.workunit.client.0.smithi148.stdout:1/347: mknod d16/d17/d4b/d59/c6d 0 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:4/309: sync 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:7/356: sync 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:9/409: sync 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:6/358: sync 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:6/359: chown d6/d9/d23/l58 1 1 2024-04-26T23:09:05.363 INFO:tasks.workunit.client.0.smithi148.stdout:3/379: creat d9/d15/d29/d4d/d5b/f7b x:0 0 0 2024-04-26T23:09:05.365 INFO:tasks.workunit.client.0.smithi148.stdout:3/380: creat d9/d15/d29/f7c x:0 0 0 2024-04-26T23:09:05.379 INFO:tasks.workunit.client.0.smithi148.stdout:1/348: dread d16/d1c/f22 [0,4194304] 0 2024-04-26T23:09:05.379 INFO:tasks.workunit.client.0.smithi148.stdout:2/470: dwrite d5/d8/d4b/d4e/d6d/f8e [0,4194304] 0 2024-04-26T23:09:05.379 INFO:tasks.workunit.client.0.smithi148.stdout:1/349: chown d16/c19 360 1 2024-04-26T23:09:05.381 INFO:tasks.workunit.client.0.smithi148.stdout:4/310: read d12/d1c/f28 [1965151,125071] 0 2024-04-26T23:09:05.385 INFO:tasks.workunit.client.0.smithi148.stdout:1/350: truncate fd 2636985 0 2024-04-26T23:09:05.391 INFO:tasks.workunit.client.0.smithi148.stdout:2/471: dread d5/d8/d9/f23 [0,4194304] 0 2024-04-26T23:09:05.391 INFO:tasks.workunit.client.0.smithi148.stdout:2/472: fdatasync d5/d8/d15/d43/d5d/f7c 0 2024-04-26T23:09:05.410 INFO:tasks.workunit.client.0.smithi148.stdout:9/410: dread d19/d1d/f51 [0,4194304] 0 2024-04-26T23:09:05.412 INFO:tasks.workunit.client.0.smithi148.stdout:5/445: dwrite da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:05.412 INFO:tasks.workunit.client.0.smithi148.stdout:5/446: chown da/d12/d78/c85 9048 1 2024-04-26T23:09:05.415 INFO:tasks.workunit.client.0.smithi148.stdout:9/411: creat d19/d1d/d25/d2f/d4d/d33/d80/f8a x:0 0 0 2024-04-26T23:09:05.415 INFO:tasks.workunit.client.0.smithi148.stdout:9/412: write d19/d1d/d25/d2f/f3d [839345,61742] 0 2024-04-26T23:09:05.419 INFO:tasks.workunit.client.0.smithi148.stdout:7/357: dread d7/f9 [0,4194304] 0 2024-04-26T23:09:05.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/473: dread d5/d10/f58 [0,4194304] 0 2024-04-26T23:09:05.420 INFO:tasks.workunit.client.0.smithi148.stdout:7/358: dread - d7/d11/f71 zero size 2024-04-26T23:09:05.426 INFO:tasks.workunit.client.0.smithi148.stdout:1/351: write d16/d45/f35 [3670816,48864] 0 2024-04-26T23:09:05.426 INFO:tasks.workunit.client.0.smithi148.stdout:0/386: dwrite d0/d8/d52/f1f [4194304,4194304] 0 2024-04-26T23:09:05.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/447: mkdir da/d1b/d2d/da8 0 2024-04-26T23:09:05.427 INFO:tasks.workunit.client.0.smithi148.stdout:9/413: rename f18 to d19/d1d/f8b 0 2024-04-26T23:09:05.428 INFO:tasks.workunit.client.0.smithi148.stdout:7/359: symlink d7/d11/d29/l78 0 2024-04-26T23:09:05.437 INFO:tasks.workunit.client.0.smithi148.stdout:4/311: dwrite d12/d2c/f46 [0,4194304] 0 2024-04-26T23:09:05.438 INFO:tasks.workunit.client.0.smithi148.stdout:4/312: chown d12/d1c/f3a 2 1 2024-04-26T23:09:05.438 INFO:tasks.workunit.client.0.smithi148.stdout:6/360: dwrite d6/d9/d23/f57 [0,4194304] 0 2024-04-26T23:09:05.438 INFO:tasks.workunit.client.0.smithi148.stdout:5/448: dread da/d1b/d2d/f60 [0,4194304] 0 2024-04-26T23:09:05.438 INFO:tasks.workunit.client.0.smithi148.stdout:0/387: truncate d0/d8/d1e/f2a 525489 0 2024-04-26T23:09:05.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/352: mkdir d16/d45/d2b/d6e 0 2024-04-26T23:09:05.440 INFO:tasks.workunit.client.0.smithi148.stdout:9/414: mkdir d19/d1d/d25/d31/d48/d8c 0 2024-04-26T23:09:05.442 INFO:tasks.workunit.client.0.smithi148.stdout:7/360: dread d7/f12 [0,4194304] 0 2024-04-26T23:09:05.443 INFO:tasks.workunit.client.0.smithi148.stdout:5/449: rmdir da 39 2024-04-26T23:09:05.445 INFO:tasks.workunit.client.0.smithi148.stdout:6/361: rename d6/d9/d1c/d1d/f65 to d6/d32/d4e/f72 0 2024-04-26T23:09:05.447 INFO:tasks.workunit.client.0.smithi148.stdout:1/353: symlink d16/d45/d2b/d6e/l6f 0 2024-04-26T23:09:05.447 INFO:tasks.workunit.client.0.smithi148.stdout:0/388: creat d0/d8/d55/f82 x:0 0 0 2024-04-26T23:09:05.448 INFO:tasks.workunit.client.0.smithi148.stdout:0/389: dread - d0/d8/d33/f45 zero size 2024-04-26T23:09:05.449 INFO:tasks.workunit.client.0.smithi148.stdout:6/362: unlink d6/d9/d1c/d1d/d1f/f36 0 2024-04-26T23:09:05.450 INFO:tasks.workunit.client.0.smithi148.stdout:0/390: mknod d0/d5/d19/d3a/c83 0 2024-04-26T23:09:05.452 INFO:tasks.workunit.client.0.smithi148.stdout:6/363: creat d6/d32/d4e/f73 x:0 0 0 2024-04-26T23:09:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:9/415: write d19/d1d/d25/f41 [2379975,121816] 0 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/416: rmdir d19/d39/d5f 39 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:4/313: write d12/d17/d2a/d33/f44 [1059568,54827] 0 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/417: creat d19/d1d/d25/d2f/d4d/d33/d50/d57/f8d x:0 0 0 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/418: readlink d19/l7f 0 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:2/474: dwrite d5/d1c/d38/f47 [0,4194304] 0 2024-04-26T23:09:05.488 INFO:tasks.workunit.client.0.smithi148.stdout:2/475: chown l3 7442 1 2024-04-26T23:09:05.490 INFO:tasks.workunit.client.0.smithi148.stdout:4/314: creat d12/d17/f5a x:0 0 0 2024-04-26T23:09:05.490 INFO:tasks.workunit.client.0.smithi148.stdout:4/315: dread - d12/f35 zero size 2024-04-26T23:09:05.491 INFO:tasks.workunit.client.0.smithi148.stdout:9/419: truncate d19/d1d/d25/d31/d32/f74 226405 0 2024-04-26T23:09:05.497 INFO:tasks.workunit.client.0.smithi148.stdout:9/420: mknod d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/c8e 0 2024-04-26T23:09:05.500 INFO:tasks.workunit.client.0.smithi148.stdout:9/421: mknod d19/d1d/d25/d31/d73/c8f 0 2024-04-26T23:09:05.503 INFO:tasks.workunit.client.0.smithi148.stdout:2/476: dread d5/d8/d15/f45 [0,4194304] 0 2024-04-26T23:09:05.503 INFO:tasks.workunit.client.0.smithi148.stdout:2/477: readlink d5/d8/d70/d32/l71 0 2024-04-26T23:09:05.513 INFO:tasks.workunit.client.0.smithi148.stdout:1/354: dwrite d16/d45/d2b/f46 [0,4194304] 0 2024-04-26T23:09:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:1/355: read f5 [4050815,50942] 0 2024-04-26T23:09:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:1/356: creat d16/d17/d4b/d4d/f70 x:0 0 0 2024-04-26T23:09:05.520 INFO:tasks.workunit.client.0.smithi148.stdout:1/357: symlink d16/d17/d68/d6b/l71 0 2024-04-26T23:09:05.521 INFO:tasks.workunit.client.0.smithi148.stdout:1/358: write d16/f37 [786572,59748] 0 2024-04-26T23:09:05.524 INFO:tasks.workunit.client.0.smithi148.stdout:7/361: dwrite d7/f9 [4194304,4194304] 0 2024-04-26T23:09:05.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/450: dwrite da/d1b/f93 [0,4194304] 0 2024-04-26T23:09:05.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/451: chown da/fc 0 1 2024-04-26T23:09:05.539 INFO:tasks.workunit.client.0.smithi148.stdout:0/391: dwrite d0/d8/d33/d6a/f6e [0,4194304] 0 2024-04-26T23:09:05.541 INFO:tasks.workunit.client.0.smithi148.stdout:5/452: creat da/d1b/d1c/d7f/fa9 x:0 0 0 2024-04-26T23:09:05.555 INFO:tasks.workunit.client.0.smithi148.stdout:5/453: dread da/d12/f13 [0,4194304] 0 2024-04-26T23:09:05.558 INFO:tasks.workunit.client.0.smithi148.stdout:0/392: write d0/d5/f3f [2474248,60721] 0 2024-04-26T23:09:05.579 INFO:tasks.workunit.client.0.smithi148.stdout:6/364: dwrite d6/f5c [0,4194304] 0 2024-04-26T23:09:05.588 INFO:tasks.workunit.client.0.smithi148.stdout:6/365: write d6/dc/f45 [299350,101500] 0 2024-04-26T23:09:05.596 INFO:tasks.workunit.client.0.smithi148.stdout:6/366: mknod d6/d32/d66/c74 0 2024-04-26T23:09:05.596 INFO:tasks.workunit.client.0.smithi148.stdout:6/367: fsync d6/f5c 0 2024-04-26T23:09:05.597 INFO:tasks.workunit.client.0.smithi148.stdout:0/393: dwrite d0/d8/d33/d6a/f6e [0,4194304] 0 2024-04-26T23:09:05.597 INFO:tasks.workunit.client.0.smithi148.stdout:0/394: chown d0/d2e/f35 451037390 1 2024-04-26T23:09:05.599 INFO:tasks.workunit.client.0.smithi148.stdout:6/368: creat d6/dc/f75 x:0 0 0 2024-04-26T23:09:05.599 INFO:tasks.workunit.client.0.smithi148.stdout:6/369: dread - d6/d9/f64 zero size 2024-04-26T23:09:05.602 INFO:tasks.workunit.client.0.smithi148.stdout:0/395: chown d0/l53 110183 1 2024-04-26T23:09:05.602 INFO:tasks.workunit.client.0.smithi148.stdout:4/316: dread d12/d2c/f3c [0,4194304] 0 2024-04-26T23:09:05.605 INFO:tasks.workunit.client.0.smithi148.stdout:1/359: dwrite d16/f3a [0,4194304] 0 2024-04-26T23:09:05.607 INFO:tasks.workunit.client.0.smithi148.stdout:4/317: mknod d12/d17/d2a/c5b 0 2024-04-26T23:09:05.617 INFO:tasks.workunit.client.0.smithi148.stdout:0/396: rename d0/d20/d54/d5d/d6c/d73 to d0/d5/d84 0 2024-04-26T23:09:05.618 INFO:tasks.workunit.client.0.smithi148.stdout:0/397: symlink d0/d20/d54/d5d/l85 0 2024-04-26T23:09:05.619 INFO:tasks.workunit.client.0.smithi148.stdout:9/422: dwrite d19/d1d/d25/d2f/d4d/d33/d50/d57/f8d [0,4194304] 0 2024-04-26T23:09:05.625 INFO:tasks.workunit.client.0.smithi148.stdout:9/423: creat d19/d39/f90 x:0 0 0 2024-04-26T23:09:05.625 INFO:tasks.workunit.client.0.smithi148.stdout:9/424: chown d19/d1d/d25/d2f/c79 6938 1 2024-04-26T23:09:05.625 INFO:tasks.workunit.client.0.smithi148.stdout:8/422: sync 2024-04-26T23:09:05.626 INFO:tasks.workunit.client.0.smithi148.stdout:3/381: sync 2024-04-26T23:09:05.628 INFO:tasks.workunit.client.0.smithi148.stdout:9/425: rename d19/d1d/d25/d2f/d4d/d33/d50/d57/f75 to d19/d1d/d25/d31/d32/f91 0 2024-04-26T23:09:05.631 INFO:tasks.workunit.client.0.smithi148.stdout:8/423: link d3/f44 d3/d9/d12/d23/f7b 0 2024-04-26T23:09:05.631 INFO:tasks.workunit.client.0.smithi148.stdout:9/426: mknod d19/d1d/d25/d2f/d4d/d33/d50/d57/c92 0 2024-04-26T23:09:05.632 INFO:tasks.workunit.client.0.smithi148.stdout:3/382: dread d9/d15/f28 [0,4194304] 0 2024-04-26T23:09:05.636 INFO:tasks.workunit.client.0.smithi148.stdout:8/424: mkdir d3/da/d1c/d7c 0 2024-04-26T23:09:05.663 INFO:tasks.workunit.client.0.smithi148.stdout:1/360: dwrite f10 [4194304,4194304] 0 2024-04-26T23:09:05.666 INFO:tasks.workunit.client.0.smithi148.stdout:1/361: creat d16/d17/d4b/f72 x:0 0 0 2024-04-26T23:09:05.668 INFO:tasks.workunit.client.0.smithi148.stdout:5/454: dwrite da/d12/f8f [0,4194304] 0 2024-04-26T23:09:05.671 INFO:tasks.workunit.client.0.smithi148.stdout:1/362: mkdir d16/d47/d73 0 2024-04-26T23:09:05.677 INFO:tasks.workunit.client.0.smithi148.stdout:1/363: dread d16/d1c/f33 [0,4194304] 0 2024-04-26T23:09:05.677 INFO:tasks.workunit.client.0.smithi148.stdout:5/455: mkdir da/d68/d69/daa 0 2024-04-26T23:09:05.679 INFO:tasks.workunit.client.0.smithi148.stdout:8/425: dwrite d3/d9/d12/f46 [0,4194304] 0 2024-04-26T23:09:05.680 INFO:tasks.workunit.client.0.smithi148.stdout:8/426: write d3/d9/f62 [4384219,99689] 0 2024-04-26T23:09:05.680 INFO:tasks.workunit.client.0.smithi148.stdout:1/364: rename d16/d17/d4b/d59/c5d to d16/d17/d4b/d53/d67/c74 0 2024-04-26T23:09:05.680 INFO:tasks.workunit.client.0.smithi148.stdout:4/318: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-04-26T23:09:05.683 INFO:tasks.workunit.client.0.smithi148.stdout:9/427: dwrite d19/d1d/d25/d31/f56 [0,4194304] 0 2024-04-26T23:09:05.684 INFO:tasks.workunit.client.0.smithi148.stdout:5/456: truncate da/fb 3986554 0 2024-04-26T23:09:05.688 INFO:tasks.workunit.client.0.smithi148.stdout:8/427: mknod d3/da/d28/d4c/c7d 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:1/365: read d16/d1c/f26 [107574,126183] 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:9/428: symlink d19/d1d/l93 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:5/457: symlink da/d1b/d2d/d82/lab 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:5/458: fdatasync da/d1b/d2d/f7b 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:8/428: rename d3/l36 to d3/d9/l7e 0 2024-04-26T23:09:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:5/459: chown da/d1b/d3b/l84 42 1 2024-04-26T23:09:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/319: creat d12/d17/d2a/d37/f5c x:0 0 0 2024-04-26T23:09:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:9/429: write d19/d1d/d25/d31/d73/f7a [1025797,65957] 0 2024-04-26T23:09:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/429: dread - d3/d9/d12/d23/d35/d69/f6e zero size 2024-04-26T23:09:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:1/366: creat d16/d45/d2b/d6e/f75 x:0 0 0 2024-04-26T23:09:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:5/460: creat da/d1b/d3b/d73/d97/fac x:0 0 0 2024-04-26T23:09:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:4/320: getdents d12/d1a 0 2024-04-26T23:09:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:1/367: mknod d16/d17/d68/c76 0 2024-04-26T23:09:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:1/368: write d16/d17/f4c [4253079,12734] 0 2024-04-26T23:09:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:4/321: write d12/d17/d2a/d33/f52 [147677,97899] 0 2024-04-26T23:09:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:5/461: creat da/d1b/d3b/d73/d97/fad x:0 0 0 2024-04-26T23:09:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:5/462: truncate da/d1b/d3b/d72/f9b 1036851 0 2024-04-26T23:09:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:1/369: mkdir d16/d17/d77 0 2024-04-26T23:09:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:4/322: link d12/d17/d2a/d33/f57 d12/d17/f5d 0 2024-04-26T23:09:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:4/323: chown d12/d17/d2a/d33/f44 19 1 2024-04-26T23:09:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:5/463: readlink da/d1a/l55 0 2024-04-26T23:09:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:1/370: rename d16/d1c/l2e to d16/d17/d4b/d59/l78 0 2024-04-26T23:09:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:4/324: rmdir d12/d2c 39 2024-04-26T23:09:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:5/464: rename da/d68/d69/c9d to da/d1b/d5b/d5e/cae 0 2024-04-26T23:09:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:5/465: creat da/d12/d78/faf x:0 0 0 2024-04-26T23:09:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:5/466: getdents da 0 2024-04-26T23:09:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:5/467: write da/d12/d78/faf [719801,118550] 0 2024-04-26T23:09:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:5/468: mkdir da/d1b/d3b/d73/d97/db0 0 2024-04-26T23:09:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:5/469: fdatasync da/d1f/d47/f75 0 2024-04-26T23:09:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:5/470: creat da/d1b/d3b/d73/d97/fb1 x:0 0 0 2024-04-26T23:09:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:5/471: write da/d12/f17 [2836726,53749] 0 2024-04-26T23:09:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:5/472: mkdir da/d1b/d3b/db2 0 2024-04-26T23:09:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:5/473: chown da/fb 5 1 2024-04-26T23:09:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:5/474: readlink da/d1b/d3b/l84 0 2024-04-26T23:09:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:5/475: mknod da/d68/d7a/cb3 0 2024-04-26T23:09:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:5/476: truncate da/f19 2502960 0 2024-04-26T23:09:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:4/325: dread d12/d17/d2a/d33/f52 [0,4194304] 0 2024-04-26T23:09:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:4/326: mknod d12/d1a/c5e 0 2024-04-26T23:09:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:4/327: unlink d12/d17/d2a/d33/f52 0 2024-04-26T23:09:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:4/328: rename d12/d1c/f4d to d12/d1c/f5f 0 2024-04-26T23:09:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:4/329: dread - d12/d17/f5d zero size 2024-04-26T23:09:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:4/330: creat d12/d1a/f60 x:0 0 0 2024-04-26T23:09:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:4/331: dread - d12/d17/d2a/d33/f57 zero size 2024-04-26T23:09:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:4/332: creat d12/d17/d2a/d33/f61 x:0 0 0 2024-04-26T23:09:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:4/333: dread - d12/d17/d2a/d37/f5c zero size 2024-04-26T23:09:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:4/334: dread fd [0,4194304] 0 2024-04-26T23:09:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:4/335: dread - d12/d17/d2a/d33/f61 zero size 2024-04-26T23:09:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/336: creat d12/d17/d2a/d37/f62 x:0 0 0 2024-04-26T23:09:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/337: symlink d12/d1c/l63 0 2024-04-26T23:09:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/338: chown d12/d2c/l59 74326501 1 2024-04-26T23:09:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:4/339: link d12/d17/f5a d12/d17/d2a/d37/f64 0 2024-04-26T23:09:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:4/340: fsync d12/d17/f2e 0 2024-04-26T23:09:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:4/341: creat d12/d1c/d56/f65 x:0 0 0 2024-04-26T23:09:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:4/342: chown fd 27 1 2024-04-26T23:09:05.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/370: dwrite d6/f47 [0,4194304] 0 2024-04-26T23:09:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:0/398: dwrite d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:4/343: rename d12/d1c/f5f to d12/f66 0 2024-04-26T23:09:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:0/399: mkdir d0/d20/d3b/d86 0 2024-04-26T23:09:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/400: chown d0/d20/d54/d5d 154485 1 2024-04-26T23:09:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:6/371: rename d6/d14/l4b to d6/d9/d1e/d69/l76 0 2024-04-26T23:09:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:6/372: symlink d6/d9/d1c/d5b/l77 0 2024-04-26T23:09:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:6/373: write d6/d32/f62 [775564,41407] 0 2024-04-26T23:09:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:6/374: truncate d6/f33 7869780 0 2024-04-26T23:09:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:6/375: creat d6/d32/d4e/f78 x:0 0 0 2024-04-26T23:09:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:4/344: dwrite d12/d17/f2e [0,4194304] 0 2024-04-26T23:09:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:4/345: chown d12/d1c/f4b 86333 1 2024-04-26T23:09:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:9/430: dwrite d19/d1d/d25/d2f/d4d/d33/d50/d57/f8d [0,4194304] 0 2024-04-26T23:09:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:9/431: write d19/d1d/d25/f41 [1200966,43164] 0 2024-04-26T23:09:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:9/432: readlink d19/d1d/l6c 0 2024-04-26T23:09:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:6/376: dwrite d6/d9/d1c/d1d/d1f/f59 [0,4194304] 0 2024-04-26T23:09:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:0/401: dwrite d0/d8/d55/f82 [0,4194304] 0 2024-04-26T23:09:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:6/377: write d6/dc/f75 [427164,1347] 0 2024-04-26T23:09:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:0/402: symlink d0/d5/d84/l87 0 2024-04-26T23:09:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:0/403: fsync d0/d8/d55/f66 0 2024-04-26T23:09:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:6/378: creat d6/d9/d1e/f79 x:0 0 0 2024-04-26T23:09:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:0/404: rename d0/d8/d33/d6a/l75 to d0/d8/d5f/l88 0 2024-04-26T23:09:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:8/430: dwrite d3/f42 [0,4194304] 0 2024-04-26T23:09:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:2/478: sync 2024-04-26T23:09:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:8/431: fsync d3/da/d28/f38 0 2024-04-26T23:09:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:7/362: sync 2024-04-26T23:09:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:0/405: creat d0/d5/d84/f89 x:0 0 0 2024-04-26T23:09:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:0/406: write d0/f62 [108493,35943] 0 2024-04-26T23:09:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:0/407: chown d0/d8/l37 1974398734 1 2024-04-26T23:09:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:8/432: mknod d3/da/d1c/d7c/c7f 0 2024-04-26T23:09:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:7/363: creat d7/d11/d60/f79 x:0 0 0 2024-04-26T23:09:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:0/408: creat d0/d5/f8a x:0 0 0 2024-04-26T23:09:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:8/433: symlink d3/d9/d40/l80 0 2024-04-26T23:09:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:8/434: chown d3/d9/l39 100196200 1 2024-04-26T23:09:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/409: rename d0/d8/d55/f82 to d0/d8/d33/d43/d4e/f8b 0 2024-04-26T23:09:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:0/410: write d0/d5/d84/f89 [187405,16502] 0 2024-04-26T23:09:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:0/411: truncate d0/d8/d1e/f2a 580846 0 2024-04-26T23:09:05.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/435: rename d3/d9/d12/d23/d65/f71 to d3/d9/d12/d23/d29/d37/d5e/f81 0 2024-04-26T23:09:05.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/436: readlink d3/da/l3a 0 2024-04-26T23:09:05.885 INFO:tasks.workunit.client.0.smithi148.stdout:0/412: symlink d0/d8/d33/d43/d4e/l8c 0 2024-04-26T23:09:05.885 INFO:tasks.workunit.client.0.smithi148.stdout:0/413: fdatasync d0/d8/d1e/f23 0 2024-04-26T23:09:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:8/437: creat d3/d9/d12/d23/d35/f82 x:0 0 0 2024-04-26T23:09:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/438: dread - d3/da/d28/d4c/f51 zero size 2024-04-26T23:09:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/439: fsync d3/d9/d12/d23/d35/f55 0 2024-04-26T23:09:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:0/414: rmdir d0/d8 39 2024-04-26T23:09:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:0/415: dread d0/d8/f4f [0,4194304] 0 2024-04-26T23:09:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/416: link d0/d20/d3b/f67 d0/d20/f8d 0 2024-04-26T23:09:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:0/417: symlink d0/d8/d33/l8e 0 2024-04-26T23:09:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:0/418: dread d0/d8/d1e/f23 [0,4194304] 0 2024-04-26T23:09:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:0/419: dread d0/d8/d5f/d72/f77 [0,4194304] 0 2024-04-26T23:09:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:0/420: rename d0/d20/d54/d5d to d0/d2e/d8f 0 2024-04-26T23:09:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:0/421: creat d0/f90 x:0 0 0 2024-04-26T23:09:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:0/422: write d0/d8/f42 [1707458,89977] 0 2024-04-26T23:09:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:0/423: fsync d0/d8/f4f 0 2024-04-26T23:09:05.949 INFO:tasks.workunit.client.0.smithi148.stdout:4/346: dwrite d12/d2c/f26 [0,4194304] 0 2024-04-26T23:09:05.949 INFO:tasks.workunit.client.0.smithi148.stdout:6/379: dwrite d6/dc/f3f [0,4194304] 0 2024-04-26T23:09:05.949 INFO:tasks.workunit.client.0.smithi148.stdout:9/433: dread d19/f2d [0,4194304] 0 2024-04-26T23:09:05.949 INFO:tasks.workunit.client.0.smithi148.stdout:7/364: dwrite d7/d11/f31 [0,4194304] 0 2024-04-26T23:09:05.949 INFO:tasks.workunit.client.0.smithi148.stdout:9/434: chown d19/d22/c58 1 1 2024-04-26T23:09:05.973 INFO:tasks.workunit.client.0.smithi148.stdout:6/380: dread d6/d32/f63 [0,4194304] 0 2024-04-26T23:09:05.987 INFO:tasks.workunit.client.0.smithi148.stdout:2/479: dwrite d5/d8/d15/f96 [0,4194304] 0 2024-04-26T23:09:05.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/480: readlink d5/d8/d9/l83 0 2024-04-26T23:09:05.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/481: truncate d5/d8/d9/f69 358892 0 2024-04-26T23:09:05.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/482: stat d5/d17/d64/d88 0 2024-04-26T23:09:05.991 INFO:tasks.workunit.client.0.smithi148.stdout:8/440: read d3/d9/d12/f46 [988791,43483] 0 2024-04-26T23:09:05.996 INFO:tasks.workunit.client.0.smithi148.stdout:8/441: unlink d3/da/l3a 0 2024-04-26T23:09:05.997 INFO:tasks.workunit.client.0.smithi148.stdout:8/442: creat d3/da/d1c/f83 x:0 0 0 2024-04-26T23:09:05.999 INFO:tasks.workunit.client.0.smithi148.stdout:8/443: mknod d3/d9/d12/d23/d29/d37/d5e/c84 0 2024-04-26T23:09:05.999 INFO:tasks.workunit.client.0.smithi148.stdout:8/444: dread - d3/d9/d12/d23/d35/f55 zero size 2024-04-26T23:09:05.999 INFO:tasks.workunit.client.0.smithi148.stdout:3/383: sync 2024-04-26T23:09:06.003 INFO:tasks.workunit.client.0.smithi148.stdout:8/445: unlink d3/da/d28/d4c/f34 0 2024-04-26T23:09:06.003 INFO:tasks.workunit.client.0.smithi148.stdout:4/347: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-04-26T23:09:06.004 INFO:tasks.workunit.client.0.smithi148.stdout:0/424: dwrite d0/d20/f8d [0,4194304] 0 2024-04-26T23:09:06.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/483: write d5/d8/d70/d32/f37 [439497,51150] 0 2024-04-26T23:09:06.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/484: chown d5/d8/d15/d43/d5d 3646688 1 2024-04-26T23:09:06.006 INFO:tasks.workunit.client.0.smithi148.stdout:9/435: dwrite ff [0,4194304] 0 2024-04-26T23:09:06.007 INFO:tasks.workunit.client.0.smithi148.stdout:4/348: truncate d12/f66 52195 0 2024-04-26T23:09:06.007 INFO:tasks.workunit.client.0.smithi148.stdout:7/365: dwrite d7/d11/d29/d2e/f32 [0,4194304] 0 2024-04-26T23:09:06.008 INFO:tasks.workunit.client.0.smithi148.stdout:0/425: symlink d0/d8/d33/d6a/l91 0 2024-04-26T23:09:06.009 INFO:tasks.workunit.client.0.smithi148.stdout:9/436: truncate d19/d1d/d25/f41 2408420 0 2024-04-26T23:09:06.009 INFO:tasks.workunit.client.0.smithi148.stdout:9/437: readlink d19/d1d/d25/d2f/d4d/l72 0 2024-04-26T23:09:06.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/349: creat d12/d1c/f67 x:0 0 0 2024-04-26T23:09:06.014 INFO:tasks.workunit.client.0.smithi148.stdout:7/366: symlink d7/d11/d29/l7a 0 2024-04-26T23:09:06.014 INFO:tasks.workunit.client.0.smithi148.stdout:7/367: stat d7/d19/f35 0 2024-04-26T23:09:06.016 INFO:tasks.workunit.client.0.smithi148.stdout:0/426: symlink d0/d5/d19/d3a/l92 0 2024-04-26T23:09:06.019 INFO:tasks.workunit.client.0.smithi148.stdout:4/350: creat d12/d17/f68 x:0 0 0 2024-04-26T23:09:06.019 INFO:tasks.workunit.client.0.smithi148.stdout:4/351: truncate d12/d17/f5d 952927 0 2024-04-26T23:09:06.020 INFO:tasks.workunit.client.0.smithi148.stdout:4/352: truncate d12/d17/d2a/d37/f64 98293 0 2024-04-26T23:09:06.022 INFO:tasks.workunit.client.0.smithi148.stdout:7/368: rename d7/d11/d17/c76 to d7/c7b 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:3/384: read d9/d15/f19 [170196,129804] 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:4/353: rename d12/d1c/f3a to d12/d1c/f69 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/427: rename d0/d20/d3b/f67 to d0/d8/d33/d68/f93 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:6/381: dwrite d6/d9/d23/d4a/f70 [0,4194304] 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:6/382: readlink d6/d9/d23/l58 0 2024-04-26T23:09:06.026 INFO:tasks.workunit.client.0.smithi148.stdout:1/371: sync 2024-04-26T23:09:06.027 INFO:tasks.workunit.client.0.smithi148.stdout:1/372: fsync d16/d45/f35 0 2024-04-26T23:09:06.028 INFO:tasks.workunit.client.0.smithi148.stdout:1/373: fdatasync d16/f1d 0 2024-04-26T23:09:06.028 INFO:tasks.workunit.client.0.smithi148.stdout:2/485: read d5/f2d [1226623,32792] 0 2024-04-26T23:09:06.029 INFO:tasks.workunit.client.0.smithi148.stdout:2/486: dread d5/d8/d4b/f77 [0,4194304] 0 2024-04-26T23:09:06.029 INFO:tasks.workunit.client.0.smithi148.stdout:2/487: read - d5/d1c/d38/f98 zero size 2024-04-26T23:09:06.030 INFO:tasks.workunit.client.0.smithi148.stdout:0/428: rename d0/d2e/l64 to d0/d8/d5f/l94 0 2024-04-26T23:09:06.039 INFO:tasks.workunit.client.0.smithi148.stdout:5/477: sync 2024-04-26T23:09:06.039 INFO:tasks.workunit.client.0.smithi148.stdout:1/374: mknod d16/d45/d2b/d3e/c79 0 2024-04-26T23:09:06.039 INFO:tasks.workunit.client.0.smithi148.stdout:2/488: creat d5/d7f/d86/f9a x:0 0 0 2024-04-26T23:09:06.039 INFO:tasks.workunit.client.0.smithi148.stdout:2/489: write d5/d10/f3b [49316,92572] 0 2024-04-26T23:09:06.042 INFO:tasks.workunit.client.0.smithi148.stdout:6/383: creat d6/d9/d1c/d1d/d1f/d40/f7a x:0 0 0 2024-04-26T23:09:06.042 INFO:tasks.workunit.client.0.smithi148.stdout:0/429: mkdir d0/d8/d95 0 2024-04-26T23:09:06.042 INFO:tasks.workunit.client.0.smithi148.stdout:3/385: rename d9/d15/d7a to d9/d15/d29/d4d/d7d 0 2024-04-26T23:09:06.044 INFO:tasks.workunit.client.0.smithi148.stdout:3/386: write d9/f2d [2307266,125020] 0 2024-04-26T23:09:06.044 INFO:tasks.workunit.client.0.smithi148.stdout:2/490: creat d5/d8/d70/d32/d4c/f9b x:0 0 0 2024-04-26T23:09:06.051 INFO:tasks.workunit.client.0.smithi148.stdout:9/438: dwrite d19/f2e [0,4194304] 0 2024-04-26T23:09:06.052 INFO:tasks.workunit.client.0.smithi148.stdout:9/439: write d19/d1d/d69/f83 [335771,112308] 0 2024-04-26T23:09:06.052 INFO:tasks.workunit.client.0.smithi148.stdout:9/440: write d19/d1d/f3a [3511308,90349] 0 2024-04-26T23:09:06.059 INFO:tasks.workunit.client.0.smithi148.stdout:4/354: read d12/d2c/f46 [1897937,25632] 0 2024-04-26T23:09:06.059 INFO:tasks.workunit.client.0.smithi148.stdout:2/491: mknod d5/d8/d70/d32/d4c/c9c 0 2024-04-26T23:09:06.059 INFO:tasks.workunit.client.0.smithi148.stdout:2/492: readlink d5/d1c/l4f 0 2024-04-26T23:09:06.062 INFO:tasks.workunit.client.0.smithi148.stdout:2/493: unlink d5/d8/d15/f81 0 2024-04-26T23:09:06.062 INFO:tasks.workunit.client.0.smithi148.stdout:2/494: readlink d5/la 0 2024-04-26T23:09:06.062 INFO:tasks.workunit.client.0.smithi148.stdout:2/495: fsync d5/d17/d64/f72 0 2024-04-26T23:09:06.063 INFO:tasks.workunit.client.0.smithi148.stdout:2/496: mknod d5/d8/d15/d43/d5d/c9d 0 2024-04-26T23:09:06.063 INFO:tasks.workunit.client.0.smithi148.stdout:2/497: dread - d5/d7f/d86/f9a zero size 2024-04-26T23:09:06.066 INFO:tasks.workunit.client.0.smithi148.stdout:2/498: truncate d5/d1c/d38/f47 253429 0 2024-04-26T23:09:06.066 INFO:tasks.workunit.client.0.smithi148.stdout:8/446: dwrite d3/da/d28/f50 [0,4194304] 0 2024-04-26T23:09:06.066 INFO:tasks.workunit.client.0.smithi148.stdout:8/447: chown d3/d9/d12/d23/d29 0 1 2024-04-26T23:09:06.077 INFO:tasks.workunit.client.0.smithi148.stdout:2/499: symlink d5/d8/d15/l9e 0 2024-04-26T23:09:06.077 INFO:tasks.workunit.client.0.smithi148.stdout:2/500: chown d5/d17/d59/l5a 15241 1 2024-04-26T23:09:06.078 INFO:tasks.workunit.client.0.smithi148.stdout:8/448: getdents d3/d9/d12/d23/d54/d60 0 2024-04-26T23:09:06.078 INFO:tasks.workunit.client.0.smithi148.stdout:8/449: chown d3/d9/d12/d23/d29/d37/l6a 132573805 1 2024-04-26T23:09:06.083 INFO:tasks.workunit.client.0.smithi148.stdout:2/501: write d5/d8/f1b [573277,125110] 0 2024-04-26T23:09:06.084 INFO:tasks.workunit.client.0.smithi148.stdout:0/430: write d0/d8/d33/d68/f93 [1077861,60200] 0 2024-04-26T23:09:06.085 INFO:tasks.workunit.client.0.smithi148.stdout:2/502: mknod d5/d17/d64/c9f 0 2024-04-26T23:09:06.085 INFO:tasks.workunit.client.0.smithi148.stdout:4/355: dread d12/f4a [0,4194304] 0 2024-04-26T23:09:06.087 INFO:tasks.workunit.client.0.smithi148.stdout:2/503: rename d5/d8/d70 to d5/d8/d4b/d4e/d6d/da0 0 2024-04-26T23:09:06.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/441: write d19/f1e [4920601,84141] 0 2024-04-26T23:09:06.091 INFO:tasks.workunit.client.0.smithi148.stdout:2/504: mknod d5/d7/d73/ca1 0 2024-04-26T23:09:06.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/356: rename d12/d17/l25 to d12/d17/d2a/d33/l6a 0 2024-04-26T23:09:06.091 INFO:tasks.workunit.client.0.smithi148.stdout:2/505: chown d5/f2d 118168731 1 2024-04-26T23:09:06.091 INFO:tasks.workunit.client.0.smithi148.stdout:2/506: chown d5/d8/d11 0 1 2024-04-26T23:09:06.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/357: mknod d12/d1c/c6b 0 2024-04-26T23:09:06.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/358: fsync d12/d17/d2a/f32 0 2024-04-26T23:09:06.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/359: dread - d12/d17/d2a/d33/f61 zero size 2024-04-26T23:09:06.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/360: rmdir d12/d1c 39 2024-04-26T23:09:06.093 INFO:tasks.workunit.client.0.smithi148.stdout:4/361: chown d12/l47 13684279 1 2024-04-26T23:09:06.095 INFO:tasks.workunit.client.0.smithi148.stdout:4/362: link d12/c58 d12/d17/d2a/c6c 0 2024-04-26T23:09:06.096 INFO:tasks.workunit.client.0.smithi148.stdout:4/363: creat d12/d1a/f6d x:0 0 0 2024-04-26T23:09:06.097 INFO:tasks.workunit.client.0.smithi148.stdout:4/364: rename d12/d17/d2a/d33/c3b to d12/d1c/d45/c6e 0 2024-04-26T23:09:06.117 INFO:tasks.workunit.client.0.smithi148.stdout:7/369: dwrite d7/fe [0,4194304] 0 2024-04-26T23:09:06.117 INFO:tasks.workunit.client.0.smithi148.stdout:7/370: stat d7/d19 0 2024-04-26T23:09:06.118 INFO:tasks.workunit.client.0.smithi148.stdout:7/371: mkdir d7/d11/d17/d7c 0 2024-04-26T23:09:06.119 INFO:tasks.workunit.client.0.smithi148.stdout:7/372: rmdir d7/d11/d17/d2f/d44 39 2024-04-26T23:09:06.120 INFO:tasks.workunit.client.0.smithi148.stdout:7/373: mkdir d7/d11/d29/d2e/d41/d67/d7d 0 2024-04-26T23:09:06.120 INFO:tasks.workunit.client.0.smithi148.stdout:7/374: readlink d7/d11/d17/d2f/d57/l6d 0 2024-04-26T23:09:06.122 INFO:tasks.workunit.client.0.smithi148.stdout:7/375: truncate d7/f12 1867291 0 2024-04-26T23:09:06.125 INFO:tasks.workunit.client.0.smithi148.stdout:7/376: unlink d7/d11/d29/c4b 0 2024-04-26T23:09:06.130 INFO:tasks.workunit.client.0.smithi148.stdout:7/377: creat d7/d11/d17/d2f/d57/f7e x:0 0 0 2024-04-26T23:09:06.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/378: creat d7/d11/d17/d2f/d44/f7f x:0 0 0 2024-04-26T23:09:06.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/379: stat d7/d11 0 2024-04-26T23:09:06.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/380: write d7/d11/d60/f79 [564248,68520] 0 2024-04-26T23:09:06.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/381: mknod d7/d11/d60/d68/c80 0 2024-04-26T23:09:06.161 INFO:tasks.workunit.client.0.smithi148.stdout:7/382: rmdir d7/d11/d17/d2f/d57 39 2024-04-26T23:09:06.164 INFO:tasks.workunit.client.0.smithi148.stdout:7/383: creat d7/d19/f81 x:0 0 0 2024-04-26T23:09:06.165 INFO:tasks.workunit.client.0.smithi148.stdout:7/384: truncate d7/fc 2382926 0 2024-04-26T23:09:06.169 INFO:tasks.workunit.client.0.smithi148.stdout:7/385: rmdir d7/d11/d29/d2e/d41/d67/d7d 0 2024-04-26T23:09:06.170 INFO:tasks.workunit.client.0.smithi148.stdout:7/386: mknod d7/d11/d29/d2e/d41/d67/c82 0 2024-04-26T23:09:06.171 INFO:tasks.workunit.client.0.smithi148.stdout:7/387: creat d7/d19/f83 x:0 0 0 2024-04-26T23:09:06.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/388: symlink d7/d11/d17/d43/l84 0 2024-04-26T23:09:06.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/389: chown d7/d11/d29/d2e/d41 157238953 1 2024-04-26T23:09:06.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/390: dread - d7/d11/d29/d2e/f72 zero size 2024-04-26T23:09:06.180 INFO:tasks.workunit.client.0.smithi148.stdout:4/365: dwrite d12/d2c/f26 [0,4194304] 0 2024-04-26T23:09:06.240 INFO:tasks.workunit.client.0.smithi148.stdout:4/366: dwrite d12/d17/f68 [0,4194304] 0 2024-04-26T23:09:06.244 INFO:tasks.workunit.client.0.smithi148.stdout:4/367: dread fd [0,4194304] 0 2024-04-26T23:09:06.284 INFO:tasks.workunit.client.0.smithi148.stdout:1/375: dwrite d16/d17/f1b [0,4194304] 0 2024-04-26T23:09:06.314 INFO:tasks.workunit.client.0.smithi148.stdout:6/384: dwrite d6/d9/d23/d4a/f70 [0,4194304] 0 2024-04-26T23:09:06.327 INFO:tasks.workunit.client.0.smithi148.stdout:8/450: dread d3/da/d1c/f45 [0,4194304] 0 2024-04-26T23:09:06.334 INFO:tasks.workunit.client.0.smithi148.stdout:0/431: dread d0/d20/f40 [0,4194304] 0 2024-04-26T23:09:06.334 INFO:tasks.workunit.client.0.smithi148.stdout:5/478: dwrite da/d68/d69/fa7 [0,4194304] 0 2024-04-26T23:09:06.335 INFO:tasks.workunit.client.0.smithi148.stdout:5/479: dread - da/d70/f77 zero size 2024-04-26T23:09:06.339 INFO:tasks.workunit.client.0.smithi148.stdout:7/391: dwrite d7/d11/d29/d2e/d41/d67/f6b [0,4194304] 0 2024-04-26T23:09:06.339 INFO:tasks.workunit.client.0.smithi148.stdout:2/507: dread d5/d8/f3e [4194304,4194304] 0 2024-04-26T23:09:06.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/508: dwrite d5/d8/d9/f2a [0,4194304] 0 2024-04-26T23:09:06.496 INFO:tasks.workunit.client.0.smithi148.stdout:4/368: truncate d12/d17/d2a/f32 4066104 0 2024-04-26T23:09:06.496 INFO:tasks.workunit.client.0.smithi148.stdout:4/369: stat d12/d1c/f51 0 2024-04-26T23:09:06.499 INFO:tasks.workunit.client.0.smithi148.stdout:1/376: symlink d16/d17/d4b/d59/l7a 0 2024-04-26T23:09:06.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/509: dwrite d5/d8/d9/f2a [0,4194304] 0 2024-04-26T23:09:06.522 INFO:tasks.workunit.client.0.smithi148.stdout:6/385: symlink d6/d9/d1c/d1d/d1f/d40/l7b 0 2024-04-26T23:09:06.526 INFO:tasks.workunit.client.0.smithi148.stdout:4/370: write d12/d17/f68 [2416341,18768] 0 2024-04-26T23:09:06.534 INFO:tasks.workunit.client.0.smithi148.stdout:0/432: rename d0/d8/c6b to d0/d8/d5f/c96 0 2024-04-26T23:09:06.547 INFO:tasks.workunit.client.0.smithi148.stdout:1/377: dwrite d16/f1d [0,4194304] 0 2024-04-26T23:09:06.549 INFO:tasks.workunit.client.0.smithi148.stdout:7/392: creat d7/d75/f85 x:0 0 0 2024-04-26T23:09:06.549 INFO:tasks.workunit.client.0.smithi148.stdout:7/393: chown d7/d11/d29 439 1 2024-04-26T23:09:06.549 INFO:tasks.workunit.client.0.smithi148.stdout:7/394: dread - d7/d19/f83 zero size 2024-04-26T23:09:06.551 INFO:tasks.workunit.client.0.smithi148.stdout:6/386: write d6/d32/f62 [97149,43685] 0 2024-04-26T23:09:06.552 INFO:tasks.workunit.client.0.smithi148.stdout:5/480: write da/d1b/d1c/f22 [955799,50088] 0 2024-04-26T23:09:06.552 INFO:tasks.workunit.client.0.smithi148.stdout:5/481: dread - da/d1b/d1c/d7f/fa9 zero size 2024-04-26T23:09:06.553 INFO:tasks.workunit.client.0.smithi148.stdout:2/510: rmdir d5/d8/d4b/d4e/d6d/da0/d78 39 2024-04-26T23:09:06.555 INFO:tasks.workunit.client.0.smithi148.stdout:3/387: sync 2024-04-26T23:09:06.555 INFO:tasks.workunit.client.0.smithi148.stdout:3/388: getdents d9/d15/d29/d4d/d78 0 2024-04-26T23:09:06.566 INFO:tasks.workunit.client.0.smithi148.stdout:4/371: dwrite d12/d17/f2e [0,4194304] 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:0/433: rename d0/d5/d19 to d0/d8/d95/d97 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:7/395: creat d7/d11/d17/f86 x:0 0 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:5/482: creat da/d1b/d1c/fb4 x:0 0 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:9/442: sync 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:9/443: write d19/d1d/d25/d2f/f53 [363062,90328] 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/372: link d12/d1a/f6d d12/d1c/d56/f6f 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/373: write d12/d1c/d56/f65 [360798,54682] 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:7/396: symlink d7/d11/d60/d68/l87 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/374: write d12/d17/d2a/d37/f62 [148600,60062] 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/375: write d12/d17/d2a/d37/f42 [346130,61563] 0 2024-04-26T23:09:06.573 INFO:tasks.workunit.client.0.smithi148.stdout:6/387: creat d6/d9/f7c x:0 0 0 2024-04-26T23:09:06.574 INFO:tasks.workunit.client.0.smithi148.stdout:6/388: dread - d6/d9/d23/d4a/f67 zero size 2024-04-26T23:09:06.577 INFO:tasks.workunit.client.0.smithi148.stdout:9/444: unlink d19/d1d/d25/d31/d48/c5b 0 2024-04-26T23:09:06.582 INFO:tasks.workunit.client.0.smithi148.stdout:9/445: link d19/d1d/l93 d19/d22/d7b/l94 0 2024-04-26T23:09:06.582 INFO:tasks.workunit.client.0.smithi148.stdout:9/446: dread - d19/d1d/d25/d31/f81 zero size 2024-04-26T23:09:06.582 INFO:tasks.workunit.client.0.smithi148.stdout:9/447: rename d19/d22/f76 to d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/f95 0 2024-04-26T23:09:06.583 INFO:tasks.workunit.client.0.smithi148.stdout:9/448: rmdir d19/d1d/d25/d31/d73 39 2024-04-26T23:09:06.586 INFO:tasks.workunit.client.0.smithi148.stdout:9/449: truncate f3 5434218 0 2024-04-26T23:09:06.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/450: getdents d19/d1d/d25/d2f/d4d/d33/d50/d57 0 2024-04-26T23:09:06.620 INFO:tasks.workunit.client.0.smithi148.stdout:1/378: dwrite d16/d45/f35 [0,4194304] 0 2024-04-26T23:09:06.620 INFO:tasks.workunit.client.0.smithi148.stdout:1/379: chown d16/d17/d4b/d55/l6a 878526 1 2024-04-26T23:09:06.620 INFO:tasks.workunit.client.0.smithi148.stdout:1/380: readlink d16/d45/l38 0 2024-04-26T23:09:06.621 INFO:tasks.workunit.client.0.smithi148.stdout:1/381: link d16/d45/d2b/d3e/l41 d16/d17/d4b/d55/l7b 0 2024-04-26T23:09:06.623 INFO:tasks.workunit.client.0.smithi148.stdout:1/382: unlink d16/f3a 0 2024-04-26T23:09:06.624 INFO:tasks.workunit.client.0.smithi148.stdout:1/383: creat d16/d17/d4b/d53/d67/f7c x:0 0 0 2024-04-26T23:09:06.627 INFO:tasks.workunit.client.0.smithi148.stdout:6/389: dwrite d6/dc/f45 [0,4194304] 0 2024-04-26T23:09:06.628 INFO:tasks.workunit.client.0.smithi148.stdout:6/390: chown d6/d14 17 1 2024-04-26T23:09:06.631 INFO:tasks.workunit.client.0.smithi148.stdout:8/451: dwrite d3/da/d1c/f41 [0,4194304] 0 2024-04-26T23:09:06.632 INFO:tasks.workunit.client.0.smithi148.stdout:6/391: link d6/d9/d1e/f5f d6/d32/d4e/f7d 0 2024-04-26T23:09:06.632 INFO:tasks.workunit.client.0.smithi148.stdout:6/392: read d6/d32/f62 [56294,21644] 0 2024-04-26T23:09:06.634 INFO:tasks.workunit.client.0.smithi148.stdout:8/452: rename d3/d9/d40 to d3/d9/d85 0 2024-04-26T23:09:06.634 INFO:tasks.workunit.client.0.smithi148.stdout:8/453: chown d3/da/d28/d4c/f6d 566288367 1 2024-04-26T23:09:06.644 INFO:tasks.workunit.client.0.smithi148.stdout:8/454: getdents d3/d9/d85 0 2024-04-26T23:09:06.645 INFO:tasks.workunit.client.0.smithi148.stdout:6/393: truncate d6/d9/d1c/d1d/d1f/f4c 423082 0 2024-04-26T23:09:06.648 INFO:tasks.workunit.client.0.smithi148.stdout:8/455: creat d3/d9/d12/d23/d35/f86 x:0 0 0 2024-04-26T23:09:06.648 INFO:tasks.workunit.client.0.smithi148.stdout:2/511: dwrite d5/d17/d64/f72 [0,4194304] 0 2024-04-26T23:09:06.653 INFO:tasks.workunit.client.0.smithi148.stdout:7/397: dwrite d7/d11/d17/d2f/d44/f7f [0,4194304] 0 2024-04-26T23:09:06.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/376: dwrite d12/d1c/f67 [0,4194304] 0 2024-04-26T23:09:06.653 INFO:tasks.workunit.client.0.smithi148.stdout:7/398: chown d7/d11/d29/d2e/d41/f48 954162453 1 2024-04-26T23:09:06.662 INFO:tasks.workunit.client.0.smithi148.stdout:8/456: dread d3/da/f74 [0,4194304] 0 2024-04-26T23:09:06.663 INFO:tasks.workunit.client.0.smithi148.stdout:2/512: dread d5/d8/d15/f45 [0,4194304] 0 2024-04-26T23:09:06.664 INFO:tasks.workunit.client.0.smithi148.stdout:2/513: write d5/d8/d4b/d4e/d6d/da0/d32/d4c/f9b [827165,110850] 0 2024-04-26T23:09:06.670 INFO:tasks.workunit.client.0.smithi148.stdout:4/377: truncate d12/d17/f68 1829468 0 2024-04-26T23:09:06.672 INFO:tasks.workunit.client.0.smithi148.stdout:8/457: unlink d3/d9/d12/d23/d29/d37/d5e/f81 0 2024-04-26T23:09:06.674 INFO:tasks.workunit.client.0.smithi148.stdout:2/514: mknod d5/d8/d4b/d4e/d6d/da0/ca2 0 2024-04-26T23:09:06.674 INFO:tasks.workunit.client.0.smithi148.stdout:1/384: dwrite d16/d17/d4b/d55/f69 [0,4194304] 0 2024-04-26T23:09:06.674 INFO:tasks.workunit.client.0.smithi148.stdout:1/385: chown d16/f37 2696 1 2024-04-26T23:09:06.675 INFO:tasks.workunit.client.0.smithi148.stdout:4/378: mknod d12/d17/c70 0 2024-04-26T23:09:06.675 INFO:tasks.workunit.client.0.smithi148.stdout:8/458: truncate d3/da/d1c/f83 708133 0 2024-04-26T23:09:06.676 INFO:tasks.workunit.client.0.smithi148.stdout:2/515: creat d5/d7/fa3 x:0 0 0 2024-04-26T23:09:06.677 INFO:tasks.workunit.client.0.smithi148.stdout:1/386: mkdir d16/d45/d7d 0 2024-04-26T23:09:06.679 INFO:tasks.workunit.client.0.smithi148.stdout:8/459: rmdir d3/d9 39 2024-04-26T23:09:06.680 INFO:tasks.workunit.client.0.smithi148.stdout:1/387: truncate f15 338854 0 2024-04-26T23:09:06.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/460: mkdir d3/d87 0 2024-04-26T23:09:06.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/461: fdatasync d3/d9/d12/d23/d29/d37/f3e 0 2024-04-26T23:09:06.682 INFO:tasks.workunit.client.0.smithi148.stdout:3/389: dwrite d9/f36 [0,4194304] 0 2024-04-26T23:09:06.683 INFO:tasks.workunit.client.0.smithi148.stdout:3/390: write d9/d15/d29/d4d/f64 [168451,33541] 0 2024-04-26T23:09:06.683 INFO:tasks.workunit.client.0.smithi148.stdout:1/388: creat d16/d45/d2b/d3e/f7e x:0 0 0 2024-04-26T23:09:06.683 INFO:tasks.workunit.client.0.smithi148.stdout:4/379: rename d12/d1c/f43 to d12/d1c/f71 0 2024-04-26T23:09:06.685 INFO:tasks.workunit.client.0.smithi148.stdout:1/389: rename d16/d45/d2b/l40 to d16/d45/d2b/d3e/l7f 0 2024-04-26T23:09:06.686 INFO:tasks.workunit.client.0.smithi148.stdout:1/390: fdatasync f5 0 2024-04-26T23:09:06.688 INFO:tasks.workunit.client.0.smithi148.stdout:1/391: rename d16/d17/d4b/d53/d67/f7c to d16/d17/d77/f80 0 2024-04-26T23:09:06.688 INFO:tasks.workunit.client.0.smithi148.stdout:1/392: fdatasync d16/f1d 0 2024-04-26T23:09:06.688 INFO:tasks.workunit.client.0.smithi148.stdout:1/393: chown d16/f37 994 1 2024-04-26T23:09:06.690 INFO:tasks.workunit.client.0.smithi148.stdout:1/394: getdents d16/d47/d49 0 2024-04-26T23:09:06.695 INFO:tasks.workunit.client.0.smithi148.stdout:7/399: dwrite d7/d11/d29/f5f [0,4194304] 0 2024-04-26T23:09:06.704 INFO:tasks.workunit.client.0.smithi148.stdout:3/391: write d9/f43 [3506126,17777] 0 2024-04-26T23:09:06.704 INFO:tasks.workunit.client.0.smithi148.stdout:7/400: stat d7/d11/d17/d2f/d44/c6a 0 2024-04-26T23:09:06.704 INFO:tasks.workunit.client.0.smithi148.stdout:7/401: fsync d7/f22 0 2024-04-26T23:09:06.705 INFO:tasks.workunit.client.0.smithi148.stdout:3/392: truncate d9/d15/f19 3550094 0 2024-04-26T23:09:06.707 INFO:tasks.workunit.client.0.smithi148.stdout:3/393: unlink c7 0 2024-04-26T23:09:06.707 INFO:tasks.workunit.client.0.smithi148.stdout:3/394: chown d9/d15/d29/c42 29 1 2024-04-26T23:09:06.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/395: read d16/d1c/f32 [41707,60945] 0 2024-04-26T23:09:06.709 INFO:tasks.workunit.client.0.smithi148.stdout:3/395: rmdir d9/d52 39 2024-04-26T23:09:06.710 INFO:tasks.workunit.client.0.smithi148.stdout:1/396: link d16/d47/l48 d16/l81 0 2024-04-26T23:09:06.710 INFO:tasks.workunit.client.0.smithi148.stdout:5/483: dread da/d1b/d5b/f39 [0,4194304] 0 2024-04-26T23:09:06.712 INFO:tasks.workunit.client.0.smithi148.stdout:3/396: link f5 d9/d15/d29/d4d/d7d/f7e 0 2024-04-26T23:09:06.713 INFO:tasks.workunit.client.0.smithi148.stdout:1/397: mkdir d16/d1c/d82 0 2024-04-26T23:09:06.713 INFO:tasks.workunit.client.0.smithi148.stdout:1/398: fsync f13 0 2024-04-26T23:09:06.720 INFO:tasks.workunit.client.0.smithi148.stdout:3/397: link d9/d15/d29/l30 d9/d15/d29/d4d/d6f/l7f 0 2024-04-26T23:09:06.720 INFO:tasks.workunit.client.0.smithi148.stdout:3/398: fdatasync d9/d15/d29/d4d/d7d/f7e 0 2024-04-26T23:09:06.720 INFO:tasks.workunit.client.0.smithi148.stdout:1/399: mkdir d16/d45/d7d/d83 0 2024-04-26T23:09:06.731 INFO:tasks.workunit.client.0.smithi148.stdout:6/394: write d6/d9/d23/d4a/f70 [2761598,88015] 0 2024-04-26T23:09:06.731 INFO:tasks.workunit.client.0.smithi148.stdout:6/395: readlink d6/d9/d23/l58 0 2024-04-26T23:09:06.735 INFO:tasks.workunit.client.0.smithi148.stdout:6/396: creat d6/d9/f7e x:0 0 0 2024-04-26T23:09:06.735 INFO:tasks.workunit.client.0.smithi148.stdout:6/397: fdatasync d6/dc/f3f 0 2024-04-26T23:09:06.735 INFO:tasks.workunit.client.0.smithi148.stdout:6/398: chown d6/d9/d23/d4a/f67 6390243 1 2024-04-26T23:09:06.738 INFO:tasks.workunit.client.0.smithi148.stdout:7/402: write d7/f9 [6641853,2819] 0 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/403: chown d7/fe 355310 1 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:8/462: dwrite d3/d9/d12/d23/d35/f86 [0,4194304] 0 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:8/463: truncate d3/da/d28/f38 4649098 0 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:1/400: dread f13 [0,4194304] 0 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:2/516: dwrite d5/d8/f1b [0,4194304] 0 2024-04-26T23:09:06.739 INFO:tasks.workunit.client.0.smithi148.stdout:2/517: chown d5/d17/d64/f76 124341266 1 2024-04-26T23:09:06.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/399: creat d6/d9/d1c/d1d/d1f/f7f x:0 0 0 2024-04-26T23:09:06.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/380: write f8 [7132642,109097] 0 2024-04-26T23:09:06.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/381: fsync d12/d2c/f3c 0 2024-04-26T23:09:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:0/434: dwrite d0/d5/d84/f89 [0,4194304] 0 2024-04-26T23:09:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:7/404: rmdir d7/d11/d29/d2e/d41 39 2024-04-26T23:09:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:7/405: read - d7/d11/d29/d2e/f72 zero size 2024-04-26T23:09:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:3/399: dwrite d9/d52/f62 [0,4194304] 0 2024-04-26T23:09:06.751 INFO:tasks.workunit.client.0.smithi148.stdout:1/401: mkdir d16/d1c/d84 0 2024-04-26T23:09:06.751 INFO:tasks.workunit.client.0.smithi148.stdout:1/402: write d16/f4a [858467,40184] 0 2024-04-26T23:09:06.751 INFO:tasks.workunit.client.0.smithi148.stdout:1/403: fdatasync d16/d17/d4b/f72 0 2024-04-26T23:09:06.751 INFO:tasks.workunit.client.0.smithi148.stdout:2/518: mknod d5/d8/d15/d43/d5d/ca4 0 2024-04-26T23:09:06.752 INFO:tasks.workunit.client.0.smithi148.stdout:8/464: creat d3/f88 x:0 0 0 2024-04-26T23:09:06.760 INFO:tasks.workunit.client.0.smithi148.stdout:6/400: dread d6/d9/d23/d4a/f70 [0,4194304] 0 2024-04-26T23:09:06.760 INFO:tasks.workunit.client.0.smithi148.stdout:6/401: readlink d6/d9/d23/l48 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:4/382: creat d12/f72 x:0 0 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:7/406: rename d7/d11/f34 to d7/d11/f88 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:3/400: unlink d9/d15/d29/c5a 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:1/404: rmdir d16/d17/d68/d6b 39 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:2/519: mknod d5/d97/ca5 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:0/435: write d0/d8/d1e/f2a [885264,120084] 0 2024-04-26T23:09:06.766 INFO:tasks.workunit.client.0.smithi148.stdout:6/402: creat d6/d32/d66/f80 x:0 0 0 2024-04-26T23:09:06.767 INFO:tasks.workunit.client.0.smithi148.stdout:4/383: rename d12/d1c/d56/f65 to d12/d1c/f73 0 2024-04-26T23:09:06.768 INFO:tasks.workunit.client.0.smithi148.stdout:7/407: symlink d7/d11/d17/l89 0 2024-04-26T23:09:06.768 INFO:tasks.workunit.client.0.smithi148.stdout:1/405: mkdir d16/d85 0 2024-04-26T23:09:06.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/401: read d9/d15/f1e [26165,83419] 0 2024-04-26T23:09:06.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/402: chown d9/l49 225640 1 2024-04-26T23:09:06.769 INFO:tasks.workunit.client.0.smithi148.stdout:2/520: mkdir d5/da6 0 2024-04-26T23:09:06.769 INFO:tasks.workunit.client.0.smithi148.stdout:0/436: truncate d0/d5/d84/f89 2225233 0 2024-04-26T23:09:06.769 INFO:tasks.workunit.client.0.smithi148.stdout:0/437: readlink d0/d5/ld 0 2024-04-26T23:09:06.770 INFO:tasks.workunit.client.0.smithi148.stdout:0/438: chown d0/d5/f8a 742013 1 2024-04-26T23:09:06.770 INFO:tasks.workunit.client.0.smithi148.stdout:0/439: write d0/d8/d52/f30 [5377522,125781] 0 2024-04-26T23:09:06.770 INFO:tasks.workunit.client.0.smithi148.stdout:0/440: truncate d0/d20/f8d 4607595 0 2024-04-26T23:09:06.771 INFO:tasks.workunit.client.0.smithi148.stdout:4/384: mknod d12/d1c/d56/c74 0 2024-04-26T23:09:06.771 INFO:tasks.workunit.client.0.smithi148.stdout:6/403: symlink d6/d32/l81 0 2024-04-26T23:09:06.771 INFO:tasks.workunit.client.0.smithi148.stdout:6/404: truncate d6/d32/d4e/f73 790133 0 2024-04-26T23:09:06.772 INFO:tasks.workunit.client.0.smithi148.stdout:6/405: chown d6/d9/d1c/d1d/d1f/l38 0 1 2024-04-26T23:09:06.772 INFO:tasks.workunit.client.0.smithi148.stdout:6/406: chown d6/d9/d23/l4d 3 1 2024-04-26T23:09:06.772 INFO:tasks.workunit.client.0.smithi148.stdout:7/408: creat d7/d11/d29/d2e/d41/f8a x:0 0 0 2024-04-26T23:09:06.772 INFO:tasks.workunit.client.0.smithi148.stdout:1/406: symlink d16/d47/d49/l86 0 2024-04-26T23:09:06.773 INFO:tasks.workunit.client.0.smithi148.stdout:3/403: mkdir d9/d65/d80 0 2024-04-26T23:09:06.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/385: rmdir d12/d17/d2a/d33 39 2024-04-26T23:09:06.779 INFO:tasks.workunit.client.0.smithi148.stdout:7/409: mknod d7/d11/d17/d43/c8b 0 2024-04-26T23:09:06.779 INFO:tasks.workunit.client.0.smithi148.stdout:1/407: creat d16/f87 x:0 0 0 2024-04-26T23:09:06.779 INFO:tasks.workunit.client.0.smithi148.stdout:3/404: truncate d9/d15/f28 655867 0 2024-04-26T23:09:06.779 INFO:tasks.workunit.client.0.smithi148.stdout:3/405: chown d9/d15/d29/d4d/c4e 18058 1 2024-04-26T23:09:06.780 INFO:tasks.workunit.client.0.smithi148.stdout:1/408: rmdir d16/d45/d7d/d83 0 2024-04-26T23:09:06.786 INFO:tasks.workunit.client.0.smithi148.stdout:6/407: dread d6/f43 [0,4194304] 0 2024-04-26T23:09:06.786 INFO:tasks.workunit.client.0.smithi148.stdout:6/408: creat d6/d9/d1e/f82 x:0 0 0 2024-04-26T23:09:06.792 INFO:tasks.workunit.client.0.smithi148.stdout:6/409: unlink d6/l35 0 2024-04-26T23:09:06.795 INFO:tasks.workunit.client.0.smithi148.stdout:3/406: dread d9/f40 [0,4194304] 0 2024-04-26T23:09:06.795 INFO:tasks.workunit.client.0.smithi148.stdout:3/407: chown d9/c63 18785425 1 2024-04-26T23:09:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:8/465: dwrite d3/da/f5c [0,4194304] 0 2024-04-26T23:09:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:4/386: write d12/d17/f2e [2796244,60601] 0 2024-04-26T23:09:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:4/387: dread - d12/d17/d2a/d37/f5c zero size 2024-04-26T23:09:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:0/441: dread d0/d5/f7 [4194304,4194304] 0 2024-04-26T23:09:06.825 INFO:tasks.workunit.client.0.smithi148.stdout:3/408: dread d9/d15/f19 [0,4194304] 0 2024-04-26T23:09:06.841 INFO:tasks.workunit.client.0.smithi148.stdout:2/521: dwrite d5/d8/d11/f61 [0,4194304] 0 2024-04-26T23:09:06.842 INFO:tasks.workunit.client.0.smithi148.stdout:1/409: dwrite d16/d1c/f33 [0,4194304] 0 2024-04-26T23:09:06.846 INFO:tasks.workunit.client.0.smithi148.stdout:2/522: dread d5/d10/f5b [0,4194304] 0 2024-04-26T23:09:06.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/410: dwrite d7/d11/d17/d2f/d57/f7e [0,4194304] 0 2024-04-26T23:09:06.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/411: dread - d7/d11/d29/d2e/f64 zero size 2024-04-26T23:09:06.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/412: write d7/d19/f81 [956259,71612] 0 2024-04-26T23:09:06.899 INFO:tasks.workunit.client.0.smithi148.stdout:4/388: dwrite d12/d17/f3e [8388608,4194304] 0 2024-04-26T23:09:06.904 INFO:tasks.workunit.client.0.smithi148.stdout:4/389: dread d12/d17/f68 [0,4194304] 0 2024-04-26T23:09:06.905 INFO:tasks.workunit.client.0.smithi148.stdout:4/390: write d12/d17/d2a/f2d [684434,63819] 0 2024-04-26T23:09:06.911 INFO:tasks.workunit.client.0.smithi148.stdout:8/466: dwrite d3/d9/d12/d23/d35/f82 [0,4194304] 0 2024-04-26T23:09:06.948 INFO:tasks.workunit.client.0.smithi148.stdout:8/467: dwrite d3/da/d28/f50 [0,4194304] 0 2024-04-26T23:09:07.063 INFO:tasks.workunit.client.0.smithi148.stdout:0/442: creat d0/d5/d84/f98 x:0 0 0 2024-04-26T23:09:07.065 INFO:tasks.workunit.client.0.smithi148.stdout:3/409: creat d9/d52/f81 x:0 0 0 2024-04-26T23:09:07.071 INFO:tasks.workunit.client.0.smithi148.stdout:1/410: creat d16/d1c/d84/f88 x:0 0 0 2024-04-26T23:09:07.071 INFO:tasks.workunit.client.0.smithi148.stdout:2/523: unlink d5/c36 0 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:7/413: truncate d7/d19/f20 8333187 0 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:7/414: chown d7/d11/d29/d2e/d41/f49 1050038444 1 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:7/415: readlink d7/d11/d29/l50 0 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/391: truncate d12/d17/d2a/d37/f42 219857 0 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/392: chown d12/d17/d2a/d33/f44 3748751 1 2024-04-26T23:09:07.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/393: fdatasync d12/d17/d2a/d37/f62 0 2024-04-26T23:09:07.093 INFO:tasks.workunit.client.0.smithi148.stdout:8/468: truncate d3/d9/d12/d23/d29/d37/f63 3319360 0 2024-04-26T23:09:07.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/411: dwrite d16/f87 [0,4194304] 0 2024-04-26T23:09:07.108 INFO:tasks.workunit.client.0.smithi148.stdout:2/524: rename d5/d8/d4b/c92 to d5/d8/d4b/d4e/d6d/da0/ca7 0 2024-04-26T23:09:07.114 INFO:tasks.workunit.client.0.smithi148.stdout:8/469: link d3/da/d28/l2b d3/d9/d85/l89 0 2024-04-26T23:09:07.119 INFO:tasks.workunit.client.0.smithi148.stdout:0/443: mkdir d0/d99 0 2024-04-26T23:09:07.123 INFO:tasks.workunit.client.0.smithi148.stdout:2/525: creat d5/d8/d9/d3d/fa8 x:0 0 0 2024-04-26T23:09:07.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/470: creat d3/d9/d12/d23/d29/d77/f8a x:0 0 0 2024-04-26T23:09:07.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/471: chown d3/d9/d85 3 1 2024-04-26T23:09:07.125 INFO:tasks.workunit.client.0.smithi148.stdout:0/444: getdents d0/d8/d52 0 2024-04-26T23:09:07.127 INFO:tasks.workunit.client.0.smithi148.stdout:3/410: dwrite d9/d15/d29/f37 [4194304,4194304] 0 2024-04-26T23:09:07.129 INFO:tasks.workunit.client.0.smithi148.stdout:2/526: creat d5/d8/d15/d43/fa9 x:0 0 0 2024-04-26T23:09:07.130 INFO:tasks.workunit.client.0.smithi148.stdout:8/472: symlink d3/d87/l8b 0 2024-04-26T23:09:07.130 INFO:tasks.workunit.client.0.smithi148.stdout:8/473: truncate d3/d9/d12/d23/d35/d69/f6e 358390 0 2024-04-26T23:09:07.134 INFO:tasks.workunit.client.0.smithi148.stdout:4/394: dread d12/d2c/f26 [0,4194304] 0 2024-04-26T23:09:07.137 INFO:tasks.workunit.client.0.smithi148.stdout:7/416: dwrite d7/d11/d17/d2f/d57/f7e [0,4194304] 0 2024-04-26T23:09:07.137 INFO:tasks.workunit.client.0.smithi148.stdout:2/527: link c4 d5/d97/caa 0 2024-04-26T23:09:07.137 INFO:tasks.workunit.client.0.smithi148.stdout:0/445: dread d0/d8/d52/f30 [4194304,4194304] 0 2024-04-26T23:09:07.137 INFO:tasks.workunit.client.0.smithi148.stdout:8/474: getdents d3/da 0 2024-04-26T23:09:07.139 INFO:tasks.workunit.client.0.smithi148.stdout:4/395: mkdir d12/d1c/d45/d75 0 2024-04-26T23:09:07.141 INFO:tasks.workunit.client.0.smithi148.stdout:0/446: readlink d0/l4 0 2024-04-26T23:09:07.141 INFO:tasks.workunit.client.0.smithi148.stdout:0/447: chown d0/d8/d1e/f2a 712531388 1 2024-04-26T23:09:07.141 INFO:tasks.workunit.client.0.smithi148.stdout:0/448: dread - d0/d2e/d8f/f7c zero size 2024-04-26T23:09:07.143 INFO:tasks.workunit.client.0.smithi148.stdout:6/410: sync 2024-04-26T23:09:07.143 INFO:tasks.workunit.client.0.smithi148.stdout:5/484: sync 2024-04-26T23:09:07.143 INFO:tasks.workunit.client.0.smithi148.stdout:9/451: sync 2024-04-26T23:09:07.144 INFO:tasks.workunit.client.0.smithi148.stdout:4/396: rmdir d12 39 2024-04-26T23:09:07.147 INFO:tasks.workunit.client.0.smithi148.stdout:0/449: mkdir d0/d20/d3b/d9a 0 2024-04-26T23:09:07.150 INFO:tasks.workunit.client.0.smithi148.stdout:8/475: mkdir d3/da/d1c/d7c/d8c 0 2024-04-26T23:09:07.160 INFO:tasks.workunit.client.0.smithi148.stdout:9/452: symlink d19/d1d/d25/d2f/d4d/d33/d80/l96 0 2024-04-26T23:09:07.160 INFO:tasks.workunit.client.0.smithi148.stdout:9/453: chown d19/d1d/d25/d2f 6356766 1 2024-04-26T23:09:07.167 INFO:tasks.workunit.client.0.smithi148.stdout:4/397: creat d12/d1a/f76 x:0 0 0 2024-04-26T23:09:07.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/454: write d19/d1d/d25/d2f/d4d/d33/d50/d61/f64 [531859,55350] 0 2024-04-26T23:09:07.167 INFO:tasks.workunit.client.0.smithi148.stdout:4/398: write d12/d17/d2a/d33/f4c [665499,6956] 0 2024-04-26T23:09:07.167 INFO:tasks.workunit.client.0.smithi148.stdout:4/399: chown d12/d17/d2a/d33/f61 7648012 1 2024-04-26T23:09:07.172 INFO:tasks.workunit.client.0.smithi148.stdout:1/412: dwrite d16/d17/f39 [0,4194304] 0 2024-04-26T23:09:07.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/476: creat d3/d9/d12/d23/d29/d4f/f8d x:0 0 0 2024-04-26T23:09:07.173 INFO:tasks.workunit.client.0.smithi148.stdout:6/411: write d6/dc/f3f [2795209,35711] 0 2024-04-26T23:09:07.180 INFO:tasks.workunit.client.0.smithi148.stdout:2/528: write d5/d10/f48 [619447,103242] 0 2024-04-26T23:09:07.180 INFO:tasks.workunit.client.0.smithi148.stdout:9/455: mknod d19/d1d/d25/d2f/d4d/d33/c97 0 2024-04-26T23:09:07.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/412: symlink d6/d9/d1c/d1d/d1f/l83 0 2024-04-26T23:09:07.185 INFO:tasks.workunit.client.0.smithi148.stdout:6/413: read d6/dc/f3f [3059088,97291] 0 2024-04-26T23:09:07.188 INFO:tasks.workunit.client.0.smithi148.stdout:3/411: dwrite f5 [0,4194304] 0 2024-04-26T23:09:07.196 INFO:tasks.workunit.client.0.smithi148.stdout:2/529: symlink d5/d10/lab 0 2024-04-26T23:09:07.198 INFO:tasks.workunit.client.0.smithi148.stdout:3/412: symlink d9/d15/d29/d4d/d7d/l82 0 2024-04-26T23:09:07.204 INFO:tasks.workunit.client.0.smithi148.stdout:0/450: dwrite d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:09:07.206 INFO:tasks.workunit.client.0.smithi148.stdout:2/530: symlink d5/d1c/d38/lac 0 2024-04-26T23:09:07.209 INFO:tasks.workunit.client.0.smithi148.stdout:1/413: dread d16/d1c/f33 [0,4194304] 0 2024-04-26T23:09:07.213 INFO:tasks.workunit.client.0.smithi148.stdout:7/417: dwrite d7/d75/f33 [0,4194304] 0 2024-04-26T23:09:07.218 INFO:tasks.workunit.client.0.smithi148.stdout:2/531: symlink d5/d17/d59/lad 0 2024-04-26T23:09:07.219 INFO:tasks.workunit.client.0.smithi148.stdout:1/414: symlink d16/d45/d7d/l89 0 2024-04-26T23:09:07.219 INFO:tasks.workunit.client.0.smithi148.stdout:1/415: chown d16/d45/d7d 261 1 2024-04-26T23:09:07.221 INFO:tasks.workunit.client.0.smithi148.stdout:7/418: unlink d7/d11/d17/d43/l84 0 2024-04-26T23:09:07.222 INFO:tasks.workunit.client.0.smithi148.stdout:2/532: rmdir d5/d7/d73 39 2024-04-26T23:09:07.224 INFO:tasks.workunit.client.0.smithi148.stdout:1/416: rename d16/d47/l63 to d16/d45/d2b/d3e/l8a 0 2024-04-26T23:09:07.224 INFO:tasks.workunit.client.0.smithi148.stdout:1/417: chown f15 2736 1 2024-04-26T23:09:07.227 INFO:tasks.workunit.client.0.smithi148.stdout:7/419: symlink d7/d11/d29/d2e/d41/l8c 0 2024-04-26T23:09:07.233 INFO:tasks.workunit.client.0.smithi148.stdout:0/451: dread d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:09:07.244 INFO:tasks.workunit.client.0.smithi148.stdout:5/485: dwrite da/d1a/f57 [0,4194304] 0 2024-04-26T23:09:07.244 INFO:tasks.workunit.client.0.smithi148.stdout:9/456: write d19/d1d/d49/f5c [2523855,66954] 0 2024-04-26T23:09:07.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/418: dread d16/d1c/f29 [0,4194304] 0 2024-04-26T23:09:07.249 INFO:tasks.workunit.client.0.smithi148.stdout:0/452: symlink d0/d2e/d8f/d6c/l9b 0 2024-04-26T23:09:07.256 INFO:tasks.workunit.client.0.smithi148.stdout:4/400: dwrite d12/d17/d2a/d37/f5c [0,4194304] 0 2024-04-26T23:09:07.256 INFO:tasks.workunit.client.0.smithi148.stdout:8/477: dread d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:09:07.257 INFO:tasks.workunit.client.0.smithi148.stdout:1/419: mkdir d16/d17/d68/d6b/d8b 0 2024-04-26T23:09:07.258 INFO:tasks.workunit.client.0.smithi148.stdout:9/457: dread d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:09:07.262 INFO:tasks.workunit.client.0.smithi148.stdout:1/420: read d16/d17/f3b [333022,93721] 0 2024-04-26T23:09:07.263 INFO:tasks.workunit.client.0.smithi148.stdout:0/453: symlink d0/d8/d33/d6a/l9c 0 2024-04-26T23:09:07.263 INFO:tasks.workunit.client.0.smithi148.stdout:9/458: dread d19/d1d/d25/d31/d60/f62 [0,4194304] 0 2024-04-26T23:09:07.265 INFO:tasks.workunit.client.0.smithi148.stdout:2/533: rename d5/d17/d59 to d5/d8/d11/dae 0 2024-04-26T23:09:07.265 INFO:tasks.workunit.client.0.smithi148.stdout:2/534: dread - d5/d8/d9/d3d/fa8 zero size 2024-04-26T23:09:07.268 INFO:tasks.workunit.client.0.smithi148.stdout:6/414: dwrite d6/dc/f42 [0,4194304] 0 2024-04-26T23:09:07.273 INFO:tasks.workunit.client.0.smithi148.stdout:9/459: unlink d19/d1d/d25/c5a 0 2024-04-26T23:09:07.273 INFO:tasks.workunit.client.0.smithi148.stdout:9/460: write d19/d39/f90 [995720,45501] 0 2024-04-26T23:09:07.275 INFO:tasks.workunit.client.0.smithi148.stdout:0/454: rename d0/d99 to d0/d2e/d51/d9d 0 2024-04-26T23:09:07.281 INFO:tasks.workunit.client.0.smithi148.stdout:8/478: write d3/f44 [6933333,46953] 0 2024-04-26T23:09:07.281 INFO:tasks.workunit.client.0.smithi148.stdout:2/535: mknod d5/d8/d11/caf 0 2024-04-26T23:09:07.282 INFO:tasks.workunit.client.0.smithi148.stdout:6/415: creat d6/d9/d23/d4a/f84 x:0 0 0 2024-04-26T23:09:07.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/461: dread d19/d1d/d69/f83 [0,4194304] 0 2024-04-26T23:09:07.285 INFO:tasks.workunit.client.0.smithi148.stdout:0/455: dread d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:09:07.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/479: unlink d3/da/d28/d4c/c33 0 2024-04-26T23:09:07.291 INFO:tasks.workunit.client.0.smithi148.stdout:2/536: rename d5/d8/d15/d43/l4d to d5/d8/d4b/d4e/d6d/da0/d32/d4c/lb0 0 2024-04-26T23:09:07.292 INFO:tasks.workunit.client.0.smithi148.stdout:0/456: creat d0/d8/d33/d68/f9e x:0 0 0 2024-04-26T23:09:07.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/480: mknod d3/da/d1c/d7c/c8e 0 2024-04-26T23:09:07.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/481: fsync d3/da/d28/d4c/f51 0 2024-04-26T23:09:07.301 INFO:tasks.workunit.client.0.smithi148.stdout:2/537: mknod d5/d8/d6c/d8f/cb1 0 2024-04-26T23:09:07.302 INFO:tasks.workunit.client.0.smithi148.stdout:0/457: truncate d0/d8/d1e/f28 2873136 0 2024-04-26T23:09:07.316 INFO:tasks.workunit.client.0.smithi148.stdout:9/462: dwrite fe [4194304,4194304] 0 2024-04-26T23:09:07.317 INFO:tasks.workunit.client.0.smithi148.stdout:8/482: symlink d3/d9/d12/d23/d29/d77/l8f 0 2024-04-26T23:09:07.363 INFO:tasks.workunit.client.0.smithi148.stdout:8/483: dwrite d3/d9/d12/f3f [4194304,4194304] 0 2024-04-26T23:09:07.363 INFO:tasks.workunit.client.0.smithi148.stdout:8/484: stat d3/da/d28/f50 0 2024-04-26T23:09:07.367 INFO:tasks.workunit.client.0.smithi148.stdout:2/538: unlink d5/d7/f24 0 2024-04-26T23:09:07.367 INFO:tasks.workunit.client.0.smithi148.stdout:2/539: stat d5/d8/d4b/d4e/c50 0 2024-04-26T23:09:07.380 INFO:tasks.workunit.client.0.smithi148.stdout:2/540: write d5/d8/d15/d43/f5f [3960179,34654] 0 2024-04-26T23:09:07.383 INFO:tasks.workunit.client.0.smithi148.stdout:0/458: mkdir d0/d8/d95/d9f 0 2024-04-26T23:09:07.386 INFO:tasks.workunit.client.0.smithi148.stdout:9/463: creat d19/d1d/d25/d2f/f98 x:0 0 0 2024-04-26T23:09:07.403 INFO:tasks.workunit.client.0.smithi148.stdout:2/541: mkdir d5/d7f/d86/d87/db2 0 2024-04-26T23:09:07.406 INFO:tasks.workunit.client.0.smithi148.stdout:0/459: getdents d0/d8/d5f/d72 0 2024-04-26T23:09:07.407 INFO:tasks.workunit.client.0.smithi148.stdout:9/464: mknod d19/d1d/d25/d2f/d4d/c99 0 2024-04-26T23:09:07.407 INFO:tasks.workunit.client.0.smithi148.stdout:9/465: fdatasync d19/d1d/d49/f5c 0 2024-04-26T23:09:07.407 INFO:tasks.workunit.client.0.smithi148.stdout:9/466: truncate d19/d1d/d25/d2f/d4d/f43 1409063 0 2024-04-26T23:09:07.407 INFO:tasks.workunit.client.0.smithi148.stdout:9/467: stat d19/d1d/d25/d2f/d4d/d33/d50/d57 0 2024-04-26T23:09:07.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/542: read d5/d8/d11/f6a [74852,85254] 0 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:1/421: sync 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/486: sync 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:7/420: sync 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:4/401: sync 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/487: chown da/d1b/d2d/d82/lab 2 1 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:3/413: sync 2024-04-26T23:09:07.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/488: fsync da/d1b/d5b/f3a 0 2024-04-26T23:09:07.432 INFO:tasks.workunit.client.0.smithi148.stdout:0/460: mknod d0/d20/ca0 0 2024-04-26T23:09:07.433 INFO:tasks.workunit.client.0.smithi148.stdout:9/468: truncate d19/f1e 6550404 0 2024-04-26T23:09:07.444 INFO:tasks.workunit.client.0.smithi148.stdout:1/422: link d16/d17/f39 d16/d17/d68/f8c 0 2024-04-26T23:09:07.444 INFO:tasks.workunit.client.0.smithi148.stdout:4/402: rmdir d12/d1c 39 2024-04-26T23:09:07.444 INFO:tasks.workunit.client.0.smithi148.stdout:4/403: chown d12/d17/d2a 1435412 1 2024-04-26T23:09:07.444 INFO:tasks.workunit.client.0.smithi148.stdout:0/461: dread d0/d20/d3b/f3c [0,4194304] 0 2024-04-26T23:09:07.449 INFO:tasks.workunit.client.0.smithi148.stdout:0/462: dread d0/d8/d5f/d72/f77 [0,4194304] 0 2024-04-26T23:09:07.451 INFO:tasks.workunit.client.0.smithi148.stdout:9/469: write d19/d1d/f8b [2766956,97691] 0 2024-04-26T23:09:07.451 INFO:tasks.workunit.client.0.smithi148.stdout:7/421: truncate d7/d75/f1f 420667 0 2024-04-26T23:09:07.453 INFO:tasks.workunit.client.0.smithi148.stdout:5/489: truncate da/d12/f35 2727318 0 2024-04-26T23:09:07.458 INFO:tasks.workunit.client.0.smithi148.stdout:4/404: creat d12/d1a/f77 x:0 0 0 2024-04-26T23:09:07.458 INFO:tasks.workunit.client.0.smithi148.stdout:4/405: write d12/d17/d2a/d33/f4e [951287,41187] 0 2024-04-26T23:09:07.461 INFO:tasks.workunit.client.0.smithi148.stdout:0/463: link d0/d8/d5f/c96 d0/d8/d55/ca1 0 2024-04-26T23:09:07.461 INFO:tasks.workunit.client.0.smithi148.stdout:1/423: write d16/d17/d68/f8c [1731970,70690] 0 2024-04-26T23:09:07.469 INFO:tasks.workunit.client.0.smithi148.stdout:9/470: link d19/d1d/d25/d2f/d4d/d33/d50/d57/f8d d19/f9a 0 2024-04-26T23:09:07.473 INFO:tasks.workunit.client.0.smithi148.stdout:5/490: link da/d1b/d5b/f4d da/d1b/d3b/db2/fb5 0 2024-04-26T23:09:07.478 INFO:tasks.workunit.client.0.smithi148.stdout:4/406: rename d12/d17/d2a/c55 to d12/d1c/d45/d75/c78 0 2024-04-26T23:09:07.481 INFO:tasks.workunit.client.0.smithi148.stdout:2/543: dwrite d5/d17/d64/f6b [0,4194304] 0 2024-04-26T23:09:07.484 INFO:tasks.workunit.client.0.smithi148.stdout:4/407: dread fd [0,4194304] 0 2024-04-26T23:09:07.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/464: rmdir d0/d20/d3b/d9a 0 2024-04-26T23:09:07.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/465: chown d0/d20/d3b/f3c 614505 1 2024-04-26T23:09:07.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/466: fsync d0/d5/f7 0 2024-04-26T23:09:07.487 INFO:tasks.workunit.client.0.smithi148.stdout:1/424: mknod d16/c8d 0 2024-04-26T23:09:07.489 INFO:tasks.workunit.client.0.smithi148.stdout:9/471: dread d19/d22/f5d [0,4194304] 0 2024-04-26T23:09:07.490 INFO:tasks.workunit.client.0.smithi148.stdout:5/491: rmdir da/d12 39 2024-04-26T23:09:07.493 INFO:tasks.workunit.client.0.smithi148.stdout:3/414: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:09:07.495 INFO:tasks.workunit.client.0.smithi148.stdout:2/544: creat d5/d7/d73/fb3 x:0 0 0 2024-04-26T23:09:07.495 INFO:tasks.workunit.client.0.smithi148.stdout:2/545: chown d5/d8/d15/d7d/l91 9921257 1 2024-04-26T23:09:07.495 INFO:tasks.workunit.client.0.smithi148.stdout:2/546: chown d5/d8/d11/c99 133 1 2024-04-26T23:09:07.496 INFO:tasks.workunit.client.0.smithi148.stdout:3/415: dread d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:07.496 INFO:tasks.workunit.client.0.smithi148.stdout:3/416: write d9/d15/d29/f73 [3945312,25730] 0 2024-04-26T23:09:07.498 INFO:tasks.workunit.client.0.smithi148.stdout:4/408: creat d12/d1a/f79 x:0 0 0 2024-04-26T23:09:07.498 INFO:tasks.workunit.client.0.smithi148.stdout:4/409: stat d12/d1c/d45/d75 0 2024-04-26T23:09:07.498 INFO:tasks.workunit.client.0.smithi148.stdout:4/410: write d12/d17/f5a [654579,121953] 0 2024-04-26T23:09:07.500 INFO:tasks.workunit.client.0.smithi148.stdout:0/467: creat d0/d8/d95/d97/d3a/fa2 x:0 0 0 2024-04-26T23:09:07.506 INFO:tasks.workunit.client.0.smithi148.stdout:9/472: write d19/f1e [2056837,13470] 0 2024-04-26T23:09:07.506 INFO:tasks.workunit.client.0.smithi148.stdout:9/473: write d19/f9a [4829363,18596] 0 2024-04-26T23:09:07.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/411: dread d12/d2c/f46 [0,4194304] 0 2024-04-26T23:09:07.510 INFO:tasks.workunit.client.0.smithi148.stdout:1/425: rename d16/f30 to d16/d17/d68/d6b/d8b/f8e 0 2024-04-26T23:09:07.510 INFO:tasks.workunit.client.0.smithi148.stdout:7/422: dread d7/fe [0,4194304] 0 2024-04-26T23:09:07.510 INFO:tasks.workunit.client.0.smithi148.stdout:2/547: symlink d5/d17/d64/lb4 0 2024-04-26T23:09:07.510 INFO:tasks.workunit.client.0.smithi148.stdout:3/417: getdents d9/d15 0 2024-04-26T23:09:07.511 INFO:tasks.workunit.client.0.smithi148.stdout:0/468: rmdir d0/d2e/d8f/d6c 39 2024-04-26T23:09:07.511 INFO:tasks.workunit.client.0.smithi148.stdout:0/469: fsync d0/d8/d52/f30 0 2024-04-26T23:09:07.515 INFO:tasks.workunit.client.0.smithi148.stdout:5/492: rename da/d1b/d5b/f39 to da/d1f/d67/fb6 0 2024-04-26T23:09:07.517 INFO:tasks.workunit.client.0.smithi148.stdout:7/423: unlink d7/d11/f31 0 2024-04-26T23:09:07.517 INFO:tasks.workunit.client.0.smithi148.stdout:7/424: dread - d7/d75/f77 zero size 2024-04-26T23:09:07.519 INFO:tasks.workunit.client.0.smithi148.stdout:3/418: rmdir d9 39 2024-04-26T23:09:07.528 INFO:tasks.workunit.client.0.smithi148.stdout:4/412: rename d12/d2c to d12/d1c/d7a 0 2024-04-26T23:09:07.528 INFO:tasks.workunit.client.0.smithi148.stdout:4/413: chown d12/f14 35 1 2024-04-26T23:09:07.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/474: truncate d19/f1e 2361956 0 2024-04-26T23:09:07.529 INFO:tasks.workunit.client.0.smithi148.stdout:5/493: symlink da/d1b/d5b/lb7 0 2024-04-26T23:09:07.535 INFO:tasks.workunit.client.0.smithi148.stdout:3/419: mkdir d9/d65/d80/d83 0 2024-04-26T23:09:07.538 INFO:tasks.workunit.client.0.smithi148.stdout:6/416: sync 2024-04-26T23:09:07.538 INFO:tasks.workunit.client.0.smithi148.stdout:1/426: rename d16/d17/d4b/d55/l6a to d16/d17/d77/l8f 0 2024-04-26T23:09:07.538 INFO:tasks.workunit.client.0.smithi148.stdout:8/485: sync 2024-04-26T23:09:07.544 INFO:tasks.workunit.client.0.smithi148.stdout:5/494: mknod da/d12/d78/cb8 0 2024-04-26T23:09:07.546 INFO:tasks.workunit.client.0.smithi148.stdout:3/420: symlink d9/d31/l84 0 2024-04-26T23:09:07.546 INFO:tasks.workunit.client.0.smithi148.stdout:1/427: mkdir d16/d17/d4b/d55/d90 0 2024-04-26T23:09:07.547 INFO:tasks.workunit.client.0.smithi148.stdout:1/428: readlink d16/l23 0 2024-04-26T23:09:07.547 INFO:tasks.workunit.client.0.smithi148.stdout:8/486: creat d3/d9/d12/d23/d35/f90 x:0 0 0 2024-04-26T23:09:07.560 INFO:tasks.workunit.client.0.smithi148.stdout:6/417: dread d6/d9/d23/f57 [0,4194304] 0 2024-04-26T23:09:07.561 INFO:tasks.workunit.client.0.smithi148.stdout:5/495: creat da/d68/d69/daa/fb9 x:0 0 0 2024-04-26T23:09:07.561 INFO:tasks.workunit.client.0.smithi148.stdout:5/496: fsync da/f10 0 2024-04-26T23:09:07.563 INFO:tasks.workunit.client.0.smithi148.stdout:2/548: dwrite d5/d8/d11/f44 [0,4194304] 0 2024-04-26T23:09:07.563 INFO:tasks.workunit.client.0.smithi148.stdout:2/549: truncate d5/d8/d4b/d4e/d6d/da0/d32/d4c/f60 2368312 0 2024-04-26T23:09:07.563 INFO:tasks.workunit.client.0.smithi148.stdout:2/550: write d5/d8/d4b/d4e/d6d/da0/d32/d4c/f60 [1361851,14175] 0 2024-04-26T23:09:07.564 INFO:tasks.workunit.client.0.smithi148.stdout:1/429: unlink d16/d47/d49/l86 0 2024-04-26T23:09:07.567 INFO:tasks.workunit.client.0.smithi148.stdout:0/470: dwrite d0/d8/d5f/d72/f77 [0,4194304] 0 2024-04-26T23:09:07.568 INFO:tasks.workunit.client.0.smithi148.stdout:1/430: dread f15 [0,4194304] 0 2024-04-26T23:09:07.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/475: dread d19/d1d/d25/d2f/d4d/d33/d50/d57/f8d [0,4194304] 0 2024-04-26T23:09:07.595 INFO:tasks.workunit.client.0.smithi148.stdout:3/421: dread d9/d15/d29/d4d/f64 [0,4194304] 0 2024-04-26T23:09:07.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/425: dwrite d7/d19/f35 [0,4194304] 0 2024-04-26T23:09:07.642 INFO:tasks.workunit.client.0.smithi148.stdout:0/471: dwrite d0/d8/d1e/f28 [0,4194304] 0 2024-04-26T23:09:07.683 INFO:tasks.workunit.client.0.smithi148.stdout:0/472: dwrite d0/d5/f2c [4194304,4194304] 0 2024-04-26T23:09:07.683 INFO:tasks.workunit.client.0.smithi148.stdout:0/473: readlink d0/l4 0 2024-04-26T23:09:07.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/474: dwrite d0/d8/d33/d68/f9e [0,4194304] 0 2024-04-26T23:09:07.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/475: dread - d0/d8/d5f/f79 zero size 2024-04-26T23:09:07.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/476: fsync d0/d8/d1e/f23 0 2024-04-26T23:09:07.726 INFO:tasks.workunit.client.0.smithi148.stdout:0/477: write d0/d5/d84/f89 [971586,49132] 0 2024-04-26T23:09:07.815 INFO:tasks.workunit.client.0.smithi148.stdout:6/418: creat d6/d32/d4e/f85 x:0 0 0 2024-04-26T23:09:07.816 INFO:tasks.workunit.client.0.smithi148.stdout:2/551: mknod d5/d8/d4b/d4e/d6d/cb5 0 2024-04-26T23:09:07.821 INFO:tasks.workunit.client.0.smithi148.stdout:1/431: creat d16/d17/d68/f91 x:0 0 0 2024-04-26T23:09:07.826 INFO:tasks.workunit.client.0.smithi148.stdout:9/476: unlink cd 0 2024-04-26T23:09:07.826 INFO:tasks.workunit.client.0.smithi148.stdout:9/477: chown d19/d1d/d25/d31/d48/c4f 247293514 1 2024-04-26T23:09:07.828 INFO:tasks.workunit.client.0.smithi148.stdout:3/422: mknod d9/d15/d29/c85 0 2024-04-26T23:09:07.834 INFO:tasks.workunit.client.0.smithi148.stdout:7/426: getdents d7 0 2024-04-26T23:09:07.837 INFO:tasks.workunit.client.0.smithi148.stdout:2/552: read d5/d8/d4b/d4e/d6d/f8e [6413314,64790] 0 2024-04-26T23:09:07.843 INFO:tasks.workunit.client.0.smithi148.stdout:0/478: mknod d0/d8/d33/d43/d4e/ca3 0 2024-04-26T23:09:07.854 INFO:tasks.workunit.client.0.smithi148.stdout:9/478: symlink d19/d39/l9b 0 2024-04-26T23:09:07.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/423: creat d9/f86 x:0 0 0 2024-04-26T23:09:07.860 INFO:tasks.workunit.client.0.smithi148.stdout:6/419: dwrite d6/d32/d4e/f78 [0,4194304] 0 2024-04-26T23:09:07.860 INFO:tasks.workunit.client.0.smithi148.stdout:6/420: read - d6/d32/d66/f80 zero size 2024-04-26T23:09:07.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/427: symlink d7/l8d 0 2024-04-26T23:09:07.866 INFO:tasks.workunit.client.0.smithi148.stdout:9/479: creat d19/d22/f9c x:0 0 0 2024-04-26T23:09:07.872 INFO:tasks.workunit.client.0.smithi148.stdout:3/424: dread d9/f43 [0,4194304] 0 2024-04-26T23:09:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:8/487: sync 2024-04-26T23:09:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:4/414: sync 2024-04-26T23:09:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:8/488: chown d3/d9/d85/l56 2813228 1 2024-04-26T23:09:07.874 INFO:tasks.workunit.client.0.smithi148.stdout:7/428: readlink d7/l3b 0 2024-04-26T23:09:07.879 INFO:tasks.workunit.client.0.smithi148.stdout:0/479: rename d0/d5/f3f to d0/fa4 0 2024-04-26T23:09:07.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/497: sync 2024-04-26T23:09:07.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/498: fsync da/d68/d7a/f8c 0 2024-04-26T23:09:07.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/480: mknod d19/d1d/d25/d2f/d4d/d33/d50/d57/c9d 0 2024-04-26T23:09:07.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/425: mknod d9/d15/d29/d4d/d68/c87 0 2024-04-26T23:09:07.886 INFO:tasks.workunit.client.0.smithi148.stdout:8/489: mkdir d3/d9/d12/d23/d29/d77/d91 0 2024-04-26T23:09:07.894 INFO:tasks.workunit.client.0.smithi148.stdout:6/421: rename d6/d9/d23/d4a/c55 to d6/d32/d66/c86 0 2024-04-26T23:09:07.895 INFO:tasks.workunit.client.0.smithi148.stdout:5/499: stat da/f19 0 2024-04-26T23:09:07.899 INFO:tasks.workunit.client.0.smithi148.stdout:3/426: unlink d9/d15/d29/f7c 0 2024-04-26T23:09:07.904 INFO:tasks.workunit.client.0.smithi148.stdout:3/427: mkdir d9/d15/d29/d88 0 2024-04-26T23:09:07.905 INFO:tasks.workunit.client.0.smithi148.stdout:2/553: dwrite d5/d8/d11/dae/f6e [0,4194304] 0 2024-04-26T23:09:07.908 INFO:tasks.workunit.client.0.smithi148.stdout:0/480: rename d0/d8/c6d to d0/ca5 0 2024-04-26T23:09:07.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/428: dread d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:07.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/429: fsync d9/f2d 0 2024-04-26T23:09:07.913 INFO:tasks.workunit.client.0.smithi148.stdout:3/430: readlink d9/d52/l76 0 2024-04-26T23:09:07.914 INFO:tasks.workunit.client.0.smithi148.stdout:6/422: dread d6/f33 [4194304,4194304] 0 2024-04-26T23:09:07.915 INFO:tasks.workunit.client.0.smithi148.stdout:6/423: chown d6/d9/d1c/d1d/d1f/f7f 128755034 1 2024-04-26T23:09:07.915 INFO:tasks.workunit.client.0.smithi148.stdout:2/554: truncate d5/f16 849610 0 2024-04-26T23:09:07.915 INFO:tasks.workunit.client.0.smithi148.stdout:0/481: creat d0/d2e/d8f/d6c/fa6 x:0 0 0 2024-04-26T23:09:07.915 INFO:tasks.workunit.client.0.smithi148.stdout:0/482: chown d0/d8/d33/d6a 373 1 2024-04-26T23:09:07.916 INFO:tasks.workunit.client.0.smithi148.stdout:3/431: creat d9/d65/d80/d83/f89 x:0 0 0 2024-04-26T23:09:07.918 INFO:tasks.workunit.client.0.smithi148.stdout:2/555: creat d5/d1c/d38/fb6 x:0 0 0 2024-04-26T23:09:07.918 INFO:tasks.workunit.client.0.smithi148.stdout:2/556: readlink d5/d8/d4b/d4e/d6d/da0/d32/l33 0 2024-04-26T23:09:07.922 INFO:tasks.workunit.client.0.smithi148.stdout:0/483: creat d0/d8/d55/fa7 x:0 0 0 2024-04-26T23:09:07.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/432: creat d9/d4c/f8a x:0 0 0 2024-04-26T23:09:07.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/433: fdatasync d9/ff 0 2024-04-26T23:09:07.924 INFO:tasks.workunit.client.0.smithi148.stdout:3/434: symlink d9/d15/d29/d4d/d5b/l8b 0 2024-04-26T23:09:07.927 INFO:tasks.workunit.client.0.smithi148.stdout:4/415: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-04-26T23:09:07.927 INFO:tasks.workunit.client.0.smithi148.stdout:4/416: stat d12/f35 0 2024-04-26T23:09:07.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/417: chown d12/d1a/f77 9858815 1 2024-04-26T23:09:07.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/418: chown d12/d1c/d7a/f3f 268625003 1 2024-04-26T23:09:07.928 INFO:tasks.workunit.client.0.smithi148.stdout:3/435: unlink d9/d15/l70 0 2024-04-26T23:09:07.930 INFO:tasks.workunit.client.0.smithi148.stdout:3/436: mkdir d9/d15/d29/d4d/d68/d8c 0 2024-04-26T23:09:07.931 INFO:tasks.workunit.client.0.smithi148.stdout:4/419: symlink d12/d1c/d45/d75/l7b 0 2024-04-26T23:09:07.931 INFO:tasks.workunit.client.0.smithi148.stdout:4/420: chown d12/d1c/l63 2054977 1 2024-04-26T23:09:07.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/421: getdents d12/d17 0 2024-04-26T23:09:07.933 INFO:tasks.workunit.client.0.smithi148.stdout:4/422: write d12/f66 [353865,20008] 0 2024-04-26T23:09:07.933 INFO:tasks.workunit.client.0.smithi148.stdout:4/423: stat d12/d17/d2a/d33 0 2024-04-26T23:09:07.933 INFO:tasks.workunit.client.0.smithi148.stdout:4/424: fsync d12/d17/d2a/d33/f4e 0 2024-04-26T23:09:07.934 INFO:tasks.workunit.client.0.smithi148.stdout:4/425: rmdir d12/d1c/d7a 39 2024-04-26T23:09:07.935 INFO:tasks.workunit.client.0.smithi148.stdout:3/437: dread d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:07.936 INFO:tasks.workunit.client.0.smithi148.stdout:4/426: creat d12/d17/f7c x:0 0 0 2024-04-26T23:09:07.937 INFO:tasks.workunit.client.0.smithi148.stdout:4/427: dread - d12/f41 zero size 2024-04-26T23:09:07.937 INFO:tasks.workunit.client.0.smithi148.stdout:4/428: chown d12/c1d 432 1 2024-04-26T23:09:07.938 INFO:tasks.workunit.client.0.smithi148.stdout:3/438: mknod d9/d15/d29/c8d 0 2024-04-26T23:09:07.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/500: write da/d1a/f57 [3319512,28536] 0 2024-04-26T23:09:07.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/501: write da/d1b/d1c/f53 [361598,80932] 0 2024-04-26T23:09:07.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/502: stat da/d1f/d67/d71 0 2024-04-26T23:09:07.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/503: readlink da/d1b/d2d/d82/lab 0 2024-04-26T23:09:07.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/504: stat da 0 2024-04-26T23:09:07.940 INFO:tasks.workunit.client.0.smithi148.stdout:4/429: symlink d12/d17/l7d 0 2024-04-26T23:09:07.940 INFO:tasks.workunit.client.0.smithi148.stdout:4/430: dread - d12/d17/f7c zero size 2024-04-26T23:09:07.942 INFO:tasks.workunit.client.0.smithi148.stdout:5/505: unlink da/d1b/d3b/d73/f83 0 2024-04-26T23:09:07.945 INFO:tasks.workunit.client.0.smithi148.stdout:5/506: creat da/d1f/d47/fba x:0 0 0 2024-04-26T23:09:07.945 INFO:tasks.workunit.client.0.smithi148.stdout:5/507: readlink da/d1b/d5b/l4e 0 2024-04-26T23:09:07.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/490: dwrite d3/d9/d12/d23/d35/f66 [0,4194304] 0 2024-04-26T23:09:07.953 INFO:tasks.workunit.client.0.smithi148.stdout:5/508: link da/d1b/d2d/f48 da/d1b/d2d/da8/fbb 0 2024-04-26T23:09:07.953 INFO:tasks.workunit.client.0.smithi148.stdout:5/509: chown da/d1b/f93 1645530 1 2024-04-26T23:09:07.953 INFO:tasks.workunit.client.0.smithi148.stdout:5/510: write da/d1b/d1c/d7f/f95 [1039770,30567] 0 2024-04-26T23:09:07.955 INFO:tasks.workunit.client.0.smithi148.stdout:4/431: getdents d12/d1c/d45/d75 0 2024-04-26T23:09:07.958 INFO:tasks.workunit.client.0.smithi148.stdout:4/432: mknod d12/d17/d2a/c7e 0 2024-04-26T23:09:07.958 INFO:tasks.workunit.client.0.smithi148.stdout:4/433: fsync d12/d17/d2a/d33/f4e 0 2024-04-26T23:09:07.959 INFO:tasks.workunit.client.0.smithi148.stdout:4/434: link d12/d1c/d56/c74 d12/d17/d2a/c7f 0 2024-04-26T23:09:07.963 INFO:tasks.workunit.client.0.smithi148.stdout:4/435: rename d12/d1c/d7a/c54 to d12/d1c/d7a/c80 0 2024-04-26T23:09:07.963 INFO:tasks.workunit.client.0.smithi148.stdout:4/436: fdatasync d12/d17/d2a/d33/f4e 0 2024-04-26T23:09:07.964 INFO:tasks.workunit.client.0.smithi148.stdout:0/484: dwrite d0/d2e/d51/f60 [0,4194304] 0 2024-04-26T23:09:07.968 INFO:tasks.workunit.client.0.smithi148.stdout:4/437: symlink d12/d1c/d7a/l81 0 2024-04-26T23:09:07.969 INFO:tasks.workunit.client.0.smithi148.stdout:0/485: symlink d0/d8/d33/d43/d4e/la8 0 2024-04-26T23:09:07.969 INFO:tasks.workunit.client.0.smithi148.stdout:7/429: dread d7/d11/d29/d2e/d41/d67/f6b [0,4194304] 0 2024-04-26T23:09:07.978 INFO:tasks.workunit.client.0.smithi148.stdout:4/438: creat d12/d1c/d56/f82 x:0 0 0 2024-04-26T23:09:07.980 INFO:tasks.workunit.client.0.smithi148.stdout:0/486: unlink d0/f1b 0 2024-04-26T23:09:07.997 INFO:tasks.workunit.client.0.smithi148.stdout:0/487: rmdir d0/d8/d33/d68 39 2024-04-26T23:09:07.997 INFO:tasks.workunit.client.0.smithi148.stdout:4/439: creat d12/d1c/d7a/f83 x:0 0 0 2024-04-26T23:09:07.997 INFO:tasks.workunit.client.0.smithi148.stdout:0/488: fdatasync d0/d8/d1e/f28 0 2024-04-26T23:09:07.999 INFO:tasks.workunit.client.0.smithi148.stdout:4/440: symlink d12/d17/d2a/d37/l84 0 2024-04-26T23:09:07.999 INFO:tasks.workunit.client.0.smithi148.stdout:4/441: chown d12/d1c/d7a/l59 1003543 1 2024-04-26T23:09:08.001 INFO:tasks.workunit.client.0.smithi148.stdout:0/489: rename d0/d5/d84/f98 to d0/d2e/d8f/d6c/fa9 0 2024-04-26T23:09:08.001 INFO:tasks.workunit.client.0.smithi148.stdout:3/439: dwrite d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:08.001 INFO:tasks.workunit.client.0.smithi148.stdout:3/440: readlink d9/d15/d29/d4d/d7d/l82 0 2024-04-26T23:09:08.004 INFO:tasks.workunit.client.0.smithi148.stdout:4/442: link d12/d1c/f67 d12/d1c/f85 0 2024-04-26T23:09:08.008 INFO:tasks.workunit.client.0.smithi148.stdout:4/443: rename d12/d17/d2a/d33/f61 to d12/d1c/d56/f86 0 2024-04-26T23:09:08.008 INFO:tasks.workunit.client.0.smithi148.stdout:4/444: chown d12/d17/d2a/d33/f44 25871453 1 2024-04-26T23:09:08.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/445: chown d12/l50 302 1 2024-04-26T23:09:08.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/446: mkdir d12/d1c/d56/d87 0 2024-04-26T23:09:08.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/447: rename d12/d1a/f79 to d12/d17/d2a/d37/f88 0 2024-04-26T23:09:08.012 INFO:tasks.workunit.client.0.smithi148.stdout:4/448: mknod d12/d1c/d7a/c89 0 2024-04-26T23:09:08.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/441: write f5 [4772564,3028] 0 2024-04-26T23:09:08.034 INFO:tasks.workunit.client.0.smithi148.stdout:3/442: link d9/d15/d29/d4d/d6f/f74 d9/d15/d29/d4d/f8e 0 2024-04-26T23:09:08.051 INFO:tasks.workunit.client.0.smithi148.stdout:0/490: dwrite d0/d20/f8d [0,4194304] 0 2024-04-26T23:09:08.053 INFO:tasks.workunit.client.0.smithi148.stdout:0/491: creat d0/d8/d1e/faa x:0 0 0 2024-04-26T23:09:08.053 INFO:tasks.workunit.client.0.smithi148.stdout:0/492: readlink d0/l4 0 2024-04-26T23:09:08.053 INFO:tasks.workunit.client.0.smithi148.stdout:0/493: chown d0/d20/f40 38711902 1 2024-04-26T23:09:08.056 INFO:tasks.workunit.client.0.smithi148.stdout:3/443: read d9/ff [1061511,88997] 0 2024-04-26T23:09:08.061 INFO:tasks.workunit.client.0.smithi148.stdout:3/444: rmdir d9/d52 39 2024-04-26T23:09:08.067 INFO:tasks.workunit.client.0.smithi148.stdout:4/449: dwrite fd [0,4194304] 0 2024-04-26T23:09:08.068 INFO:tasks.workunit.client.0.smithi148.stdout:4/450: getdents d12/d1a 0 2024-04-26T23:09:08.070 INFO:tasks.workunit.client.0.smithi148.stdout:4/451: symlink d12/d1c/d56/l8a 0 2024-04-26T23:09:08.070 INFO:tasks.workunit.client.0.smithi148.stdout:4/452: write d12/d1c/d7a/f83 [800919,93906] 0 2024-04-26T23:09:08.070 INFO:tasks.workunit.client.0.smithi148.stdout:4/453: write d12/d1a/f23 [968815,97961] 0 2024-04-26T23:09:08.076 INFO:tasks.workunit.client.0.smithi148.stdout:4/454: link d12/d1c/f73 d12/d1c/f8b 0 2024-04-26T23:09:08.087 INFO:tasks.workunit.client.0.smithi148.stdout:0/494: dwrite d0/fa4 [0,4194304] 0 2024-04-26T23:09:08.104 INFO:tasks.workunit.client.0.smithi148.stdout:6/424: dwrite d6/f33 [0,4194304] 0 2024-04-26T23:09:08.104 INFO:tasks.workunit.client.0.smithi148.stdout:6/425: fsync d6/d32/d4e/f85 0 2024-04-26T23:09:08.105 INFO:tasks.workunit.client.0.smithi148.stdout:0/495: read d0/d2e/d51/f60 [2086452,14043] 0 2024-04-26T23:09:08.107 INFO:tasks.workunit.client.0.smithi148.stdout:6/426: creat d6/d9/d1c/d1d/d1f/f87 x:0 0 0 2024-04-26T23:09:08.107 INFO:tasks.workunit.client.0.smithi148.stdout:6/427: fsync d6/f6f 0 2024-04-26T23:09:08.113 INFO:tasks.workunit.client.0.smithi148.stdout:0/496: rename d0/d8/d55 to d0/d2e/d8f/d6c/dab 0 2024-04-26T23:09:08.114 INFO:tasks.workunit.client.0.smithi148.stdout:6/428: getdents d6/dc 0 2024-04-26T23:09:08.116 INFO:tasks.workunit.client.0.smithi148.stdout:0/497: symlink d0/d8/d33/d68/lac 0 2024-04-26T23:09:08.118 INFO:tasks.workunit.client.0.smithi148.stdout:6/429: creat d6/d9/d1e/d69/f88 x:0 0 0 2024-04-26T23:09:08.118 INFO:tasks.workunit.client.0.smithi148.stdout:6/430: fdatasync d6/d9/d23/d4a/f67 0 2024-04-26T23:09:08.118 INFO:tasks.workunit.client.0.smithi148.stdout:0/498: getdents d0/d5/d84 0 2024-04-26T23:09:08.118 INFO:tasks.workunit.client.0.smithi148.stdout:0/499: chown d0/d20/c34 3946799 1 2024-04-26T23:09:08.118 INFO:tasks.workunit.client.0.smithi148.stdout:0/500: truncate d0/d2e/d8f/d6c/fa6 157762 0 2024-04-26T23:09:08.124 INFO:tasks.workunit.client.0.smithi148.stdout:5/511: dread da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:08.124 INFO:tasks.workunit.client.0.smithi148.stdout:4/455: dwrite d12/f72 [0,4194304] 0 2024-04-26T23:09:08.129 INFO:tasks.workunit.client.0.smithi148.stdout:4/456: rename d12/d1c/d7a to d12/d1c/d45/d8c 0 2024-04-26T23:09:08.129 INFO:tasks.workunit.client.0.smithi148.stdout:4/457: write d12/d1a/f3d [393137,51013] 0 2024-04-26T23:09:08.129 INFO:tasks.workunit.client.0.smithi148.stdout:4/458: fsync d12/d17/d2a/d33/f4e 0 2024-04-26T23:09:08.133 INFO:tasks.workunit.client.0.smithi148.stdout:3/445: read d9/d15/d29/f37 [5602884,7386] 0 2024-04-26T23:09:08.134 INFO:tasks.workunit.client.0.smithi148.stdout:8/491: dwrite d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:08.134 INFO:tasks.workunit.client.0.smithi148.stdout:8/492: stat d3/da/c26 0 2024-04-26T23:09:08.135 INFO:tasks.workunit.client.0.smithi148.stdout:3/446: mkdir d9/d31/d8f 0 2024-04-26T23:09:08.137 INFO:tasks.workunit.client.0.smithi148.stdout:8/493: creat d3/da/d1c/d7c/d8c/f92 x:0 0 0 2024-04-26T23:09:08.138 INFO:tasks.workunit.client.0.smithi148.stdout:8/494: write d3/d9/d12/d23/d29/d37/f3e [5208533,7963] 0 2024-04-26T23:09:08.138 INFO:tasks.workunit.client.0.smithi148.stdout:1/432: sync 2024-04-26T23:09:08.139 INFO:tasks.workunit.client.0.smithi148.stdout:1/433: write f5 [1521493,124586] 0 2024-04-26T23:09:08.141 INFO:tasks.workunit.client.0.smithi148.stdout:8/495: creat d3/d87/f93 x:0 0 0 2024-04-26T23:09:08.141 INFO:tasks.workunit.client.0.smithi148.stdout:8/496: truncate d3/da/d1c/d7c/d8c/f92 42211 0 2024-04-26T23:09:08.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/434: rename c6 to d16/d47/d73/c92 0 2024-04-26T23:09:08.148 INFO:tasks.workunit.client.0.smithi148.stdout:4/459: dread d12/d1c/f85 [0,4194304] 0 2024-04-26T23:09:08.149 INFO:tasks.workunit.client.0.smithi148.stdout:4/460: readlink d12/d1c/d45/d8c/l59 0 2024-04-26T23:09:08.149 INFO:tasks.workunit.client.0.smithi148.stdout:4/461: fsync d12/d17/d2a/d37/f42 0 2024-04-26T23:09:08.149 INFO:tasks.workunit.client.0.smithi148.stdout:6/431: read d6/f5c [776035,37431] 0 2024-04-26T23:09:08.149 INFO:tasks.workunit.client.0.smithi148.stdout:6/432: symlink d6/d9/d23/d4a/l89 0 2024-04-26T23:09:08.150 INFO:tasks.workunit.client.0.smithi148.stdout:6/433: dread - d6/d9/f7c zero size 2024-04-26T23:09:08.151 INFO:tasks.workunit.client.0.smithi148.stdout:0/501: write d0/d2e/f35 [39577,59099] 0 2024-04-26T23:09:08.155 INFO:tasks.workunit.client.0.smithi148.stdout:0/502: creat d0/d8/fad x:0 0 0 2024-04-26T23:09:08.166 INFO:tasks.workunit.client.0.smithi148.stdout:1/435: write d16/d45/d2b/f31 [796370,99697] 0 2024-04-26T23:09:08.169 INFO:tasks.workunit.client.0.smithi148.stdout:5/512: dwrite da/d1f/f49 [0,4194304] 0 2024-04-26T23:09:08.169 INFO:tasks.workunit.client.0.smithi148.stdout:1/436: link d16/d1c/f32 d16/d17/f93 0 2024-04-26T23:09:08.171 INFO:tasks.workunit.client.0.smithi148.stdout:5/513: mknod da/d68/d69/cbc 0 2024-04-26T23:09:08.172 INFO:tasks.workunit.client.0.smithi148.stdout:5/514: truncate da/fc 1574716 0 2024-04-26T23:09:08.172 INFO:tasks.workunit.client.0.smithi148.stdout:5/515: chown da/d1b/d1c/c38 1623745 1 2024-04-26T23:09:08.177 INFO:tasks.workunit.client.0.smithi148.stdout:1/437: stat d16/d17/d4b/d53/d67/c74 0 2024-04-26T23:09:08.177 INFO:tasks.workunit.client.0.smithi148.stdout:5/516: link da/d1b/d5b/lb7 da/d68/lbd 0 2024-04-26T23:09:08.184 INFO:tasks.workunit.client.0.smithi148.stdout:5/517: write da/d1b/d1c/f36 [2622468,36852] 0 2024-04-26T23:09:08.185 INFO:tasks.workunit.client.0.smithi148.stdout:5/518: symlink da/d1b/d3b/d73/lbe 0 2024-04-26T23:09:08.185 INFO:tasks.workunit.client.0.smithi148.stdout:5/519: stat da/d68/d7a 0 2024-04-26T23:09:08.185 INFO:tasks.workunit.client.0.smithi148.stdout:6/434: dread d6/f43 [0,4194304] 0 2024-04-26T23:09:08.186 INFO:tasks.workunit.client.0.smithi148.stdout:6/435: dread - d6/d9/d1c/d1d/d1f/f7f zero size 2024-04-26T23:09:08.187 INFO:tasks.workunit.client.0.smithi148.stdout:6/436: getdents d6/d9/d1c/d1d/d1f 0 2024-04-26T23:09:08.189 INFO:tasks.workunit.client.0.smithi148.stdout:5/520: rename da/d1b/d3b/d73/d97/fb1 to da/d1a/fbf 0 2024-04-26T23:09:08.189 INFO:tasks.workunit.client.0.smithi148.stdout:6/437: stat d6/d14/c3b 0 2024-04-26T23:09:08.189 INFO:tasks.workunit.client.0.smithi148.stdout:6/438: write d6/d9/d1c/f5d [482058,99850] 0 2024-04-26T23:09:08.189 INFO:tasks.workunit.client.0.smithi148.stdout:6/439: write d6/d9/d1e/f79 [799336,82116] 0 2024-04-26T23:09:08.189 INFO:tasks.workunit.client.0.smithi148.stdout:6/440: stat d6/d9/d1c/d5b/l77 0 2024-04-26T23:09:08.190 INFO:tasks.workunit.client.0.smithi148.stdout:5/521: write da/d1a/f1e [2664055,122490] 0 2024-04-26T23:09:08.191 INFO:tasks.workunit.client.0.smithi148.stdout:1/438: write d16/d17/f28 [646277,79307] 0 2024-04-26T23:09:08.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/462: dwrite d12/d17/d2a/d33/f4c [0,4194304] 0 2024-04-26T23:09:08.191 INFO:tasks.workunit.client.0.smithi148.stdout:1/439: fdatasync d16/d45/d2b/d3e/f7e 0 2024-04-26T23:09:08.192 INFO:tasks.workunit.client.0.smithi148.stdout:5/522: unlink da/f7c 0 2024-04-26T23:09:08.194 INFO:tasks.workunit.client.0.smithi148.stdout:1/440: unlink d16/d1c/l21 0 2024-04-26T23:09:08.196 INFO:tasks.workunit.client.0.smithi148.stdout:5/523: mkdir da/d68/d69/daa/dc0 0 2024-04-26T23:09:08.198 INFO:tasks.workunit.client.0.smithi148.stdout:1/441: mkdir d16/d1c/d84/d94 0 2024-04-26T23:09:08.200 INFO:tasks.workunit.client.0.smithi148.stdout:5/524: symlink da/d12/lc1 0 2024-04-26T23:09:08.202 INFO:tasks.workunit.client.0.smithi148.stdout:5/525: mkdir da/d1a/dc2 0 2024-04-26T23:09:08.203 INFO:tasks.workunit.client.0.smithi148.stdout:5/526: rmdir da/d12 39 2024-04-26T23:09:08.203 INFO:tasks.workunit.client.0.smithi148.stdout:5/527: fdatasync da/d1b/f93 0 2024-04-26T23:09:08.204 INFO:tasks.workunit.client.0.smithi148.stdout:5/528: rename da/d1a/f57 to da/d1b/d3b/d72/fc3 0 2024-04-26T23:09:08.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/447: dwrite d9/d15/f28 [0,4194304] 0 2024-04-26T23:09:08.212 INFO:tasks.workunit.client.0.smithi148.stdout:3/448: fsync d9/d15/d29/f56 0 2024-04-26T23:09:08.228 INFO:tasks.workunit.client.0.smithi148.stdout:4/463: dread d12/f4a [0,4194304] 0 2024-04-26T23:09:08.229 INFO:tasks.workunit.client.0.smithi148.stdout:4/464: chown d12/d17/d2a/d37/f5c 22841 1 2024-04-26T23:09:08.230 INFO:tasks.workunit.client.0.smithi148.stdout:1/442: write d16/f4a [648905,10948] 0 2024-04-26T23:09:08.230 INFO:tasks.workunit.client.0.smithi148.stdout:1/443: truncate d16/f4a 1705984 0 2024-04-26T23:09:08.247 INFO:tasks.workunit.client.0.smithi148.stdout:6/441: dwrite d6/d32/d66/f80 [0,4194304] 0 2024-04-26T23:09:08.247 INFO:tasks.workunit.client.0.smithi148.stdout:6/442: readlink d6/d32/d66/l6b 0 2024-04-26T23:09:08.247 INFO:tasks.workunit.client.0.smithi148.stdout:6/443: write d6/d9/d1e/d69/f88 [166117,64336] 0 2024-04-26T23:09:08.250 INFO:tasks.workunit.client.0.smithi148.stdout:6/444: mkdir d6/d32/d8a 0 2024-04-26T23:09:08.250 INFO:tasks.workunit.client.0.smithi148.stdout:6/445: readlink d6/d9/d1c/d1d/d1f/l71 0 2024-04-26T23:09:08.252 INFO:tasks.workunit.client.0.smithi148.stdout:6/446: rename d6/f5c to d6/d32/f8b 0 2024-04-26T23:09:08.254 INFO:tasks.workunit.client.0.smithi148.stdout:6/447: mknod d6/d9/d1c/d1d/c8c 0 2024-04-26T23:09:08.255 INFO:tasks.workunit.client.0.smithi148.stdout:1/444: dread d16/d17/f25 [0,4194304] 0 2024-04-26T23:09:08.255 INFO:tasks.workunit.client.0.smithi148.stdout:1/445: dread - d16/d45/d2b/d6e/f75 zero size 2024-04-26T23:09:08.255 INFO:tasks.workunit.client.0.smithi148.stdout:1/446: write d16/d1c/d84/f88 [603594,30794] 0 2024-04-26T23:09:08.269 INFO:tasks.workunit.client.0.smithi148.stdout:6/448: dread d6/dc/f45 [0,4194304] 0 2024-04-26T23:09:08.280 INFO:tasks.workunit.client.0.smithi148.stdout:0/503: dwrite d0/d8/f42 [0,4194304] 0 2024-04-26T23:09:08.284 INFO:tasks.workunit.client.0.smithi148.stdout:0/504: rename d0/d8/d1e/f28 to d0/d8/d5f/fae 0 2024-04-26T23:09:08.284 INFO:tasks.workunit.client.0.smithi148.stdout:0/505: chown d0/d8/d5f/fae 3345742 1 2024-04-26T23:09:08.289 INFO:tasks.workunit.client.0.smithi148.stdout:0/506: mkdir d0/d2e/d51/daf 0 2024-04-26T23:09:08.302 INFO:tasks.workunit.client.0.smithi148.stdout:0/507: write d0/d8/d1e/f2a [131883,88135] 0 2024-04-26T23:09:08.302 INFO:tasks.workunit.client.0.smithi148.stdout:0/508: chown d0/d20/d54/c7d 973598350 1 2024-04-26T23:09:08.304 INFO:tasks.workunit.client.0.smithi148.stdout:4/465: dwrite d12/d17/d2a/d37/f5c [4194304,4194304] 0 2024-04-26T23:09:08.304 INFO:tasks.workunit.client.0.smithi148.stdout:5/529: dwrite da/f10 [0,4194304] 0 2024-04-26T23:09:08.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/466: creat d12/d1a/f8d x:0 0 0 2024-04-26T23:09:08.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/467: write d12/d1a/f77 [882172,74971] 0 2024-04-26T23:09:08.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/468: stat d12/d1c 0 2024-04-26T23:09:08.309 INFO:tasks.workunit.client.0.smithi148.stdout:5/530: creat da/d1b/d2d/d82/fc4 x:0 0 0 2024-04-26T23:09:08.309 INFO:tasks.workunit.client.0.smithi148.stdout:5/531: chown da/d1b/d3b/d73/d97/fac 14242765 1 2024-04-26T23:09:08.310 INFO:tasks.workunit.client.0.smithi148.stdout:4/469: creat d12/d1a/f8e x:0 0 0 2024-04-26T23:09:08.311 INFO:tasks.workunit.client.0.smithi148.stdout:4/470: creat d12/f8f x:0 0 0 2024-04-26T23:09:08.311 INFO:tasks.workunit.client.0.smithi148.stdout:4/471: rmdir d12/d17/d2a/d37 39 2024-04-26T23:09:08.313 INFO:tasks.workunit.client.0.smithi148.stdout:4/472: unlink d12/d1c/f51 0 2024-04-26T23:09:08.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/473: unlink d12/f14 0 2024-04-26T23:09:08.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/474: truncate d12/d1c/f4b 410626 0 2024-04-26T23:09:08.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/475: stat d12/d17/f2e 0 2024-04-26T23:09:08.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/476: write d12/d17/f5a [1503003,90913] 0 2024-04-26T23:09:08.315 INFO:tasks.workunit.client.0.smithi148.stdout:4/477: getdents d12/d1c/d56 0 2024-04-26T23:09:08.315 INFO:tasks.workunit.client.0.smithi148.stdout:4/478: write d12/f8f [321964,12730] 0 2024-04-26T23:09:08.316 INFO:tasks.workunit.client.0.smithi148.stdout:4/479: creat d12/d17/d2a/d33/f90 x:0 0 0 2024-04-26T23:09:08.316 INFO:tasks.workunit.client.0.smithi148.stdout:4/480: fsync d12/f35 0 2024-04-26T23:09:08.317 INFO:tasks.workunit.client.0.smithi148.stdout:4/481: truncate d12/d1c/f67 3526609 0 2024-04-26T23:09:08.336 INFO:tasks.workunit.client.0.smithi148.stdout:5/532: write da/d12/f8f [2691187,16231] 0 2024-04-26T23:09:08.336 INFO:tasks.workunit.client.0.smithi148.stdout:5/533: fdatasync da/d12/f8e 0 2024-04-26T23:09:08.339 INFO:tasks.workunit.client.0.smithi148.stdout:4/482: dread d12/f72 [0,4194304] 0 2024-04-26T23:09:08.340 INFO:tasks.workunit.client.0.smithi148.stdout:4/483: mknod d12/d17/c91 0 2024-04-26T23:09:08.342 INFO:tasks.workunit.client.0.smithi148.stdout:4/484: rename d12/d17/c21 to d12/c92 0 2024-04-26T23:09:08.343 INFO:tasks.workunit.client.0.smithi148.stdout:4/485: mknod d12/d1c/d45/d8c/c93 0 2024-04-26T23:09:08.343 INFO:tasks.workunit.client.0.smithi148.stdout:4/486: chown d12/c15 2641906 1 2024-04-26T23:09:08.345 INFO:tasks.workunit.client.0.smithi148.stdout:4/487: mknod d12/d1c/c94 0 2024-04-26T23:09:08.346 INFO:tasks.workunit.client.0.smithi148.stdout:4/488: mknod d12/d17/d2a/d37/c95 0 2024-04-26T23:09:08.355 INFO:tasks.workunit.client.0.smithi148.stdout:0/509: dwrite d0/f90 [0,4194304] 0 2024-04-26T23:09:08.356 INFO:tasks.workunit.client.0.smithi148.stdout:0/510: write d0/d2e/d8f/d6c/fa9 [271304,78833] 0 2024-04-26T23:09:08.358 INFO:tasks.workunit.client.0.smithi148.stdout:0/511: symlink d0/d5/d84/lb0 0 2024-04-26T23:09:08.358 INFO:tasks.workunit.client.0.smithi148.stdout:0/512: fdatasync d0/d5/d84/f89 0 2024-04-26T23:09:08.359 INFO:tasks.workunit.client.0.smithi148.stdout:0/513: truncate d0/d5/f7 3670494 0 2024-04-26T23:09:08.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/514: write d0/d8/d33/d68/f76 [962957,30134] 0 2024-04-26T23:09:08.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/515: read - d0/d8/d33/f45 zero size 2024-04-26T23:09:08.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/516: write d0/f62 [556882,124721] 0 2024-04-26T23:09:08.364 INFO:tasks.workunit.client.0.smithi148.stdout:0/517: mkdir d0/d8/d95/d97/d3a/db1 0 2024-04-26T23:09:08.365 INFO:tasks.workunit.client.0.smithi148.stdout:0/518: link d0/d8/d33/d6a/l91 d0/d8/d52/lb2 0 2024-04-26T23:09:08.368 INFO:tasks.workunit.client.0.smithi148.stdout:0/519: creat d0/d8/d52/fb3 x:0 0 0 2024-04-26T23:09:08.368 INFO:tasks.workunit.client.0.smithi148.stdout:0/520: write d0/d2e/d8f/f7c [272720,92575] 0 2024-04-26T23:09:08.369 INFO:tasks.workunit.client.0.smithi148.stdout:5/534: dwrite da/d1b/d1c/f30 [0,4194304] 0 2024-04-26T23:09:08.423 INFO:tasks.workunit.client.0.smithi148.stdout:3/449: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:09:08.425 INFO:tasks.workunit.client.0.smithi148.stdout:3/450: truncate d9/d4c/f5f 10850 0 2024-04-26T23:09:08.431 INFO:tasks.workunit.client.0.smithi148.stdout:3/451: dread d9/d15/d29/f3b [0,4194304] 0 2024-04-26T23:09:08.435 INFO:tasks.workunit.client.0.smithi148.stdout:3/452: rmdir d9/d15/d29/d4d/d6f 39 2024-04-26T23:09:08.438 INFO:tasks.workunit.client.0.smithi148.stdout:6/449: dwrite d6/dc/f42 [0,4194304] 0 2024-04-26T23:09:08.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/450: write d6/d32/f8b [2758919,110013] 0 2024-04-26T23:09:08.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/451: write d6/d9/d23/d4a/f67 [894350,56803] 0 2024-04-26T23:09:08.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/452: stat d6/d9/d1c/d1d 0 2024-04-26T23:09:08.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/453: write d6/f6f [1001018,113308] 0 2024-04-26T23:09:08.440 INFO:tasks.workunit.client.0.smithi148.stdout:3/453: rename d9/d15/d29/d4d/d7d/l82 to d9/d15/d29/d4d/l90 0 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:9/481: sync 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/557: sync 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/430: sync 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/558: stat d5/d8/d15/f45 0 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/431: chown d7/d11/d29/c36 48373558 1 2024-04-26T23:09:08.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/559: fdatasync d5/d8/d9/f4a 0 2024-04-26T23:09:08.461 INFO:tasks.workunit.client.0.smithi148.stdout:6/454: mknod d6/d9/d23/d4a/c8d 0 2024-04-26T23:09:08.462 INFO:tasks.workunit.client.0.smithi148.stdout:3/454: rename d9/d15/d29/d4d/d5b/f5e to d9/d65/f91 0 2024-04-26T23:09:08.463 INFO:tasks.workunit.client.0.smithi148.stdout:6/455: mknod d6/d9/d1c/d1d/d1f/d40/c8e 0 2024-04-26T23:09:08.464 INFO:tasks.workunit.client.0.smithi148.stdout:6/456: readlink d6/d32/l81 0 2024-04-26T23:09:08.477 INFO:tasks.workunit.client.0.smithi148.stdout:4/489: write d12/d17/d2a/d37/f5c [1929944,85474] 0 2024-04-26T23:09:08.477 INFO:tasks.workunit.client.0.smithi148.stdout:4/490: chown d12/d17/d2a/d33/l6a 11798325 1 2024-04-26T23:09:08.490 INFO:tasks.workunit.client.0.smithi148.stdout:3/455: creat d9/d15/f92 x:0 0 0 2024-04-26T23:09:08.490 INFO:tasks.workunit.client.0.smithi148.stdout:3/456: write d9/d15/d29/d4d/f64 [776361,5138] 0 2024-04-26T23:09:08.491 INFO:tasks.workunit.client.0.smithi148.stdout:7/432: creat d7/d75/f8e x:0 0 0 2024-04-26T23:09:08.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/491: creat d12/d1c/d56/d87/f96 x:0 0 0 2024-04-26T23:09:08.492 INFO:tasks.workunit.client.0.smithi148.stdout:3/457: creat d9/f93 x:0 0 0 2024-04-26T23:09:08.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/458: fdatasync d9/d15/d29/d4d/f64 0 2024-04-26T23:09:08.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/459: truncate d9/d15/f19 4926161 0 2024-04-26T23:09:08.498 INFO:tasks.workunit.client.0.smithi148.stdout:7/433: mknod d7/d11/c8f 0 2024-04-26T23:09:08.500 INFO:tasks.workunit.client.0.smithi148.stdout:2/560: write d5/d8/d9/f79 [2114506,5414] 0 2024-04-26T23:09:08.500 INFO:tasks.workunit.client.0.smithi148.stdout:2/561: write d5/d1c/d38/f98 [370341,93886] 0 2024-04-26T23:09:08.500 INFO:tasks.workunit.client.0.smithi148.stdout:2/562: readlink d5/d8/d4b/d4e/d6d/da0/d32/l33 0 2024-04-26T23:09:08.501 INFO:tasks.workunit.client.0.smithi148.stdout:2/563: readlink d5/d8/d4b/d4e/d6d/da0/d32/l71 0 2024-04-26T23:09:08.505 INFO:tasks.workunit.client.0.smithi148.stdout:4/492: mkdir d12/d17/d2a/d37/d97 0 2024-04-26T23:09:08.505 INFO:tasks.workunit.client.0.smithi148.stdout:4/493: truncate d12/d1c/d56/d87/f96 724385 0 2024-04-26T23:09:08.514 INFO:tasks.workunit.client.0.smithi148.stdout:3/460: unlink d9/l49 0 2024-04-26T23:09:08.515 INFO:tasks.workunit.client.0.smithi148.stdout:3/461: write d9/d15/d29/f45 [1459784,121603] 0 2024-04-26T23:09:08.515 INFO:tasks.workunit.client.0.smithi148.stdout:3/462: dread - d9/d15/d29/d4d/d6f/f74 zero size 2024-04-26T23:09:08.516 INFO:tasks.workunit.client.0.smithi148.stdout:4/494: truncate d12/d1c/f85 1880947 0 2024-04-26T23:09:08.528 INFO:tasks.workunit.client.0.smithi148.stdout:5/535: dwrite da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:08.529 INFO:tasks.workunit.client.0.smithi148.stdout:0/521: dwrite d0/d8/d5f/f79 [0,4194304] 0 2024-04-26T23:09:08.531 INFO:tasks.workunit.client.0.smithi148.stdout:3/463: link d9/f11 d9/f94 0 2024-04-26T23:09:08.531 INFO:tasks.workunit.client.0.smithi148.stdout:4/495: rmdir d12/d1c/d45/d75 39 2024-04-26T23:09:08.535 INFO:tasks.workunit.client.0.smithi148.stdout:5/536: rmdir da/d1b/d2d/d82 39 2024-04-26T23:09:08.538 INFO:tasks.workunit.client.0.smithi148.stdout:0/522: mkdir d0/d2e/d51/d9d/db4 0 2024-04-26T23:09:08.538 INFO:tasks.workunit.client.0.smithi148.stdout:0/523: readlink d0/d2e/d8f/d6c/l9b 0 2024-04-26T23:09:08.552 INFO:tasks.workunit.client.0.smithi148.stdout:7/434: dwrite d7/d11/d17/f3c [0,4194304] 0 2024-04-26T23:09:08.552 INFO:tasks.workunit.client.0.smithi148.stdout:7/435: chown d7/d11/d17/d2f/c46 141043 1 2024-04-26T23:09:08.555 INFO:tasks.workunit.client.0.smithi148.stdout:3/464: creat d9/d31/f95 x:0 0 0 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/496: truncate d12/d1c/f85 33752 0 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/497: chown d12/d17/d2a/f2d 428 1 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/498: dread - d12/d1c/f71 zero size 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/499: chown d12/d17/f2e 24 1 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/500: write d12/d17/d2a/d37/f62 [963329,79573] 0 2024-04-26T23:09:08.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/501: read d12/d17/d2a/d33/f44 [973112,971] 0 2024-04-26T23:09:08.567 INFO:tasks.workunit.client.0.smithi148.stdout:1/447: sync 2024-04-26T23:09:08.567 INFO:tasks.workunit.client.0.smithi148.stdout:8/497: sync 2024-04-26T23:09:08.581 INFO:tasks.workunit.client.0.smithi148.stdout:7/436: rmdir d7/d11/d17 39 2024-04-26T23:09:08.581 INFO:tasks.workunit.client.0.smithi148.stdout:8/498: read d3/d9/d12/d23/f7b [10088935,108191] 0 2024-04-26T23:09:08.582 INFO:tasks.workunit.client.0.smithi148.stdout:3/465: rename d9/d31/f3c to d9/d15/d29/d4d/d68/f96 0 2024-04-26T23:09:08.583 INFO:tasks.workunit.client.0.smithi148.stdout:1/448: mkdir d16/d47/d49/d95 0 2024-04-26T23:09:08.583 INFO:tasks.workunit.client.0.smithi148.stdout:1/449: readlink d16/d17/d4b/d59/l7a 0 2024-04-26T23:09:08.584 INFO:tasks.workunit.client.0.smithi148.stdout:7/437: creat d7/f90 x:0 0 0 2024-04-26T23:09:08.594 INFO:tasks.workunit.client.0.smithi148.stdout:8/499: dread d3/d9/d12/d23/d35/f47 [0,4194304] 0 2024-04-26T23:09:08.595 INFO:tasks.workunit.client.0.smithi148.stdout:1/450: symlink d16/d45/l96 0 2024-04-26T23:09:08.595 INFO:tasks.workunit.client.0.smithi148.stdout:1/451: fdatasync d16/d17/d77/f80 0 2024-04-26T23:09:08.609 INFO:tasks.workunit.client.0.smithi148.stdout:0/524: dread d0/d2e/f35 [0,4194304] 0 2024-04-26T23:09:08.611 INFO:tasks.workunit.client.0.smithi148.stdout:8/500: creat d3/d9/d12/d23/d35/f94 x:0 0 0 2024-04-26T23:09:08.611 INFO:tasks.workunit.client.0.smithi148.stdout:8/501: fsync d3/d9/d12/d23/d35/f82 0 2024-04-26T23:09:08.611 INFO:tasks.workunit.client.0.smithi148.stdout:8/502: write d3/d9/d12/d23/d65/f68 [91206,102941] 0 2024-04-26T23:09:08.611 INFO:tasks.workunit.client.0.smithi148.stdout:8/503: readlink d3/d9/d12/d23/d29/l67 0 2024-04-26T23:09:08.617 INFO:tasks.workunit.client.0.smithi148.stdout:3/466: dwrite d9/d31/f55 [0,4194304] 0 2024-04-26T23:09:08.618 INFO:tasks.workunit.client.0.smithi148.stdout:1/452: dread d16/d1c/f33 [0,4194304] 0 2024-04-26T23:09:08.618 INFO:tasks.workunit.client.0.smithi148.stdout:3/467: read d9/d15/d29/f3b [390340,49795] 0 2024-04-26T23:09:08.618 INFO:tasks.workunit.client.0.smithi148.stdout:0/525: write d0/f2 [1735513,122480] 0 2024-04-26T23:09:08.624 INFO:tasks.workunit.client.0.smithi148.stdout:7/438: rename d7/d19/f23 to d7/d75/f91 0 2024-04-26T23:09:08.624 INFO:tasks.workunit.client.0.smithi148.stdout:1/453: unlink d16/d17/d4b/d55/l7b 0 2024-04-26T23:09:08.625 INFO:tasks.workunit.client.0.smithi148.stdout:3/468: rmdir d9/d15 39 2024-04-26T23:09:08.634 INFO:tasks.workunit.client.0.smithi148.stdout:7/439: write d7/d11/d29/d2e/f32 [6015029,124661] 0 2024-04-26T23:09:08.634 INFO:tasks.workunit.client.0.smithi148.stdout:7/440: dread - d7/d11/f71 zero size 2024-04-26T23:09:08.635 INFO:tasks.workunit.client.0.smithi148.stdout:3/469: dread d9/f11 [0,4194304] 0 2024-04-26T23:09:08.679 INFO:tasks.workunit.client.0.smithi148.stdout:4/502: dwrite d12/d17/d2a/d37/f5c [0,4194304] 0 2024-04-26T23:09:08.781 INFO:tasks.workunit.client.0.smithi148.stdout:7/441: unlink d7/d11/d29/f5f 0 2024-04-26T23:09:08.783 INFO:tasks.workunit.client.0.smithi148.stdout:3/470: creat d9/d15/d29/d4d/d6f/f97 x:0 0 0 2024-04-26T23:09:08.797 INFO:tasks.workunit.client.0.smithi148.stdout:4/503: mknod d12/d17/d2a/d33/c98 0 2024-04-26T23:09:08.823 INFO:tasks.workunit.client.0.smithi148.stdout:1/454: dwrite d16/f4e [0,4194304] 0 2024-04-26T23:09:08.846 INFO:tasks.workunit.client.0.smithi148.stdout:7/442: write d7/d75/f21 [3813349,117254] 0 2024-04-26T23:09:08.853 INFO:tasks.workunit.client.0.smithi148.stdout:1/455: dread d16/f1d [0,4194304] 0 2024-04-26T23:09:08.854 INFO:tasks.workunit.client.0.smithi148.stdout:3/471: dwrite d9/d15/f27 [4194304,4194304] 0 2024-04-26T23:09:08.860 INFO:tasks.workunit.client.0.smithi148.stdout:7/443: rename d7/d75/f21 to d7/d11/d17/d7c/f92 0 2024-04-26T23:09:08.862 INFO:tasks.workunit.client.0.smithi148.stdout:1/456: creat d16/d17/d4b/d55/d90/f97 x:0 0 0 2024-04-26T23:09:08.867 INFO:tasks.workunit.client.0.smithi148.stdout:9/482: sync 2024-04-26T23:09:08.870 INFO:tasks.workunit.client.0.smithi148.stdout:3/472: rename d9/d15/f27 to d9/d15/d29/d4d/d78/f98 0 2024-04-26T23:09:08.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/457: creat d16/d45/d2b/d3e/d5a/f98 x:0 0 0 2024-04-26T23:09:08.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/458: chown d16/d45/l44 1 1 2024-04-26T23:09:08.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/459: read d16/d17/f93 [41449,130694] 0 2024-04-26T23:09:08.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/460: fsync d16/d17/d4b/d55/f69 0 2024-04-26T23:09:08.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/461: chown d16/d1c/d84/f88 24 1 2024-04-26T23:09:08.875 INFO:tasks.workunit.client.0.smithi148.stdout:1/462: dread f15 [0,4194304] 0 2024-04-26T23:09:08.878 INFO:tasks.workunit.client.0.smithi148.stdout:9/483: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d61/d88/d9e 0 2024-04-26T23:09:08.878 INFO:tasks.workunit.client.0.smithi148.stdout:9/484: write d19/d1d/d25/d2f/f3d [5216407,28870] 0 2024-04-26T23:09:08.881 INFO:tasks.workunit.client.0.smithi148.stdout:3/473: unlink d9/c63 0 2024-04-26T23:09:08.884 INFO:tasks.workunit.client.0.smithi148.stdout:1/463: link d16/d1c/f33 d16/d17/d4b/f99 0 2024-04-26T23:09:08.886 INFO:tasks.workunit.client.0.smithi148.stdout:9/485: mkdir d19/d9f 0 2024-04-26T23:09:08.888 INFO:tasks.workunit.client.0.smithi148.stdout:3/474: mkdir d9/d65/d80/d83/d99 0 2024-04-26T23:09:08.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/464: creat d16/d17/d4b/d55/f9a x:0 0 0 2024-04-26T23:09:08.894 INFO:tasks.workunit.client.0.smithi148.stdout:9/486: mknod d19/d1d/d25/d2f/d4d/d33/d50/ca0 0 2024-04-26T23:09:08.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/465: creat d16/d1c/f9b x:0 0 0 2024-04-26T23:09:08.913 INFO:tasks.workunit.client.0.smithi148.stdout:4/504: dwrite d12/d17/f5d [0,4194304] 0 2024-04-26T23:09:08.913 INFO:tasks.workunit.client.0.smithi148.stdout:4/505: chown d12/d1c/f73 6152 1 2024-04-26T23:09:08.913 INFO:tasks.workunit.client.0.smithi148.stdout:4/506: write d12/d1c/f67 [235220,103885] 0 2024-04-26T23:09:08.915 INFO:tasks.workunit.client.0.smithi148.stdout:1/466: link c11 d16/d17/d4b/d55/d90/c9c 0 2024-04-26T23:09:08.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/444: dwrite d7/d11/d29/f53 [0,4194304] 0 2024-04-26T23:09:08.922 INFO:tasks.workunit.client.0.smithi148.stdout:4/507: creat d12/d1c/d56/d87/f99 x:0 0 0 2024-04-26T23:09:08.952 INFO:tasks.workunit.client.0.smithi148.stdout:0/526: sync 2024-04-26T23:09:08.952 INFO:tasks.workunit.client.0.smithi148.stdout:0/527: write d0/d2e/d8f/d6c/fa9 [749265,65895] 0 2024-04-26T23:09:08.953 INFO:tasks.workunit.client.0.smithi148.stdout:5/537: sync 2024-04-26T23:09:08.953 INFO:tasks.workunit.client.0.smithi148.stdout:8/504: sync 2024-04-26T23:09:08.953 INFO:tasks.workunit.client.0.smithi148.stdout:6/457: sync 2024-04-26T23:09:08.954 INFO:tasks.workunit.client.0.smithi148.stdout:2/564: sync 2024-04-26T23:09:08.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/508: rename d12/d1a to d12/d1c/d56/d87/d9a 0 2024-04-26T23:09:08.959 INFO:tasks.workunit.client.0.smithi148.stdout:0/528: creat d0/d2e/d51/d9d/db4/fb5 x:0 0 0 2024-04-26T23:09:08.960 INFO:tasks.workunit.client.0.smithi148.stdout:0/529: write d0/d2e/d8f/d6c/fa6 [978461,118043] 0 2024-04-26T23:09:08.960 INFO:tasks.workunit.client.0.smithi148.stdout:0/530: chown d0/d8/d33/d43/d4e/l8c 1 1 2024-04-26T23:09:08.961 INFO:tasks.workunit.client.0.smithi148.stdout:6/458: truncate d6/f19 6588924 0 2024-04-26T23:09:08.963 INFO:tasks.workunit.client.0.smithi148.stdout:1/467: dwrite d16/d1c/f57 [0,4194304] 0 2024-04-26T23:09:08.965 INFO:tasks.workunit.client.0.smithi148.stdout:2/565: truncate d5/d8/d11/f5e 271705 0 2024-04-26T23:09:08.966 INFO:tasks.workunit.client.0.smithi148.stdout:6/459: mknod d6/d14/c8f 0 2024-04-26T23:09:08.972 INFO:tasks.workunit.client.0.smithi148.stdout:8/505: dread d3/da/d28/f50 [0,4194304] 0 2024-04-26T23:09:08.976 INFO:tasks.workunit.client.0.smithi148.stdout:1/468: creat d16/d17/d4b/d59/f9d x:0 0 0 2024-04-26T23:09:08.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/566: symlink d5/d8/d6c/d8f/lb7 0 2024-04-26T23:09:08.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/538: write da/d12/f13 [3548130,27888] 0 2024-04-26T23:09:08.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/539: fsync da/d1b/d1c/f53 0 2024-04-26T23:09:08.981 INFO:tasks.workunit.client.0.smithi148.stdout:7/445: dwrite d7/d11/d29/f53 [0,4194304] 0 2024-04-26T23:09:08.982 INFO:tasks.workunit.client.0.smithi148.stdout:4/509: dread d12/f66 [0,4194304] 0 2024-04-26T23:09:08.984 INFO:tasks.workunit.client.0.smithi148.stdout:6/460: link d6/d9/d1c/c3a d6/d9/d1c/d1d/d1f/d40/c90 0 2024-04-26T23:09:08.987 INFO:tasks.workunit.client.0.smithi148.stdout:8/506: mkdir d3/d9/d12/d95 0 2024-04-26T23:09:08.987 INFO:tasks.workunit.client.0.smithi148.stdout:8/507: fdatasync d3/d9/d12/d23/d35/f4e 0 2024-04-26T23:09:08.988 INFO:tasks.workunit.client.0.smithi148.stdout:4/510: mknod d12/c9b 0 2024-04-26T23:09:09.016 INFO:tasks.workunit.client.0.smithi148.stdout:0/531: dwrite d0/f62 [0,4194304] 0 2024-04-26T23:09:09.018 INFO:tasks.workunit.client.0.smithi148.stdout:8/508: creat d3/d9/d12/d95/f96 x:0 0 0 2024-04-26T23:09:09.021 INFO:tasks.workunit.client.0.smithi148.stdout:1/469: dread f10 [0,4194304] 0 2024-04-26T23:09:09.022 INFO:tasks.workunit.client.0.smithi148.stdout:0/532: symlink d0/d8/d95/d97/d3a/lb6 0 2024-04-26T23:09:09.022 INFO:tasks.workunit.client.0.smithi148.stdout:2/567: dwrite d5/d17/d64/f72 [4194304,4194304] 0 2024-04-26T23:09:09.022 INFO:tasks.workunit.client.0.smithi148.stdout:2/568: fsync d5/d17/f30 0 2024-04-26T23:09:09.024 INFO:tasks.workunit.client.0.smithi148.stdout:8/509: symlink d3/l97 0 2024-04-26T23:09:09.027 INFO:tasks.workunit.client.0.smithi148.stdout:1/470: unlink d16/d45/d2b/d3e/f7e 0 2024-04-26T23:09:09.031 INFO:tasks.workunit.client.0.smithi148.stdout:0/533: link d0/d2e/f35 d0/d8/d95/d9f/fb7 0 2024-04-26T23:09:09.031 INFO:tasks.workunit.client.0.smithi148.stdout:0/534: fsync d0/d2e/d51/d9d/db4/fb5 0 2024-04-26T23:09:09.031 INFO:tasks.workunit.client.0.smithi148.stdout:0/535: dread - d0/d8/d33/f7e zero size 2024-04-26T23:09:09.033 INFO:tasks.workunit.client.0.smithi148.stdout:2/569: mkdir d5/db8 0 2024-04-26T23:09:09.045 INFO:tasks.workunit.client.0.smithi148.stdout:4/511: dwrite d12/d17/d2a/d37/f88 [0,4194304] 0 2024-04-26T23:09:09.063 INFO:tasks.workunit.client.0.smithi148.stdout:7/446: read d7/d11/d17/d2f/d44/f7f [281183,20339] 0 2024-04-26T23:09:09.063 INFO:tasks.workunit.client.0.smithi148.stdout:5/540: dwrite da/d12/f17 [0,4194304] 0 2024-04-26T23:09:09.063 INFO:tasks.workunit.client.0.smithi148.stdout:5/541: fdatasync da/f3f 0 2024-04-26T23:09:09.068 INFO:tasks.workunit.client.0.smithi148.stdout:6/461: dread d6/d9/d1e/f79 [0,4194304] 0 2024-04-26T23:09:09.076 INFO:tasks.workunit.client.0.smithi148.stdout:1/471: dwrite d16/d1c/f3c [0,4194304] 0 2024-04-26T23:09:09.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/570: dwrite d5/f16 [0,4194304] 0 2024-04-26T23:09:09.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/571: dread - d5/d8/d15/d43/fa9 zero size 2024-04-26T23:09:09.270 INFO:tasks.workunit.client.0.smithi148.stdout:5/542: read da/d1b/d3b/d72/f94 [506949,80000] 0 2024-04-26T23:09:09.274 INFO:tasks.workunit.client.0.smithi148.stdout:5/543: write da/d1b/d1c/f22 [815459,21798] 0 2024-04-26T23:09:09.290 INFO:tasks.workunit.client.0.smithi148.stdout:0/536: mkdir d0/d2e/d8f/d6c/db8 0 2024-04-26T23:09:09.291 INFO:tasks.workunit.client.0.smithi148.stdout:0/537: chown d0/d5 283781671 1 2024-04-26T23:09:09.291 INFO:tasks.workunit.client.0.smithi148.stdout:0/538: fdatasync d0/d8/d1e/f2a 0 2024-04-26T23:09:09.291 INFO:tasks.workunit.client.0.smithi148.stdout:8/510: creat d3/da/d1c/d7a/f98 x:0 0 0 2024-04-26T23:09:09.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/512: mkdir d12/d1c/d56/d87/d9c 0 2024-04-26T23:09:09.309 INFO:tasks.workunit.client.0.smithi148.stdout:7/447: unlink d7/d11/d17/d2f/d44/l47 0 2024-04-26T23:09:09.309 INFO:tasks.workunit.client.0.smithi148.stdout:6/462: mkdir d6/d14/d91 0 2024-04-26T23:09:09.320 INFO:tasks.workunit.client.0.smithi148.stdout:0/539: creat d0/d20/d54/fb9 x:0 0 0 2024-04-26T23:09:09.322 INFO:tasks.workunit.client.0.smithi148.stdout:7/448: readlink d7/d11/d29/d2e/d41/l56 0 2024-04-26T23:09:09.322 INFO:tasks.workunit.client.0.smithi148.stdout:7/449: fdatasync d7/d19/f20 0 2024-04-26T23:09:09.324 INFO:tasks.workunit.client.0.smithi148.stdout:0/540: mknod d0/d2e/d8f/d6c/dab/cba 0 2024-04-26T23:09:09.325 INFO:tasks.workunit.client.0.smithi148.stdout:8/511: dwrite d3/da/f64 [0,4194304] 0 2024-04-26T23:09:09.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/450: readlink d7/l10 0 2024-04-26T23:09:09.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/451: write d7/d11/d17/d2f/d44/f7f [4153123,113580] 0 2024-04-26T23:09:09.327 INFO:tasks.workunit.client.0.smithi148.stdout:0/541: creat d0/d20/d3b/fbb x:0 0 0 2024-04-26T23:09:09.339 INFO:tasks.workunit.client.0.smithi148.stdout:1/472: creat d16/d17/d4b/f9e x:0 0 0 2024-04-26T23:09:09.341 INFO:tasks.workunit.client.0.smithi148.stdout:7/452: creat d7/d75/f93 x:0 0 0 2024-04-26T23:09:09.347 INFO:tasks.workunit.client.0.smithi148.stdout:8/512: write d3/da/f5c [1315284,91890] 0 2024-04-26T23:09:09.347 INFO:tasks.workunit.client.0.smithi148.stdout:8/513: chown d3/l2a 10 1 2024-04-26T23:09:09.348 INFO:tasks.workunit.client.0.smithi148.stdout:1/473: getdents d16/d47/d49 0 2024-04-26T23:09:09.366 INFO:tasks.workunit.client.0.smithi148.stdout:0/542: dwrite d0/d2e/d51/d9d/db4/fb5 [0,4194304] 0 2024-04-26T23:09:09.366 INFO:tasks.workunit.client.0.smithi148.stdout:0/543: write d0/d2e/d8f/d6c/fa6 [2030324,117742] 0 2024-04-26T23:09:09.367 INFO:tasks.workunit.client.0.smithi148.stdout:1/474: symlink d16/d17/d4b/d59/l9f 0 2024-04-26T23:09:09.367 INFO:tasks.workunit.client.0.smithi148.stdout:1/475: truncate d16/d17/f1a 5000981 0 2024-04-26T23:09:09.367 INFO:tasks.workunit.client.0.smithi148.stdout:0/544: read - d0/f7b zero size 2024-04-26T23:09:09.379 INFO:tasks.workunit.client.0.smithi148.stdout:7/453: write d7/d11/d17/d2f/f54 [987759,106014] 0 2024-04-26T23:09:09.380 INFO:tasks.workunit.client.0.smithi148.stdout:1/476: rmdir d16/d47/d73 39 2024-04-26T23:09:09.385 INFO:tasks.workunit.client.0.smithi148.stdout:7/454: write d7/fc [827288,42082] 0 2024-04-26T23:09:09.390 INFO:tasks.workunit.client.0.smithi148.stdout:0/545: write d0/d5/f2c [1764986,32279] 0 2024-04-26T23:09:09.391 INFO:tasks.workunit.client.0.smithi148.stdout:7/455: rmdir d7/d11/d29/d2e/d41/d67 39 2024-04-26T23:09:09.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/456: read d7/d11/d29/d2e/f26 [1973872,112968] 0 2024-04-26T23:09:09.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/457: chown d7/d11/d29/l7a 4 1 2024-04-26T23:09:09.393 INFO:tasks.workunit.client.0.smithi148.stdout:0/546: symlink d0/d2e/d8f/d6c/dab/lbc 0 2024-04-26T23:09:09.394 INFO:tasks.workunit.client.0.smithi148.stdout:7/458: truncate d7/d11/d17/d43/f52 359898 0 2024-04-26T23:09:09.395 INFO:tasks.workunit.client.0.smithi148.stdout:0/547: creat d0/d8/d33/d43/d4e/fbd x:0 0 0 2024-04-26T23:09:09.423 INFO:tasks.workunit.client.0.smithi148.stdout:1/477: dread d16/d1c/f2c [0,4194304] 0 2024-04-26T23:09:09.485 INFO:tasks.workunit.client.0.smithi148.stdout:1/478: dwrite d16/d17/d4b/d4d/f52 [0,4194304] 0 2024-04-26T23:09:09.492 INFO:tasks.workunit.client.0.smithi148.stdout:7/459: dread d7/d11/d29/d2e/d41/f49 [0,4194304] 0 2024-04-26T23:09:09.492 INFO:tasks.workunit.client.0.smithi148.stdout:7/460: write d7/fc [2804805,69350] 0 2024-04-26T23:09:09.492 INFO:tasks.workunit.client.0.smithi148.stdout:7/461: chown d7/d11/d29/c45 91980 1 2024-04-26T23:09:09.556 INFO:tasks.workunit.client.0.smithi148.stdout:0/548: dwrite d0/d2e/d51/f60 [0,4194304] 0 2024-04-26T23:09:09.556 INFO:tasks.workunit.client.0.smithi148.stdout:0/549: chown d0/d8/d95/d97 46 1 2024-04-26T23:09:09.563 INFO:tasks.workunit.client.0.smithi148.stdout:7/462: mkdir d7/d11/d29/d2e/d41/d67/d94 0 2024-04-26T23:09:09.589 INFO:tasks.workunit.client.0.smithi148.stdout:7/463: dread d7/d19/f35 [0,4194304] 0 2024-04-26T23:09:09.592 INFO:tasks.workunit.client.0.smithi148.stdout:0/550: dwrite d0/d8/d5f/f79 [0,4194304] 0 2024-04-26T23:09:09.598 INFO:tasks.workunit.client.0.smithi148.stdout:7/464: mkdir d7/d11/d29/d2e/d41/d67/d94/d95 0 2024-04-26T23:09:09.605 INFO:tasks.workunit.client.0.smithi148.stdout:0/551: write d0/d2e/d51/f60 [1233066,12259] 0 2024-04-26T23:09:09.605 INFO:tasks.workunit.client.0.smithi148.stdout:0/552: read - d0/d5/f8a zero size 2024-04-26T23:09:09.623 INFO:tasks.workunit.client.0.smithi148.stdout:0/553: dread d0/d20/f40 [0,4194304] 0 2024-04-26T23:09:09.708 INFO:tasks.workunit.client.0.smithi148.stdout:7/465: dwrite d7/fb [0,4194304] 0 2024-04-26T23:09:10.081 INFO:tasks.workunit.client.0.smithi148.stdout:8/514: symlink d3/d9/l99 0 2024-04-26T23:09:10.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/572: mkdir d5/d8/db9 0 2024-04-26T23:09:10.097 INFO:tasks.workunit.client.0.smithi148.stdout:2/573: link d5/d8/d9/c67 d5/d7/cba 0 2024-04-26T23:09:10.099 INFO:tasks.workunit.client.0.smithi148.stdout:2/574: read d5/d8/d9/f28 [1287696,69837] 0 2024-04-26T23:09:10.099 INFO:tasks.workunit.client.0.smithi148.stdout:2/575: fsync d5/d10/f48 0 2024-04-26T23:09:10.099 INFO:tasks.workunit.client.0.smithi148.stdout:2/576: chown d5/d8/d4b/d4e/d6d/da0/d78 255943339 1 2024-04-26T23:09:10.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/513: rename d12/d17/d2a/d33 to d12/d1c/d56/d87/d9a/d9d 0 2024-04-26T23:09:10.105 INFO:tasks.workunit.client.0.smithi148.stdout:2/577: link d5/d8/d15/d43/d5d/f7c d5/d8/d15/d43/d8d/fbb 0 2024-04-26T23:09:10.108 INFO:tasks.workunit.client.0.smithi148.stdout:4/514: rmdir d12/d1c/d56 39 2024-04-26T23:09:10.112 INFO:tasks.workunit.client.0.smithi148.stdout:2/578: truncate d5/d8/d9/fc 8265051 0 2024-04-26T23:09:10.113 INFO:tasks.workunit.client.0.smithi148.stdout:2/579: chown d5/d8/d4b/d4e/c7e 9230475 1 2024-04-26T23:09:10.117 INFO:tasks.workunit.client.0.smithi148.stdout:4/515: unlink d12/d17/f22 0 2024-04-26T23:09:10.120 INFO:tasks.workunit.client.0.smithi148.stdout:2/580: symlink d5/d7/lbc 0 2024-04-26T23:09:10.124 INFO:tasks.workunit.client.0.smithi148.stdout:4/516: creat d12/d1c/d45/f9e x:0 0 0 2024-04-26T23:09:10.129 INFO:tasks.workunit.client.0.smithi148.stdout:2/581: unlink d5/d7/cba 0 2024-04-26T23:09:10.375 INFO:tasks.workunit.client.0.smithi148.stdout:6/463: rename d6/d9/f7c to d6/d9/d23/d4a/f92 0 2024-04-26T23:09:10.375 INFO:tasks.workunit.client.0.smithi148.stdout:6/464: write d6/d32/d4e/f73 [875051,127954] 0 2024-04-26T23:09:10.375 INFO:tasks.workunit.client.0.smithi148.stdout:4/517: truncate d12/d1c/d56/d87/d9a/f23 1852389 0 2024-04-26T23:09:10.375 INFO:tasks.workunit.client.0.smithi148.stdout:4/518: fsync d12/d1c/d56/d87/d9a/f8d 0 2024-04-26T23:09:10.376 INFO:tasks.workunit.client.0.smithi148.stdout:2/582: write d5/d8/d9/f69 [749373,19775] 0 2024-04-26T23:09:10.376 INFO:tasks.workunit.client.0.smithi148.stdout:3/475: sync 2024-04-26T23:09:10.376 INFO:tasks.workunit.client.0.smithi148.stdout:9/487: sync 2024-04-26T23:09:10.377 INFO:tasks.workunit.client.0.smithi148.stdout:5/544: sync 2024-04-26T23:09:10.377 INFO:tasks.workunit.client.0.smithi148.stdout:0/554: sync 2024-04-26T23:09:10.381 INFO:tasks.workunit.client.0.smithi148.stdout:1/479: rename d16/d17/d4b/d4d/f52 to d16/d47/fa0 0 2024-04-26T23:09:10.381 INFO:tasks.workunit.client.0.smithi148.stdout:1/480: chown d16/d45/d2b 8262063 1 2024-04-26T23:09:10.385 INFO:tasks.workunit.client.0.smithi148.stdout:4/519: mknod d12/d17/d2a/c9f 0 2024-04-26T23:09:10.385 INFO:tasks.workunit.client.0.smithi148.stdout:4/520: chown d12/f4a 977 1 2024-04-26T23:09:10.387 INFO:tasks.workunit.client.0.smithi148.stdout:4/521: read d12/d1c/f8b [62953,55806] 0 2024-04-26T23:09:10.388 INFO:tasks.workunit.client.0.smithi148.stdout:4/522: truncate d12/d17/f7c 316758 0 2024-04-26T23:09:10.388 INFO:tasks.workunit.client.0.smithi148.stdout:4/523: read - d12/d1c/d56/d87/f99 zero size 2024-04-26T23:09:10.390 INFO:tasks.workunit.client.0.smithi148.stdout:2/583: creat d5/d8/d15/d43/d8d/fbd x:0 0 0 2024-04-26T23:09:10.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/476: mkdir d9/d15/d29/d4d/d9a 0 2024-04-26T23:09:10.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/477: write d9/d15/f1e [980550,108389] 0 2024-04-26T23:09:10.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/478: fsync d9/d65/d80/d83/f89 0 2024-04-26T23:09:10.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/479: write d9/d15/d29/f73 [2025412,122483] 0 2024-04-26T23:09:10.397 INFO:tasks.workunit.client.0.smithi148.stdout:5/545: mkdir da/d1b/d5b/d5e/dc5 0 2024-04-26T23:09:10.400 INFO:tasks.workunit.client.0.smithi148.stdout:0/555: creat d0/d8/d33/d43/d4e/fbe x:0 0 0 2024-04-26T23:09:10.402 INFO:tasks.workunit.client.0.smithi148.stdout:7/466: rename d7/d11/c8f to d7/d75/c96 0 2024-04-26T23:09:10.408 INFO:tasks.workunit.client.0.smithi148.stdout:2/584: mkdir d5/d8/d4b/d4e/d6d/dbe 0 2024-04-26T23:09:10.408 INFO:tasks.workunit.client.0.smithi148.stdout:4/524: creat d12/d17/d2a/d37/d97/fa0 x:0 0 0 2024-04-26T23:09:10.411 INFO:tasks.workunit.client.0.smithi148.stdout:5/546: mknod da/d1a/dc2/cc6 0 2024-04-26T23:09:10.424 INFO:tasks.workunit.client.0.smithi148.stdout:8/515: rename d3/d9/d12/d23/d29/d4f to d3/d9a 0 2024-04-26T23:09:10.425 INFO:tasks.workunit.client.0.smithi148.stdout:7/467: mknod d7/d11/d60/d68/c97 0 2024-04-26T23:09:10.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/525: mkdir d12/d1c/d56/d87/d9c/da1 0 2024-04-26T23:09:10.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/585: symlink d5/d8/d4b/d4e/d6d/lbf 0 2024-04-26T23:09:10.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/586: readlink d5/la 0 2024-04-26T23:09:10.428 INFO:tasks.workunit.client.0.smithi148.stdout:5/547: mkdir da/d1b/d8b/dc7 0 2024-04-26T23:09:10.434 INFO:tasks.workunit.client.0.smithi148.stdout:6/465: rename d6/c2c to d6/dc/c93 0 2024-04-26T23:09:10.434 INFO:tasks.workunit.client.0.smithi148.stdout:6/466: write d6/d9/d1c/d1d/d1f/f4c [495600,5460] 0 2024-04-26T23:09:10.437 INFO:tasks.workunit.client.0.smithi148.stdout:7/468: getdents d7/d11/d29/d2e 0 2024-04-26T23:09:10.442 INFO:tasks.workunit.client.0.smithi148.stdout:6/467: dread d6/d9/d1c/f5d [0,4194304] 0 2024-04-26T23:09:10.443 INFO:tasks.workunit.client.0.smithi148.stdout:4/526: unlink d12/d1c/d56/d87/d9a/f77 0 2024-04-26T23:09:10.444 INFO:tasks.workunit.client.0.smithi148.stdout:3/480: dwrite d9/d52/f62 [0,4194304] 0 2024-04-26T23:09:10.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/587: mknod d5/d8/d11/cc0 0 2024-04-26T23:09:10.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/588: dread - d5/d8/f7b zero size 2024-04-26T23:09:10.447 INFO:tasks.workunit.client.0.smithi148.stdout:5/548: mknod da/d1b/d3b/d72/cc8 0 2024-04-26T23:09:10.447 INFO:tasks.workunit.client.0.smithi148.stdout:0/556: dwrite d0/f90 [0,4194304] 0 2024-04-26T23:09:10.450 INFO:tasks.workunit.client.0.smithi148.stdout:8/516: write d3/d9/f49 [3544669,128765] 0 2024-04-26T23:09:10.450 INFO:tasks.workunit.client.0.smithi148.stdout:9/488: rename d19/l2c to d19/d22/la1 0 2024-04-26T23:09:10.450 INFO:tasks.workunit.client.0.smithi148.stdout:5/549: dread da/d1b/d3b/d72/f9b [0,4194304] 0 2024-04-26T23:09:10.452 INFO:tasks.workunit.client.0.smithi148.stdout:7/469: getdents d7/d11/d17 0 2024-04-26T23:09:10.455 INFO:tasks.workunit.client.0.smithi148.stdout:3/481: unlink d9/d15/d29/f56 0 2024-04-26T23:09:10.456 INFO:tasks.workunit.client.0.smithi148.stdout:0/557: mkdir d0/d2e/d8f/dbf 0 2024-04-26T23:09:10.459 INFO:tasks.workunit.client.0.smithi148.stdout:2/589: rename d5/d8/f1b to d5/d7f/d86/d87/db2/fc1 0 2024-04-26T23:09:10.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/590: fdatasync d5/d8/d15/f96 0 2024-04-26T23:09:10.460 INFO:tasks.workunit.client.0.smithi148.stdout:5/550: readlink da/d1a/l62 0 2024-04-26T23:09:10.461 INFO:tasks.workunit.client.0.smithi148.stdout:0/558: mkdir d0/d8/d33/d6a/d70/dc0 0 2024-04-26T23:09:10.464 INFO:tasks.workunit.client.0.smithi148.stdout:8/517: symlink d3/da/d1c/l9b 0 2024-04-26T23:09:10.467 INFO:tasks.workunit.client.0.smithi148.stdout:9/489: rename f9 to d19/d1d/d25/d2f/d4d/d33/fa2 0 2024-04-26T23:09:10.467 INFO:tasks.workunit.client.0.smithi148.stdout:9/490: fdatasync d19/d1d/d25/d2f/f3d 0 2024-04-26T23:09:10.467 INFO:tasks.workunit.client.0.smithi148.stdout:9/491: chown d19/d22/la1 795692274 1 2024-04-26T23:09:10.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/551: mkdir da/d68/d69/dc9 0 2024-04-26T23:09:10.471 INFO:tasks.workunit.client.0.smithi148.stdout:8/518: symlink d3/da/l9c 0 2024-04-26T23:09:10.473 INFO:tasks.workunit.client.0.smithi148.stdout:6/468: getdents d6 0 2024-04-26T23:09:10.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/559: dread d0/d20/f40 [0,4194304] 0 2024-04-26T23:09:10.477 INFO:tasks.workunit.client.0.smithi148.stdout:9/492: symlink d19/d22/d7b/la3 0 2024-04-26T23:09:10.479 INFO:tasks.workunit.client.0.smithi148.stdout:5/552: mknod da/d1b/d3b/d73/d97/cca 0 2024-04-26T23:09:10.479 INFO:tasks.workunit.client.0.smithi148.stdout:5/553: write da/d12/f8f [3738995,69694] 0 2024-04-26T23:09:10.484 INFO:tasks.workunit.client.0.smithi148.stdout:6/469: creat d6/d9/d1c/f94 x:0 0 0 2024-04-26T23:09:10.486 INFO:tasks.workunit.client.0.smithi148.stdout:8/519: creat d3/d9a/f9d x:0 0 0 2024-04-26T23:09:10.490 INFO:tasks.workunit.client.0.smithi148.stdout:7/470: rename d7/d11/d17/d43/l6f to d7/d11/d29/d2e/d41/l98 0 2024-04-26T23:09:10.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/560: link d0/l53 d0/d2e/d51/d9d/db4/lc1 0 2024-04-26T23:09:10.496 INFO:tasks.workunit.client.0.smithi148.stdout:6/470: mkdir d6/d9/d23/d4a/d95 0 2024-04-26T23:09:10.496 INFO:tasks.workunit.client.0.smithi148.stdout:5/554: truncate da/d68/d69/f89 992686 0 2024-04-26T23:09:10.498 INFO:tasks.workunit.client.0.smithi148.stdout:2/591: dwrite d5/d8/d15/f96 [0,4194304] 0 2024-04-26T23:09:10.509 INFO:tasks.workunit.client.0.smithi148.stdout:8/520: rename d3/da/c22 to d3/da/c9e 0 2024-04-26T23:09:10.509 INFO:tasks.workunit.client.0.smithi148.stdout:0/561: link d0/d8/d52/c4d d0/d2e/d51/daf/cc2 0 2024-04-26T23:09:10.511 INFO:tasks.workunit.client.0.smithi148.stdout:2/592: symlink d5/da6/lc2 0 2024-04-26T23:09:10.512 INFO:tasks.workunit.client.0.smithi148.stdout:5/555: creat da/d1b/d1c/d7f/fcb x:0 0 0 2024-04-26T23:09:10.512 INFO:tasks.workunit.client.0.smithi148.stdout:4/527: dwrite d12/d17/d2a/d37/d97/fa0 [0,4194304] 0 2024-04-26T23:09:10.513 INFO:tasks.workunit.client.0.smithi148.stdout:4/528: readlink d12/d1c/l63 0 2024-04-26T23:09:10.515 INFO:tasks.workunit.client.0.smithi148.stdout:3/482: dwrite d9/d52/f62 [4194304,4194304] 0 2024-04-26T23:09:10.517 INFO:tasks.workunit.client.0.smithi148.stdout:0/562: creat d0/d2e/d51/daf/fc3 x:0 0 0 2024-04-26T23:09:10.517 INFO:tasks.workunit.client.0.smithi148.stdout:8/521: rename d3/da/d28/d4c to d3/da/d1c/d7c/d8c/d9f 0 2024-04-26T23:09:10.517 INFO:tasks.workunit.client.0.smithi148.stdout:0/563: write d0/d2e/d8f/d6c/fa9 [1169552,78985] 0 2024-04-26T23:09:10.517 INFO:tasks.workunit.client.0.smithi148.stdout:0/564: write d0/d8/d52/f1f [9191078,60386] 0 2024-04-26T23:09:10.518 INFO:tasks.workunit.client.0.smithi148.stdout:6/471: dread d6/d32/f63 [0,4194304] 0 2024-04-26T23:09:10.519 INFO:tasks.workunit.client.0.smithi148.stdout:5/556: link da/d12/f17 da/d1b/d5b/d5e/dc5/fcc 0 2024-04-26T23:09:10.522 INFO:tasks.workunit.client.0.smithi148.stdout:8/522: getdents d3/d9/d12/d23/d65 0 2024-04-26T23:09:10.522 INFO:tasks.workunit.client.0.smithi148.stdout:8/523: dread - d3/d9/f58 zero size 2024-04-26T23:09:10.522 INFO:tasks.workunit.client.0.smithi148.stdout:8/524: read - d3/d9a/f9d zero size 2024-04-26T23:09:10.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/483: dread d9/d15/d29/d4d/f64 [0,4194304] 0 2024-04-26T23:09:10.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/484: read - d9/d15/d29/d4d/d6f/f74 zero size 2024-04-26T23:09:10.528 INFO:tasks.workunit.client.0.smithi148.stdout:3/485: fdatasync d9/d4c/f66 0 2024-04-26T23:09:10.528 INFO:tasks.workunit.client.0.smithi148.stdout:3/486: dread - d9/d15/d29/d4d/d6f/f74 zero size 2024-04-26T23:09:10.528 INFO:tasks.workunit.client.0.smithi148.stdout:3/487: fdatasync d9/d15/d29/d4d/f57 0 2024-04-26T23:09:10.528 INFO:tasks.workunit.client.0.smithi148.stdout:3/488: truncate d9/f86 863786 0 2024-04-26T23:09:10.529 INFO:tasks.workunit.client.0.smithi148.stdout:0/565: link d0/d2e/d51/l65 d0/d8/d33/d43/lc4 0 2024-04-26T23:09:10.529 INFO:tasks.workunit.client.0.smithi148.stdout:2/593: rename d5/d8/d4b/f7a to d5/d8/d15/d43/d8d/fc3 0 2024-04-26T23:09:10.530 INFO:tasks.workunit.client.0.smithi148.stdout:6/472: creat d6/d9/d1c/f96 x:0 0 0 2024-04-26T23:09:10.530 INFO:tasks.workunit.client.0.smithi148.stdout:5/557: symlink da/d1b/d3b/db2/lcd 0 2024-04-26T23:09:10.531 INFO:tasks.workunit.client.0.smithi148.stdout:5/558: chown da/d1b/d2d/c4f 1612 1 2024-04-26T23:09:10.532 INFO:tasks.workunit.client.0.smithi148.stdout:3/489: creat d9/d65/f9b x:0 0 0 2024-04-26T23:09:10.533 INFO:tasks.workunit.client.0.smithi148.stdout:4/529: dread f8 [0,4194304] 0 2024-04-26T23:09:10.534 INFO:tasks.workunit.client.0.smithi148.stdout:9/493: dwrite d19/d1d/f66 [0,4194304] 0 2024-04-26T23:09:10.534 INFO:tasks.workunit.client.0.smithi148.stdout:9/494: chown d19/d1d/d25/d2f/d4d/d33/fa2 44804069 1 2024-04-26T23:09:10.534 INFO:tasks.workunit.client.0.smithi148.stdout:9/495: readlink d19/d1d/l6c 0 2024-04-26T23:09:10.535 INFO:tasks.workunit.client.0.smithi148.stdout:0/566: rename d0/d8/d1e/f2a to d0/d2e/d51/fc5 0 2024-04-26T23:09:10.535 INFO:tasks.workunit.client.0.smithi148.stdout:0/567: dread - d0/f7b zero size 2024-04-26T23:09:10.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/594: rmdir d5/d8/d6c/d8f 39 2024-04-26T23:09:10.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/473: creat d6/d32/d8a/f97 x:0 0 0 2024-04-26T23:09:10.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/474: readlink d6/d9/d23/l58 0 2024-04-26T23:09:10.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/475: write d6/f6f [2079263,35271] 0 2024-04-26T23:09:10.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/476: chown d6/d32/d66/c86 0 1 2024-04-26T23:09:10.539 INFO:tasks.workunit.client.0.smithi148.stdout:5/559: creat da/d68/d69/daa/fce x:0 0 0 2024-04-26T23:09:10.542 INFO:tasks.workunit.client.0.smithi148.stdout:3/490: mkdir d9/d15/d29/d4d/d68/d9c 0 2024-04-26T23:09:10.557 INFO:tasks.workunit.client.0.smithi148.stdout:8/525: dwrite d3/da/f64 [4194304,4194304] 0 2024-04-26T23:09:10.557 INFO:tasks.workunit.client.0.smithi148.stdout:0/568: link d0/d8/d33/d43/d4e/l8c d0/d8/d95/d9f/lc6 0 2024-04-26T23:09:10.557 INFO:tasks.workunit.client.0.smithi148.stdout:5/560: dread f6 [0,4194304] 0 2024-04-26T23:09:10.557 INFO:tasks.workunit.client.0.smithi148.stdout:2/595: link d5/d8/d4b/l65 d5/d7f/d86/d87/db2/lc4 0 2024-04-26T23:09:10.557 INFO:tasks.workunit.client.0.smithi148.stdout:9/496: symlink d19/d22/d7b/la4 0 2024-04-26T23:09:10.561 INFO:tasks.workunit.client.0.smithi148.stdout:6/477: fsync d6/f6f 0 2024-04-26T23:09:10.561 INFO:tasks.workunit.client.0.smithi148.stdout:2/596: mknod d5/d8/d4b/cc5 0 2024-04-26T23:09:10.561 INFO:tasks.workunit.client.0.smithi148.stdout:2/597: chown d5/d8/d15/d43/d8d 547359284 1 2024-04-26T23:09:10.562 INFO:tasks.workunit.client.0.smithi148.stdout:2/598: write d5/d10/f3b [112296,119382] 0 2024-04-26T23:09:10.562 INFO:tasks.workunit.client.0.smithi148.stdout:3/491: mknod d9/d15/d29/d4d/d5b/c9d 0 2024-04-26T23:09:10.568 INFO:tasks.workunit.client.0.smithi148.stdout:5/561: creat da/d1b/d3b/d73/fcf x:0 0 0 2024-04-26T23:09:10.568 INFO:tasks.workunit.client.0.smithi148.stdout:5/562: fsync da/d1b/d3b/d72/f94 0 2024-04-26T23:09:10.568 INFO:tasks.workunit.client.0.smithi148.stdout:5/563: write da/d1a/f9f [562096,76388] 0 2024-04-26T23:09:10.571 INFO:tasks.workunit.client.0.smithi148.stdout:0/569: symlink d0/d8/d1e/lc7 0 2024-04-26T23:09:10.575 INFO:tasks.workunit.client.0.smithi148.stdout:0/570: rmdir d0/d5 39 2024-04-26T23:09:10.575 INFO:tasks.workunit.client.0.smithi148.stdout:0/571: truncate d0/d5/f8a 715400 0 2024-04-26T23:09:10.577 INFO:tasks.workunit.client.0.smithi148.stdout:5/564: unlink da/d1a/l79 0 2024-04-26T23:09:10.578 INFO:tasks.workunit.client.0.smithi148.stdout:3/492: dread d9/d15/d29/f73 [0,4194304] 0 2024-04-26T23:09:10.578 INFO:tasks.workunit.client.0.smithi148.stdout:3/493: fdatasync d9/ff 0 2024-04-26T23:09:10.579 INFO:tasks.workunit.client.0.smithi148.stdout:5/565: symlink da/d70/ld0 0 2024-04-26T23:09:10.579 INFO:tasks.workunit.client.0.smithi148.stdout:5/566: dread - da/d1f/d67/f96 zero size 2024-04-26T23:09:10.581 INFO:tasks.workunit.client.0.smithi148.stdout:0/572: rename d0/c13 to d0/d8/d1e/cc8 0 2024-04-26T23:09:10.583 INFO:tasks.workunit.client.0.smithi148.stdout:5/567: unlink da/d1f/d47/f75 0 2024-04-26T23:09:10.583 INFO:tasks.workunit.client.0.smithi148.stdout:5/568: write da/f18 [3196196,127509] 0 2024-04-26T23:09:10.583 INFO:tasks.workunit.client.0.smithi148.stdout:6/478: dread d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:10.586 INFO:tasks.workunit.client.0.smithi148.stdout:0/573: symlink d0/d8/d95/d97/d3a/lc9 0 2024-04-26T23:09:10.587 INFO:tasks.workunit.client.0.smithi148.stdout:5/569: rmdir da/d1b 39 2024-04-26T23:09:10.589 INFO:tasks.workunit.client.0.smithi148.stdout:6/479: mkdir d6/d32/d98 0 2024-04-26T23:09:10.594 INFO:tasks.workunit.client.0.smithi148.stdout:8/526: dread d3/d9/d12/d23/d35/f86 [0,4194304] 0 2024-04-26T23:09:10.602 INFO:tasks.workunit.client.0.smithi148.stdout:4/530: dwrite d12/d1c/f85 [0,4194304] 0 2024-04-26T23:09:10.603 INFO:tasks.workunit.client.0.smithi148.stdout:8/527: mkdir d3/d9/da0 0 2024-04-26T23:09:10.606 INFO:tasks.workunit.client.0.smithi148.stdout:5/570: dread da/d1b/d2d/da8/fbb [0,4194304] 0 2024-04-26T23:09:10.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/497: dwrite d19/d1d/d25/d31/f56 [4194304,4194304] 0 2024-04-26T23:09:10.613 INFO:tasks.workunit.client.0.smithi148.stdout:8/528: symlink d3/da/d1c/d7c/d8c/la1 0 2024-04-26T23:09:10.613 INFO:tasks.workunit.client.0.smithi148.stdout:8/529: truncate d3/da/d1c/d7a/f98 978127 0 2024-04-26T23:09:10.613 INFO:tasks.workunit.client.0.smithi148.stdout:8/530: fsync d3/f88 0 2024-04-26T23:09:10.618 INFO:tasks.workunit.client.0.smithi148.stdout:2/599: dread d5/d10/f3b [0,4194304] 0 2024-04-26T23:09:10.618 INFO:tasks.workunit.client.0.smithi148.stdout:2/600: chown d5/d7 25911963 1 2024-04-26T23:09:10.618 INFO:tasks.workunit.client.0.smithi148.stdout:9/498: unlink d19/d1d/d25/d31/d32/f74 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:0/574: dwrite d0/d8/d52/f30 [0,4194304] 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:0/575: truncate d0/d2e/f35 4968425 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:8/531: mknod d3/d9/d12/d23/d65/ca2 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:8/532: write d3/d9/d12/d23/f73 [63217,75357] 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:6/480: dread d6/f47 [0,4194304] 0 2024-04-26T23:09:10.621 INFO:tasks.workunit.client.0.smithi148.stdout:6/481: write d6/d9/d23/d4a/f67 [1338752,722] 0 2024-04-26T23:09:10.622 INFO:tasks.workunit.client.0.smithi148.stdout:5/571: rename da/d12/d78/l99 to da/d1b/d1c/ld1 0 2024-04-26T23:09:10.624 INFO:tasks.workunit.client.0.smithi148.stdout:2/601: creat d5/d17/d64/d88/fc6 x:0 0 0 2024-04-26T23:09:10.626 INFO:tasks.workunit.client.0.smithi148.stdout:9/499: unlink d19/d1d/d25/d31/c86 0 2024-04-26T23:09:10.627 INFO:tasks.workunit.client.0.smithi148.stdout:8/533: symlink d3/da/d1c/d7c/la3 0 2024-04-26T23:09:10.627 INFO:tasks.workunit.client.0.smithi148.stdout:8/534: chown d3/d9/d12/d23/d35/f4e 1395800 1 2024-04-26T23:09:10.627 INFO:tasks.workunit.client.0.smithi148.stdout:8/535: stat d3/d9/d12/d23/d29/d37/f3e 0 2024-04-26T23:09:10.627 INFO:tasks.workunit.client.0.smithi148.stdout:5/572: creat da/d1b/d3b/fd2 x:0 0 0 2024-04-26T23:09:10.630 INFO:tasks.workunit.client.0.smithi148.stdout:2/602: creat d5/d8/d6c/d8f/fc7 x:0 0 0 2024-04-26T23:09:10.630 INFO:tasks.workunit.client.0.smithi148.stdout:9/500: symlink d19/d1d/d25/d2f/d4d/d33/d50/la5 0 2024-04-26T23:09:10.631 INFO:tasks.workunit.client.0.smithi148.stdout:1/481: sync 2024-04-26T23:09:10.631 INFO:tasks.workunit.client.0.smithi148.stdout:1/482: fdatasync d16/d45/d2b/d6e/f75 0 2024-04-26T23:09:10.632 INFO:tasks.workunit.client.0.smithi148.stdout:8/536: mknod d3/da/d28/ca4 0 2024-04-26T23:09:10.632 INFO:tasks.workunit.client.0.smithi148.stdout:8/537: chown d3/d9/d12/d23/d35/f47 0 1 2024-04-26T23:09:10.632 INFO:tasks.workunit.client.0.smithi148.stdout:2/603: mkdir d5/d8/dc8 0 2024-04-26T23:09:10.635 INFO:tasks.workunit.client.0.smithi148.stdout:0/576: dread d0/d8/d5f/fae [0,4194304] 0 2024-04-26T23:09:10.637 INFO:tasks.workunit.client.0.smithi148.stdout:9/501: creat d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/fa6 x:0 0 0 2024-04-26T23:09:10.638 INFO:tasks.workunit.client.0.smithi148.stdout:6/482: dread d6/d9/d1c/d1d/d1f/f59 [0,4194304] 0 2024-04-26T23:09:10.663 INFO:tasks.workunit.client.0.smithi148.stdout:2/604: dread d5/d8/d9/fc [4194304,4194304] 0 2024-04-26T23:09:10.663 INFO:tasks.workunit.client.0.smithi148.stdout:2/605: write d5/d8/d15/f45 [1578700,13330] 0 2024-04-26T23:09:10.691 INFO:tasks.workunit.client.0.smithi148.stdout:2/606: dwrite d5/d17/d64/f6b [0,4194304] 0 2024-04-26T23:09:10.691 INFO:tasks.workunit.client.0.smithi148.stdout:2/607: fsync d5/d8/d9/f63 0 2024-04-26T23:09:10.696 INFO:tasks.workunit.client.0.smithi148.stdout:0/577: unlink d0/d8/f42 0 2024-04-26T23:09:10.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/608: link d5/d8/d9/fc d5/fc9 0 2024-04-26T23:09:10.705 INFO:tasks.workunit.client.0.smithi148.stdout:0/578: rename d0/d2e/d51/fc5 to d0/d2e/d8f/dbf/fca 0 2024-04-26T23:09:10.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/483: dread d16/d17/f24 [0,4194304] 0 2024-04-26T23:09:10.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/484: chown d16/f37 5 1 2024-04-26T23:09:10.746 INFO:tasks.workunit.client.0.smithi148.stdout:9/502: dwrite d19/d1d/d25/d2f/f53 [0,4194304] 0 2024-04-26T23:09:10.748 INFO:tasks.workunit.client.0.smithi148.stdout:5/573: dwrite da/d1a/f1e [0,4194304] 0 2024-04-26T23:09:10.767 INFO:tasks.workunit.client.0.smithi148.stdout:5/574: write da/d1b/d3b/d72/f9b [121818,61930] 0 2024-04-26T23:09:10.770 INFO:tasks.workunit.client.0.smithi148.stdout:5/575: creat da/d12/d78/fd3 x:0 0 0 2024-04-26T23:09:10.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/576: symlink da/d1b/d5b/ld4 0 2024-04-26T23:09:10.776 INFO:tasks.workunit.client.0.smithi148.stdout:5/577: rename da/d1b/d1c/f30 to da/d1f/fd5 0 2024-04-26T23:09:10.776 INFO:tasks.workunit.client.0.smithi148.stdout:5/578: getdents da/d68/d69/daa/dc0 0 2024-04-26T23:09:10.777 INFO:tasks.workunit.client.0.smithi148.stdout:5/579: symlink da/d1b/d1c/d7f/d90/ld6 0 2024-04-26T23:09:10.778 INFO:tasks.workunit.client.0.smithi148.stdout:5/580: creat da/d1f/d47/fd7 x:0 0 0 2024-04-26T23:09:10.779 INFO:tasks.workunit.client.0.smithi148.stdout:5/581: fdatasync da/f5c 0 2024-04-26T23:09:10.779 INFO:tasks.workunit.client.0.smithi148.stdout:5/582: fdatasync da/d1b/d3b/d72/fc3 0 2024-04-26T23:09:10.781 INFO:tasks.workunit.client.0.smithi148.stdout:9/503: dwrite d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/f95 [0,4194304] 0 2024-04-26T23:09:10.781 INFO:tasks.workunit.client.0.smithi148.stdout:5/583: unlink da/d1a/l2e 0 2024-04-26T23:09:10.781 INFO:tasks.workunit.client.0.smithi148.stdout:5/584: chown da/d1b/d3b/d73/d97/cca 165324 1 2024-04-26T23:09:10.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/504: getdents d19/d1d/d25/d2f/d4d/d33/d50/d61/d88 0 2024-04-26T23:09:10.787 INFO:tasks.workunit.client.0.smithi148.stdout:5/585: link da/d1b/d5b/la3 da/d1f/d67/ld8 0 2024-04-26T23:09:10.787 INFO:tasks.workunit.client.0.smithi148.stdout:9/505: link d19/c1b d19/d1d/d69/ca7 0 2024-04-26T23:09:10.787 INFO:tasks.workunit.client.0.smithi148.stdout:8/538: dwrite d3/d9/d12/d23/d65/f68 [0,4194304] 0 2024-04-26T23:09:10.793 INFO:tasks.workunit.client.0.smithi148.stdout:5/586: rename da/d1b/d5b/c6e to da/d1b/d3b/d73/d97/db0/cd9 0 2024-04-26T23:09:10.793 INFO:tasks.workunit.client.0.smithi148.stdout:0/579: dwrite d0/d8/d1e/faa [0,4194304] 0 2024-04-26T23:09:10.794 INFO:tasks.workunit.client.0.smithi148.stdout:0/580: readlink d0/d2e/d8f/l85 0 2024-04-26T23:09:10.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/581: symlink d0/d2e/d8f/dbf/lcb 0 2024-04-26T23:09:10.797 INFO:tasks.workunit.client.0.smithi148.stdout:5/587: mknod da/d12/d78/cda 0 2024-04-26T23:09:10.798 INFO:tasks.workunit.client.0.smithi148.stdout:5/588: write da/d1b/d3b/d73/d97/fac [832562,41217] 0 2024-04-26T23:09:10.798 INFO:tasks.workunit.client.0.smithi148.stdout:5/589: fdatasync f3 0 2024-04-26T23:09:10.799 INFO:tasks.workunit.client.0.smithi148.stdout:0/582: rename d0/d2e/c69 to d0/d20/d3b/ccc 0 2024-04-26T23:09:10.800 INFO:tasks.workunit.client.0.smithi148.stdout:5/590: symlink da/d68/d69/daa/dc0/ldb 0 2024-04-26T23:09:10.804 INFO:tasks.workunit.client.0.smithi148.stdout:0/583: rmdir d0/d8/d95/d97/d3a/db1 0 2024-04-26T23:09:10.805 INFO:tasks.workunit.client.0.smithi148.stdout:5/591: creat da/d1b/d5b/d5e/d6a/fdc x:0 0 0 2024-04-26T23:09:10.805 INFO:tasks.workunit.client.0.smithi148.stdout:5/592: stat da/d1b/d2d/f37 0 2024-04-26T23:09:10.807 INFO:tasks.workunit.client.0.smithi148.stdout:5/593: mkdir da/d1b/d3b/d73/ddd 0 2024-04-26T23:09:10.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/539: write d3/d9/d12/d23/d35/f82 [2937697,79274] 0 2024-04-26T23:09:10.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/540: truncate d3/da/d1c/f83 1096568 0 2024-04-26T23:09:10.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/541: write d3/da/d1c/d7c/d8c/d9f/f6d [682879,78149] 0 2024-04-26T23:09:10.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/542: read - d3/d9a/f9d zero size 2024-04-26T23:09:10.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/485: dread d16/d1c/f3c [0,4194304] 0 2024-04-26T23:09:10.816 INFO:tasks.workunit.client.0.smithi148.stdout:6/483: dwrite d6/d32/f8b [0,4194304] 0 2024-04-26T23:09:10.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/543: mknod d3/da/d1c/d7c/ca5 0 2024-04-26T23:09:10.817 INFO:tasks.workunit.client.0.smithi148.stdout:1/486: creat d16/d1c/d84/fa1 x:0 0 0 2024-04-26T23:09:10.817 INFO:tasks.workunit.client.0.smithi148.stdout:1/487: chown d16/d45/d2b/l34 338050 1 2024-04-26T23:09:10.819 INFO:tasks.workunit.client.0.smithi148.stdout:6/484: mknod d6/d9/d1c/d1d/d1f/d40/c99 0 2024-04-26T23:09:10.819 INFO:tasks.workunit.client.0.smithi148.stdout:6/485: stat d6/dc/c6a 0 2024-04-26T23:09:10.819 INFO:tasks.workunit.client.0.smithi148.stdout:1/488: truncate d16/d45/f35 2910949 0 2024-04-26T23:09:10.820 INFO:tasks.workunit.client.0.smithi148.stdout:6/486: mknod d6/d9/d1e/c9a 0 2024-04-26T23:09:10.820 INFO:tasks.workunit.client.0.smithi148.stdout:0/584: dread d0/d5/f1a [0,4194304] 0 2024-04-26T23:09:10.821 INFO:tasks.workunit.client.0.smithi148.stdout:0/585: write d0/d8/d95/d97/d3a/fa2 [176003,106837] 0 2024-04-26T23:09:10.821 INFO:tasks.workunit.client.0.smithi148.stdout:8/544: rename d3/da/d1c/d7c/c7f to d3/da/d1c/ca6 0 2024-04-26T23:09:10.822 INFO:tasks.workunit.client.0.smithi148.stdout:6/487: creat d6/d9/d1c/f9b x:0 0 0 2024-04-26T23:09:10.822 INFO:tasks.workunit.client.0.smithi148.stdout:6/488: readlink d6/d9/d1c/d1d/d68/l6d 0 2024-04-26T23:09:10.822 INFO:tasks.workunit.client.0.smithi148.stdout:0/586: mknod d0/d5/d84/ccd 0 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:0/587: write d0/d2e/d8f/d6c/fa9 [759939,36741] 0 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:0/588: chown d0/d8/d5f/d72 3539736 1 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:8/545: mknod d3/da/d1c/d7c/d8c/ca7 0 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:6/489: symlink d6/d9/d1c/d1d/d1f/d40/l9c 0 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:6/490: dread - d6/d9/d1c/d1d/d1f/f7f zero size 2024-04-26T23:09:10.823 INFO:tasks.workunit.client.0.smithi148.stdout:6/491: truncate d6/d9/d1e/f82 549665 0 2024-04-26T23:09:10.825 INFO:tasks.workunit.client.0.smithi148.stdout:6/492: creat d6/d9/d1c/d5b/f9d x:0 0 0 2024-04-26T23:09:10.825 INFO:tasks.workunit.client.0.smithi148.stdout:6/493: write d6/f33 [7187402,101196] 0 2024-04-26T23:09:10.826 INFO:tasks.workunit.client.0.smithi148.stdout:6/494: rmdir d6/d9/d1c 39 2024-04-26T23:09:10.836 INFO:tasks.workunit.client.0.smithi148.stdout:6/495: symlink d6/dc/l9e 0 2024-04-26T23:09:10.840 INFO:tasks.workunit.client.0.smithi148.stdout:7/471: sync 2024-04-26T23:09:10.843 INFO:tasks.workunit.client.0.smithi148.stdout:1/489: write d16/d17/d68/d6b/d8b/f8e [7120002,20116] 0 2024-04-26T23:09:10.843 INFO:tasks.workunit.client.0.smithi148.stdout:8/546: dread d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:09:10.848 INFO:tasks.workunit.client.0.smithi148.stdout:8/547: unlink d3/da/d1c/f41 0 2024-04-26T23:09:10.848 INFO:tasks.workunit.client.0.smithi148.stdout:1/490: rename d16/d45/d2b/d3e/l4f to d16/d45/d2b/d3e/la2 0 2024-04-26T23:09:10.849 INFO:tasks.workunit.client.0.smithi148.stdout:1/491: mknod d16/d45/d2b/ca3 0 2024-04-26T23:09:10.851 INFO:tasks.workunit.client.0.smithi148.stdout:1/492: truncate d16/d17/f3b 708292 0 2024-04-26T23:09:10.856 INFO:tasks.workunit.client.0.smithi148.stdout:1/493: unlink d16/d45/d7d/l89 0 2024-04-26T23:09:10.861 INFO:tasks.workunit.client.0.smithi148.stdout:9/506: dwrite d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:09:10.865 INFO:tasks.workunit.client.0.smithi148.stdout:8/548: dread d3/da/d1c/f83 [0,4194304] 0 2024-04-26T23:09:10.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/494: rename d16/d45/d2b/d3e/l7f to d16/d17/d77/la4 0 2024-04-26T23:09:10.875 INFO:tasks.workunit.client.0.smithi148.stdout:9/507: creat d19/d1d/d25/d2f/d4d/d33/d50/d61/d88/d9e/fa8 x:0 0 0 2024-04-26T23:09:10.877 INFO:tasks.workunit.client.0.smithi148.stdout:8/549: creat d3/d9a/fa8 x:0 0 0 2024-04-26T23:09:10.879 INFO:tasks.workunit.client.0.smithi148.stdout:1/495: mkdir d16/d17/d4b/d55/d90/da5 0 2024-04-26T23:09:10.881 INFO:tasks.workunit.client.0.smithi148.stdout:0/589: dwrite d0/f2 [0,4194304] 0 2024-04-26T23:09:10.884 INFO:tasks.workunit.client.0.smithi148.stdout:9/508: mknod d19/d4b/ca9 0 2024-04-26T23:09:10.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/550: creat d3/da/d1c/d7a/fa9 x:0 0 0 2024-04-26T23:09:10.885 INFO:tasks.workunit.client.0.smithi148.stdout:1/496: mknod d16/d17/d4b/ca6 0 2024-04-26T23:09:10.885 INFO:tasks.workunit.client.0.smithi148.stdout:9/509: write d19/d1d/f3b [535798,125566] 0 2024-04-26T23:09:10.885 INFO:tasks.workunit.client.0.smithi148.stdout:0/590: mknod d0/d20/d3b/d86/cce 0 2024-04-26T23:09:10.885 INFO:tasks.workunit.client.0.smithi148.stdout:0/591: chown d0/d2e/d8f/d6c/dab/f66 1923783 1 2024-04-26T23:09:10.886 INFO:tasks.workunit.client.0.smithi148.stdout:5/594: dwrite da/f18 [0,4194304] 0 2024-04-26T23:09:10.886 INFO:tasks.workunit.client.0.smithi148.stdout:5/595: read da/d1f/d67/fb6 [69374,83983] 0 2024-04-26T23:09:10.886 INFO:tasks.workunit.client.0.smithi148.stdout:1/497: truncate d16/f1d 1886512 0 2024-04-26T23:09:10.888 INFO:tasks.workunit.client.0.smithi148.stdout:8/551: truncate d3/d9/d12/d23/f7b 8723496 0 2024-04-26T23:09:10.897 INFO:tasks.workunit.client.0.smithi148.stdout:9/510: rename d19/d1d/d25/d2f/d4d/d33/d50/d61/d88 to d19/d1d/d25/d2f/d4d/d33/daa 0 2024-04-26T23:09:10.897 INFO:tasks.workunit.client.0.smithi148.stdout:9/511: write d19/d39/f90 [1704863,14058] 0 2024-04-26T23:09:10.898 INFO:tasks.workunit.client.0.smithi148.stdout:9/512: write d19/d22/f26 [565262,49386] 0 2024-04-26T23:09:10.898 INFO:tasks.workunit.client.0.smithi148.stdout:9/513: chown d19/d1d/d25/f41 13308159 1 2024-04-26T23:09:10.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/498: dread d16/d17/f4c [4194304,4194304] 0 2024-04-26T23:09:10.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/499: truncate f13 620684 0 2024-04-26T23:09:10.899 INFO:tasks.workunit.client.0.smithi148.stdout:8/552: rename d3/d9/d12/d23/d65/l6f to d3/d9/d12/d23/d65/laa 0 2024-04-26T23:09:10.899 INFO:tasks.workunit.client.0.smithi148.stdout:8/553: readlink d3/da/l9c 0 2024-04-26T23:09:10.900 INFO:tasks.workunit.client.0.smithi148.stdout:0/592: rename d0/d8/d1e/cc8 to d0/d8/d33/d6a/d70/ccf 0 2024-04-26T23:09:10.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/500: mkdir d16/d1c/d84/da7 0 2024-04-26T23:09:10.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/501: readlink d16/d17/d77/la4 0 2024-04-26T23:09:10.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/502: chown d16/d47/d73 1548 1 2024-04-26T23:09:10.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/503: write d16/d47/fa0 [4601375,94885] 0 2024-04-26T23:09:10.903 INFO:tasks.workunit.client.0.smithi148.stdout:8/554: symlink d3/d9/d12/d23/d29/d77/d91/lab 0 2024-04-26T23:09:10.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/514: rename d19/d1d/d25/d2f/d4d/d33/d50/d57 to d19/d1d/d25/d31/d48/d8c/dab 0 2024-04-26T23:09:10.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/593: mknod d0/d2e/d51/d9d/cd0 0 2024-04-26T23:09:10.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/594: readlink d0/d8/d33/d43/lc4 0 2024-04-26T23:09:10.908 INFO:tasks.workunit.client.0.smithi148.stdout:1/504: creat d16/d17/d4b/fa8 x:0 0 0 2024-04-26T23:09:10.910 INFO:tasks.workunit.client.0.smithi148.stdout:8/555: creat d3/d9/d12/d23/d65/fac x:0 0 0 2024-04-26T23:09:10.910 INFO:tasks.workunit.client.0.smithi148.stdout:8/556: chown d3/da 16206 1 2024-04-26T23:09:10.919 INFO:tasks.workunit.client.0.smithi148.stdout:9/515: truncate d19/d1d/f66 3341017 0 2024-04-26T23:09:10.919 INFO:tasks.workunit.client.0.smithi148.stdout:9/516: readlink d19/d22/l6a 0 2024-04-26T23:09:10.923 INFO:tasks.workunit.client.0.smithi148.stdout:1/505: truncate d16/d1c/f3c 1087533 0 2024-04-26T23:09:10.924 INFO:tasks.workunit.client.0.smithi148.stdout:8/557: mkdir d3/d9/d12/d23/d35/dad 0 2024-04-26T23:09:10.924 INFO:tasks.workunit.client.0.smithi148.stdout:8/558: chown d3/d9/d12/d95 211868864 1 2024-04-26T23:09:10.928 INFO:tasks.workunit.client.0.smithi148.stdout:9/517: creat d19/d1d/d25/d2f/d4d/d33/fac x:0 0 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/472: dwrite d7/d11/d17/d7c/f92 [0,4194304] 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/473: dread - d7/d75/f85 zero size 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/506: creat d16/d17/d4b/d55/fa9 x:0 0 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/507: fdatasync d16/d45/d2b/f5c 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/508: chown d16/d1c/f32 34742 1 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/509: fsync d16/d17/d4b/f9e 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:8/559: creat d3/d9/d85/d79/fae x:0 0 0 2024-04-26T23:09:10.929 INFO:tasks.workunit.client.0.smithi148.stdout:5/596: dwrite da/d1b/d3b/d73/fcf [0,4194304] 0 2024-04-26T23:09:10.930 INFO:tasks.workunit.client.0.smithi148.stdout:7/474: symlink d7/d11/d17/d2f/d57/l99 0 2024-04-26T23:09:10.930 INFO:tasks.workunit.client.0.smithi148.stdout:7/475: chown d7/d11/d17/d2f/f5b 798602569 1 2024-04-26T23:09:10.930 INFO:tasks.workunit.client.0.smithi148.stdout:7/476: chown d7/d19/f83 17 1 2024-04-26T23:09:10.931 INFO:tasks.workunit.client.0.smithi148.stdout:1/510: rename d16/d1c/f9b to d16/d1c/faa 0 2024-04-26T23:09:10.933 INFO:tasks.workunit.client.0.smithi148.stdout:8/560: unlink d3/d9/d12/d23/d35/f82 0 2024-04-26T23:09:10.938 INFO:tasks.workunit.client.0.smithi148.stdout:5/597: link da/d12/c81 da/d1b/d2d/da8/cde 0 2024-04-26T23:09:10.939 INFO:tasks.workunit.client.0.smithi148.stdout:7/477: rmdir d7/d11/d29/d2e/d41 39 2024-04-26T23:09:10.943 INFO:tasks.workunit.client.0.smithi148.stdout:1/511: symlink d16/lab 0 2024-04-26T23:09:10.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/561: getdents d3/da/d1c/d7c 0 2024-04-26T23:09:10.943 INFO:tasks.workunit.client.0.smithi148.stdout:5/598: creat da/d1f/fdf x:0 0 0 2024-04-26T23:09:10.946 INFO:tasks.workunit.client.0.smithi148.stdout:1/512: symlink d16/d17/d4b/d53/lac 0 2024-04-26T23:09:10.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/562: getdents d3/d9/d12/d23/d29 0 2024-04-26T23:09:10.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/563: chown d3/d9/d12/d23/d54 8 1 2024-04-26T23:09:10.954 INFO:tasks.workunit.client.0.smithi148.stdout:0/595: dwrite d0/d8/d33/d6a/f6e [0,4194304] 0 2024-04-26T23:09:10.957 INFO:tasks.workunit.client.0.smithi148.stdout:1/513: creat d16/d17/d4b/d4d/fad x:0 0 0 2024-04-26T23:09:10.959 INFO:tasks.workunit.client.0.smithi148.stdout:6/496: dwrite d6/d9/f64 [0,4194304] 0 2024-04-26T23:09:10.959 INFO:tasks.workunit.client.0.smithi148.stdout:5/599: rename da/d1a/l3c to da/d1b/d3b/d73/d97/db0/le0 0 2024-04-26T23:09:10.966 INFO:tasks.workunit.client.0.smithi148.stdout:1/514: link d16/d17/d4b/f99 d16/d17/d4b/d53/d67/fae 0 2024-04-26T23:09:10.966 INFO:tasks.workunit.client.0.smithi148.stdout:7/478: write d7/f22 [2795303,49601] 0 2024-04-26T23:09:10.967 INFO:tasks.workunit.client.0.smithi148.stdout:6/497: rename d6/d32/d4e to d6/d14/d91/d9f 0 2024-04-26T23:09:10.967 INFO:tasks.workunit.client.0.smithi148.stdout:1/515: dread - d16/d17/d4b/d53/f5e zero size 2024-04-26T23:09:10.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/600: mkdir da/d1b/d5b/de1 0 2024-04-26T23:09:10.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/601: fsync f3 0 2024-04-26T23:09:10.967 INFO:tasks.workunit.client.0.smithi148.stdout:8/564: write d3/da/d1c/d7c/d8c/d9f/f17 [4030043,86853] 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:6/498: write d6/d32/f63 [2377698,65166] 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:6/499: fdatasync d6/f19 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:7/479: mkdir d7/d11/d29/d9a 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:0/596: rename d0/d20/d3b/d86 to d0/d8/d5f/d72/dd1 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:7/480: stat d7/d11/d17/d2f/d44/l4e 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:1/516: mkdir d16/d17/daf 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:5/602: link da/d1b/d2d/da8/cde da/d1b/d1c/d7f/ce2 0 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:4/531: sync 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:3/494: sync 2024-04-26T23:09:10.981 INFO:tasks.workunit.client.0.smithi148.stdout:2/609: sync 2024-04-26T23:09:10.982 INFO:tasks.workunit.client.0.smithi148.stdout:2/610: write d5/d8/d9/f69 [877822,106822] 0 2024-04-26T23:09:10.983 INFO:tasks.workunit.client.0.smithi148.stdout:6/500: creat d6/d9/d1c/d1d/fa0 x:0 0 0 2024-04-26T23:09:10.984 INFO:tasks.workunit.client.0.smithi148.stdout:6/501: stat d6/ld 0 2024-04-26T23:09:10.984 INFO:tasks.workunit.client.0.smithi148.stdout:7/481: mkdir d7/d11/d17/d2f/d44/d9b 0 2024-04-26T23:09:10.985 INFO:tasks.workunit.client.0.smithi148.stdout:4/532: symlink d12/d17/la2 0 2024-04-26T23:09:10.986 INFO:tasks.workunit.client.0.smithi148.stdout:3/495: creat d9/d15/d29/d4d/d68/f9e x:0 0 0 2024-04-26T23:09:10.986 INFO:tasks.workunit.client.0.smithi148.stdout:3/496: chown d9/d15/d29/d4d/d68/f9e 2 1 2024-04-26T23:09:10.986 INFO:tasks.workunit.client.0.smithi148.stdout:3/497: write d9/d52/f5c [1310916,56900] 0 2024-04-26T23:09:10.986 INFO:tasks.workunit.client.0.smithi148.stdout:3/498: dread - d9/d15/d29/d4d/f8e zero size 2024-04-26T23:09:10.987 INFO:tasks.workunit.client.0.smithi148.stdout:0/597: write d0/d2e/d8f/d6c/dab/f66 [4275779,68711] 0 2024-04-26T23:09:10.987 INFO:tasks.workunit.client.0.smithi148.stdout:2/611: rename d5/d7f/d86/d87/db2 to d5/d7f/d86/dca 0 2024-04-26T23:09:10.987 INFO:tasks.workunit.client.0.smithi148.stdout:2/612: truncate d5/d7f/d86/f9a 784221 0 2024-04-26T23:09:10.987 INFO:tasks.workunit.client.0.smithi148.stdout:6/502: getdents d6/d9/d1c 0 2024-04-26T23:09:10.987 INFO:tasks.workunit.client.0.smithi148.stdout:6/503: dread - d6/d9/f7e zero size 2024-04-26T23:09:10.989 INFO:tasks.workunit.client.0.smithi148.stdout:4/533: mknod d12/d17/d2a/ca3 0 2024-04-26T23:09:10.990 INFO:tasks.workunit.client.0.smithi148.stdout:3/499: mkdir d9/d15/d29/d88/d9f 0 2024-04-26T23:09:10.992 INFO:tasks.workunit.client.0.smithi148.stdout:0/598: mkdir d0/d8/d95/d97/d3a/dd2 0 2024-04-26T23:09:10.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/504: link d6/d9/d1c/d1d/d1f/l38 d6/d9/d1c/la1 0 2024-04-26T23:09:10.993 INFO:tasks.workunit.client.0.smithi148.stdout:3/500: mknod d9/d4c/ca0 0 2024-04-26T23:09:10.994 INFO:tasks.workunit.client.0.smithi148.stdout:0/599: creat d0/d2e/d51/fd3 x:0 0 0 2024-04-26T23:09:10.994 INFO:tasks.workunit.client.0.smithi148.stdout:0/600: chown d0/d8/d33/d6a/l91 1202 1 2024-04-26T23:09:11.012 INFO:tasks.workunit.client.0.smithi148.stdout:6/505: dread d6/d14/d91/d9f/f78 [0,4194304] 0 2024-04-26T23:09:11.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/482: dread d7/d11/f18 [0,4194304] 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:8/565: dwrite d3/d9/d12/d23/d35/f66 [0,4194304] 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:8/566: dread - d3/d9/f58 zero size 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:3/501: rename d9/d15/f1b to d9/d15/d29/d88/fa1 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:8/567: fsync d3/d9/d12/d23/d35/f47 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:4/534: write d12/d1c/d45/d8c/f26 [2458869,102853] 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:7/483: symlink d7/d19/l9c 0 2024-04-26T23:09:11.028 INFO:tasks.workunit.client.0.smithi148.stdout:7/484: read - d7/d11/d29/d2e/f72 zero size 2024-04-26T23:09:11.029 INFO:tasks.workunit.client.0.smithi148.stdout:6/506: unlink d6/d14/c8f 0 2024-04-26T23:09:11.029 INFO:tasks.workunit.client.0.smithi148.stdout:6/507: fsync d6/d9/d1c/f94 0 2024-04-26T23:09:11.029 INFO:tasks.workunit.client.0.smithi148.stdout:6/508: stat d6/d9/d1e/f79 0 2024-04-26T23:09:11.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/485: dwrite d7/d11/d29/d2e/d41/f8a [0,4194304] 0 2024-04-26T23:09:11.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/486: chown d7/d11/d29/d2e/d41/l56 37592549 1 2024-04-26T23:09:11.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/487: stat d7/d11/l3e 0 2024-04-26T23:09:11.080 INFO:tasks.workunit.client.0.smithi148.stdout:7/488: write d7/d75/f33 [5125700,1381] 0 2024-04-26T23:09:11.080 INFO:tasks.workunit.client.0.smithi148.stdout:6/509: creat d6/d9/d1c/d1d/d1f/fa2 x:0 0 0 2024-04-26T23:09:11.080 INFO:tasks.workunit.client.0.smithi148.stdout:6/510: chown d6/d32/c3e 13668237 1 2024-04-26T23:09:11.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/535: read d12/d17/d2a/d37/f42 [85861,12708] 0 2024-04-26T23:09:11.092 INFO:tasks.workunit.client.0.smithi148.stdout:4/536: write d12/d1c/d45/f9e [554903,34388] 0 2024-04-26T23:09:11.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/613: dwrite d5/d7/d73/fb3 [0,4194304] 0 2024-04-26T23:09:11.098 INFO:tasks.workunit.client.0.smithi148.stdout:6/511: creat d6/d32/fa3 x:0 0 0 2024-04-26T23:09:11.100 INFO:tasks.workunit.client.0.smithi148.stdout:4/537: link d12/d1c/d45/d8c/l81 d12/d1c/d56/d87/d9c/da1/la4 0 2024-04-26T23:09:11.100 INFO:tasks.workunit.client.0.smithi148.stdout:7/489: dread d7/d75/f91 [0,4194304] 0 2024-04-26T23:09:11.104 INFO:tasks.workunit.client.0.smithi148.stdout:0/601: dwrite d0/d8/d95/d97/d3a/fa2 [0,4194304] 0 2024-04-26T23:09:11.104 INFO:tasks.workunit.client.0.smithi148.stdout:3/502: dread d9/f86 [0,4194304] 0 2024-04-26T23:09:11.113 INFO:tasks.workunit.client.0.smithi148.stdout:2/614: dread d5/d8/d15/d43/d8d/fc3 [0,4194304] 0 2024-04-26T23:09:11.119 INFO:tasks.workunit.client.0.smithi148.stdout:8/568: dwrite d3/f44 [4194304,4194304] 0 2024-04-26T23:09:11.119 INFO:tasks.workunit.client.0.smithi148.stdout:8/569: write d3/da/d1c/d7c/d8c/d9f/f20 [431499,73718] 0 2024-04-26T23:09:11.121 INFO:tasks.workunit.client.0.smithi148.stdout:3/503: write d9/d52/f62 [593208,87585] 0 2024-04-26T23:09:11.131 INFO:tasks.workunit.client.0.smithi148.stdout:3/504: dread d9/d15/d29/d4d/d68/f96 [0,4194304] 0 2024-04-26T23:09:11.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/603: dwrite da/d1a/fbf [0,4194304] 0 2024-04-26T23:09:11.149 INFO:tasks.workunit.client.0.smithi148.stdout:5/604: chown da/c20 1 1 2024-04-26T23:09:11.180 INFO:tasks.workunit.client.0.smithi148.stdout:1/517: dwrite d16/d1c/f2c [8388608,4194304] 0 2024-04-26T23:09:11.181 INFO:tasks.workunit.client.0.smithi148.stdout:1/518: write d16/d17/f39 [4696288,32680] 0 2024-04-26T23:09:11.181 INFO:tasks.workunit.client.0.smithi148.stdout:1/519: chown d16/d17/f25 443167 1 2024-04-26T23:09:11.355 INFO:tasks.workunit.client.0.smithi148.stdout:6/512: symlink d6/d9/d1c/d1d/d1f/d40/la4 0 2024-04-26T23:09:11.356 INFO:tasks.workunit.client.0.smithi148.stdout:4/538: rmdir d12/d1c/d56 39 2024-04-26T23:09:11.356 INFO:tasks.workunit.client.0.smithi148.stdout:4/539: read d12/d17/f2e [3778688,84278] 0 2024-04-26T23:09:11.356 INFO:tasks.workunit.client.0.smithi148.stdout:4/540: chown d12/d17 11 1 2024-04-26T23:09:11.356 INFO:tasks.workunit.client.0.smithi148.stdout:4/541: read - d12/d1c/d56/f86 zero size 2024-04-26T23:09:11.361 INFO:tasks.workunit.client.0.smithi148.stdout:0/602: mkdir d0/d5/dd4 0 2024-04-26T23:09:11.362 INFO:tasks.workunit.client.0.smithi148.stdout:0/603: fsync d0/d2e/d51/f60 0 2024-04-26T23:09:11.363 INFO:tasks.workunit.client.0.smithi148.stdout:4/542: dread d12/d1c/f69 [0,4194304] 0 2024-04-26T23:09:11.363 INFO:tasks.workunit.client.0.smithi148.stdout:2/615: creat d5/d8/d15/d43/d5d/fcb x:0 0 0 2024-04-26T23:09:11.366 INFO:tasks.workunit.client.0.smithi148.stdout:8/570: creat d3/d9/d12/d23/d35/faf x:0 0 0 2024-04-26T23:09:11.366 INFO:tasks.workunit.client.0.smithi148.stdout:8/571: read - d3/d9a/fa8 zero size 2024-04-26T23:09:11.371 INFO:tasks.workunit.client.0.smithi148.stdout:3/505: creat d9/d31/d8f/fa2 x:0 0 0 2024-04-26T23:09:11.385 INFO:tasks.workunit.client.0.smithi148.stdout:7/490: write d7/d11/d29/d2e/d41/f48 [2714280,126800] 0 2024-04-26T23:09:11.385 INFO:tasks.workunit.client.0.smithi148.stdout:7/491: truncate d7/d75/f77 246744 0 2024-04-26T23:09:11.387 INFO:tasks.workunit.client.0.smithi148.stdout:5/605: rmdir da/d68/d69/daa/dc0 39 2024-04-26T23:09:11.387 INFO:tasks.workunit.client.0.smithi148.stdout:5/606: chown da/d1b/d3b/db2 822 1 2024-04-26T23:09:11.396 INFO:tasks.workunit.client.0.smithi148.stdout:1/520: creat d16/d85/fb0 x:0 0 0 2024-04-26T23:09:11.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/543: dwrite d12/d17/d2a/d37/f64 [0,4194304] 0 2024-04-26T23:09:11.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/544: chown d12/d17/d2a/c7e 17 1 2024-04-26T23:09:11.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/545: chown d12/d1c/f67 13414 1 2024-04-26T23:09:11.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/546: chown d12/d1c/d56/d87/d9a/d9d/f4e 6391148 1 2024-04-26T23:09:11.412 INFO:tasks.workunit.client.0.smithi148.stdout:5/607: dread da/f3e [0,4194304] 0 2024-04-26T23:09:11.412 INFO:tasks.workunit.client.0.smithi148.stdout:5/608: stat da/d1b/d1c/l56 0 2024-04-26T23:09:11.415 INFO:tasks.workunit.client.0.smithi148.stdout:8/572: dwrite d3/d9/d12/f3f [0,4194304] 0 2024-04-26T23:09:11.415 INFO:tasks.workunit.client.0.smithi148.stdout:8/573: fsync d3/d9/d12/d23/d29/d37/f3e 0 2024-04-26T23:09:11.415 INFO:tasks.workunit.client.0.smithi148.stdout:6/513: mkdir d6/d9/d1c/d1d/d1f/da5 0 2024-04-26T23:09:11.418 INFO:tasks.workunit.client.0.smithi148.stdout:0/604: creat d0/d8/d95/d97/d3a/dd2/fd5 x:0 0 0 2024-04-26T23:09:11.418 INFO:tasks.workunit.client.0.smithi148.stdout:0/605: stat d0/d2e/d8f/l85 0 2024-04-26T23:09:11.419 INFO:tasks.workunit.client.0.smithi148.stdout:3/506: dwrite d9/d15/d29/f3b [0,4194304] 0 2024-04-26T23:09:11.419 INFO:tasks.workunit.client.0.smithi148.stdout:3/507: readlink d9/l6c 0 2024-04-26T23:09:11.420 INFO:tasks.workunit.client.0.smithi148.stdout:3/508: write d9/d4c/f8a [439085,127903] 0 2024-04-26T23:09:11.421 INFO:tasks.workunit.client.0.smithi148.stdout:2/616: truncate d5/d10/f3b 470769 0 2024-04-26T23:09:11.421 INFO:tasks.workunit.client.0.smithi148.stdout:2/617: write d5/d8/d4b/f55 [912267,87296] 0 2024-04-26T23:09:11.425 INFO:tasks.workunit.client.0.smithi148.stdout:7/492: unlink d7/d19/f30 0 2024-04-26T23:09:11.428 INFO:tasks.workunit.client.0.smithi148.stdout:1/521: creat d16/d85/fb1 x:0 0 0 2024-04-26T23:09:11.441 INFO:tasks.workunit.client.0.smithi148.stdout:4/547: mknod d12/d17/d2a/d37/d97/ca5 0 2024-04-26T23:09:11.441 INFO:tasks.workunit.client.0.smithi148.stdout:4/548: fdatasync d12/f8f 0 2024-04-26T23:09:11.441 INFO:tasks.workunit.client.0.smithi148.stdout:4/549: write d12/d1c/d56/d87/d9a/f8e [690592,58122] 0 2024-04-26T23:09:11.441 INFO:tasks.workunit.client.0.smithi148.stdout:5/609: symlink da/d68/d69/daa/dc0/le3 0 2024-04-26T23:09:11.444 INFO:tasks.workunit.client.0.smithi148.stdout:6/514: mknod d6/d9/d23/ca6 0 2024-04-26T23:09:11.444 INFO:tasks.workunit.client.0.smithi148.stdout:6/515: stat d6/dc/c3d 0 2024-04-26T23:09:11.451 INFO:tasks.workunit.client.0.smithi148.stdout:0/606: truncate d0/d2e/f50 4083850 0 2024-04-26T23:09:11.459 INFO:tasks.workunit.client.0.smithi148.stdout:2/618: symlink d5/db8/lcc 0 2024-04-26T23:09:11.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/619: fsync d5/d7f/d86/d87/f8a 0 2024-04-26T23:09:11.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/620: readlink d5/d8/d4b/d4e/d6d/da0/d32/l33 0 2024-04-26T23:09:11.460 INFO:tasks.workunit.client.0.smithi148.stdout:3/509: dwrite d9/d15/f25 [0,4194304] 0 2024-04-26T23:09:11.462 INFO:tasks.workunit.client.0.smithi148.stdout:9/518: sync 2024-04-26T23:09:11.467 INFO:tasks.workunit.client.0.smithi148.stdout:7/493: getdents d7/d11/d29/d2e/d41 0 2024-04-26T23:09:11.468 INFO:tasks.workunit.client.0.smithi148.stdout:8/574: dwrite d3/d9/d12/d95/f96 [0,4194304] 0 2024-04-26T23:09:11.470 INFO:tasks.workunit.client.0.smithi148.stdout:1/522: mkdir d16/d1c/d82/db2 0 2024-04-26T23:09:11.471 INFO:tasks.workunit.client.0.smithi148.stdout:1/523: dread - d16/d17/d77/f80 zero size 2024-04-26T23:09:11.471 INFO:tasks.workunit.client.0.smithi148.stdout:1/524: stat d16/d47/d49 0 2024-04-26T23:09:11.478 INFO:tasks.workunit.client.0.smithi148.stdout:4/550: rename d12/d1c/d45/d8c/f39 to d12/d1c/d45/d75/fa6 0 2024-04-26T23:09:11.478 INFO:tasks.workunit.client.0.smithi148.stdout:5/610: mkdir da/d1b/d5b/d5e/d6a/de4 0 2024-04-26T23:09:11.478 INFO:tasks.workunit.client.0.smithi148.stdout:5/611: write da/d1b/d3b/d73/d97/fad [352456,60302] 0 2024-04-26T23:09:11.482 INFO:tasks.workunit.client.0.smithi148.stdout:2/621: mknod d5/d8/d4b/d4e/d6d/da0/d32/d4c/ccd 0 2024-04-26T23:09:11.485 INFO:tasks.workunit.client.0.smithi148.stdout:3/510: mknod d9/d65/d80/d83/ca3 0 2024-04-26T23:09:11.485 INFO:tasks.workunit.client.0.smithi148.stdout:2/622: dread d5/d8/d11/f5e [0,4194304] 0 2024-04-26T23:09:11.485 INFO:tasks.workunit.client.0.smithi148.stdout:2/623: read - d5/d8/d15/d43/d5d/f7c zero size 2024-04-26T23:09:11.488 INFO:tasks.workunit.client.0.smithi148.stdout:7/494: symlink d7/d11/d29/d2e/l9d 0 2024-04-26T23:09:11.491 INFO:tasks.workunit.client.0.smithi148.stdout:1/525: mknod d16/d17/daf/cb3 0 2024-04-26T23:09:11.494 INFO:tasks.workunit.client.0.smithi148.stdout:4/551: mkdir d12/d1c/d56/d87/d9c/da7 0 2024-04-26T23:09:11.497 INFO:tasks.workunit.client.0.smithi148.stdout:0/607: rename d0/d2e/d51 to d0/d8/d33/d6a/d70/dd6 0 2024-04-26T23:09:11.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/511: write d9/d15/d29/d88/fa1 [3929940,109159] 0 2024-04-26T23:09:11.503 INFO:tasks.workunit.client.0.smithi148.stdout:7/495: mkdir d7/d11/d17/d9e 0 2024-04-26T23:09:11.504 INFO:tasks.workunit.client.0.smithi148.stdout:1/526: mknod d16/d17/d4b/d53/d67/cb4 0 2024-04-26T23:09:11.507 INFO:tasks.workunit.client.0.smithi148.stdout:9/519: rename l14 to d19/d1d/lad 0 2024-04-26T23:09:11.509 INFO:tasks.workunit.client.0.smithi148.stdout:3/512: symlink d9/la4 0 2024-04-26T23:09:11.511 INFO:tasks.workunit.client.0.smithi148.stdout:1/527: creat d16/d17/fb5 x:0 0 0 2024-04-26T23:09:11.511 INFO:tasks.workunit.client.0.smithi148.stdout:1/528: write f13 [1343394,37157] 0 2024-04-26T23:09:11.513 INFO:tasks.workunit.client.0.smithi148.stdout:9/520: symlink d19/d1d/d25/d2f/lae 0 2024-04-26T23:09:11.515 INFO:tasks.workunit.client.0.smithi148.stdout:3/513: creat d9/d15/d29/d4d/d68/d8c/fa5 x:0 0 0 2024-04-26T23:09:11.517 INFO:tasks.workunit.client.0.smithi148.stdout:1/529: symlink d16/d85/lb6 0 2024-04-26T23:09:11.520 INFO:tasks.workunit.client.0.smithi148.stdout:9/521: truncate d19/d1d/d25/d31/f55 830086 0 2024-04-26T23:09:11.554 INFO:tasks.workunit.client.0.smithi148.stdout:2/624: dwrite d5/d7f/d86/f9a [0,4194304] 0 2024-04-26T23:09:11.554 INFO:tasks.workunit.client.0.smithi148.stdout:2/625: dread - d5/d8/f7b zero size 2024-04-26T23:09:11.556 INFO:tasks.workunit.client.0.smithi148.stdout:2/626: mknod d5/da6/cce 0 2024-04-26T23:09:11.556 INFO:tasks.workunit.client.0.smithi148.stdout:2/627: chown d5/d8/d4b/d4e/d6d/da0/d32/l33 16487261 1 2024-04-26T23:09:11.557 INFO:tasks.workunit.client.0.smithi148.stdout:2/628: creat d5/d8/d4b/d4e/d6d/dbe/fcf x:0 0 0 2024-04-26T23:09:11.557 INFO:tasks.workunit.client.0.smithi148.stdout:2/629: chown d5/d8/d11/dae/lad 161 1 2024-04-26T23:09:11.558 INFO:tasks.workunit.client.0.smithi148.stdout:2/630: mknod d5/d8/db9/cd0 0 2024-04-26T23:09:11.567 INFO:tasks.workunit.client.0.smithi148.stdout:2/631: dread d5/d8/d11/f44 [0,4194304] 0 2024-04-26T23:09:11.658 INFO:tasks.workunit.client.0.smithi148.stdout:9/522: dread d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/f95 [0,4194304] 0 2024-04-26T23:09:11.664 INFO:tasks.workunit.client.0.smithi148.stdout:7/496: write d7/d11/d29/d2e/f32 [1670308,74666] 0 2024-04-26T23:09:11.665 INFO:tasks.workunit.client.0.smithi148.stdout:4/552: dwrite d12/d1c/d56/d87/d9a/f76 [0,4194304] 0 2024-04-26T23:09:11.669 INFO:tasks.workunit.client.0.smithi148.stdout:7/497: unlink d7/d11/d29/l50 0 2024-04-26T23:09:11.671 INFO:tasks.workunit.client.0.smithi148.stdout:4/553: creat d12/d1c/d56/d87/d9a/d9d/fa8 x:0 0 0 2024-04-26T23:09:11.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/523: dread d19/d1d/d25/f3e [0,4194304] 0 2024-04-26T23:09:11.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/524: chown d19/d22/f5d 2578 1 2024-04-26T23:09:11.674 INFO:tasks.workunit.client.0.smithi148.stdout:7/498: rename d7/d11/d17/d7c/f92 to d7/d11/d29/d2e/d41/d67/d94/f9f 0 2024-04-26T23:09:11.680 INFO:tasks.workunit.client.0.smithi148.stdout:7/499: creat d7/d11/d29/d2e/d41/d67/fa0 x:0 0 0 2024-04-26T23:09:11.680 INFO:tasks.workunit.client.0.smithi148.stdout:7/500: chown d7/d11/d29/d2e/d41/f8a 98324 1 2024-04-26T23:09:11.682 INFO:tasks.workunit.client.0.smithi148.stdout:7/501: mkdir d7/d11/d17/d2f/d44/d9b/da1 0 2024-04-26T23:09:11.682 INFO:tasks.workunit.client.0.smithi148.stdout:7/502: chown d7/d11/d17/d43/f52 221342 1 2024-04-26T23:09:11.703 INFO:tasks.workunit.client.0.smithi148.stdout:4/554: dwrite d12/d17/d2a/d37/f5c [4194304,4194304] 0 2024-04-26T23:09:11.708 INFO:tasks.workunit.client.0.smithi148.stdout:4/555: dread d12/d1c/d56/d87/d9a/f8e [0,4194304] 0 2024-04-26T23:09:11.736 INFO:tasks.workunit.client.0.smithi148.stdout:9/525: dwrite d19/d1d/d25/d31/f55 [0,4194304] 0 2024-04-26T23:09:11.740 INFO:tasks.workunit.client.0.smithi148.stdout:9/526: rename d19/d1d/d25/d2f/d4d/d33/d50/d61/f64 to d19/d9f/faf 0 2024-04-26T23:09:11.742 INFO:tasks.workunit.client.0.smithi148.stdout:9/527: creat d19/d1d/d25/d2f/d4d/d33/daa/fb0 x:0 0 0 2024-04-26T23:09:11.750 INFO:tasks.workunit.client.0.smithi148.stdout:4/556: dwrite d12/d1c/d56/d87/d9a/d9d/f57 [0,4194304] 0 2024-04-26T23:09:11.752 INFO:tasks.workunit.client.0.smithi148.stdout:4/557: mkdir d12/d1c/d56/d87/d9c/da1/da9 0 2024-04-26T23:09:11.754 INFO:tasks.workunit.client.0.smithi148.stdout:4/558: creat d12/d1c/d56/d87/d9a/d9d/faa x:0 0 0 2024-04-26T23:09:11.754 INFO:tasks.workunit.client.0.smithi148.stdout:4/559: stat d12/d1c/d45 0 2024-04-26T23:09:11.755 INFO:tasks.workunit.client.0.smithi148.stdout:4/560: fdatasync d12/d17/d2a/f2f 0 2024-04-26T23:09:11.755 INFO:tasks.workunit.client.0.smithi148.stdout:4/561: fdatasync d12/f41 0 2024-04-26T23:09:11.756 INFO:tasks.workunit.client.0.smithi148.stdout:4/562: mknod d12/d1c/d56/d87/d9a/cab 0 2024-04-26T23:09:11.757 INFO:tasks.workunit.client.0.smithi148.stdout:4/563: creat d12/d17/d2a/fac x:0 0 0 2024-04-26T23:09:11.759 INFO:tasks.workunit.client.0.smithi148.stdout:4/564: rename d12/c40 to d12/d1c/d56/d87/d9c/cad 0 2024-04-26T23:09:11.760 INFO:tasks.workunit.client.0.smithi148.stdout:4/565: symlink d12/d1c/d45/d8c/lae 0 2024-04-26T23:09:11.762 INFO:tasks.workunit.client.0.smithi148.stdout:4/566: unlink fd 0 2024-04-26T23:09:11.762 INFO:tasks.workunit.client.0.smithi148.stdout:9/528: write d19/d39/f54 [2271234,3207] 0 2024-04-26T23:09:11.765 INFO:tasks.workunit.client.0.smithi148.stdout:9/529: read d19/d22/f26 [257982,31242] 0 2024-04-26T23:09:11.776 INFO:tasks.workunit.client.0.smithi148.stdout:4/567: dread d12/d17/d2a/d37/f5c [4194304,4194304] 0 2024-04-26T23:09:11.778 INFO:tasks.workunit.client.0.smithi148.stdout:4/568: truncate d12/d17/d2a/f2f 3158646 0 2024-04-26T23:09:11.781 INFO:tasks.workunit.client.0.smithi148.stdout:4/569: unlink d12/d1c/d45/d8c/c80 0 2024-04-26T23:09:11.787 INFO:tasks.workunit.client.0.smithi148.stdout:4/570: link d12/f66 d12/d1c/faf 0 2024-04-26T23:09:11.791 INFO:tasks.workunit.client.0.smithi148.stdout:4/571: dread d12/d17/d2a/d37/f62 [0,4194304] 0 2024-04-26T23:09:11.801 INFO:tasks.workunit.client.0.smithi148.stdout:9/530: dwrite d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:11.811 INFO:tasks.workunit.client.0.smithi148.stdout:4/572: dread d12/d17/d2a/d37/f5c [0,4194304] 0 2024-04-26T23:09:11.813 INFO:tasks.workunit.client.0.smithi148.stdout:4/573: mknod d12/cb0 0 2024-04-26T23:09:11.813 INFO:tasks.workunit.client.0.smithi148.stdout:4/574: chown d12/d17/d2a/c5b 381506 1 2024-04-26T23:09:11.813 INFO:tasks.workunit.client.0.smithi148.stdout:4/575: chown d12/d1c/d56/f86 0 1 2024-04-26T23:09:11.814 INFO:tasks.workunit.client.0.smithi148.stdout:4/576: creat d12/d1c/d56/d87/d9c/da7/fb1 x:0 0 0 2024-04-26T23:09:11.815 INFO:tasks.workunit.client.0.smithi148.stdout:4/577: mknod d12/d1c/d56/d87/d9c/da7/cb2 0 2024-04-26T23:09:11.854 INFO:tasks.workunit.client.0.smithi148.stdout:6/516: sync 2024-04-26T23:09:11.854 INFO:tasks.workunit.client.0.smithi148.stdout:6/517: readlink d6/d9/d1c/d1d/d1f/l71 0 2024-04-26T23:09:11.854 INFO:tasks.workunit.client.0.smithi148.stdout:6/518: fdatasync d6/d9/d1c/d1d/d1f/f87 0 2024-04-26T23:09:11.858 INFO:tasks.workunit.client.0.smithi148.stdout:6/519: creat d6/d9/d1c/d1d/fa7 x:0 0 0 2024-04-26T23:09:11.860 INFO:tasks.workunit.client.0.smithi148.stdout:4/578: dwrite d12/d1c/f8b [0,4194304] 0 2024-04-26T23:09:11.860 INFO:tasks.workunit.client.0.smithi148.stdout:4/579: chown d12/l50 916949114 1 2024-04-26T23:09:11.871 INFO:tasks.workunit.client.0.smithi148.stdout:4/580: rename d12/d1c/f69 to d12/d1c/d56/d87/d9a/fb3 0 2024-04-26T23:09:11.875 INFO:tasks.workunit.client.0.smithi148.stdout:4/581: mknod d12/d1c/d45/d75/cb4 0 2024-04-26T23:09:11.882 INFO:tasks.workunit.client.0.smithi148.stdout:4/582: dread d12/d17/d2a/f2f [0,4194304] 0 2024-04-26T23:09:11.882 INFO:tasks.workunit.client.0.smithi148.stdout:4/583: fdatasync d12/d1c/d56/d87/d9a/f8e 0 2024-04-26T23:09:11.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/584: mknod d12/d1c/d56/cb5 0 2024-04-26T23:09:11.888 INFO:tasks.workunit.client.0.smithi148.stdout:4/585: creat d12/d1c/d56/fb6 x:0 0 0 2024-04-26T23:09:11.888 INFO:tasks.workunit.client.0.smithi148.stdout:4/586: write d12/f66 [982479,67171] 0 2024-04-26T23:09:11.888 INFO:tasks.workunit.client.0.smithi148.stdout:4/587: dread - d12/d1c/d56/d87/f99 zero size 2024-04-26T23:09:11.891 INFO:tasks.workunit.client.0.smithi148.stdout:4/588: creat d12/d1c/d45/fb7 x:0 0 0 2024-04-26T23:09:11.895 INFO:tasks.workunit.client.0.smithi148.stdout:4/589: unlink d12/d1c/d56/d87/d9a/f8e 0 2024-04-26T23:09:11.911 INFO:tasks.workunit.client.0.smithi148.stdout:9/531: dwrite d19/d1d/d25/d31/d48/d8c/dab/f8d [0,4194304] 0 2024-04-26T23:09:11.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/590: write d12/d1c/f67 [3359078,108567] 0 2024-04-26T23:09:11.918 INFO:tasks.workunit.client.0.smithi148.stdout:9/532: rename ca to d19/d1d/d25/d2f/d4d/d33/d50/cb1 0 2024-04-26T23:09:11.920 INFO:tasks.workunit.client.0.smithi148.stdout:4/591: mknod d12/d17/cb8 0 2024-04-26T23:09:11.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/592: dread d12/d17/f7c [0,4194304] 0 2024-04-26T23:09:11.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/593: write d12/f41 [495626,70492] 0 2024-04-26T23:09:11.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/594: stat d12/d17/d2a/d37/d97 0 2024-04-26T23:09:11.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/533: mkdir d19/d1d/d25/d2f/d4d/d33/d50/d61/d85/db2 0 2024-04-26T23:09:11.925 INFO:tasks.workunit.client.0.smithi148.stdout:4/595: symlink d12/d1c/d56/d87/d9c/lb9 0 2024-04-26T23:09:11.928 INFO:tasks.workunit.client.0.smithi148.stdout:9/534: creat d19/d1d/d25/d2f/d4d/d33/fb3 x:0 0 0 2024-04-26T23:09:11.929 INFO:tasks.workunit.client.0.smithi148.stdout:9/535: readlink d19/d22/l42 0 2024-04-26T23:09:11.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/596: link d12/d1c/d56/d87/d9a/c5e d12/cba 0 2024-04-26T23:09:11.936 INFO:tasks.workunit.client.0.smithi148.stdout:4/597: rename d12/d1c/d56/d87/d9c/lb9 to d12/d1c/d45/d75/lbb 0 2024-04-26T23:09:11.959 INFO:tasks.workunit.client.0.smithi148.stdout:9/536: dwrite d19/d1d/d25/d2f/d4d/d33/fb3 [0,4194304] 0 2024-04-26T23:09:11.975 INFO:tasks.workunit.client.0.smithi148.stdout:4/598: dwrite d12/d1c/d56/d87/d9a/d9d/f90 [0,4194304] 0 2024-04-26T23:09:11.979 INFO:tasks.workunit.client.0.smithi148.stdout:4/599: creat d12/d1c/d56/d87/d9a/d9d/fbc x:0 0 0 2024-04-26T23:09:11.981 INFO:tasks.workunit.client.0.smithi148.stdout:4/600: read d12/d17/d2a/d37/f62 [183035,43151] 0 2024-04-26T23:09:11.983 INFO:tasks.workunit.client.0.smithi148.stdout:9/537: read d19/d1d/d25/d31/d48/d8c/dab/f8d [2796403,87427] 0 2024-04-26T23:09:11.984 INFO:tasks.workunit.client.0.smithi148.stdout:4/601: unlink d12/d17/cb8 0 2024-04-26T23:09:11.984 INFO:tasks.workunit.client.0.smithi148.stdout:4/602: fsync d12/d17/f5a 0 2024-04-26T23:09:11.987 INFO:tasks.workunit.client.0.smithi148.stdout:9/538: link d19/d1d/d25/d31/d48/d8c/dab/c9d d19/d1d/d69/cb4 0 2024-04-26T23:09:11.990 INFO:tasks.workunit.client.0.smithi148.stdout:4/603: mkdir d12/dbd 0 2024-04-26T23:09:12.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/604: write d12/d1c/d56/d87/d9a/f76 [2414543,98266] 0 2024-04-26T23:09:12.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/605: chown l11 164828585 1 2024-04-26T23:09:12.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/606: dread - d12/d17/d2a/fac zero size 2024-04-26T23:09:12.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/607: write d12/d1c/d45/d8c/f46 [73909,24358] 0 2024-04-26T23:09:12.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/608: chown d12/d17/d2a/d37/f62 1902 1 2024-04-26T23:09:12.011 INFO:tasks.workunit.client.0.smithi148.stdout:9/539: link d19/d1d/d25/d31/c3c d19/d1d/d25/d2f/d4d/d33/d50/cb5 0 2024-04-26T23:09:12.013 INFO:tasks.workunit.client.0.smithi148.stdout:4/609: mknod d12/d17/d2a/d37/d97/cbe 0 2024-04-26T23:09:12.017 INFO:tasks.workunit.client.0.smithi148.stdout:4/610: dread d12/d17/d2a/d37/f62 [0,4194304] 0 2024-04-26T23:09:12.017 INFO:tasks.workunit.client.0.smithi148.stdout:4/611: stat d12/d1c/d45/d8c/f26 0 2024-04-26T23:09:12.019 INFO:tasks.workunit.client.0.smithi148.stdout:9/540: mkdir d19/d1d/d25/d78/db6 0 2024-04-26T23:09:12.021 INFO:tasks.workunit.client.0.smithi148.stdout:4/612: mknod d12/d17/d2a/d37/cbf 0 2024-04-26T23:09:12.027 INFO:tasks.workunit.client.0.smithi148.stdout:4/613: fdatasync d12/d1c/faf 0 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/514: sync 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:8/575: sync 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/612: sync 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/608: sync 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:8/576: dread - d3/d9a/f8d zero size 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/530: sync 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/609: chown d0/d8/d95/d97/d3a/lc9 19405380 1 2024-04-26T23:09:12.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/610: stat d0/d5/d84/ccd 0 2024-04-26T23:09:12.033 INFO:tasks.workunit.client.0.smithi148.stdout:9/541: rmdir d19/d1d/d49 39 2024-04-26T23:09:12.038 INFO:tasks.workunit.client.0.smithi148.stdout:3/515: unlink d9/d31/c41 0 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:4/614: dread d12/d1c/d45/d8c/f3f [0,4194304] 0 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/613: mkdir da/d1b/d3b/d73/ddd/de5 0 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/614: chown da/d1f/d67/f96 1438597441 1 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:4/615: chown d12/d1c/d56/d87/d9a/d9d/c49 2607238 1 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:4/616: chown d12/d1c/d45/d8c/lae 322368 1 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/615: fdatasync da/d1f/d47/fd7 0 2024-04-26T23:09:12.045 INFO:tasks.workunit.client.0.smithi148.stdout:0/611: dread d0/f62 [0,4194304] 0 2024-04-26T23:09:12.047 INFO:tasks.workunit.client.0.smithi148.stdout:9/542: mknod d19/d1d/d25/cb7 0 2024-04-26T23:09:12.050 INFO:tasks.workunit.client.0.smithi148.stdout:3/516: creat d9/d15/d29/d4d/d5b/fa6 x:0 0 0 2024-04-26T23:09:12.053 INFO:tasks.workunit.client.0.smithi148.stdout:5/616: getdents da/d1b/d3b/d73 0 2024-04-26T23:09:12.056 INFO:tasks.workunit.client.0.smithi148.stdout:0/612: unlink d0/d2e/d8f/d6c/dab/f66 0 2024-04-26T23:09:12.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/531: write d16/d1c/f2c [2739164,77059] 0 2024-04-26T23:09:12.059 INFO:tasks.workunit.client.0.smithi148.stdout:9/543: creat d19/d39/d5f/fb8 x:0 0 0 2024-04-26T23:09:12.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/517: creat d9/d15/d29/d88/fa7 x:0 0 0 2024-04-26T23:09:12.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/518: readlink d9/d15/d29/l53 0 2024-04-26T23:09:12.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/519: stat d9/d15/d29/d4d/d5b 0 2024-04-26T23:09:12.064 INFO:tasks.workunit.client.0.smithi148.stdout:3/520: chown d9/d15/d29/d4d/d68/d8c 327574 1 2024-04-26T23:09:12.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/577: write d3/da/f64 [8124927,28244] 0 2024-04-26T23:09:12.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/578: fsync d3/d9a/f9d 0 2024-04-26T23:09:12.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/579: truncate d3/d9/d12/d23/d35/faf 195029 0 2024-04-26T23:09:12.068 INFO:tasks.workunit.client.0.smithi148.stdout:5/617: truncate da/d68/d69/fa7 1143666 0 2024-04-26T23:09:12.068 INFO:tasks.workunit.client.0.smithi148.stdout:5/618: chown da/d1a 641396 1 2024-04-26T23:09:12.071 INFO:tasks.workunit.client.0.smithi148.stdout:4/617: dwrite d12/d1c/f73 [0,4194304] 0 2024-04-26T23:09:12.072 INFO:tasks.workunit.client.0.smithi148.stdout:1/532: mknod d16/d1c/cb7 0 2024-04-26T23:09:12.076 INFO:tasks.workunit.client.0.smithi148.stdout:9/544: mkdir d19/d1d/d25/d31/d32/db9 0 2024-04-26T23:09:12.079 INFO:tasks.workunit.client.0.smithi148.stdout:0/613: dread d0/d8/d5f/fae [0,4194304] 0 2024-04-26T23:09:12.079 INFO:tasks.workunit.client.0.smithi148.stdout:0/614: write d0/d8/d95/d97/d3a/dd2/fd5 [976432,84929] 0 2024-04-26T23:09:12.091 INFO:tasks.workunit.client.0.smithi148.stdout:5/619: mknod da/d1b/d1c/d7f/ce6 0 2024-04-26T23:09:12.091 INFO:tasks.workunit.client.0.smithi148.stdout:5/620: fsync da/d1b/d1c/f53 0 2024-04-26T23:09:12.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/618: mkdir d12/d1c/dc0 0 2024-04-26T23:09:12.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/580: symlink d3/da/d1c/lb0 0 2024-04-26T23:09:12.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/615: write d0/f2 [229482,33825] 0 2024-04-26T23:09:12.100 INFO:tasks.workunit.client.0.smithi148.stdout:4/619: rmdir d12 39 2024-04-26T23:09:12.100 INFO:tasks.workunit.client.0.smithi148.stdout:4/620: chown d12/d17/la2 22 1 2024-04-26T23:09:12.100 INFO:tasks.workunit.client.0.smithi148.stdout:4/621: write d12/f35 [1813936,66437] 0 2024-04-26T23:09:12.104 INFO:tasks.workunit.client.0.smithi148.stdout:8/581: rename d3/l2a to d3/d9/d85/lb1 0 2024-04-26T23:09:12.104 INFO:tasks.workunit.client.0.smithi148.stdout:8/582: chown d3/d9/d12/d23/d54/c75 9318894 1 2024-04-26T23:09:12.109 INFO:tasks.workunit.client.0.smithi148.stdout:0/616: creat d0/d8/d95/d97/d3a/dd2/fd7 x:0 0 0 2024-04-26T23:09:12.112 INFO:tasks.workunit.client.0.smithi148.stdout:4/622: mkdir d12/d17/d2a/d37/d97/dc1 0 2024-04-26T23:09:12.115 INFO:tasks.workunit.client.0.smithi148.stdout:8/583: mkdir d3/d9/d12/d23/d29/db2 0 2024-04-26T23:09:12.115 INFO:tasks.workunit.client.0.smithi148.stdout:8/584: readlink d3/d9/d85/l56 0 2024-04-26T23:09:12.115 INFO:tasks.workunit.client.0.smithi148.stdout:8/585: fsync d3/d9/d12/d23/d29/d37/f63 0 2024-04-26T23:09:12.119 INFO:tasks.workunit.client.0.smithi148.stdout:0/617: rename d0/d8/d1e to d0/d2e/d8f/dd8 0 2024-04-26T23:09:12.123 INFO:tasks.workunit.client.0.smithi148.stdout:4/623: mkdir d12/d1c/d45/dc2 0 2024-04-26T23:09:12.142 INFO:tasks.workunit.client.0.smithi148.stdout:7/503: sync 2024-04-26T23:09:12.143 INFO:tasks.workunit.client.0.smithi148.stdout:4/624: rmdir d12/d1c/d45/d75 39 2024-04-26T23:09:12.144 INFO:tasks.workunit.client.0.smithi148.stdout:2/632: sync 2024-04-26T23:09:12.148 INFO:tasks.workunit.client.0.smithi148.stdout:1/533: dwrite d16/d45/d2b/f5c [0,4194304] 0 2024-04-26T23:09:12.148 INFO:tasks.workunit.client.0.smithi148.stdout:7/504: rename d7/d11/d60/f79 to d7/d75/fa2 0 2024-04-26T23:09:12.149 INFO:tasks.workunit.client.0.smithi148.stdout:4/625: mkdir d12/d1c/d56/d87/d9c/da1/dc3 0 2024-04-26T23:09:12.149 INFO:tasks.workunit.client.0.smithi148.stdout:4/626: fsync d12/d1c/d56/d87/f96 0 2024-04-26T23:09:12.154 INFO:tasks.workunit.client.0.smithi148.stdout:7/505: unlink d7/d11/d29/l55 0 2024-04-26T23:09:12.156 INFO:tasks.workunit.client.0.smithi148.stdout:2/633: truncate d5/d1c/d38/f47 118981 0 2024-04-26T23:09:12.157 INFO:tasks.workunit.client.0.smithi148.stdout:4/627: rmdir d12/d1c/d45/d8c 39 2024-04-26T23:09:12.162 INFO:tasks.workunit.client.0.smithi148.stdout:1/534: write d16/d45/d2b/f46 [4151573,83663] 0 2024-04-26T23:09:12.162 INFO:tasks.workunit.client.0.smithi148.stdout:1/535: chown d16/d1c/d84/da7 14582413 1 2024-04-26T23:09:12.166 INFO:tasks.workunit.client.0.smithi148.stdout:7/506: symlink d7/d11/d60/d68/la3 0 2024-04-26T23:09:12.166 INFO:tasks.workunit.client.0.smithi148.stdout:7/507: stat d7/f90 0 2024-04-26T23:09:12.166 INFO:tasks.workunit.client.0.smithi148.stdout:7/508: chown d7/d75/c2b 3663237 1 2024-04-26T23:09:12.166 INFO:tasks.workunit.client.0.smithi148.stdout:4/628: mknod d12/d1c/d56/d87/d9c/da1/da9/cc4 0 2024-04-26T23:09:12.167 INFO:tasks.workunit.client.0.smithi148.stdout:2/634: mkdir d5/d8/d15/d7d/dd1 0 2024-04-26T23:09:12.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/618: dwrite d0/d5/f7 [0,4194304] 0 2024-04-26T23:09:12.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/619: chown d0/d2e 7273 1 2024-04-26T23:09:12.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/620: truncate d0/d20/d54/fb9 207220 0 2024-04-26T23:09:12.232 INFO:tasks.workunit.client.0.smithi148.stdout:9/545: dwrite d19/f7d [0,4194304] 0 2024-04-26T23:09:12.246 INFO:tasks.workunit.client.0.smithi148.stdout:8/586: dwrite d3/d9/d12/f46 [0,4194304] 0 2024-04-26T23:09:12.261 INFO:tasks.workunit.client.0.smithi148.stdout:5/621: dwrite da/fb [4194304,4194304] 0 2024-04-26T23:09:12.261 INFO:tasks.workunit.client.0.smithi148.stdout:5/622: write da/d1b/d3b/fd2 [330750,115075] 0 2024-04-26T23:09:12.285 INFO:tasks.workunit.client.0.smithi148.stdout:8/587: dwrite d3/d9/f49 [0,4194304] 0 2024-04-26T23:09:12.285 INFO:tasks.workunit.client.0.smithi148.stdout:8/588: write d3/da/f18 [4568281,115718] 0 2024-04-26T23:09:12.288 INFO:tasks.workunit.client.0.smithi148.stdout:2/635: dwrite d5/d8/d9/f23 [0,4194304] 0 2024-04-26T23:09:12.419 INFO:tasks.workunit.client.0.smithi148.stdout:1/536: rename d16/d17/d4b/d59/f9d to d16/d47/d49/fb8 0 2024-04-26T23:09:12.419 INFO:tasks.workunit.client.0.smithi148.stdout:4/629: creat d12/d1c/d45/d75/fc5 x:0 0 0 2024-04-26T23:09:12.430 INFO:tasks.workunit.client.0.smithi148.stdout:5/623: symlink da/d1b/d8b/dc7/le7 0 2024-04-26T23:09:12.434 INFO:tasks.workunit.client.0.smithi148.stdout:8/589: unlink d3/d9/d85/d79/fae 0 2024-04-26T23:09:12.438 INFO:tasks.workunit.client.0.smithi148.stdout:2/636: creat d5/d7f/fd2 x:0 0 0 2024-04-26T23:09:12.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/637: dread d5/d10/f14 [0,4194304] 0 2024-04-26T23:09:12.452 INFO:tasks.workunit.client.0.smithi148.stdout:1/537: creat d16/d17/d4b/d55/d90/fb9 x:0 0 0 2024-04-26T23:09:12.456 INFO:tasks.workunit.client.0.smithi148.stdout:4/630: mkdir d12/d1c/d56/d87/d9a/d9d/dc6 0 2024-04-26T23:09:12.456 INFO:tasks.workunit.client.0.smithi148.stdout:4/631: chown d12/d1c/d56 69483847 1 2024-04-26T23:09:12.461 INFO:tasks.workunit.client.0.smithi148.stdout:8/590: getdents d3/d9/d12/d95 0 2024-04-26T23:09:12.469 INFO:tasks.workunit.client.0.smithi148.stdout:2/638: link d5/d7f/d86/dca/lc4 d5/d8/d15/d7d/dd1/ld3 0 2024-04-26T23:09:12.475 INFO:tasks.workunit.client.0.smithi148.stdout:7/509: rename d7/c14 to d7/d11/d29/d2e/d41/d67/d94/ca4 0 2024-04-26T23:09:12.475 INFO:tasks.workunit.client.0.smithi148.stdout:4/632: dread d12/f35 [0,4194304] 0 2024-04-26T23:09:12.475 INFO:tasks.workunit.client.0.smithi148.stdout:4/633: fdatasync d12/d1c/d56/d87/d9a/f23 0 2024-04-26T23:09:12.475 INFO:tasks.workunit.client.0.smithi148.stdout:4/634: truncate d12/d1c/d56/d87/d9a/d9d/faa 753405 0 2024-04-26T23:09:12.478 INFO:tasks.workunit.client.0.smithi148.stdout:6/520: sync 2024-04-26T23:09:12.479 INFO:tasks.workunit.client.0.smithi148.stdout:6/521: write d6/d9/d1c/d5b/f9d [188236,121061] 0 2024-04-26T23:09:12.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/621: rename d0/d2e/d8f/d6c/l9b to d0/d2e/d8f/d6c/dab/ld9 0 2024-04-26T23:09:12.483 INFO:tasks.workunit.client.0.smithi148.stdout:5/624: dwrite f3 [0,4194304] 0 2024-04-26T23:09:12.487 INFO:tasks.workunit.client.0.smithi148.stdout:7/510: symlink d7/d11/d17/d2f/d44/d9b/la5 0 2024-04-26T23:09:12.489 INFO:tasks.workunit.client.0.smithi148.stdout:4/635: creat d12/d1c/d56/fc7 x:0 0 0 2024-04-26T23:09:12.489 INFO:tasks.workunit.client.0.smithi148.stdout:4/636: readlink d12/d1c/d45/d8c/l59 0 2024-04-26T23:09:12.491 INFO:tasks.workunit.client.0.smithi148.stdout:6/522: rmdir d6/d14 39 2024-04-26T23:09:12.491 INFO:tasks.workunit.client.0.smithi148.stdout:6/523: readlink d6/d9/d1c/d1d/d1f/d40/l56 0 2024-04-26T23:09:12.491 INFO:tasks.workunit.client.0.smithi148.stdout:6/524: write d6/d14/d91/d9f/f73 [1784174,95826] 0 2024-04-26T23:09:12.498 INFO:tasks.workunit.client.0.smithi148.stdout:6/525: read d6/d9/d23/d4a/f67 [651953,87846] 0 2024-04-26T23:09:12.498 INFO:tasks.workunit.client.0.smithi148.stdout:0/622: mknod d0/d5/d84/cda 0 2024-04-26T23:09:12.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/521: sync 2024-04-26T23:09:12.501 INFO:tasks.workunit.client.0.smithi148.stdout:7/511: mknod d7/d11/d17/d9e/ca6 0 2024-04-26T23:09:12.501 INFO:tasks.workunit.client.0.smithi148.stdout:7/512: fsync d7/d11/f88 0 2024-04-26T23:09:12.501 INFO:tasks.workunit.client.0.smithi148.stdout:7/513: fsync d7/d11/d17/d2f/f5b 0 2024-04-26T23:09:12.503 INFO:tasks.workunit.client.0.smithi148.stdout:1/538: dwrite d16/d17/d4b/d55/fa9 [0,4194304] 0 2024-04-26T23:09:12.504 INFO:tasks.workunit.client.0.smithi148.stdout:0/623: creat d0/d8/d33/d6a/d70/dd6/daf/fdb x:0 0 0 2024-04-26T23:09:12.505 INFO:tasks.workunit.client.0.smithi148.stdout:9/546: sync 2024-04-26T23:09:12.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/522: link d9/c60 d9/d65/d80/ca8 0 2024-04-26T23:09:12.507 INFO:tasks.workunit.client.0.smithi148.stdout:3/523: fdatasync d9/d31/f95 0 2024-04-26T23:09:12.508 INFO:tasks.workunit.client.0.smithi148.stdout:7/514: rmdir d7/d11/d17/d2f/d44 39 2024-04-26T23:09:12.513 INFO:tasks.workunit.client.0.smithi148.stdout:2/639: rename d5/d7f/d86/dca to d5/d8/d15/d43/dd4 0 2024-04-26T23:09:12.519 INFO:tasks.workunit.client.0.smithi148.stdout:0/624: creat d0/d8/d33/fdc x:0 0 0 2024-04-26T23:09:12.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/524: creat d9/d31/fa9 x:0 0 0 2024-04-26T23:09:12.524 INFO:tasks.workunit.client.0.smithi148.stdout:9/547: rename d19/d1d/d25/d2f/d4d/d33/d50/d61 to d19/d1d/d25/d31/d60/dba 0 2024-04-26T23:09:12.524 INFO:tasks.workunit.client.0.smithi148.stdout:9/548: write d19/d22/f26 [1651958,107700] 0 2024-04-26T23:09:12.525 INFO:tasks.workunit.client.0.smithi148.stdout:3/525: dread d9/d15/d29/d4d/f64 [0,4194304] 0 2024-04-26T23:09:12.525 INFO:tasks.workunit.client.0.smithi148.stdout:2/640: truncate d5/d10/f58 77255 0 2024-04-26T23:09:12.528 INFO:tasks.workunit.client.0.smithi148.stdout:0/625: unlink d0/d8/d33/d68/f93 0 2024-04-26T23:09:12.531 INFO:tasks.workunit.client.0.smithi148.stdout:7/515: rename d7/d75/f77 to d7/d11/d29/d2e/fa7 0 2024-04-26T23:09:12.536 INFO:tasks.workunit.client.0.smithi148.stdout:8/591: dwrite d3/da/d28/f70 [0,4194304] 0 2024-04-26T23:09:12.537 INFO:tasks.workunit.client.0.smithi148.stdout:9/549: truncate d19/d1d/d25/d31/d60/f62 265279 0 2024-04-26T23:09:12.539 INFO:tasks.workunit.client.0.smithi148.stdout:0/626: mkdir d0/d8/d52/ddd 0 2024-04-26T23:09:12.542 INFO:tasks.workunit.client.0.smithi148.stdout:3/526: rename d9/l6c to d9/d15/d29/d4d/d5b/laa 0 2024-04-26T23:09:12.555 INFO:tasks.workunit.client.0.smithi148.stdout:0/627: creat d0/d8/d5f/fde x:0 0 0 2024-04-26T23:09:12.600 INFO:tasks.workunit.client.0.smithi148.stdout:1/539: dwrite d16/f87 [0,4194304] 0 2024-04-26T23:09:12.603 INFO:tasks.workunit.client.0.smithi148.stdout:4/637: dwrite d12/d1c/d56/d87/d9a/d9d/f57 [0,4194304] 0 2024-04-26T23:09:12.606 INFO:tasks.workunit.client.0.smithi148.stdout:0/628: dwrite d0/f62 [0,4194304] 0 2024-04-26T23:09:12.607 INFO:tasks.workunit.client.0.smithi148.stdout:1/540: creat d16/d17/d4b/d53/fba x:0 0 0 2024-04-26T23:09:12.607 INFO:tasks.workunit.client.0.smithi148.stdout:1/541: dread - d16/d17/d4b/d55/f58 zero size 2024-04-26T23:09:12.609 INFO:tasks.workunit.client.0.smithi148.stdout:4/638: mkdir d12/d1c/dc8 0 2024-04-26T23:09:12.611 INFO:tasks.workunit.client.0.smithi148.stdout:0/629: creat d0/d8/d33/d6a/d70/dd6/d9d/fdf x:0 0 0 2024-04-26T23:09:12.625 INFO:tasks.workunit.client.0.smithi148.stdout:3/527: dwrite d9/d15/d29/f73 [0,4194304] 0 2024-04-26T23:09:12.625 INFO:tasks.workunit.client.0.smithi148.stdout:6/526: write d6/d9/d23/f57 [3982764,48478] 0 2024-04-26T23:09:12.631 INFO:tasks.workunit.client.0.smithi148.stdout:4/639: creat d12/d1c/d56/d87/d9c/da1/fc9 x:0 0 0 2024-04-26T23:09:12.632 INFO:tasks.workunit.client.0.smithi148.stdout:4/640: fdatasync d12/d17/f5a 0 2024-04-26T23:09:12.645 INFO:tasks.workunit.client.0.smithi148.stdout:0/630: dwrite d0/f90 [0,4194304] 0 2024-04-26T23:09:12.646 INFO:tasks.workunit.client.0.smithi148.stdout:6/527: link d6/d14/d91/d9f/f73 d6/d9/d1c/d1d/d68/fa8 0 2024-04-26T23:09:12.647 INFO:tasks.workunit.client.0.smithi148.stdout:0/631: mknod d0/d5/d84/ce0 0 2024-04-26T23:09:12.648 INFO:tasks.workunit.client.0.smithi148.stdout:0/632: write d0/d8/d33/d68/f76 [1441922,114495] 0 2024-04-26T23:09:12.648 INFO:tasks.workunit.client.0.smithi148.stdout:0/633: chown d0/d8/d95/d97/d3a/lb6 70727859 1 2024-04-26T23:09:12.677 INFO:tasks.workunit.client.0.smithi148.stdout:9/550: read f13 [1185113,119037] 0 2024-04-26T23:09:12.677 INFO:tasks.workunit.client.0.smithi148.stdout:9/551: stat f3 0 2024-04-26T23:09:12.678 INFO:tasks.workunit.client.0.smithi148.stdout:8/592: dwrite d3/da/d1c/d7c/d8c/d9f/f51 [0,4194304] 0 2024-04-26T23:09:12.679 INFO:tasks.workunit.client.0.smithi148.stdout:6/528: mknod d6/d9/d23/d4a/ca9 0 2024-04-26T23:09:12.679 INFO:tasks.workunit.client.0.smithi148.stdout:6/529: fsync d6/d9/f7e 0 2024-04-26T23:09:12.679 INFO:tasks.workunit.client.0.smithi148.stdout:6/530: chown d6/d9/d1e/d69/l76 534688 1 2024-04-26T23:09:12.679 INFO:tasks.workunit.client.0.smithi148.stdout:9/552: getdents d19/d4b 0 2024-04-26T23:09:12.703 INFO:tasks.workunit.client.0.smithi148.stdout:8/593: symlink d3/d9/d12/d23/d35/lb3 0 2024-04-26T23:09:12.707 INFO:tasks.workunit.client.0.smithi148.stdout:0/634: dwrite d0/d8/d33/d43/d4e/fbe [0,4194304] 0 2024-04-26T23:09:12.738 INFO:tasks.workunit.client.0.smithi148.stdout:5/625: dwrite da/d1a/f28 [0,4194304] 0 2024-04-26T23:09:12.739 INFO:tasks.workunit.client.0.smithi148.stdout:8/594: dwrite d3/d9/d12/d23/d35/f55 [0,4194304] 0 2024-04-26T23:09:12.742 INFO:tasks.workunit.client.0.smithi148.stdout:6/531: dwrite d6/d9/d1e/d69/f88 [0,4194304] 0 2024-04-26T23:09:12.745 INFO:tasks.workunit.client.0.smithi148.stdout:8/595: rename d3/da/d28/l2b to d3/da/d1c/d7c/d8c/d9f/lb4 0 2024-04-26T23:09:12.760 INFO:tasks.workunit.client.0.smithi148.stdout:7/516: dwrite d7/f90 [0,4194304] 0 2024-04-26T23:09:12.760 INFO:tasks.workunit.client.0.smithi148.stdout:7/517: truncate d7/d19/f83 35141 0 2024-04-26T23:09:12.760 INFO:tasks.workunit.client.0.smithi148.stdout:7/518: write d7/d11/d29/d2e/f32 [7554147,98557] 0 2024-04-26T23:09:12.760 INFO:tasks.workunit.client.0.smithi148.stdout:7/519: write d7/d75/f8e [436927,27187] 0 2024-04-26T23:09:12.768 INFO:tasks.workunit.client.0.smithi148.stdout:4/641: dwrite d12/d1c/d56/d87/d9a/f23 [0,4194304] 0 2024-04-26T23:09:12.776 INFO:tasks.workunit.client.0.smithi148.stdout:8/596: write d3/f42 [4637428,35428] 0 2024-04-26T23:09:12.784 INFO:tasks.workunit.client.0.smithi148.stdout:0/635: dread d0/d8/d5f/f79 [0,4194304] 0 2024-04-26T23:09:12.785 INFO:tasks.workunit.client.0.smithi148.stdout:4/642: dread d12/d17/d2a/f32 [0,4194304] 0 2024-04-26T23:09:12.788 INFO:tasks.workunit.client.0.smithi148.stdout:0/636: creat d0/d2e/d8f/d6c/dab/fe1 x:0 0 0 2024-04-26T23:09:12.788 INFO:tasks.workunit.client.0.smithi148.stdout:4/643: creat d12/d17/fca x:0 0 0 2024-04-26T23:09:12.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/637: mknod d0/d8/d33/d6a/d70/dc0/ce2 0 2024-04-26T23:09:12.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/528: dwrite d9/d15/d29/f37 [4194304,4194304] 0 2024-04-26T23:09:12.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/529: truncate d9/d52/f81 817527 0 2024-04-26T23:09:12.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/530: write d9/d31/d8f/fa2 [1015859,17449] 0 2024-04-26T23:09:12.790 INFO:tasks.workunit.client.0.smithi148.stdout:4/644: symlink d12/d1c/d56/d87/d9c/da7/lcb 0 2024-04-26T23:09:12.791 INFO:tasks.workunit.client.0.smithi148.stdout:0/638: rmdir d0/d2e/d8f 39 2024-04-26T23:09:12.791 INFO:tasks.workunit.client.0.smithi148.stdout:3/531: creat d9/d31/d8f/fab x:0 0 0 2024-04-26T23:09:12.792 INFO:tasks.workunit.client.0.smithi148.stdout:3/532: chown d9/d4c/c6a 13 1 2024-04-26T23:09:12.792 INFO:tasks.workunit.client.0.smithi148.stdout:5/626: dwrite da/d1b/f93 [4194304,4194304] 0 2024-04-26T23:09:12.795 INFO:tasks.workunit.client.0.smithi148.stdout:4/645: rmdir d12/d17/d2a/d37 39 2024-04-26T23:09:12.795 INFO:tasks.workunit.client.0.smithi148.stdout:0/639: unlink d0/d8/d33/f7e 0 2024-04-26T23:09:12.795 INFO:tasks.workunit.client.0.smithi148.stdout:2/641: sync 2024-04-26T23:09:12.796 INFO:tasks.workunit.client.0.smithi148.stdout:3/533: link d9/d31/fa9 d9/d15/d29/d4d/d68/d8c/fac 0 2024-04-26T23:09:12.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/640: symlink d0/d8/d95/le3 0 2024-04-26T23:09:12.800 INFO:tasks.workunit.client.0.smithi148.stdout:3/534: truncate d9/f36 2101735 0 2024-04-26T23:09:12.800 INFO:tasks.workunit.client.0.smithi148.stdout:3/535: dread - d9/f93 zero size 2024-04-26T23:09:12.807 INFO:tasks.workunit.client.0.smithi148.stdout:3/536: rmdir d9/d15/d29/d4d/d68 39 2024-04-26T23:09:12.810 INFO:tasks.workunit.client.0.smithi148.stdout:5/627: write da/fb [5446465,55773] 0 2024-04-26T23:09:12.811 INFO:tasks.workunit.client.0.smithi148.stdout:3/537: symlink d9/d15/d29/d88/d9f/lad 0 2024-04-26T23:09:12.816 INFO:tasks.workunit.client.0.smithi148.stdout:4/646: write f8 [1151683,32089] 0 2024-04-26T23:09:12.817 INFO:tasks.workunit.client.0.smithi148.stdout:4/647: chown d12/d17/d2a/d37 7 1 2024-04-26T23:09:12.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/642: dwrite d5/d8/d9/f28 [0,4194304] 0 2024-04-26T23:09:12.869 INFO:tasks.workunit.client.0.smithi148.stdout:2/643: link d5/d8/d6c/d8f/lb7 d5/d17/d64/d88/ld5 0 2024-04-26T23:09:12.905 INFO:tasks.workunit.client.0.smithi148.stdout:2/644: write d5/d8/d4b/f77 [987864,5527] 0 2024-04-26T23:09:12.932 INFO:tasks.workunit.client.0.smithi148.stdout:5/628: dwrite da/d1b/d1c/d7f/fcb [0,4194304] 0 2024-04-26T23:09:12.947 INFO:tasks.workunit.client.0.smithi148.stdout:2/645: dwrite d5/d8/d15/d43/d5d/f7c [0,4194304] 0 2024-04-26T23:09:13.072 INFO:tasks.workunit.client.0.smithi148.stdout:3/538: dwrite d9/d15/d29/f37 [4194304,4194304] 0 2024-04-26T23:09:13.072 INFO:tasks.workunit.client.0.smithi148.stdout:4/648: dwrite d12/d1c/d56/d87/d9a/d9d/faa [0,4194304] 0 2024-04-26T23:09:13.087 INFO:tasks.workunit.client.0.smithi148.stdout:5/629: dwrite da/d1b/d3b/d72/f9b [0,4194304] 0 2024-04-26T23:09:13.091 INFO:tasks.workunit.client.0.smithi148.stdout:4/649: dread d12/d17/d2a/d37/f62 [0,4194304] 0 2024-04-26T23:09:13.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/539: dwrite d9/f94 [0,4194304] 0 2024-04-26T23:09:13.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:09:13.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:09:13.703 INFO:tasks.workunit.client.0.smithi148.stdout:2/646: creat d5/d97/fd6 x:0 0 0 2024-04-26T23:09:13.704 INFO:tasks.workunit.client.0.smithi148.stdout:2/647: chown d5/d8/d11/caf 4 1 2024-04-26T23:09:13.713 INFO:tasks.workunit.client.0.smithi148.stdout:5/630: stat da/d1b/d2d/da8/cde 0 2024-04-26T23:09:13.713 INFO:tasks.workunit.client.0.smithi148.stdout:5/631: chown da/d1b/d1c/f36 305068641 1 2024-04-26T23:09:13.717 INFO:tasks.workunit.client.0.smithi148.stdout:4/650: rmdir d12/d1c/d56/d87/d9c/da1/da9 39 2024-04-26T23:09:13.717 INFO:tasks.workunit.client.0.smithi148.stdout:4/651: fdatasync d12/d1c/f71 0 2024-04-26T23:09:13.722 INFO:tasks.workunit.client.0.smithi148.stdout:3/540: dread d9/d52/f81 [0,4194304] 0 2024-04-26T23:09:13.722 INFO:tasks.workunit.client.0.smithi148.stdout:3/541: chown d9/f86 844936561 1 2024-04-26T23:09:13.723 INFO:tasks.workunit.client.0.smithi148.stdout:2/648: link d5/d8/f54 d5/d8/fd7 0 2024-04-26T23:09:13.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/632: symlink da/d1b/d3b/d73/le8 0 2024-04-26T23:09:13.725 INFO:tasks.workunit.client.0.smithi148.stdout:4/652: rmdir d12/d1c/d56/d87 39 2024-04-26T23:09:13.730 INFO:tasks.workunit.client.0.smithi148.stdout:3/542: rename d9/f40 to d9/d15/d29/d4d/d6f/fae 0 2024-04-26T23:09:13.730 INFO:tasks.workunit.client.0.smithi148.stdout:3/543: fsync d9/d65/f9b 0 2024-04-26T23:09:13.731 INFO:tasks.workunit.client.0.smithi148.stdout:4/653: mknod d12/d1c/d56/d87/d9c/da1/da9/ccc 0 2024-04-26T23:09:13.731 INFO:tasks.workunit.client.0.smithi148.stdout:5/633: dread da/d1b/d1c/f22 [0,4194304] 0 2024-04-26T23:09:13.734 INFO:tasks.workunit.client.0.smithi148.stdout:4/654: creat d12/fcd x:0 0 0 2024-04-26T23:09:13.734 INFO:tasks.workunit.client.0.smithi148.stdout:4/655: write d12/d1c/d56/d87/d9a/f76 [3840319,15541] 0 2024-04-26T23:09:13.734 INFO:tasks.workunit.client.0.smithi148.stdout:4/656: truncate d12/d1c/d45/fb7 829956 0 2024-04-26T23:09:13.738 INFO:tasks.workunit.client.0.smithi148.stdout:2/649: dread d5/d8/d4b/d4e/d6d/f8e [0,4194304] 0 2024-04-26T23:09:13.739 INFO:tasks.workunit.client.0.smithi148.stdout:2/650: write d5/d8/d11/f5e [770957,75380] 0 2024-04-26T23:09:13.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/657: rmdir d12/d1c 39 2024-04-26T23:09:13.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/658: fsync d12/d1c/d56/d87/d9a/fb3 0 2024-04-26T23:09:13.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/659: fdatasync d12/d1c/d56/d87/d9a/d9d/f90 0 2024-04-26T23:09:13.742 INFO:tasks.workunit.client.0.smithi148.stdout:2/651: mkdir d5/d17/d64/dd8 0 2024-04-26T23:09:13.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/660: rename d12/c15 to d12/d1c/d45/d8c/cce 0 2024-04-26T23:09:13.763 INFO:tasks.workunit.client.0.smithi148.stdout:9/553: sync 2024-04-26T23:09:13.764 INFO:tasks.workunit.client.0.smithi148.stdout:7/520: sync 2024-04-26T23:09:13.764 INFO:tasks.workunit.client.0.smithi148.stdout:0/641: sync 2024-04-26T23:09:13.764 INFO:tasks.workunit.client.0.smithi148.stdout:1/542: sync 2024-04-26T23:09:13.764 INFO:tasks.workunit.client.0.smithi148.stdout:6/532: sync 2024-04-26T23:09:13.764 INFO:tasks.workunit.client.0.smithi148.stdout:8/597: sync 2024-04-26T23:09:13.765 INFO:tasks.workunit.client.0.smithi148.stdout:5/634: dread da/d1b/d2d/f60 [0,4194304] 0 2024-04-26T23:09:13.765 INFO:tasks.workunit.client.0.smithi148.stdout:5/635: write da/d1f/fdf [85467,8396] 0 2024-04-26T23:09:13.765 INFO:tasks.workunit.client.0.smithi148.stdout:5/636: dread - da/d1b/d8b/fa0 zero size 2024-04-26T23:09:13.766 INFO:tasks.workunit.client.0.smithi148.stdout:4/661: creat d12/d1c/d56/d87/d9c/da1/da9/fcf x:0 0 0 2024-04-26T23:09:13.770 INFO:tasks.workunit.client.0.smithi148.stdout:6/533: read d6/d9/d23/d4a/f67 [1313948,65125] 0 2024-04-26T23:09:13.770 INFO:tasks.workunit.client.0.smithi148.stdout:6/534: chown d6/d9/d23/d4a/f92 152969 1 2024-04-26T23:09:13.770 INFO:tasks.workunit.client.0.smithi148.stdout:6/535: getdents d6/d32/d98 0 2024-04-26T23:09:13.771 INFO:tasks.workunit.client.0.smithi148.stdout:6/536: write d6/d9/d1c/f96 [73549,66986] 0 2024-04-26T23:09:13.771 INFO:tasks.workunit.client.0.smithi148.stdout:1/543: unlink d16/d17/d4b/f99 0 2024-04-26T23:09:13.771 INFO:tasks.workunit.client.0.smithi148.stdout:1/544: write d16/d85/fb0 [978344,86861] 0 2024-04-26T23:09:13.777 INFO:tasks.workunit.client.0.smithi148.stdout:8/598: mkdir d3/d9/d12/d23/d29/d37/db5 0 2024-04-26T23:09:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/544: dwrite d9/d15/f1e [0,4194304] 0 2024-04-26T23:09:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:4/662: write d12/f72 [3018431,97024] 0 2024-04-26T23:09:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/545: fdatasync d9/d15/d29/f73 0 2024-04-26T23:09:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/642: dread d0/d5/f1a [0,4194304] 0 2024-04-26T23:09:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/643: chown d0/d8/d95/d97/d3a 2 1 2024-04-26T23:09:13.792 INFO:tasks.workunit.client.0.smithi148.stdout:6/537: creat d6/faa x:0 0 0 2024-04-26T23:09:13.792 INFO:tasks.workunit.client.0.smithi148.stdout:6/538: write d6/d32/f62 [274385,20230] 0 2024-04-26T23:09:13.794 INFO:tasks.workunit.client.0.smithi148.stdout:1/545: mknod d16/d85/cbb 0 2024-04-26T23:09:13.796 INFO:tasks.workunit.client.0.smithi148.stdout:9/554: write fe [4820083,78713] 0 2024-04-26T23:09:13.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/546: rename d9/d15/d29/d4d/f8e to d9/d15/d29/d4d/d68/faf 0 2024-04-26T23:09:13.798 INFO:tasks.workunit.client.0.smithi148.stdout:3/547: fdatasync d9/d15/d29/f47 0 2024-04-26T23:09:13.799 INFO:tasks.workunit.client.0.smithi148.stdout:0/644: symlink d0/d8/d95/d97/le4 0 2024-04-26T23:09:13.802 INFO:tasks.workunit.client.0.smithi148.stdout:6/539: rmdir d6/d14 39 2024-04-26T23:09:13.802 INFO:tasks.workunit.client.0.smithi148.stdout:1/546: mknod d16/d17/d4b/d4d/cbc 0 2024-04-26T23:09:13.802 INFO:tasks.workunit.client.0.smithi148.stdout:1/547: chown d16/d1c/f57 6 1 2024-04-26T23:09:13.803 INFO:tasks.workunit.client.0.smithi148.stdout:1/548: truncate d16/d1c/f57 4636866 0 2024-04-26T23:09:13.803 INFO:tasks.workunit.client.0.smithi148.stdout:1/549: write d16/d17/f39 [1840728,7494] 0 2024-04-26T23:09:13.803 INFO:tasks.workunit.client.0.smithi148.stdout:9/555: getdents d19/d22/d7b 0 2024-04-26T23:09:13.803 INFO:tasks.workunit.client.0.smithi148.stdout:9/556: chown ff 4657 1 2024-04-26T23:09:13.805 INFO:tasks.workunit.client.0.smithi148.stdout:8/599: read d3/d9/d12/d23/d35/f4e [2818057,86541] 0 2024-04-26T23:09:13.805 INFO:tasks.workunit.client.0.smithi148.stdout:8/600: read - d3/d9a/fa8 zero size 2024-04-26T23:09:13.809 INFO:tasks.workunit.client.0.smithi148.stdout:1/550: mkdir d16/d17/daf/dbd 0 2024-04-26T23:09:13.811 INFO:tasks.workunit.client.0.smithi148.stdout:3/548: truncate d9/d15/f24 3730433 0 2024-04-26T23:09:13.820 INFO:tasks.workunit.client.0.smithi148.stdout:9/557: mkdir d19/d9f/dbb 0 2024-04-26T23:09:13.824 INFO:tasks.workunit.client.0.smithi148.stdout:8/601: rename d3/d9/d85 to d3/da/db6 0 2024-04-26T23:09:13.827 INFO:tasks.workunit.client.0.smithi148.stdout:7/521: dwrite d7/d11/d29/d2e/f26 [0,4194304] 0 2024-04-26T23:09:13.827 INFO:tasks.workunit.client.0.smithi148.stdout:3/549: creat d9/d4c/fb0 x:0 0 0 2024-04-26T23:09:13.836 INFO:tasks.workunit.client.0.smithi148.stdout:7/522: unlink d7/d11/d29/d2e/f32 0 2024-04-26T23:09:13.836 INFO:tasks.workunit.client.0.smithi148.stdout:3/550: mkdir d9/d15/db1 0 2024-04-26T23:09:13.840 INFO:tasks.workunit.client.0.smithi148.stdout:3/551: getdents d9/d31 0 2024-04-26T23:09:13.844 INFO:tasks.workunit.client.0.smithi148.stdout:1/551: dread d16/d85/fb0 [0,4194304] 0 2024-04-26T23:09:13.844 INFO:tasks.workunit.client.0.smithi148.stdout:1/552: readlink lc 0 2024-04-26T23:09:13.846 INFO:tasks.workunit.client.0.smithi148.stdout:0/645: dread d0/d20/f8d [0,4194304] 0 2024-04-26T23:09:13.846 INFO:tasks.workunit.client.0.smithi148.stdout:0/646: write d0/d8/d95/d9f/fb7 [3702424,11171] 0 2024-04-26T23:09:13.847 INFO:tasks.workunit.client.0.smithi148.stdout:5/637: dwrite da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:13.847 INFO:tasks.workunit.client.0.smithi148.stdout:5/638: fdatasync da/d12/f8e 0 2024-04-26T23:09:13.848 INFO:tasks.workunit.client.0.smithi148.stdout:8/602: dread d3/d9/d12/d23/d35/faf [0,4194304] 0 2024-04-26T23:09:13.849 INFO:tasks.workunit.client.0.smithi148.stdout:7/523: creat d7/d11/d17/d9e/fa8 x:0 0 0 2024-04-26T23:09:13.850 INFO:tasks.workunit.client.0.smithi148.stdout:7/524: readlink d7/d11/d60/d68/l6e 0 2024-04-26T23:09:13.854 INFO:tasks.workunit.client.0.smithi148.stdout:5/639: dread da/d1b/d1c/f66 [0,4194304] 0 2024-04-26T23:09:13.854 INFO:tasks.workunit.client.0.smithi148.stdout:5/640: truncate da/d1b/d3b/fd2 691776 0 2024-04-26T23:09:13.857 INFO:tasks.workunit.client.0.smithi148.stdout:8/603: mknod d3/da/db6/cb7 0 2024-04-26T23:09:13.860 INFO:tasks.workunit.client.0.smithi148.stdout:7/525: truncate d7/d11/d29/d2e/d41/d67/d94/f9f 3682659 0 2024-04-26T23:09:13.876 INFO:tasks.workunit.client.0.smithi148.stdout:8/604: unlink d3/da/d1c/ca6 0 2024-04-26T23:09:13.876 INFO:tasks.workunit.client.0.smithi148.stdout:3/552: write d9/d15/d29/f3b [2791358,77954] 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:3/553: chown d9/d15/d29 40927 1 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:8/605: write d3/d9/d12/d23/f73 [584707,47702] 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/641: link da/d1b/d1c/f22 da/d68/d69/daa/dc0/fe9 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/642: fsync da/d1b/d3b/d73/fcf 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:4/663: dwrite d12/d1c/d56/d87/d9a/d9d/fa8 [0,4194304] 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:3/554: symlink d9/d31/d8f/lb2 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:3/555: write d9/ff [3446312,52760] 0 2024-04-26T23:09:13.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/643: mknod da/d1b/d5b/d5e/dc5/cea 0 2024-04-26T23:09:13.878 INFO:tasks.workunit.client.0.smithi148.stdout:5/644: read da/d1b/d1c/f36 [499274,12539] 0 2024-04-26T23:09:13.878 INFO:tasks.workunit.client.0.smithi148.stdout:7/526: dread d7/d75/f33 [0,4194304] 0 2024-04-26T23:09:13.878 INFO:tasks.workunit.client.0.smithi148.stdout:7/527: stat d7/d11/d17/d2f/l70 0 2024-04-26T23:09:13.879 INFO:tasks.workunit.client.0.smithi148.stdout:4/664: mkdir d12/d1c/d56/d87/d9c/da1/dc3/dd0 0 2024-04-26T23:09:13.900 INFO:tasks.workunit.client.0.smithi148.stdout:1/553: dwrite f13 [0,4194304] 0 2024-04-26T23:09:13.904 INFO:tasks.workunit.client.0.smithi148.stdout:5/645: creat da/d68/d7a/feb x:0 0 0 2024-04-26T23:09:13.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/528: mkdir d7/d11/d17/d9e/da9 0 2024-04-26T23:09:13.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/529: readlink d7/d75/l4a 0 2024-04-26T23:09:13.916 INFO:tasks.workunit.client.0.smithi148.stdout:9/558: dwrite f13 [0,4194304] 0 2024-04-26T23:09:13.916 INFO:tasks.workunit.client.0.smithi148.stdout:9/559: write d19/d1d/d25/d31/d60/dba/d85/fa6 [588044,16277] 0 2024-04-26T23:09:13.920 INFO:tasks.workunit.client.0.smithi148.stdout:0/647: getdents d0/d8/d95/d97 0 2024-04-26T23:09:13.925 INFO:tasks.workunit.client.0.smithi148.stdout:3/556: dwrite d9/d15/d29/d4d/d68/faf [0,4194304] 0 2024-04-26T23:09:13.934 INFO:tasks.workunit.client.0.smithi148.stdout:5/646: symlink da/d1b/lec 0 2024-04-26T23:09:13.934 INFO:tasks.workunit.client.0.smithi148.stdout:7/530: creat d7/d11/d17/d2f/d44/d9b/faa x:0 0 0 2024-04-26T23:09:13.934 INFO:tasks.workunit.client.0.smithi148.stdout:9/560: creat d19/d1d/d25/d2f/d4d/d33/fbc x:0 0 0 2024-04-26T23:09:13.937 INFO:tasks.workunit.client.0.smithi148.stdout:4/665: dwrite d12/d1c/f8b [0,4194304] 0 2024-04-26T23:09:13.939 INFO:tasks.workunit.client.0.smithi148.stdout:0/648: unlink d0/d8/d52/fb3 0 2024-04-26T23:09:13.943 INFO:tasks.workunit.client.0.smithi148.stdout:5/647: creat da/d1b/fed x:0 0 0 2024-04-26T23:09:13.945 INFO:tasks.workunit.client.0.smithi148.stdout:7/531: creat d7/d11/d17/d2f/fab x:0 0 0 2024-04-26T23:09:13.947 INFO:tasks.workunit.client.0.smithi148.stdout:4/666: creat d12/d1c/d56/d87/d9c/fd1 x:0 0 0 2024-04-26T23:09:13.947 INFO:tasks.workunit.client.0.smithi148.stdout:4/667: fsync d12/d1c/d56/d87/d9a/f76 0 2024-04-26T23:09:13.947 INFO:tasks.workunit.client.0.smithi148.stdout:8/606: dwrite d3/d9/d12/d23/d29/d77/f8a [0,4194304] 0 2024-04-26T23:09:13.948 INFO:tasks.workunit.client.0.smithi148.stdout:0/649: mkdir d0/d8/d33/d6a/d70/de5 0 2024-04-26T23:09:13.948 INFO:tasks.workunit.client.0.smithi148.stdout:0/650: chown d0/d8/d95/d97/f80 7 1 2024-04-26T23:09:13.949 INFO:tasks.workunit.client.0.smithi148.stdout:5/648: mknod da/d1f/d47/cee 0 2024-04-26T23:09:13.950 INFO:tasks.workunit.client.0.smithi148.stdout:5/649: write da/d1b/d1c/d7f/f95 [1147448,76958] 0 2024-04-26T23:09:13.950 INFO:tasks.workunit.client.0.smithi148.stdout:5/650: fdatasync da/d1b/d1c/d7f/fcb 0 2024-04-26T23:09:13.950 INFO:tasks.workunit.client.0.smithi148.stdout:7/532: rmdir d7/d11/d17/d2f/d57 39 2024-04-26T23:09:13.951 INFO:tasks.workunit.client.0.smithi148.stdout:4/668: creat d12/d1c/d56/d87/d9c/da1/da9/fd2 x:0 0 0 2024-04-26T23:09:13.963 INFO:tasks.workunit.client.0.smithi148.stdout:0/651: dread d0/d8/d33/d6a/f6e [0,4194304] 0 2024-04-26T23:09:13.964 INFO:tasks.workunit.client.0.smithi148.stdout:0/652: chown d0/d2e/d8f/d6c/fa6 1777900 1 2024-04-26T23:09:13.964 INFO:tasks.workunit.client.0.smithi148.stdout:0/653: getdents d0/d5/dd4 0 2024-04-26T23:09:13.980 INFO:tasks.workunit.client.0.smithi148.stdout:5/651: dread da/d1b/d2d/f48 [0,4194304] 0 2024-04-26T23:09:13.980 INFO:tasks.workunit.client.0.smithi148.stdout:8/607: creat d3/d9/d12/d23/d54/fb8 x:0 0 0 2024-04-26T23:09:13.981 INFO:tasks.workunit.client.0.smithi148.stdout:3/557: dwrite d9/d15/d29/d4d/d68/faf [0,4194304] 0 2024-04-26T23:09:13.982 INFO:tasks.workunit.client.0.smithi148.stdout:7/533: mknod d7/d11/cac 0 2024-04-26T23:09:13.983 INFO:tasks.workunit.client.0.smithi148.stdout:5/652: truncate da/d1b/d2d/f60 409452 0 2024-04-26T23:09:13.986 INFO:tasks.workunit.client.0.smithi148.stdout:3/558: mkdir d9/db3 0 2024-04-26T23:09:13.987 INFO:tasks.workunit.client.0.smithi148.stdout:0/654: mknod d0/d20/d54/ce6 0 2024-04-26T23:09:13.987 INFO:tasks.workunit.client.0.smithi148.stdout:0/655: truncate d0/d2e/d8f/d6c/fa6 2228336 0 2024-04-26T23:09:13.988 INFO:tasks.workunit.client.0.smithi148.stdout:5/653: creat da/d1b/d3b/fef x:0 0 0 2024-04-26T23:09:13.988 INFO:tasks.workunit.client.0.smithi148.stdout:5/654: chown da/d68/lbd 2506434 1 2024-04-26T23:09:13.989 INFO:tasks.workunit.client.0.smithi148.stdout:3/559: rmdir d9/d15/d29/d4d/d68/d8c 39 2024-04-26T23:09:13.991 INFO:tasks.workunit.client.0.smithi148.stdout:0/656: symlink d0/d8/d33/d6a/d70/dd6/d9d/db4/le7 0 2024-04-26T23:09:14.002 INFO:tasks.workunit.client.0.smithi148.stdout:5/655: fsync da/d1b/d3b/fef 0 2024-04-26T23:09:14.005 INFO:tasks.workunit.client.0.smithi148.stdout:4/669: dwrite d12/d1c/f73 [0,4194304] 0 2024-04-26T23:09:14.007 INFO:tasks.workunit.client.0.smithi148.stdout:3/560: rename d9/d15/l38 to d9/d15/d29/lb4 0 2024-04-26T23:09:14.007 INFO:tasks.workunit.client.0.smithi148.stdout:3/561: chown d9/d31/c48 1804 1 2024-04-26T23:09:14.007 INFO:tasks.workunit.client.0.smithi148.stdout:3/562: chown d9/d4c/f66 255438689 1 2024-04-26T23:09:14.027 INFO:tasks.workunit.client.0.smithi148.stdout:2/652: dwrite d5/d1c/d38/f47 [0,4194304] 0 2024-04-26T23:09:14.029 INFO:tasks.workunit.client.0.smithi148.stdout:0/657: symlink d0/d5/d84/le8 0 2024-04-26T23:09:14.029 INFO:tasks.workunit.client.0.smithi148.stdout:0/658: readlink d0/d5/ld 0 2024-04-26T23:09:14.065 INFO:tasks.workunit.client.0.smithi148.stdout:3/563: dwrite d9/d15/d29/d4d/d6f/f74 [4194304,4194304] 0 2024-04-26T23:09:14.065 INFO:tasks.workunit.client.0.smithi148.stdout:4/670: write d12/d17/d2a/d37/d97/fa0 [1610359,89656] 0 2024-04-26T23:09:14.065 INFO:tasks.workunit.client.0.smithi148.stdout:4/671: fdatasync d12/d17/d2a/fac 0 2024-04-26T23:09:14.069 INFO:tasks.workunit.client.0.smithi148.stdout:2/653: mknod d5/d1c/cd9 0 2024-04-26T23:09:14.069 INFO:tasks.workunit.client.0.smithi148.stdout:2/654: truncate d5/d7/fa3 375088 0 2024-04-26T23:09:14.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/659: creat d0/d8/d33/d43/d4e/fe9 x:0 0 0 2024-04-26T23:09:14.074 INFO:tasks.workunit.client.0.smithi148.stdout:7/534: write d7/d19/f35 [2319999,25754] 0 2024-04-26T23:09:14.075 INFO:tasks.workunit.client.0.smithi148.stdout:1/554: dwrite d16/d17/d4b/d55/d90/f97 [0,4194304] 0 2024-04-26T23:09:14.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/660: dread d0/d2e/d8f/dbf/fca [0,4194304] 0 2024-04-26T23:09:14.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/661: chown d0/d8/d33/fdc 2 1 2024-04-26T23:09:14.082 INFO:tasks.workunit.client.0.smithi148.stdout:3/564: unlink d9/d15/c16 0 2024-04-26T23:09:14.082 INFO:tasks.workunit.client.0.smithi148.stdout:2/655: truncate d5/d8/d11/f5e 16601 0 2024-04-26T23:09:14.088 INFO:tasks.workunit.client.0.smithi148.stdout:5/656: dread da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:14.099 INFO:tasks.workunit.client.0.smithi148.stdout:7/535: unlink d7/d11/d17/d2f/d44/l4e 0 2024-04-26T23:09:14.100 INFO:tasks.workunit.client.0.smithi148.stdout:7/536: write d7/d19/f81 [1889887,40540] 0 2024-04-26T23:09:14.100 INFO:tasks.workunit.client.0.smithi148.stdout:7/537: fsync d7/d11/d17/d2f/d57/f7e 0 2024-04-26T23:09:14.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/555: symlink d16/d1c/d84/da7/lbe 0 2024-04-26T23:09:14.134 INFO:tasks.workunit.client.0.smithi148.stdout:4/672: dwrite d12/f72 [0,4194304] 0 2024-04-26T23:09:14.148 INFO:tasks.workunit.client.0.smithi148.stdout:3/565: dread d9/d15/d29/d4d/d6f/f74 [0,4194304] 0 2024-04-26T23:09:14.150 INFO:tasks.workunit.client.0.smithi148.stdout:7/538: mkdir d7/d75/dad 0 2024-04-26T23:09:14.150 INFO:tasks.workunit.client.0.smithi148.stdout:3/566: dread d9/d15/f19 [4194304,4194304] 0 2024-04-26T23:09:14.152 INFO:tasks.workunit.client.0.smithi148.stdout:4/673: mkdir d12/dbd/dd3 0 2024-04-26T23:09:14.153 INFO:tasks.workunit.client.0.smithi148.stdout:2/656: dwrite d5/d8/d15/d43/fa9 [0,4194304] 0 2024-04-26T23:09:14.154 INFO:tasks.workunit.client.0.smithi148.stdout:7/539: symlink d7/d75/lae 0 2024-04-26T23:09:14.154 INFO:tasks.workunit.client.0.smithi148.stdout:7/540: chown d7/d11/d29/d2e/d41/c4c 856091 1 2024-04-26T23:09:14.156 INFO:tasks.workunit.client.0.smithi148.stdout:3/567: rename d9/d52/l5d to d9/d4c/lb5 0 2024-04-26T23:09:14.157 INFO:tasks.workunit.client.0.smithi148.stdout:4/674: mkdir d12/d1c/d45/dc2/dd4 0 2024-04-26T23:09:14.161 INFO:tasks.workunit.client.0.smithi148.stdout:2/657: link d5/d8/d4b/d4e/d6d/cb5 d5/d8/d15/cda 0 2024-04-26T23:09:14.185 INFO:tasks.workunit.client.0.smithi148.stdout:2/658: dread d5/d7f/d86/f9a [0,4194304] 0 2024-04-26T23:09:14.188 INFO:tasks.workunit.client.0.smithi148.stdout:8/608: dwrite d3/da/f64 [4194304,4194304] 0 2024-04-26T23:09:14.189 INFO:tasks.workunit.client.0.smithi148.stdout:7/541: mknod d7/d11/d29/d2e/caf 0 2024-04-26T23:09:14.189 INFO:tasks.workunit.client.0.smithi148.stdout:7/542: stat d7/d11/d29/d2e/f64 0 2024-04-26T23:09:14.193 INFO:tasks.workunit.client.0.smithi148.stdout:4/675: unlink d12/d1c/d56/d87/d9a/fb3 0 2024-04-26T23:09:14.193 INFO:tasks.workunit.client.0.smithi148.stdout:4/676: write d12/d1c/d45/f9e [896248,89901] 0 2024-04-26T23:09:14.193 INFO:tasks.workunit.client.0.smithi148.stdout:4/677: write d12/d1c/d56/d87/d9a/f60 [738415,109022] 0 2024-04-26T23:09:14.203 INFO:tasks.workunit.client.0.smithi148.stdout:3/568: dwrite d9/d15/d29/d4d/d6f/f74 [4194304,4194304] 0 2024-04-26T23:09:14.205 INFO:tasks.workunit.client.0.smithi148.stdout:8/609: mknod d3/da/d28/cb9 0 2024-04-26T23:09:14.208 INFO:tasks.workunit.client.0.smithi148.stdout:7/543: rename d7/f22 to d7/d11/fb0 0 2024-04-26T23:09:14.221 INFO:tasks.workunit.client.0.smithi148.stdout:7/544: dread d7/d11/fb0 [0,4194304] 0 2024-04-26T23:09:14.221 INFO:tasks.workunit.client.0.smithi148.stdout:7/545: fsync d7/d11/d17/d2f/d44/d9b/faa 0 2024-04-26T23:09:14.224 INFO:tasks.workunit.client.0.smithi148.stdout:4/678: dwrite d12/f8f [0,4194304] 0 2024-04-26T23:09:14.224 INFO:tasks.workunit.client.0.smithi148.stdout:4/679: truncate d12/d1c/f71 890639 0 2024-04-26T23:09:14.232 INFO:tasks.workunit.client.0.smithi148.stdout:0/662: dwrite d0/d5/d84/f89 [0,4194304] 0 2024-04-26T23:09:14.250 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T23:09:14.251 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T23:09:14.251 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:09:14.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:09:14.266 INFO:tasks.workunit.client.0.smithi148.stdout:1/556: read d16/d17/f1b [1916019,13585] 0 2024-04-26T23:09:14.266 INFO:tasks.workunit.client.0.smithi148.stdout:5/657: dwrite da/d1f/d67/fb6 [0,4194304] 0 2024-04-26T23:09:14.268 INFO:tasks.workunit.client.0.smithi148.stdout:3/569: creat d9/d15/d29/d4d/d6f/fb6 x:0 0 0 2024-04-26T23:09:14.269 INFO:tasks.workunit.client.0.smithi148.stdout:8/610: getdents d3/d9/d12/d23/d35 0 2024-04-26T23:09:14.270 INFO:tasks.workunit.client.0.smithi148.stdout:4/680: mkdir d12/d1c/dc0/dd5 0 2024-04-26T23:09:14.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/663: rmdir d0/d8/d95/d97/d3a/dd2 39 2024-04-26T23:09:14.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/664: readlink d0/d8/d33/l8e 0 2024-04-26T23:09:14.274 INFO:tasks.workunit.client.0.smithi148.stdout:2/659: dread d5/d8/d9/fc [4194304,4194304] 0 2024-04-26T23:09:14.274 INFO:tasks.workunit.client.0.smithi148.stdout:8/611: dread d3/d9/d12/f21 [0,4194304] 0 2024-04-26T23:09:14.286 INFO:tasks.workunit.client.0.smithi148.stdout:3/570: write d9/d15/d29/d4d/d68/faf [6006423,107587] 0 2024-04-26T23:09:14.286 INFO:tasks.workunit.client.0.smithi148.stdout:3/571: dread - d9/d15/d29/d4d/d68/d8c/fa5 zero size 2024-04-26T23:09:14.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/665: unlink d0/d8/d33/d6a/d70/dd6/d9d/db4/lc1 0 2024-04-26T23:09:14.289 INFO:tasks.workunit.client.0.smithi148.stdout:2/660: unlink d5/d17/d64/lb4 0 2024-04-26T23:09:14.289 INFO:tasks.workunit.client.0.smithi148.stdout:2/661: write d5/d8/d15/d43/dd4/fc1 [1010907,73526] 0 2024-04-26T23:09:14.292 INFO:tasks.workunit.client.0.smithi148.stdout:8/612: creat d3/d9/d12/d23/d29/d77/d91/fba x:0 0 0 2024-04-26T23:09:14.292 INFO:tasks.workunit.client.0.smithi148.stdout:8/613: write d3/d9/d12/d23/f7b [1823209,3616] 0 2024-04-26T23:09:14.295 INFO:tasks.workunit.client.0.smithi148.stdout:4/681: rename d12/d1c/d56/d87/d9c/da1/fc9 to d12/d1c/d45/fd6 0 2024-04-26T23:09:14.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/614: dread d3/d9/d12/d23/d29/d37/f63 [0,4194304] 0 2024-04-26T23:09:14.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/615: dread - d3/d9/d12/d23/d54/fb8 zero size 2024-04-26T23:09:14.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/616: fdatasync d3/d9/d12/d23/d54/d60/f61 0 2024-04-26T23:09:14.301 INFO:tasks.workunit.client.0.smithi148.stdout:3/572: symlink d9/d31/lb7 0 2024-04-26T23:09:14.301 INFO:tasks.workunit.client.0.smithi148.stdout:3/573: readlink d9/d15/l4a 0 2024-04-26T23:09:14.302 INFO:tasks.workunit.client.0.smithi148.stdout:0/666: rmdir d0/d8/d5f/d72/dd1 39 2024-04-26T23:09:14.302 INFO:tasks.workunit.client.0.smithi148.stdout:0/667: stat d0/d8/d52/c58 0 2024-04-26T23:09:14.304 INFO:tasks.workunit.client.0.smithi148.stdout:7/546: mknod d7/d11/d29/d2e/cb1 0 2024-04-26T23:09:14.304 INFO:tasks.workunit.client.0.smithi148.stdout:7/547: chown d7/d11/d29/d2e/fa7 3 1 2024-04-26T23:09:14.304 INFO:tasks.workunit.client.0.smithi148.stdout:7/548: dread - d7/d11/d17/d9e/fa8 zero size 2024-04-26T23:09:14.308 INFO:tasks.workunit.client.0.smithi148.stdout:2/662: creat d5/d8/db9/fdb x:0 0 0 2024-04-26T23:09:14.345 INFO:tasks.workunit.client.0.smithi148.stdout:5/658: dread da/d1b/d3b/d73/d97/fac [0,4194304] 0 2024-04-26T23:09:14.345 INFO:tasks.workunit.client.0.smithi148.stdout:5/659: stat da/d12/c81 0 2024-04-26T23:09:14.346 INFO:tasks.workunit.client.0.smithi148.stdout:1/557: dwrite d16/d17/d4b/d55/f9a [0,4194304] 0 2024-04-26T23:09:14.347 INFO:tasks.workunit.client.0.smithi148.stdout:4/682: rmdir d12/d1c/dc0/dd5 0 2024-04-26T23:09:14.347 INFO:tasks.workunit.client.0.smithi148.stdout:4/683: truncate d12/d1c/d56/fb6 725455 0 2024-04-26T23:09:14.350 INFO:tasks.workunit.client.0.smithi148.stdout:8/617: mkdir d3/d9/d12/d23/d35/dad/dbb 0 2024-04-26T23:09:14.350 INFO:tasks.workunit.client.0.smithi148.stdout:7/549: link d7/d11/d29/d2e/d41/d67/d94/f9f d7/d11/d29/d2e/d41/d67/fb2 0 2024-04-26T23:09:14.350 INFO:tasks.workunit.client.0.smithi148.stdout:7/550: fdatasync d7/d75/f33 0 2024-04-26T23:09:14.352 INFO:tasks.workunit.client.0.smithi148.stdout:5/660: mkdir da/d1b/d1c/d54/df0 0 2024-04-26T23:09:14.354 INFO:tasks.workunit.client.0.smithi148.stdout:4/684: mknod d12/d1c/d45/cd7 0 2024-04-26T23:09:14.360 INFO:tasks.workunit.client.0.smithi148.stdout:3/574: creat d9/d15/d29/d88/fb8 x:0 0 0 2024-04-26T23:09:14.376 INFO:tasks.workunit.client.0.smithi148.stdout:1/558: dread d16/d1c/f29 [0,4194304] 0 2024-04-26T23:09:14.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/559: fdatasync d16/f4a 0 2024-04-26T23:09:14.377 INFO:tasks.workunit.client.0.smithi148.stdout:1/560: fdatasync d16/f4e 0 2024-04-26T23:09:14.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/661: dwrite da/d68/d69/daa/fce [0,4194304] 0 2024-04-26T23:09:14.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/662: dread - da/d1b/d1c/f8d zero size 2024-04-26T23:09:14.403 INFO:tasks.workunit.client.0.smithi148.stdout:3/575: mkdir d9/d65/d80/d83/db9 0 2024-04-26T23:09:14.409 INFO:tasks.workunit.client.0.smithi148.stdout:4/685: write d12/d17/d2a/f32 [560351,74059] 0 2024-04-26T23:09:14.416 INFO:tasks.workunit.client.0.smithi148.stdout:5/663: getdents da/d1f 0 2024-04-26T23:09:14.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/551: write d7/d11/d17/f39 [2651601,56493] 0 2024-04-26T23:09:14.421 INFO:tasks.workunit.client.0.smithi148.stdout:6/540: sync 2024-04-26T23:09:14.421 INFO:tasks.workunit.client.0.smithi148.stdout:6/541: chown d6/d9/d1c/d1d/d1f/d40/l9c 1 1 2024-04-26T23:09:14.422 INFO:tasks.workunit.client.0.smithi148.stdout:0/668: dwrite d0/d8/d33/d6a/d70/dd6/fd3 [0,4194304] 0 2024-04-26T23:09:14.422 INFO:tasks.workunit.client.0.smithi148.stdout:2/663: dwrite d5/d8/d4b/d4e/d6d/f8e [4194304,4194304] 0 2024-04-26T23:09:14.424 INFO:tasks.workunit.client.0.smithi148.stdout:4/686: rmdir d12/dbd/dd3 0 2024-04-26T23:09:14.425 INFO:tasks.workunit.client.0.smithi148.stdout:4/687: write d12/d1c/d56/d87/d9c/da1/da9/fd2 [372223,127684] 0 2024-04-26T23:09:14.426 INFO:tasks.workunit.client.0.smithi148.stdout:7/552: mknod d7/d75/dad/cb3 0 2024-04-26T23:09:14.429 INFO:tasks.workunit.client.0.smithi148.stdout:6/542: link d6/d9/d1c/d1d/d1f/f59 d6/d9/d1c/d1d/d1f/fab 0 2024-04-26T23:09:14.429 INFO:tasks.workunit.client.0.smithi148.stdout:6/543: fdatasync d6/d14/d91/d9f/f7d 0 2024-04-26T23:09:14.431 INFO:tasks.workunit.client.0.smithi148.stdout:0/669: unlink d0/d2e/d8f/dbf/fca 0 2024-04-26T23:09:14.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/664: mkdir d5/d8/d6c/ddc 0 2024-04-26T23:09:14.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/665: stat d5/d8/d15/d7d 0 2024-04-26T23:09:14.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/666: chown d5/d7/d73 693 1 2024-04-26T23:09:14.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/667: stat d5/d7f/d86/d87 0 2024-04-26T23:09:14.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/664: write da/d1b/d5b/d5e/dc5/fcc [2646676,9523] 0 2024-04-26T23:09:14.435 INFO:tasks.workunit.client.0.smithi148.stdout:4/688: rename d12/d17/f2e to d12/d1c/dc8/fd8 0 2024-04-26T23:09:14.436 INFO:tasks.workunit.client.0.smithi148.stdout:1/561: dwrite d16/d17/f3d [0,4194304] 0 2024-04-26T23:09:14.436 INFO:tasks.workunit.client.0.smithi148.stdout:6/544: creat d6/d9/d1c/d1d/d68/fac x:0 0 0 2024-04-26T23:09:14.437 INFO:tasks.workunit.client.0.smithi148.stdout:0/670: creat d0/d2e/d8f/d6c/dab/fea x:0 0 0 2024-04-26T23:09:14.438 INFO:tasks.workunit.client.0.smithi148.stdout:2/668: dread d5/d1c/d38/f98 [0,4194304] 0 2024-04-26T23:09:14.448 INFO:tasks.workunit.client.0.smithi148.stdout:3/576: write d9/d15/d29/d4d/d68/faf [609827,105014] 0 2024-04-26T23:09:14.448 INFO:tasks.workunit.client.0.smithi148.stdout:3/577: truncate d9/d15/d29/f47 5493 0 2024-04-26T23:09:14.448 INFO:tasks.workunit.client.0.smithi148.stdout:3/578: read d9/f43 [1840786,3549] 0 2024-04-26T23:09:14.448 INFO:tasks.workunit.client.0.smithi148.stdout:3/579: dread - d9/d15/d29/d4d/d6f/fb6 zero size 2024-04-26T23:09:14.448 INFO:tasks.workunit.client.0.smithi148.stdout:1/562: symlink d16/d17/d4b/d55/d90/lbf 0 2024-04-26T23:09:14.450 INFO:tasks.workunit.client.0.smithi148.stdout:6/545: symlink d6/d14/d91/lad 0 2024-04-26T23:09:14.451 INFO:tasks.workunit.client.0.smithi148.stdout:0/671: symlink d0/d8/d95/d9f/leb 0 2024-04-26T23:09:14.451 INFO:tasks.workunit.client.0.smithi148.stdout:0/672: truncate d0/d8/d95/d97/d3a/dd2/fd7 502820 0 2024-04-26T23:09:14.451 INFO:tasks.workunit.client.0.smithi148.stdout:0/673: chown d0/d8/d33/d6a/d70/dd6/fd3 121 1 2024-04-26T23:09:14.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/580: creat d9/d15/d29/d4d/d68/d8c/fba x:0 0 0 2024-04-26T23:09:14.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/581: dread - d9/f93 zero size 2024-04-26T23:09:14.457 INFO:tasks.workunit.client.0.smithi148.stdout:6/546: creat d6/d9/d23/d4a/d95/fae x:0 0 0 2024-04-26T23:09:14.457 INFO:tasks.workunit.client.0.smithi148.stdout:0/674: symlink d0/d8/d33/d6a/lec 0 2024-04-26T23:09:14.468 INFO:tasks.workunit.client.0.smithi148.stdout:6/547: symlink d6/d9/laf 0 2024-04-26T23:09:14.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 Processor -- start 2024-04-26T23:09:14.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 -- start start 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c072eb0 con 0x7f197c152120 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0c8f40 con 0x7f197c072a40 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1980a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f197c0c9190 con 0x7f197c0708f0 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49712/0 (socket says 172.21.15.148:49712) 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 learned_addr learned my addr 172.21.15.148:0/3378769272 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:09:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.490+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:14.501 INFO:tasks.workunit.client.0.smithi148.stdout:7/553: dwrite d7/d11/d17/d2f/fab [0,4194304] 0 2024-04-26T23:09:14.502 INFO:tasks.workunit.client.0.smithi148.stdout:0/675: fdatasync d0/d20/f40 0 2024-04-26T23:09:14.502 INFO:tasks.workunit.client.0.smithi148.stdout:0/676: write d0/d2e/f35 [3315557,27910] 0 2024-04-26T23:09:14.514 INFO:tasks.workunit.client.0.smithi148.stdout:3/582: write d9/d15/d29/d4d/f57 [1219331,80025] 0 2024-04-26T23:09:14.518 INFO:tasks.workunit.client.0.smithi148.stdout:7/554: dread d7/d11/d17/d2f/f5b [0,4194304] 0 2024-04-26T23:09:14.527 INFO:tasks.workunit.client.0.smithi148.stdout:0/677: dread d0/d8/f4f [0,4194304] 0 2024-04-26T23:09:14.602 INFO:tasks.workunit.client.0.smithi148.stdout:1/563: read d16/d17/d4b/d55/fa9 [1529949,109257] 0 2024-04-26T23:09:14.602 INFO:tasks.workunit.client.0.smithi148.stdout:1/564: chown d16/d1c/f29 136111932 1 2024-04-26T23:09:14.602 INFO:tasks.workunit.client.0.smithi148.stdout:4/689: dwrite d12/d1c/d45/f9e [0,4194304] 0 2024-04-26T23:09:14.610 INFO:tasks.workunit.client.0.smithi148.stdout:0/678: getdents d0/d8/d33/d6a/d70/dd6/d9d/db4 0 2024-04-26T23:09:14.617 INFO:tasks.workunit.client.0.smithi148.stdout:7/555: read d7/d11/d17/f3c [595453,116525] 0 2024-04-26T23:09:14.617 INFO:tasks.workunit.client.0.smithi148.stdout:6/548: dwrite d6/d32/f62 [0,4194304] 0 2024-04-26T23:09:14.617 INFO:tasks.workunit.client.0.smithi148.stdout:6/549: read - d6/d14/d91/d9f/f85 zero size 2024-04-26T23:09:14.634 INFO:tasks.workunit.client.0.smithi148.stdout:7/556: truncate d7/d19/f83 749092 0 2024-04-26T23:09:14.636 INFO:tasks.workunit.client.0.smithi148.stdout:6/550: creat d6/d32/d98/fb0 x:0 0 0 2024-04-26T23:09:14.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/557: mknod d7/d11/d17/d2f/d57/cb4 0 2024-04-26T23:09:14.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/558: write d7/d11/f18 [370803,32326] 0 2024-04-26T23:09:14.690 INFO:tasks.workunit.client.0.smithi148.stdout:7/559: link d7/d11/d29/d2e/f64 d7/d11/d29/d2e/d41/d67/d94/d95/fb5 0 2024-04-26T23:09:14.690 INFO:tasks.workunit.client.0.smithi148.stdout:7/560: chown d7/d75/c42 18964 1 2024-04-26T23:09:14.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:09:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:14.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:14.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:14.694+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:09:14.702 INFO:tasks.workunit.client.0.smithi148.stdout:7/561: dread d7/d11/d29/d2e/d41/f48 [0,4194304] 0 2024-04-26T23:09:14.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/565: dwrite d16/d85/fb0 [0,4194304] 0 2024-04-26T23:09:14.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/566: chown d16/d17/d4b/d55/d90/da5 237 1 2024-04-26T23:09:14.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/567: read f5 [3609650,62448] 0 2024-04-26T23:09:14.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/568: write d16/d17/d4b/d55/d90/fb9 [643224,94596] 0 2024-04-26T23:09:14.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/569: read - d16/d17/fb5 zero size 2024-04-26T23:09:14.715 INFO:tasks.workunit.client.0.smithi148.stdout:4/690: write d12/d1c/d56/d87/d9a/d9d/f4c [1147041,31767] 0 2024-04-26T23:09:14.737 INFO:tasks.workunit.client.0.smithi148.stdout:4/691: creat d12/d1c/d56/fd9 x:0 0 0 2024-04-26T23:09:14.741 INFO:tasks.workunit.client.0.smithi148.stdout:1/570: dread d16/d45/d2b/f31 [4194304,4194304] 0 2024-04-26T23:09:14.743 INFO:tasks.workunit.client.0.smithi148.stdout:6/551: dwrite d6/d9/d1c/f9b [0,4194304] 0 2024-04-26T23:09:14.744 INFO:tasks.workunit.client.0.smithi148.stdout:4/692: truncate d12/d1c/d56/d87/d9a/d9d/f90 1473103 0 2024-04-26T23:09:14.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/571: truncate d16/d17/f1b 2899958 0 2024-04-26T23:09:14.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/572: write d16/d17/d4b/f72 [848181,29597] 0 2024-04-26T23:09:14.750 INFO:tasks.workunit.client.0.smithi148.stdout:6/552: unlink d6/d14/c3b 0 2024-04-26T23:09:14.750 INFO:tasks.workunit.client.0.smithi148.stdout:6/553: stat d6/d9/c49 0 2024-04-26T23:09:14.754 INFO:tasks.workunit.client.0.smithi148.stdout:4/693: mkdir d12/d1c/dc8/dda 0 2024-04-26T23:09:14.761 INFO:tasks.workunit.client.0.smithi148.stdout:1/573: write d16/f87 [711719,81099] 0 2024-04-26T23:09:14.761 INFO:tasks.workunit.client.0.smithi148.stdout:1/574: stat d16/d47/l61 0 2024-04-26T23:09:14.761 INFO:tasks.workunit.client.0.smithi148.stdout:1/575: fdatasync d16/d1c/f57 0 2024-04-26T23:09:14.762 INFO:tasks.workunit.client.0.smithi148.stdout:1/576: readlink d16/d47/l61 0 2024-04-26T23:09:14.770 INFO:tasks.workunit.client.0.smithi148.stdout:4/694: dread d12/d1c/d56/d87/d9a/d9d/f4c [0,4194304] 0 2024-04-26T23:09:14.867 INFO:tasks.workunit.client.0.smithi148.stdout:4/695: write d12/d17/d2a/fac [933230,45181] 0 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/554: rename d6/dc/c6a to d6/d9/d1c/d5b/cb1 0 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/555: truncate d6/d9/f7e 831892 0 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/556: dread - d6/d9/d23/d4a/d95/fae zero size 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/557: getdents d6/d9/d1c/d1d/d68 0 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/558: symlink d6/d9/d1e/lb2 0 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/559: dread - d6/d32/d8a/f97 zero size 2024-04-26T23:09:14.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/560: rename d6/d9/c49 to d6/d9/d1c/d1d/d68/cb3 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/561: read d6/dc/f3f [1916619,42396] 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:1/577: dwrite d16/d17/f39 [0,4194304] 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/562: link d6/d9/d1c/d5b/l77 d6/lb4 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/563: chown d6/d9/d23/c2d 0 1 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/564: dread d6/d14/d91/d9f/f78 [0,4194304] 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/565: rename d6/c11 to d6/d9/d1c/d1d/d1f/cb5 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/566: symlink d6/lb6 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:6/567: dread - d6/d9/f52 zero size 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/679: dwrite d0/d8/d33/fdc [0,4194304] 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/680: fsync d0/d8/d95/d9f/fb7 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/681: creat d0/d2e/d8f/fed x:0 0 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/682: creat d0/d8/fee x:0 0 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:0/683: rename d0/d8/d5f/d72 to d0/d8/d33/d68/def 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:1/578: dwrite d16/d1c/f57 [0,4194304] 0 2024-04-26T23:09:14.871 INFO:tasks.workunit.client.0.smithi148.stdout:1/579: fdatasync d16/d47/d49/fb8 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/580: write d16/d45/d2b/d6e/f75 [212395,6240] 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/581: getdents d16/d1c/d82/db2 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/582: chown d16/d1c/f2c 1803811 1 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/583: write d16/d17/d68/f91 [1040295,19360] 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/684: creat d0/d2e/d8f/ff0 x:0 0 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/685: link d0/d20/d3b/l81 d0/d8/d33/d43/d4e/lf1 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/686: creat d0/d5/ff2 x:0 0 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:6/568: dread d6/d32/f8b [0,4194304] 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/687: mkdir d0/d5/dd4/df3 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:6/569: dread d6/d9/d1c/f5d [0,4194304] 0 2024-04-26T23:09:14.872 INFO:tasks.workunit.client.0.smithi148.stdout:6/570: fdatasync d6/d32/f63 0 2024-04-26T23:09:14.873 INFO:tasks.workunit.client.0.smithi148.stdout:0/688: dread d0/d8/d95/d97/d3a/fa2 [0,4194304] 0 2024-04-26T23:09:14.888 INFO:tasks.workunit.client.0.smithi148.stdout:0/689: dread d0/fa4 [0,4194304] 0 2024-04-26T23:09:14.892 INFO:tasks.workunit.client.0.smithi148.stdout:0/690: rename d0/d20/c34 to d0/d20/d3b/cf4 0 2024-04-26T23:09:14.932 INFO:tasks.workunit.client.0.smithi148.stdout:6/571: dwrite d6/d9/f7e [0,4194304] 0 2024-04-26T23:09:14.932 INFO:tasks.workunit.client.0.smithi148.stdout:6/572: chown d6/d9/d1e/f5f 6130 1 2024-04-26T23:09:14.937 INFO:tasks.workunit.client.0.smithi148.stdout:6/573: truncate d6/d32/d66/f80 1854695 0 2024-04-26T23:09:14.941 INFO:tasks.workunit.client.0.smithi148.stdout:6/574: mkdir d6/d9/d1c/d1d/d1f/da5/db7 0 2024-04-26T23:09:14.948 INFO:tasks.workunit.client.0.smithi148.stdout:6/575: creat d6/d9/d1c/d1d/d1f/da5/db7/fb8 x:0 0 0 2024-04-26T23:09:14.951 INFO:tasks.workunit.client.0.smithi148.stdout:6/576: rename d6/d9/d1c/d1d/d1f/d40/l56 to d6/d9/d1c/d1d/d1f/da5/lb9 0 2024-04-26T23:09:14.951 INFO:tasks.workunit.client.0.smithi148.stdout:6/577: dread - d6/d9/d23/d4a/d95/fae zero size 2024-04-26T23:09:14.953 INFO:tasks.workunit.client.0.smithi148.stdout:6/578: symlink d6/d9/d1c/lba 0 2024-04-26T23:09:14.954 INFO:tasks.workunit.client.0.smithi148.stdout:6/579: write d6/d32/f62 [5218585,73582] 0 2024-04-26T23:09:14.957 INFO:tasks.workunit.client.0.smithi148.stdout:6/580: rename d6/c5e to d6/d9/d1e/d69/cbb 0 2024-04-26T23:09:14.959 INFO:tasks.workunit.client.0.smithi148.stdout:6/581: mkdir d6/d9/d1c/d1d/d68/dbc 0 2024-04-26T23:09:14.960 INFO:tasks.workunit.client.0.smithi148.stdout:6/582: write d6/d9/f52 [956093,26256] 0 2024-04-26T23:09:14.962 INFO:tasks.workunit.client.0.smithi148.stdout:6/583: mknod d6/d9/d1c/cbd 0 2024-04-26T23:09:14.962 INFO:tasks.workunit.client.0.smithi148.stdout:6/584: fdatasync d6/f33 0 2024-04-26T23:09:14.965 INFO:tasks.workunit.client.0.smithi148.stdout:6/585: mkdir d6/dbe 0 2024-04-26T23:09:15.016 INFO:tasks.workunit.client.0.smithi148.stdout:9/561: sync 2024-04-26T23:09:15.016 INFO:tasks.workunit.client.0.smithi148.stdout:8/618: sync 2024-04-26T23:09:15.017 INFO:tasks.workunit.client.0.smithi148.stdout:9/562: write d19/d1d/f8b [1159271,4573] 0 2024-04-26T23:09:15.017 INFO:tasks.workunit.client.0.smithi148.stdout:9/563: getdents d19/d1d/d25/d31/d32/db9 0 2024-04-26T23:09:15.021 INFO:tasks.workunit.client.0.smithi148.stdout:8/619: creat d3/d9/d12/d23/d29/fbc x:0 0 0 2024-04-26T23:09:15.021 INFO:tasks.workunit.client.0.smithi148.stdout:8/620: chown d3/f42 740710 1 2024-04-26T23:09:15.021 INFO:tasks.workunit.client.0.smithi148.stdout:8/621: read - d3/d9/d12/d23/d35/f90 zero size 2024-04-26T23:09:15.027 INFO:tasks.workunit.client.0.smithi148.stdout:9/564: unlink d19/d1d/l2a 0 2024-04-26T23:09:15.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/565: rmdir d19/d1d/d25/d78 39 2024-04-26T23:09:15.032 INFO:tasks.workunit.client.0.smithi148.stdout:9/566: rmdir d19/d1d/d25/d31/d48/d8c 39 2024-04-26T23:09:15.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/567: rmdir d19/d1d/d25/d2f 39 2024-04-26T23:09:15.040 INFO:tasks.workunit.client.0.smithi148.stdout:6/586: rename d6/d9/d1c/d1d/d1f/da5 to d6/d9/d1c/dbf 0 2024-04-26T23:09:15.041 INFO:tasks.workunit.client.0.smithi148.stdout:9/568: write d19/d1d/d25/d31/d60/dba/d85/fa6 [244717,83805] 0 2024-04-26T23:09:15.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/587: creat d6/d32/fc0 x:0 0 0 2024-04-26T23:09:15.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/588: chown d6/f33 187 1 2024-04-26T23:09:15.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/589: write d6/d9/f52 [1209135,69258] 0 2024-04-26T23:09:15.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/590: chown d6/d9/d23/l48 6481 1 2024-04-26T23:09:15.050 INFO:tasks.workunit.client.0.smithi148.stdout:9/569: link d19/d1d/f66 d19/d39/fbd 0 2024-04-26T23:09:15.054 INFO:tasks.workunit.client.0.smithi148.stdout:6/591: mkdir d6/d9/d23/dc1 0 2024-04-26T23:09:15.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/622: dwrite d3/da/d1c/d7c/d8c/d9f/f20 [0,4194304] 0 2024-04-26T23:09:15.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/623: write d3/d9/f58 [810228,100178] 0 2024-04-26T23:09:15.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/624: creat d3/d9/d12/d23/d65/fbd x:0 0 0 2024-04-26T23:09:15.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/625: fdatasync d3/d9/d12/d23/d35/f86 0 2024-04-26T23:09:15.077 INFO:tasks.workunit.client.0.smithi148.stdout:8/626: creat d3/da/d1c/d7c/fbe x:0 0 0 2024-04-26T23:09:15.080 INFO:tasks.workunit.client.0.smithi148.stdout:8/627: symlink d3/da/d1c/d7c/lbf 0 2024-04-26T23:09:15.080 INFO:tasks.workunit.client.0.smithi148.stdout:8/628: chown d3/da 5677 1 2024-04-26T23:09:15.084 INFO:tasks.workunit.client.0.smithi148.stdout:8/629: creat d3/d9/d12/d23/d35/dad/fc0 x:0 0 0 2024-04-26T23:09:15.084 INFO:tasks.workunit.client.0.smithi148.stdout:8/630: dread - d3/d9/d12/f78 zero size 2024-04-26T23:09:15.089 INFO:tasks.workunit.client.0.smithi148.stdout:8/631: creat d3/d9/d12/fc1 x:0 0 0 2024-04-26T23:09:15.089 INFO:tasks.workunit.client.0.smithi148.stdout:8/632: chown d3/d9/d12/d23/d65/ca2 0 1 2024-04-26T23:09:15.089 INFO:tasks.workunit.client.0.smithi148.stdout:6/592: dwrite d6/d32/d98/fb0 [0,4194304] 0 2024-04-26T23:09:15.091 INFO:tasks.workunit.client.0.smithi148.stdout:9/570: dwrite d19/d1d/d25/f41 [0,4194304] 0 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:09:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:09:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.098+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:09:15.105 INFO:tasks.workunit.client.0.smithi148.stdout:9/571: rename d19/d1d/f52 to d19/d9f/dbb/fbe 0 2024-04-26T23:09:15.116 INFO:tasks.workunit.client.0.smithi148.stdout:9/572: mknod d19/d1d/d25/d31/d32/db9/cbf 0 2024-04-26T23:09:15.123 INFO:tasks.workunit.client.0.smithi148.stdout:9/573: link d19/d1d/d25/d2f/d4d/d33/fa2 d19/d1d/d25/d2f/d4d/d33/daa/fc0 0 2024-04-26T23:09:15.124 INFO:tasks.workunit.client.0.smithi148.stdout:9/574: readlink d19/d1d/l6c 0 2024-04-26T23:09:15.124 INFO:tasks.workunit.client.0.smithi148.stdout:6/593: dwrite d6/d14/d91/d9f/f7d [0,4194304] 0 2024-04-26T23:09:15.124 INFO:tasks.workunit.client.0.smithi148.stdout:6/594: dread - d6/d14/d91/d9f/f72 zero size 2024-04-26T23:09:15.125 INFO:tasks.workunit.client.0.smithi148.stdout:9/575: mknod d19/d1d/d25/d2f/d4d/d33/cc1 0 2024-04-26T23:09:15.129 INFO:tasks.workunit.client.0.smithi148.stdout:6/595: mknod d6/d9/d1e/d69/cc2 0 2024-04-26T23:09:15.131 INFO:tasks.workunit.client.0.smithi148.stdout:9/576: creat d19/d1d/d69/fc2 x:0 0 0 2024-04-26T23:09:15.131 INFO:tasks.workunit.client.0.smithi148.stdout:9/577: write d19/d1d/d25/f63 [503940,119143] 0 2024-04-26T23:09:15.132 INFO:tasks.workunit.client.0.smithi148.stdout:6/596: creat d6/d9/fc3 x:0 0 0 2024-04-26T23:09:15.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/597: creat d6/d9/fc4 x:0 0 0 2024-04-26T23:09:15.152 INFO:tasks.workunit.client.0.smithi148.stdout:3/583: sync 2024-04-26T23:09:15.152 INFO:tasks.workunit.client.0.smithi148.stdout:2/669: sync 2024-04-26T23:09:15.152 INFO:tasks.workunit.client.0.smithi148.stdout:7/562: sync 2024-04-26T23:09:15.152 INFO:tasks.workunit.client.0.smithi148.stdout:5/665: sync 2024-04-26T23:09:15.153 INFO:tasks.workunit.client.0.smithi148.stdout:3/584: fsync d9/d65/f91 0 2024-04-26T23:09:15.155 INFO:tasks.workunit.client.0.smithi148.stdout:2/670: mknod d5/d8/cdd 0 2024-04-26T23:09:15.157 INFO:tasks.workunit.client.0.smithi148.stdout:5/666: creat da/d1b/d1c/ff1 x:0 0 0 2024-04-26T23:09:15.159 INFO:tasks.workunit.client.0.smithi148.stdout:7/563: link d7/f15 d7/d11/fb6 0 2024-04-26T23:09:15.161 INFO:tasks.workunit.client.0.smithi148.stdout:3/585: read d9/d31/d8f/fa2 [962586,28096] 0 2024-04-26T23:09:15.161 INFO:tasks.workunit.client.0.smithi148.stdout:2/671: creat d5/d8/d4b/d4e/d6d/da0/fde x:0 0 0 2024-04-26T23:09:15.161 INFO:tasks.workunit.client.0.smithi148.stdout:2/672: fdatasync d5/d7/fb 0 2024-04-26T23:09:15.162 INFO:tasks.workunit.client.0.smithi148.stdout:5/667: mkdir da/d1b/d1c/df2 0 2024-04-26T23:09:15.162 INFO:tasks.workunit.client.0.smithi148.stdout:2/673: creat d5/d8/d9/fdf x:0 0 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:3/586: dread d9/d52/f62 [0,4194304] 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:3/587: fsync d9/d65/f91 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:3/588: truncate d9/d52/f5c 2343171 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:5/668: link da/d12/f13 da/d1b/d3b/ff3 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:2/674: creat d5/d17/d64/fe0 x:0 0 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:5/669: mknod da/d1b/d2d/cf4 0 2024-04-26T23:09:15.181 INFO:tasks.workunit.client.0.smithi148.stdout:9/578: dwrite d19/d1d/d25/d31/f55 [0,4194304] 0 2024-04-26T23:09:15.182 INFO:tasks.workunit.client.0.smithi148.stdout:9/579: truncate d19/d1d/d25/d2f/f98 483488 0 2024-04-26T23:09:15.201 INFO:tasks.workunit.client.0.smithi148.stdout:5/670: dread da/d12/d78/f87 [0,4194304] 0 2024-04-26T23:09:15.203 INFO:tasks.workunit.client.0.smithi148.stdout:5/671: mkdir da/d1b/d2d/d82/df5 0 2024-04-26T23:09:15.228 INFO:tasks.workunit.client.0.smithi148.stdout:9/580: write d19/d1d/d25/f41 [2650998,97995] 0 2024-04-26T23:09:15.229 INFO:tasks.workunit.client.0.smithi148.stdout:9/581: readlink d19/d22/l4e 0 2024-04-26T23:09:15.230 INFO:tasks.workunit.client.0.smithi148.stdout:9/582: symlink d19/d1d/d25/d31/d60/dba/lc3 0 2024-04-26T23:09:15.230 INFO:tasks.workunit.client.0.smithi148.stdout:9/583: fsync fe 0 2024-04-26T23:09:15.232 INFO:tasks.workunit.client.0.smithi148.stdout:9/584: unlink d19/d1d/d25/d2f/d4d/l72 0 2024-04-26T23:09:15.233 INFO:tasks.workunit.client.0.smithi148.stdout:9/585: getdents d19/d1d/d49 0 2024-04-26T23:09:15.234 INFO:tasks.workunit.client.0.smithi148.stdout:9/586: truncate d19/d1d/d49/f5c 1293009 0 2024-04-26T23:09:15.234 INFO:tasks.workunit.client.0.smithi148.stdout:9/587: fsync f2 0 2024-04-26T23:09:15.245 INFO:tasks.workunit.client.0.smithi148.stdout:9/588: mkdir d19/d4b/dc4 0 2024-04-26T23:09:15.245 INFO:tasks.workunit.client.0.smithi148.stdout:9/589: chown d19/d1d/d25/d2f/d4d/d33/daa/d9e 20475588 1 2024-04-26T23:09:15.245 INFO:tasks.workunit.client.0.smithi148.stdout:9/590: fdatasync d19/d1d/d25/d31/d60/f62 0 2024-04-26T23:09:15.272 INFO:tasks.workunit.client.0.smithi148.stdout:9/591: write f2 [2197692,72897] 0 2024-04-26T23:09:15.272 INFO:tasks.workunit.client.0.smithi148.stdout:9/592: stat d19/d39/f59 0 2024-04-26T23:09:15.272 INFO:tasks.workunit.client.0.smithi148.stdout:6/598: dwrite d6/f43 [4194304,4194304] 0 2024-04-26T23:09:15.275 INFO:tasks.workunit.client.0.smithi148.stdout:5/672: dread da/d1f/fd5 [0,4194304] 0 2024-04-26T23:09:15.276 INFO:tasks.workunit.client.0.smithi148.stdout:3/589: dwrite d9/d15/d29/d4d/d6f/fb6 [0,4194304] 0 2024-04-26T23:09:15.276 INFO:tasks.workunit.client.0.smithi148.stdout:2/675: dread d5/d10/f3b [0,4194304] 0 2024-04-26T23:09:15.276 INFO:tasks.workunit.client.0.smithi148.stdout:2/676: chown d5/d8/d4b 34817 1 2024-04-26T23:09:15.276 INFO:tasks.workunit.client.0.smithi148.stdout:2/677: fsync d5/d8/d6c/d8f/fc7 0 2024-04-26T23:09:15.281 INFO:tasks.workunit.client.0.smithi148.stdout:6/599: write d6/d9/d1c/d1d/d68/fa8 [350052,30888] 0 2024-04-26T23:09:15.281 INFO:tasks.workunit.client.0.smithi148.stdout:6/600: dread - d6/d9/d1c/d1d/d1f/f87 zero size 2024-04-26T23:09:15.281 INFO:tasks.workunit.client.0.smithi148.stdout:6/601: chown d6/dc/f45 87 1 2024-04-26T23:09:15.281 INFO:tasks.workunit.client.0.smithi148.stdout:3/590: read d9/d15/d29/d4d/f64 [249285,48760] 0 2024-04-26T23:09:15.287 INFO:tasks.workunit.client.0.smithi148.stdout:7/564: dwrite d7/d11/d29/f53 [0,4194304] 0 2024-04-26T23:09:15.291 INFO:tasks.workunit.client.0.smithi148.stdout:6/602: dread d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:15.291 INFO:tasks.workunit.client.0.smithi148.stdout:6/603: dread - d6/d9/d1c/d1d/d1f/f87 zero size 2024-04-26T23:09:15.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/673: mkdir da/d68/d69/dc9/df6 0 2024-04-26T23:09:15.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/678: truncate d5/f16 2368427 0 2024-04-26T23:09:15.527 INFO:tasks.workunit.client.0.smithi148.stdout:9/593: mkdir d19/d1d/d25/d31/dc5 0 2024-04-26T23:09:15.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/679: truncate d5/d8/fd7 868706 0 2024-04-26T23:09:15.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/594: readlink d19/d1d/d25/d2f/lae 0 2024-04-26T23:09:15.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/595: write d19/d1d/d69/f83 [1392686,67918] 0 2024-04-26T23:09:15.528 INFO:tasks.workunit.client.0.smithi148.stdout:3/591: creat d9/d15/d29/d4d/fbb x:0 0 0 2024-04-26T23:09:15.529 INFO:tasks.workunit.client.0.smithi148.stdout:0/691: sync 2024-04-26T23:09:15.529 INFO:tasks.workunit.client.0.smithi148.stdout:1/584: sync 2024-04-26T23:09:15.529 INFO:tasks.workunit.client.0.smithi148.stdout:0/692: chown d0/ca5 129799 1 2024-04-26T23:09:15.529 INFO:tasks.workunit.client.0.smithi148.stdout:4/696: sync 2024-04-26T23:09:15.529 INFO:tasks.workunit.client.0.smithi148.stdout:4/697: chown d12/d17/d2a/d37/f62 6388 1 2024-04-26T23:09:15.530 INFO:tasks.workunit.client.0.smithi148.stdout:4/698: chown d12/d1c/dc8/dda 1971 1 2024-04-26T23:09:15.532 INFO:tasks.workunit.client.0.smithi148.stdout:7/565: mknod d7/d11/d17/d9e/da9/cb7 0 2024-04-26T23:09:15.532 INFO:tasks.workunit.client.0.smithi148.stdout:7/566: fsync d7/d11/d29/d2e/d41/d67/fb2 0 2024-04-26T23:09:15.534 INFO:tasks.workunit.client.0.smithi148.stdout:6/604: symlink d6/d9/d1c/d1d/lc5 0 2024-04-26T23:09:15.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/674: mknod da/d1b/d5b/cf7 0 2024-04-26T23:09:15.540 INFO:tasks.workunit.client.0.smithi148.stdout:2/680: rmdir d5 39 2024-04-26T23:09:15.542 INFO:tasks.workunit.client.0.smithi148.stdout:9/596: mknod d19/d1d/d25/d31/d60/cc6 0 2024-04-26T23:09:15.544 INFO:tasks.workunit.client.0.smithi148.stdout:1/585: symlink d16/d1c/d82/lc0 0 2024-04-26T23:09:15.547 INFO:tasks.workunit.client.0.smithi148.stdout:0/693: getdents d0/d2e 0 2024-04-26T23:09:15.551 INFO:tasks.workunit.client.0.smithi148.stdout:6/605: truncate d6/f6f 1786313 0 2024-04-26T23:09:15.559 INFO:tasks.workunit.client.0.smithi148.stdout:5/675: creat da/d68/d69/dc9/df6/ff8 x:0 0 0 2024-04-26T23:09:15.559 INFO:tasks.workunit.client.0.smithi148.stdout:5/676: chown da/d1a/dc2/cc6 988 1 2024-04-26T23:09:15.559 INFO:tasks.workunit.client.0.smithi148.stdout:8/633: sync 2024-04-26T23:09:15.559 INFO:tasks.workunit.client.0.smithi148.stdout:2/681: symlink d5/d10/le1 0 2024-04-26T23:09:15.559 INFO:tasks.workunit.client.0.smithi148.stdout:9/597: symlink d19/d1d/d25/d2f/lc7 0 2024-04-26T23:09:15.560 INFO:tasks.workunit.client.0.smithi148.stdout:9/598: write d19/d1d/d25/f63 [657856,18009] 0 2024-04-26T23:09:15.565 INFO:tasks.workunit.client.0.smithi148.stdout:1/586: symlink d16/d45/lc1 0 2024-04-26T23:09:15.565 INFO:tasks.workunit.client.0.smithi148.stdout:1/587: truncate d16/d1c/f3c 1491259 0 2024-04-26T23:09:15.565 INFO:tasks.workunit.client.0.smithi148.stdout:1/588: fsync d16/f20 0 2024-04-26T23:09:15.565 INFO:tasks.workunit.client.0.smithi148.stdout:1/589: write d16/d17/d4b/d55/f58 [884832,120022] 0 2024-04-26T23:09:15.572 INFO:tasks.workunit.client.0.smithi148.stdout:8/634: creat d3/d9/fc2 x:0 0 0 2024-04-26T23:09:15.575 INFO:tasks.workunit.client.0.smithi148.stdout:9/599: mkdir d19/d1d/d25/d31/d32/dc8 0 2024-04-26T23:09:15.580 INFO:tasks.workunit.client.0.smithi148.stdout:8/635: dread d3/d9/f58 [0,4194304] 0 2024-04-26T23:09:15.586 INFO:tasks.workunit.client.0.smithi148.stdout:9/600: dread d19/d39/f44 [0,4194304] 0 2024-04-26T23:09:15.589 INFO:tasks.workunit.client.0.smithi148.stdout:9/601: link d19/d1d/d25/d2f/f53 d19/d1d/d25/d2f/d4d/d33/d50/fc9 0 2024-04-26T23:09:15.590 INFO:tasks.workunit.client.0.smithi148.stdout:9/602: write d19/f2d [901382,22945] 0 2024-04-26T23:09:15.590 INFO:tasks.workunit.client.0.smithi148.stdout:9/603: fsync d19/d22/f9c 0 2024-04-26T23:09:15.593 INFO:tasks.workunit.client.0.smithi148.stdout:9/604: creat d19/d1d/d69/fca x:0 0 0 2024-04-26T23:09:15.593 INFO:tasks.workunit.client.0.smithi148.stdout:9/605: chown d19/d39/f44 618566463 1 2024-04-26T23:09:15.599 INFO:tasks.workunit.client.0.smithi148.stdout:9/606: mkdir d19/d1d/d25/d78/db6/dcb 0 2024-04-26T23:09:15.603 INFO:tasks.workunit.client.0.smithi148.stdout:9/607: truncate d19/d1d/d25/d31/f56 3286000 0 2024-04-26T23:09:15.606 INFO:tasks.workunit.client.0.smithi148.stdout:9/608: link d19/d1d/f66 d19/d1d/d25/d31/dc5/fcc 0 2024-04-26T23:09:15.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/609: rmdir d19/d1d/d49 39 2024-04-26T23:09:15.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/606: dwrite d6/d9/d1c/d1d/d1f/fa2 [0,4194304] 0 2024-04-26T23:09:15.609 INFO:tasks.workunit.client.0.smithi148.stdout:9/610: truncate d19/d1d/f66 194374 0 2024-04-26T23:09:15.612 INFO:tasks.workunit.client.0.smithi148.stdout:9/611: truncate d19/d1d/d25/d2f/d4d/d33/daa/d9e/fa8 493450 0 2024-04-26T23:09:15.613 INFO:tasks.workunit.client.0.smithi148.stdout:6/607: link d6/d32/d66/c74 d6/d9/d1c/d1d/d1f/cc6 0 2024-04-26T23:09:15.613 INFO:tasks.workunit.client.0.smithi148.stdout:6/608: chown d6/d32/fc0 166 1 2024-04-26T23:09:15.614 INFO:tasks.workunit.client.0.smithi148.stdout:6/609: write d6/d9/fc4 [1043529,16264] 0 2024-04-26T23:09:15.615 INFO:tasks.workunit.client.0.smithi148.stdout:3/592: dread d9/d15/d29/d4d/d68/f96 [0,4194304] 0 2024-04-26T23:09:15.615 INFO:tasks.workunit.client.0.smithi148.stdout:3/593: write d9/d52/f62 [1285315,17088] 0 2024-04-26T23:09:15.620 INFO:tasks.workunit.client.0.smithi148.stdout:3/594: mkdir d9/d15/d29/d88/d9f/dbc 0 2024-04-26T23:09:15.621 INFO:tasks.workunit.client.0.smithi148.stdout:7/567: write d7/fe [2245376,116495] 0 2024-04-26T23:09:15.621 INFO:tasks.workunit.client.0.smithi148.stdout:5/677: write da/d1b/f93 [7687543,100569] 0 2024-04-26T23:09:15.621 INFO:tasks.workunit.client.0.smithi148.stdout:7/568: write d7/d19/f2d [538911,14787] 0 2024-04-26T23:09:15.623 INFO:tasks.workunit.client.0.smithi148.stdout:1/590: read d16/d1c/f2c [5438550,73498] 0 2024-04-26T23:09:15.628 INFO:tasks.workunit.client.0.smithi148.stdout:3/595: creat d9/d15/db1/fbd x:0 0 0 2024-04-26T23:09:15.636 INFO:tasks.workunit.client.0.smithi148.stdout:4/699: dwrite d12/d1c/d45/d8c/f3f [0,4194304] 0 2024-04-26T23:09:15.636 INFO:tasks.workunit.client.0.smithi148.stdout:4/700: truncate d12/d17/fca 32925 0 2024-04-26T23:09:15.636 INFO:tasks.workunit.client.0.smithi148.stdout:8/636: write d3/d9/d12/d23/d29/d77/f8a [335288,1816] 0 2024-04-26T23:09:15.641 INFO:tasks.workunit.client.0.smithi148.stdout:5/678: write da/d1f/f26 [1591244,49350] 0 2024-04-26T23:09:15.641 INFO:tasks.workunit.client.0.smithi148.stdout:5/679: fdatasync da/d12/f35 0 2024-04-26T23:09:15.642 INFO:tasks.workunit.client.0.smithi148.stdout:2/682: dread d5/d8/d11/dae/f6e [0,4194304] 0 2024-04-26T23:09:15.644 INFO:tasks.workunit.client.0.smithi148.stdout:2/683: write d5/d8/d15/d43/d5d/f7c [4529306,69108] 0 2024-04-26T23:09:15.657 INFO:tasks.workunit.client.0.smithi148.stdout:2/684: dread d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:09:15.657 INFO:tasks.workunit.client.0.smithi148.stdout:2/685: write d5/d8/db9/fdb [750768,11391] 0 2024-04-26T23:09:15.659 INFO:tasks.workunit.client.0.smithi148.stdout:0/694: dwrite d0/f62 [0,4194304] 0 2024-04-26T23:09:15.659 INFO:tasks.workunit.client.0.smithi148.stdout:2/686: creat d5/d17/d64/d88/fe2 x:0 0 0 2024-04-26T23:09:15.659 INFO:tasks.workunit.client.0.smithi148.stdout:0/695: truncate d0/d2e/d8f/d6c/dab/fea 740214 0 2024-04-26T23:09:15.659 INFO:tasks.workunit.client.0.smithi148.stdout:0/696: stat d0/d8/d52/l2f 0 2024-04-26T23:09:15.671 INFO:tasks.workunit.client.0.smithi148.stdout:0/697: symlink d0/d20/d54/lf5 0 2024-04-26T23:09:15.671 INFO:tasks.workunit.client.0.smithi148.stdout:0/698: fdatasync d0/d8/d33/f45 0 2024-04-26T23:09:15.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/687: creat d5/da6/fe3 x:0 0 0 2024-04-26T23:09:15.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/688: write d5/d17/d64/d88/fc6 [298343,44480] 0 2024-04-26T23:09:15.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/689: dread - d5/d8/d9/d3d/fa8 zero size 2024-04-26T23:09:15.672 INFO:tasks.workunit.client.0.smithi148.stdout:2/690: chown d5/d8/d15/d7d/dd1/ld3 15780501 1 2024-04-26T23:09:15.672 INFO:tasks.workunit.client.0.smithi148.stdout:2/691: truncate d5/d8/d4b/d4e/d6d/f8e 1092175 0 2024-04-26T23:09:15.685 INFO:tasks.workunit.client.0.smithi148.stdout:6/610: dread d6/f19 [0,4194304] 0 2024-04-26T23:09:15.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/692: creat d5/d7f/d86/fe4 x:0 0 0 2024-04-26T23:09:15.685 INFO:tasks.workunit.client.0.smithi148.stdout:6/611: chown d6/d32/fa3 10392 1 2024-04-26T23:09:15.685 INFO:tasks.workunit.client.0.smithi148.stdout:6/612: truncate d6/d32/fc0 958397 0 2024-04-26T23:09:15.694 INFO:tasks.workunit.client.0.smithi148.stdout:6/613: symlink d6/d9/d23/d4a/d95/lc7 0 2024-04-26T23:09:15.699 INFO:tasks.workunit.client.0.smithi148.stdout:6/614: rmdir d6/d9/d23 39 2024-04-26T23:09:15.706 INFO:tasks.workunit.client.0.smithi148.stdout:3/596: dread d9/d15/d29/d4d/d6f/fae [4194304,4194304] 0 2024-04-26T23:09:15.713 INFO:tasks.workunit.client.0.smithi148.stdout:6/615: dread d6/dc/f3f [0,4194304] 0 2024-04-26T23:09:15.713 INFO:tasks.workunit.client.0.smithi148.stdout:3/597: creat d9/d65/fbe x:0 0 0 2024-04-26T23:09:15.713 INFO:tasks.workunit.client.0.smithi148.stdout:6/616: readlink d6/d9/d23/l48 0 2024-04-26T23:09:15.713 INFO:tasks.workunit.client.0.smithi148.stdout:6/617: stat d6/d9/d23/f57 0 2024-04-26T23:09:15.715 INFO:tasks.workunit.client.0.smithi148.stdout:1/591: dwrite f10 [4194304,4194304] 0 2024-04-26T23:09:15.727 INFO:tasks.workunit.client.0.smithi148.stdout:1/592: dread d16/d85/fb0 [0,4194304] 0 2024-04-26T23:09:15.730 INFO:tasks.workunit.client.0.smithi148.stdout:6/618: dread d6/d9/f64 [0,4194304] 0 2024-04-26T23:09:15.734 INFO:tasks.workunit.client.0.smithi148.stdout:7/569: dwrite d7/d11/d29/d2e/d41/d67/d94/f9f [0,4194304] 0 2024-04-26T23:09:15.767 INFO:tasks.workunit.client.0.smithi148.stdout:1/593: dread d16/d45/d2b/f5c [0,4194304] 0 2024-04-26T23:09:15.767 INFO:tasks.workunit.client.0.smithi148.stdout:1/594: chown d16/d17/d4b/d55/d90/lbf 1797130 1 2024-04-26T23:09:15.776 INFO:tasks.workunit.client.0.smithi148.stdout:6/619: dwrite d6/d9/d1c/d1d/d1f/f7f [0,4194304] 0 2024-04-26T23:09:15.780 INFO:tasks.workunit.client.0.smithi148.stdout:7/570: symlink d7/lb8 0 2024-04-26T23:09:15.781 INFO:tasks.workunit.client.0.smithi148.stdout:7/571: write d7/d11/d17/d2f/d44/f7f [3302482,106664] 0 2024-04-26T23:09:15.781 INFO:tasks.workunit.client.0.smithi148.stdout:1/595: symlink d16/d47/d73/lc2 0 2024-04-26T23:09:15.784 INFO:tasks.workunit.client.0.smithi148.stdout:7/572: read d7/d75/f8e [180230,127076] 0 2024-04-26T23:09:15.785 INFO:tasks.workunit.client.0.smithi148.stdout:6/620: write d6/dc/f45 [3588955,112386] 0 2024-04-26T23:09:15.790 INFO:tasks.workunit.client.0.smithi148.stdout:4/701: dread d12/f66 [0,4194304] 0 2024-04-26T23:09:15.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/637: write d3/da/d28/f38 [2018612,82613] 0 2024-04-26T23:09:15.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/638: fsync d3/d9/d12/d23/d35/f47 0 2024-04-26T23:09:15.798 INFO:tasks.workunit.client.0.smithi148.stdout:1/596: mknod d16/d1c/d84/cc3 0 2024-04-26T23:09:15.803 INFO:tasks.workunit.client.0.smithi148.stdout:7/573: link d7/d11/d29/d2e/d41/d67/d94/f9f d7/d11/d29/d2e/d41/d67/fb9 0 2024-04-26T23:09:15.807 INFO:tasks.workunit.client.0.smithi148.stdout:4/702: creat d12/fdb x:0 0 0 2024-04-26T23:09:15.810 INFO:tasks.workunit.client.0.smithi148.stdout:8/639: symlink d3/da/d1c/d7c/d8c/lc3 0 2024-04-26T23:09:15.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/597: symlink d16/d17/d4b/d55/d90/lc4 0 2024-04-26T23:09:15.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/598: chown d16/d1c/d84/da7 1725 1 2024-04-26T23:09:15.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/599: read - d16/d45/d2b/d3e/d5a/f98 zero size 2024-04-26T23:09:15.819 INFO:tasks.workunit.client.0.smithi148.stdout:0/699: write d0/d8/d5f/f79 [2040658,62802] 0 2024-04-26T23:09:15.820 INFO:tasks.workunit.client.0.smithi148.stdout:5/680: dwrite da/d12/f35 [0,4194304] 0 2024-04-26T23:09:15.821 INFO:tasks.workunit.client.0.smithi148.stdout:6/621: dwrite d6/d9/d23/d4a/f67 [0,4194304] 0 2024-04-26T23:09:15.826 INFO:tasks.workunit.client.0.smithi148.stdout:4/703: mknod d12/d1c/d56/d87/d9c/da1/dc3/dd0/cdc 0 2024-04-26T23:09:15.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/640: dread d3/da/d1c/d7c/d8c/d9f/f17 [0,4194304] 0 2024-04-26T23:09:15.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/641: dread - d3/d9/d12/fc1 zero size 2024-04-26T23:09:15.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/642: write d3/d9/d12/d23/d35/f90 [309641,72870] 0 2024-04-26T23:09:15.826 INFO:tasks.workunit.client.0.smithi148.stdout:8/643: chown d3/d9/d12/d23/d65 5 1 2024-04-26T23:09:15.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/700: creat d0/ff6 x:0 0 0 2024-04-26T23:09:15.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/701: fdatasync d0/d8/d33/f45 0 2024-04-26T23:09:15.828 INFO:tasks.workunit.client.0.smithi148.stdout:5/681: symlink da/d1b/d8b/dc7/lf9 0 2024-04-26T23:09:15.833 INFO:tasks.workunit.client.0.smithi148.stdout:6/622: symlink d6/d9/d1e/d69/lc8 0 2024-04-26T23:09:15.833 INFO:tasks.workunit.client.0.smithi148.stdout:6/623: fdatasync d6/d9/d1c/d1d/d1f/fa2 0 2024-04-26T23:09:15.834 INFO:tasks.workunit.client.0.smithi148.stdout:4/704: getdents d12/d1c/d56/d87/d9a/d9d 0 2024-04-26T23:09:15.834 INFO:tasks.workunit.client.0.smithi148.stdout:4/705: read d12/d1c/d45/d8c/f3c [4072622,109851] 0 2024-04-26T23:09:15.835 INFO:tasks.workunit.client.0.smithi148.stdout:8/644: mkdir d3/d9/d12/d23/dc4 0 2024-04-26T23:09:15.837 INFO:tasks.workunit.client.0.smithi148.stdout:5/682: creat da/d1b/d3b/d73/ddd/de5/ffa x:0 0 0 2024-04-26T23:09:15.839 INFO:tasks.workunit.client.0.smithi148.stdout:6/624: mkdir d6/d9/d1c/d1d/d68/dc9 0 2024-04-26T23:09:15.839 INFO:tasks.workunit.client.0.smithi148.stdout:6/625: chown d6/d9/d1c/d1d/d1f/d40/c99 27662 1 2024-04-26T23:09:15.845 INFO:tasks.workunit.client.0.smithi148.stdout:3/598: dwrite d9/f86 [0,4194304] 0 2024-04-26T23:09:15.846 INFO:tasks.workunit.client.0.smithi148.stdout:4/706: rename d12/d1c/d56/d87/d9a/f60 to d12/d1c/dc8/fdd 0 2024-04-26T23:09:15.847 INFO:tasks.workunit.client.0.smithi148.stdout:8/645: creat d3/d9/d12/d23/d65/fc5 x:0 0 0 2024-04-26T23:09:15.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/574: dwrite d7/d11/d29/d2e/d41/f48 [0,4194304] 0 2024-04-26T23:09:15.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/575: fsync d7/d75/f85 0 2024-04-26T23:09:15.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/576: readlink d7/d11/d29/d2e/l9d 0 2024-04-26T23:09:15.873 INFO:tasks.workunit.client.0.smithi148.stdout:3/599: link d9/f43 d9/d15/db1/fbf 0 2024-04-26T23:09:15.874 INFO:tasks.workunit.client.0.smithi148.stdout:7/577: symlink d7/d11/d17/d43/lba 0 2024-04-26T23:09:15.875 INFO:tasks.workunit.client.0.smithi148.stdout:3/600: read d9/d52/f81 [696343,59764] 0 2024-04-26T23:09:15.875 INFO:tasks.workunit.client.0.smithi148.stdout:3/601: rename d9/d15 to d9/d15/d29/d88/d9f/dc0 22 2024-04-26T23:09:15.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/578: creat d7/d75/fbb x:0 0 0 2024-04-26T23:09:15.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/579: write d7/d11/d29/d2e/f64 [706731,121725] 0 2024-04-26T23:09:15.876 INFO:tasks.workunit.client.0.smithi148.stdout:3/602: rmdir d9/d15/d29/d4d/d68/d9c 0 2024-04-26T23:09:15.877 INFO:tasks.workunit.client.0.smithi148.stdout:7/580: symlink d7/d19/lbc 0 2024-04-26T23:09:15.880 INFO:tasks.workunit.client.0.smithi148.stdout:3/603: symlink d9/d15/d29/d4d/d5b/lc1 0 2024-04-26T23:09:15.880 INFO:tasks.workunit.client.0.smithi148.stdout:7/581: creat d7/d11/d17/d2f/d44/d9b/fbd x:0 0 0 2024-04-26T23:09:15.881 INFO:tasks.workunit.client.0.smithi148.stdout:3/604: mkdir d9/d15/d29/d4d/d78/dc2 0 2024-04-26T23:09:15.881 INFO:tasks.workunit.client.0.smithi148.stdout:3/605: write d9/f11 [4408910,92086] 0 2024-04-26T23:09:15.881 INFO:tasks.workunit.client.0.smithi148.stdout:3/606: dread - d9/d15/d29/d4d/d68/d8c/fba zero size 2024-04-26T23:09:15.882 INFO:tasks.workunit.client.0.smithi148.stdout:7/582: dread d7/d11/d29/d2e/fa7 [0,4194304] 0 2024-04-26T23:09:15.886 INFO:tasks.workunit.client.0.smithi148.stdout:5/683: write da/f19 [619430,85936] 0 2024-04-26T23:09:15.887 INFO:tasks.workunit.client.0.smithi148.stdout:7/583: dread d7/d11/f18 [0,4194304] 0 2024-04-26T23:09:15.887 INFO:tasks.workunit.client.0.smithi148.stdout:7/584: write d7/d11/d17/d9e/fa8 [875851,75966] 0 2024-04-26T23:09:15.888 INFO:tasks.workunit.client.0.smithi148.stdout:5/684: link da/d1b/d3b/d73/fcf da/d1f/d67/ffb 0 2024-04-26T23:09:15.888 INFO:tasks.workunit.client.0.smithi148.stdout:5/685: fdatasync da/d1b/d2d/da8/fbb 0 2024-04-26T23:09:15.888 INFO:tasks.workunit.client.0.smithi148.stdout:5/686: chown da/d68/d7a/f8c 271875 1 2024-04-26T23:09:15.892 INFO:tasks.workunit.client.0.smithi148.stdout:5/687: mkdir da/d1b/d8b/dfc 0 2024-04-26T23:09:15.893 INFO:tasks.workunit.client.0.smithi148.stdout:5/688: write da/d68/d69/dc9/df6/ff8 [962052,101611] 0 2024-04-26T23:09:15.893 INFO:tasks.workunit.client.0.smithi148.stdout:5/689: creat da/d12/d78/ffd x:0 0 0 2024-04-26T23:09:15.897 INFO:tasks.workunit.client.0.smithi148.stdout:4/707: dwrite d12/d1c/d56/fd9 [0,4194304] 0 2024-04-26T23:09:15.901 INFO:tasks.workunit.client.0.smithi148.stdout:4/708: creat d12/d1c/d56/d87/d9c/fde x:0 0 0 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f1979400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:09:15.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:15.902+0000 7f197a800640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:09:15.918 INFO:tasks.workunit.client.0.smithi148.stdout:8/646: dwrite d3/d9a/f9d [0,4194304] 0 2024-04-26T23:09:15.918 INFO:tasks.workunit.client.0.smithi148.stdout:8/647: dread - d3/d9/d12/d23/d65/fc5 zero size 2024-04-26T23:09:15.920 INFO:tasks.workunit.client.0.smithi148.stdout:8/648: symlink d3/d9/d12/d23/d29/db2/lc6 0 2024-04-26T23:09:15.928 INFO:tasks.workunit.client.0.smithi148.stdout:0/702: write d0/d8/d5f/fae [3226831,63897] 0 2024-04-26T23:09:15.930 INFO:tasks.workunit.client.0.smithi148.stdout:1/600: dwrite d16/d17/d4b/d55/fa9 [0,4194304] 0 2024-04-26T23:09:15.932 INFO:tasks.workunit.client.0.smithi148.stdout:0/703: truncate d0/d2e/d8f/dd8/f22 2369920 0 2024-04-26T23:09:15.932 INFO:tasks.workunit.client.0.smithi148.stdout:0/704: chown d0/d2e/f50 9516 1 2024-04-26T23:09:15.934 INFO:tasks.workunit.client.0.smithi148.stdout:1/601: mknod d16/d17/d4b/d53/d67/cc5 0 2024-04-26T23:09:15.934 INFO:tasks.workunit.client.0.smithi148.stdout:1/602: chown d16/d17/d77/l8f 1086843 1 2024-04-26T23:09:15.938 INFO:tasks.workunit.client.0.smithi148.stdout:1/603: creat d16/d1c/fc6 x:0 0 0 2024-04-26T23:09:15.938 INFO:tasks.workunit.client.0.smithi148.stdout:1/604: stat d16/d85/cbb 0 2024-04-26T23:09:15.944 INFO:tasks.workunit.client.0.smithi148.stdout:3/607: dwrite d9/d31/d8f/fa2 [0,4194304] 0 2024-04-26T23:09:15.944 INFO:tasks.workunit.client.0.smithi148.stdout:3/608: dread - d9/d15/f92 zero size 2024-04-26T23:09:15.944 INFO:tasks.workunit.client.0.smithi148.stdout:3/609: truncate d9/d31/d8f/fab 101562 0 2024-04-26T23:09:15.950 INFO:tasks.workunit.client.0.smithi148.stdout:4/709: dwrite d12/d1c/d56/fc7 [0,4194304] 0 2024-04-26T23:09:15.950 INFO:tasks.workunit.client.0.smithi148.stdout:4/710: write d12/d1c/d56/d87/d9a/d9d/fbc [598876,12875] 0 2024-04-26T23:09:15.954 INFO:tasks.workunit.client.0.smithi148.stdout:9/612: sync 2024-04-26T23:09:15.954 INFO:tasks.workunit.client.0.smithi148.stdout:2/693: sync 2024-04-26T23:09:15.955 INFO:tasks.workunit.client.0.smithi148.stdout:3/610: rmdir d9/d65/d80/d83 39 2024-04-26T23:09:15.958 INFO:tasks.workunit.client.0.smithi148.stdout:4/711: creat d12/d17/fdf x:0 0 0 2024-04-26T23:09:15.960 INFO:tasks.workunit.client.0.smithi148.stdout:9/613: truncate d19/f7d 2578923 0 2024-04-26T23:09:15.961 INFO:tasks.workunit.client.0.smithi148.stdout:2/694: rmdir d5/d8/d15/d43 39 2024-04-26T23:09:15.962 INFO:tasks.workunit.client.0.smithi148.stdout:3/611: mkdir d9/d31/dc3 0 2024-04-26T23:09:15.962 INFO:tasks.workunit.client.0.smithi148.stdout:3/612: dread - d9/d4c/f66 zero size 2024-04-26T23:09:15.966 INFO:tasks.workunit.client.0.smithi148.stdout:4/712: mknod d12/d17/d2a/d37/d97/dc1/ce0 0 2024-04-26T23:09:15.966 INFO:tasks.workunit.client.0.smithi148.stdout:9/614: creat d19/d1d/d25/d31/d48/d8c/fcd x:0 0 0 2024-04-26T23:09:15.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/690: write da/d1b/d1c/d54/f6b [1085927,88688] 0 2024-04-26T23:09:15.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/585: dread d7/d11/d17/d2f/d44/f7f [0,4194304] 0 2024-04-26T23:09:15.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/586: chown d7/d75/c42 28824 1 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:4/713: unlink d12/d1c/d45/f9e 0 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:9/615: mknod d19/d1d/d25/d31/d32/dc8/cce 0 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:2/695: truncate d5/d8/f54 462755 0 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/691: mknod da/d12/cfe 0 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/692: fsync da/d1b/d1c/d7f/fcb 0 2024-04-26T23:09:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/693: getdents da/d1b/d1c/df2 0 2024-04-26T23:09:15.972 INFO:tasks.workunit.client.0.smithi148.stdout:5/694: dread - da/d12/f8e zero size 2024-04-26T23:09:15.973 INFO:tasks.workunit.client.0.smithi148.stdout:7/587: rename d7/d19/f81 to d7/d11/d29/d2e/d41/d67/d94/d95/fbe 0 2024-04-26T23:09:15.974 INFO:tasks.workunit.client.0.smithi148.stdout:9/616: mknod d19/d1d/d25/d78/ccf 0 2024-04-26T23:09:15.974 INFO:tasks.workunit.client.0.smithi148.stdout:2/696: mknod d5/d8/d15/d43/dd4/ce5 0 2024-04-26T23:09:15.975 INFO:tasks.workunit.client.0.smithi148.stdout:5/695: creat da/d1b/d1c/d54/df0/fff x:0 0 0 2024-04-26T23:09:15.975 INFO:tasks.workunit.client.0.smithi148.stdout:5/696: fsync da/d1b/d2d/f60 0 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:0/705: dread d0/d5/f7 [0,4194304] 0 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:0/706: chown d0/d8/d33/d6a/d70/dd6/daf 91093 1 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:6/626: dwrite d6/d9/d1e/f79 [0,4194304] 0 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:7/588: symlink d7/d11/d29/d2e/d41/d67/d94/lbf 0 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:1/605: write d16/d17/d4b/d53/d67/fae [420750,82565] 0 2024-04-26T23:09:15.979 INFO:tasks.workunit.client.0.smithi148.stdout:9/617: getdents d19/d1d/d25/d2f/d4d/d33/d80 0 2024-04-26T23:09:15.980 INFO:tasks.workunit.client.0.smithi148.stdout:9/618: write d19/d1d/d25/d2f/f53 [4689128,93778] 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:6/627: mknod d6/d32/d8a/cca 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:1/606: symlink d16/d45/d2b/d3e/lc7 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:1/607: truncate d16/d17/d4b/d55/f9a 4533562 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:9/619: creat d19/d1d/d25/d78/db6/fd0 x:0 0 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:1/608: creat d16/d1c/d84/da7/fc8 x:0 0 0 2024-04-26T23:09:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:9/620: mkdir d19/d1d/d25/d31/d73/dd1 0 2024-04-26T23:09:15.989 INFO:tasks.workunit.client.0.smithi148.stdout:7/589: dread d7/d11/fb6 [0,4194304] 0 2024-04-26T23:09:15.992 INFO:tasks.workunit.client.0.smithi148.stdout:1/609: rmdir d16/d17/d4b/d55/d90 39 2024-04-26T23:09:15.996 INFO:tasks.workunit.client.0.smithi148.stdout:8/649: dread d3/da/d28/f38 [0,4194304] 0 2024-04-26T23:09:15.996 INFO:tasks.workunit.client.0.smithi148.stdout:8/650: read d3/da/d28/f38 [3046311,67193] 0 2024-04-26T23:09:16.001 INFO:tasks.workunit.client.0.smithi148.stdout:8/651: mknod d3/d9/d12/d23/d29/d37/d5e/cc7 0 2024-04-26T23:09:16.001 INFO:tasks.workunit.client.0.smithi148.stdout:8/652: stat d3/d9/f49 0 2024-04-26T23:09:16.012 INFO:tasks.workunit.client.0.smithi148.stdout:5/697: read da/d1f/f49 [4173409,44419] 0 2024-04-26T23:09:16.013 INFO:tasks.workunit.client.0.smithi148.stdout:5/698: getdents da/d1b/d5b/d5e 0 2024-04-26T23:09:16.013 INFO:tasks.workunit.client.0.smithi148.stdout:5/699: write da/d12/f8f [4622162,129354] 0 2024-04-26T23:09:16.013 INFO:tasks.workunit.client.0.smithi148.stdout:5/700: dread - da/d1b/d2d/d82/fc4 zero size 2024-04-26T23:09:16.013 INFO:tasks.workunit.client.0.smithi148.stdout:2/697: dread d5/d8/d9/f63 [4194304,4194304] 0 2024-04-26T23:09:16.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/707: dread d0/d2e/d8f/d6c/fa9 [0,4194304] 0 2024-04-26T23:09:16.020 INFO:tasks.workunit.client.0.smithi148.stdout:0/708: mkdir d0/d5/df7 0 2024-04-26T23:09:16.022 INFO:tasks.workunit.client.0.smithi148.stdout:0/709: mkdir d0/d8/d33/d6a/d70/dd6/d9d/df8 0 2024-04-26T23:09:16.022 INFO:tasks.workunit.client.0.smithi148.stdout:2/698: dread d5/d8/d11/f44 [0,4194304] 0 2024-04-26T23:09:16.022 INFO:tasks.workunit.client.0.smithi148.stdout:2/699: write d5/d17/d64/fe0 [736685,85150] 0 2024-04-26T23:09:16.034 INFO:tasks.workunit.client.0.smithi148.stdout:6/628: read d6/f19 [2518134,25868] 0 2024-04-26T23:09:16.034 INFO:tasks.workunit.client.0.smithi148.stdout:0/710: write d0/d8/f4f [3419109,92322] 0 2024-04-26T23:09:16.035 INFO:tasks.workunit.client.0.smithi148.stdout:0/711: write d0/d8/d33/d43/d4e/fbd [295868,118005] 0 2024-04-26T23:09:16.035 INFO:tasks.workunit.client.0.smithi148.stdout:6/629: stat d6/d14/l4f 0 2024-04-26T23:09:16.035 INFO:tasks.workunit.client.0.smithi148.stdout:6/630: write d6/d9/d1c/f96 [891898,1796] 0 2024-04-26T23:09:16.037 INFO:tasks.workunit.client.0.smithi148.stdout:0/712: symlink d0/d8/d33/d68/def/dd1/lf9 0 2024-04-26T23:09:16.038 INFO:tasks.workunit.client.0.smithi148.stdout:6/631: truncate d6/d9/d1c/d1d/d1f/f4c 6652 0 2024-04-26T23:09:16.038 INFO:tasks.workunit.client.0.smithi148.stdout:6/632: write d6/d9/d23/d4a/f92 [326509,50722] 0 2024-04-26T23:09:16.038 INFO:tasks.workunit.client.0.smithi148.stdout:6/633: readlink d6/d9/d1c/d1d/d1f/l6c 0 2024-04-26T23:09:16.038 INFO:tasks.workunit.client.0.smithi148.stdout:0/713: symlink d0/d20/d3b/lfa 0 2024-04-26T23:09:16.039 INFO:tasks.workunit.client.0.smithi148.stdout:6/634: creat d6/d32/d8a/fcb x:0 0 0 2024-04-26T23:09:16.039 INFO:tasks.workunit.client.0.smithi148.stdout:6/635: stat d6/d14/d91/d9f/f73 0 2024-04-26T23:09:16.040 INFO:tasks.workunit.client.0.smithi148.stdout:0/714: symlink d0/d5/dd4/df3/lfb 0 2024-04-26T23:09:16.040 INFO:tasks.workunit.client.0.smithi148.stdout:0/715: write d0/d8/d33/d68/def/f77 [4298420,68986] 0 2024-04-26T23:09:16.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/636: creat d6/d14/d91/fcc x:0 0 0 2024-04-26T23:09:16.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/637: dread - d6/d9/d1c/d1d/d68/fac zero size 2024-04-26T23:09:16.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/716: creat d0/d8/d33/d6a/ffc x:0 0 0 2024-04-26T23:09:16.044 INFO:tasks.workunit.client.0.smithi148.stdout:6/638: creat d6/d9/d1c/fcd x:0 0 0 2024-04-26T23:09:16.044 INFO:tasks.workunit.client.0.smithi148.stdout:6/639: chown d6/d32/d66/l6b 0 1 2024-04-26T23:09:16.046 INFO:tasks.workunit.client.0.smithi148.stdout:0/717: symlink d0/d8/d95/d9f/lfd 0 2024-04-26T23:09:16.046 INFO:tasks.workunit.client.0.smithi148.stdout:0/718: write d0/d8/d33/d6a/d70/dd6/f60 [1497567,39337] 0 2024-04-26T23:09:16.046 INFO:tasks.workunit.client.0.smithi148.stdout:0/719: chown d0/d2e/d8f/dd8/l32 99 1 2024-04-26T23:09:16.046 INFO:tasks.workunit.client.0.smithi148.stdout:6/640: symlink d6/dc/lce 0 2024-04-26T23:09:16.053 INFO:tasks.workunit.client.0.smithi148.stdout:9/621: dread d19/d1d/f8b [0,4194304] 0 2024-04-26T23:09:16.053 INFO:tasks.workunit.client.0.smithi148.stdout:9/622: fsync f13 0 2024-04-26T23:09:16.054 INFO:tasks.workunit.client.0.smithi148.stdout:9/623: fsync d19/d1d/f3a 0 2024-04-26T23:09:16.061 INFO:tasks.workunit.client.0.smithi148.stdout:4/714: write d12/d17/d2a/d37/f64 [2929020,121495] 0 2024-04-26T23:09:16.067 INFO:tasks.workunit.client.0.smithi148.stdout:9/624: symlink d19/d1d/d25/d2f/d4d/d33/d50/ld2 0 2024-04-26T23:09:16.067 INFO:tasks.workunit.client.0.smithi148.stdout:9/625: truncate d19/d1d/d69/f83 1575025 0 2024-04-26T23:09:16.085 INFO:tasks.workunit.client.0.smithi148.stdout:1/610: dwrite d16/f1d [0,4194304] 0 2024-04-26T23:09:16.096 INFO:tasks.workunit.client.0.smithi148.stdout:8/653: dwrite d3/d9/f58 [0,4194304] 0 2024-04-26T23:09:16.096 INFO:tasks.workunit.client.0.smithi148.stdout:9/626: creat d19/d1d/d25/d2f/d4d/d33/daa/fd3 x:0 0 0 2024-04-26T23:09:16.096 INFO:tasks.workunit.client.0.smithi148.stdout:1/611: creat d16/d1c/d82/db2/fc9 x:0 0 0 2024-04-26T23:09:16.096 INFO:tasks.workunit.client.0.smithi148.stdout:1/612: chown d16/d85/lb6 21908318 1 2024-04-26T23:09:16.097 INFO:tasks.workunit.client.0.smithi148.stdout:9/627: creat d19/d1d/d25/d31/d48/fd4 x:0 0 0 2024-04-26T23:09:16.097 INFO:tasks.workunit.client.0.smithi148.stdout:1/613: rmdir d16/d1c/d84/da7 39 2024-04-26T23:09:16.097 INFO:tasks.workunit.client.0.smithi148.stdout:1/614: fsync d16/d85/fb0 0 2024-04-26T23:09:16.097 INFO:tasks.workunit.client.0.smithi148.stdout:9/628: mknod d19/d1d/d25/d31/d48/cd5 0 2024-04-26T23:09:16.097 INFO:tasks.workunit.client.0.smithi148.stdout:9/629: dread - d19/d39/d5f/fb8 zero size 2024-04-26T23:09:16.103 INFO:tasks.workunit.client.0.smithi148.stdout:9/630: creat d19/d39/d5f/fd6 x:0 0 0 2024-04-26T23:09:16.103 INFO:tasks.workunit.client.0.smithi148.stdout:9/631: dread - d19/d22/f9c zero size 2024-04-26T23:09:16.105 INFO:tasks.workunit.client.0.smithi148.stdout:9/632: creat d19/d1d/d25/d2f/d4d/d33/fd7 x:0 0 0 2024-04-26T23:09:16.106 INFO:tasks.workunit.client.0.smithi148.stdout:2/700: dread d5/d17/d64/fe0 [0,4194304] 0 2024-04-26T23:09:16.107 INFO:tasks.workunit.client.0.smithi148.stdout:5/701: dwrite da/d1b/d2d/f7b [0,4194304] 0 2024-04-26T23:09:16.108 INFO:tasks.workunit.client.0.smithi148.stdout:9/633: rename d19/d1d/d69/f83 to d19/d1d/d25/d31/d48/fd8 0 2024-04-26T23:09:16.109 INFO:tasks.workunit.client.0.smithi148.stdout:4/715: dwrite d12/d1c/d56/d87/d9a/d9d/f90 [0,4194304] 0 2024-04-26T23:09:16.109 INFO:tasks.workunit.client.0.smithi148.stdout:4/716: stat d12/d1c/c1e 0 2024-04-26T23:09:16.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/702: mknod da/d68/c100 0 2024-04-26T23:09:16.114 INFO:tasks.workunit.client.0.smithi148.stdout:9/634: mkdir d19/d1d/d25/d2f/d4d/d33/d50/dd9 0 2024-04-26T23:09:16.114 INFO:tasks.workunit.client.0.smithi148.stdout:9/635: dread - d19/d1d/d25/d2f/d4d/d33/daa/fb0 zero size 2024-04-26T23:09:16.114 INFO:tasks.workunit.client.0.smithi148.stdout:5/703: unlink da/d1b/d3b/d73/d97/db0/le0 0 2024-04-26T23:09:16.114 INFO:tasks.workunit.client.0.smithi148.stdout:5/704: write da/d12/f8f [839833,109900] 0 2024-04-26T23:09:16.117 INFO:tasks.workunit.client.0.smithi148.stdout:5/705: creat da/d68/d69/daa/f101 x:0 0 0 2024-04-26T23:09:16.119 INFO:tasks.workunit.client.0.smithi148.stdout:5/706: link da/d1a/f1e da/d68/d69/daa/f102 0 2024-04-26T23:09:16.124 INFO:tasks.workunit.client.0.smithi148.stdout:5/707: creat da/d1b/d2d/d82/f103 x:0 0 0 2024-04-26T23:09:16.126 INFO:tasks.workunit.client.0.smithi148.stdout:2/701: dread d5/d17/f30 [0,4194304] 0 2024-04-26T23:09:16.128 INFO:tasks.workunit.client.0.smithi148.stdout:2/702: truncate d5/d8/f54 32650 0 2024-04-26T23:09:16.128 INFO:tasks.workunit.client.0.smithi148.stdout:8/654: dwrite d3/d9/d12/d23/d29/f4a [0,4194304] 0 2024-04-26T23:09:16.130 INFO:tasks.workunit.client.0.smithi148.stdout:6/641: dwrite d6/d9/f15 [0,4194304] 0 2024-04-26T23:09:16.130 INFO:tasks.workunit.client.0.smithi148.stdout:1/615: dread d16/d17/f1b [0,4194304] 0 2024-04-26T23:09:16.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/642: read d6/d9/f52 [514583,7796] 0 2024-04-26T23:09:16.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/643: write d6/dc/f3f [2002392,13550] 0 2024-04-26T23:09:16.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/644: dread - d6/d32/d8a/f97 zero size 2024-04-26T23:09:16.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/645: fsync d6/d9/d1c/d1d/d68/fac 0 2024-04-26T23:09:16.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/646: readlink d6/d9/d1c/d1d/d1f/l6c 0 2024-04-26T23:09:16.140 INFO:tasks.workunit.client.0.smithi148.stdout:8/655: mknod d3/d9/cc8 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/616: mknod d16/d17/d4b/d59/cca 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:2/703: dread d5/d8/f54 [0,4194304] 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:2/704: fsync d5/d8/d15/d43/d5d/fcb 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/617: write d16/d1c/faa [144458,54493] 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/618: fsync d16/d47/d49/fb8 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:1/619: write f15 [809288,42207] 0 2024-04-26T23:09:16.142 INFO:tasks.workunit.client.0.smithi148.stdout:6/647: creat d6/d9/d1e/d69/fcf x:0 0 0 2024-04-26T23:09:16.143 INFO:tasks.workunit.client.0.smithi148.stdout:8/656: symlink d3/d9/d12/d23/d35/d69/lc9 0 2024-04-26T23:09:16.144 INFO:tasks.workunit.client.0.smithi148.stdout:2/705: unlink d5/d8/d11/f61 0 2024-04-26T23:09:16.144 INFO:tasks.workunit.client.0.smithi148.stdout:2/706: chown d5/d8/d4b/d4e/d6d/lbf 6420954 1 2024-04-26T23:09:16.144 INFO:tasks.workunit.client.0.smithi148.stdout:2/707: fdatasync d5/d8/db9/fdb 0 2024-04-26T23:09:16.145 INFO:tasks.workunit.client.0.smithi148.stdout:1/620: creat d16/d45/d2b/fcb x:0 0 0 2024-04-26T23:09:16.145 INFO:tasks.workunit.client.0.smithi148.stdout:6/648: symlink d6/d9/d1c/d1d/d68/dbc/ld0 0 2024-04-26T23:09:16.146 INFO:tasks.workunit.client.0.smithi148.stdout:2/708: mknod d5/d17/d64/ce6 0 2024-04-26T23:09:16.149 INFO:tasks.workunit.client.0.smithi148.stdout:6/649: creat d6/d9/d1c/dbf/db7/fd1 x:0 0 0 2024-04-26T23:09:16.150 INFO:tasks.workunit.client.0.smithi148.stdout:7/590: write d7/d11/d29/d2e/d41/d67/d94/d95/fb5 [677484,26700] 0 2024-04-26T23:09:16.150 INFO:tasks.workunit.client.0.smithi148.stdout:7/591: write d7/d11/d29/d2e/fa7 [287073,8765] 0 2024-04-26T23:09:16.150 INFO:tasks.workunit.client.0.smithi148.stdout:7/592: truncate d7/d75/f8e 1049115 0 2024-04-26T23:09:16.154 INFO:tasks.workunit.client.0.smithi148.stdout:2/709: symlink d5/d8/d4b/d4e/le7 0 2024-04-26T23:09:16.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/593: symlink d7/d11/d29/d2e/d41/d67/d94/lc0 0 2024-04-26T23:09:16.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/594: creat d7/d11/d29/d2e/d41/d67/d94/fc1 x:0 0 0 2024-04-26T23:09:16.165 INFO:tasks.workunit.client.0.smithi148.stdout:7/595: link d7/d11/d17/d43/c51 d7/d11/d29/cc2 0 2024-04-26T23:09:16.170 INFO:tasks.workunit.client.0.smithi148.stdout:7/596: mknod d7/d11/d17/d9e/da9/cc3 0 2024-04-26T23:09:16.171 INFO:tasks.workunit.client.0.smithi148.stdout:1/621: write d16/d17/d68/f8c [2050258,46130] 0 2024-04-26T23:09:16.171 INFO:tasks.workunit.client.0.smithi148.stdout:2/710: dread d5/d10/f48 [0,4194304] 0 2024-04-26T23:09:16.173 INFO:tasks.workunit.client.0.smithi148.stdout:2/711: rmdir d5/d8/d15/d43/d5d 39 2024-04-26T23:09:16.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/597: rename d7/fe to d7/d11/d17/fc4 0 2024-04-26T23:09:16.173 INFO:tasks.workunit.client.0.smithi148.stdout:2/712: chown d5/d7f/d86/d87/f8a 3952 1 2024-04-26T23:09:16.174 INFO:tasks.workunit.client.0.smithi148.stdout:2/713: fdatasync d5/d8/d15/d43/f49 0 2024-04-26T23:09:16.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/598: mknod d7/d11/d29/d2e/d41/cc5 0 2024-04-26T23:09:16.177 INFO:tasks.workunit.client.0.smithi148.stdout:6/650: write d6/d9/f7e [1757524,102513] 0 2024-04-26T23:09:16.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/599: write d7/d75/f33 [5375306,78012] 0 2024-04-26T23:09:16.177 INFO:tasks.workunit.client.0.smithi148.stdout:6/651: write d6/d9/d23/d4a/f84 [214100,49640] 0 2024-04-26T23:09:16.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/600: chown d7/d11/d29/d2e/d41/f48 83 1 2024-04-26T23:09:16.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/652: unlink d6/ld 0 2024-04-26T23:09:16.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/653: write d6/d9/d1c/d1d/d68/fa8 [2208051,127542] 0 2024-04-26T23:09:16.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/654: readlink d6/d9/d23/d4a/l89 0 2024-04-26T23:09:16.183 INFO:tasks.workunit.client.0.smithi148.stdout:7/601: unlink d7/ca 0 2024-04-26T23:09:16.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/655: mkdir d6/d9/d1c/dbf/db7/dd2 0 2024-04-26T23:09:16.187 INFO:tasks.workunit.client.0.smithi148.stdout:7/602: mkdir d7/d11/d29/d2e/dc6 0 2024-04-26T23:09:16.187 INFO:tasks.workunit.client.0.smithi148.stdout:2/714: dread d5/d10/f48 [0,4194304] 0 2024-04-26T23:09:16.187 INFO:tasks.workunit.client.0.smithi148.stdout:2/715: write d5/d8/d11/f6a [1195297,76592] 0 2024-04-26T23:09:16.188 INFO:tasks.workunit.client.0.smithi148.stdout:7/603: creat d7/d11/d17/d2f/fc7 x:0 0 0 2024-04-26T23:09:16.189 INFO:tasks.workunit.client.0.smithi148.stdout:1/622: read d16/d45/f2f [2204144,71219] 0 2024-04-26T23:09:16.189 INFO:tasks.workunit.client.0.smithi148.stdout:2/716: rename d5/d8/d9/f28 to d5/d8/d9/d3d/fe8 0 2024-04-26T23:09:16.189 INFO:tasks.workunit.client.0.smithi148.stdout:2/717: write d5/d8/d15/d7d/f84 [615720,32388] 0 2024-04-26T23:09:16.225 INFO:tasks.workunit.client.0.smithi148.stdout:4/717: dwrite d12/f66 [0,4194304] 0 2024-04-26T23:09:16.243 INFO:tasks.workunit.client.0.smithi148.stdout:4/718: write d12/f72 [3520641,95604] 0 2024-04-26T23:09:16.261 INFO:tasks.workunit.client.0.smithi148.stdout:2/718: dwrite d5/f2d [0,4194304] 0 2024-04-26T23:09:16.275 INFO:tasks.workunit.client.0.smithi148.stdout:7/604: dwrite d7/d75/f8e [0,4194304] 0 2024-04-26T23:09:16.277 INFO:tasks.workunit.client.0.smithi148.stdout:2/719: write d5/d8/d11/f44 [3402689,66413] 0 2024-04-26T23:09:16.286 INFO:tasks.workunit.client.0.smithi148.stdout:9/636: dwrite d19/d1d/d25/d31/d48/fd8 [0,4194304] 0 2024-04-26T23:09:16.286 INFO:tasks.workunit.client.0.smithi148.stdout:9/637: write d19/f1e [89255,2351] 0 2024-04-26T23:09:16.290 INFO:tasks.workunit.client.0.smithi148.stdout:1/623: dwrite d16/d17/d4b/d53/d67/fae [0,4194304] 0 2024-04-26T23:09:16.290 INFO:tasks.workunit.client.0.smithi148.stdout:1/624: dread - d16/d17/d4b/d4d/fad zero size 2024-04-26T23:09:16.368 INFO:tasks.workunit.client.0.smithi148.stdout:5/708: dwrite da/d1b/d1c/d54/fa2 [0,4194304] 0 2024-04-26T23:09:16.368 INFO:tasks.workunit.client.0.smithi148.stdout:6/656: dwrite d6/d9/d1e/f79 [0,4194304] 0 2024-04-26T23:09:16.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/657: write d6/d9/d1e/f82 [463291,47068] 0 2024-04-26T23:09:16.370 INFO:tasks.workunit.client.0.smithi148.stdout:6/658: chown d6/d32/f8b 257131213 1 2024-04-26T23:09:16.382 INFO:tasks.workunit.client.0.smithi148.stdout:7/605: dwrite d7/d11/d29/d2e/d41/d67/fb9 [0,4194304] 0 2024-04-26T23:09:16.383 INFO:tasks.workunit.client.0.smithi148.stdout:9/638: dwrite d19/d39/d5f/fd6 [0,4194304] 0 2024-04-26T23:09:16.383 INFO:tasks.workunit.client.0.smithi148.stdout:9/639: readlink d19/d1d/d25/d2f/d4d/d33/d50/la5 0 2024-04-26T23:09:16.398 INFO:tasks.workunit.client.0.smithi148.stdout:7/606: dread d7/d75/f91 [0,4194304] 0 2024-04-26T23:09:16.398 INFO:tasks.workunit.client.0.smithi148.stdout:7/607: truncate d7/d11/d17/d2f/d44/d9b/fbd 58446 0 2024-04-26T23:09:16.398 INFO:tasks.workunit.client.0.smithi148.stdout:1/625: dwrite d16/d45/f2f [0,4194304] 0 2024-04-26T23:09:16.414 INFO:tasks.workunit.client.0.smithi148.stdout:7/608: write d7/f90 [3347048,96962] 0 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 msgr2=0x7f197c1589e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f197c0708f0 0x7f197c1589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 msgr2=0x7f197c06fb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f197c072a40 0x7f197c06fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.148:6789/0 conn(0x7f197c152120 legacy=0x7f197c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c0c7c20 con 0x7f1958006180 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0c8f40 con 0x7f19580036b0 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f1958006180 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:17.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 msgr2=0x7f1958005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:17.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.490+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:17.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.694+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f1958006180 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:17.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.694+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 msgr2=0x7f1958005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:17.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:17.694+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:09:18.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.098+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f1958006180 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:18.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.098+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 msgr2=0x7f1958005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:18.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.098+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:09:18.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.902+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 msgr2=0x7f1958005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:18.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.902+0000 7f1979400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f1958006180 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:18.902+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:09:19.983 INFO:tasks.workunit.client.0.smithi148.stdout:4/719: mknod d12/d1c/d56/d87/ce1 0 2024-04-26T23:09:19.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/720: rmdir d5/d1c/d38 39 2024-04-26T23:09:20.008 INFO:tasks.workunit.client.0.smithi148.stdout:5/709: unlink da/d1b/d3b/fef 0 2024-04-26T23:09:20.008 INFO:tasks.workunit.client.0.smithi148.stdout:5/710: readlink da/d1b/d3b/l84 0 2024-04-26T23:09:20.010 INFO:tasks.workunit.client.0.smithi148.stdout:6/659: mkdir d6/d32/dd3 0 2024-04-26T23:09:20.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/640: rename d19/c3f to d19/d1d/d25/d2f/d4d/d33/cda 0 2024-04-26T23:09:20.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/641: read d19/f9a [3178936,33998] 0 2024-04-26T23:09:20.034 INFO:tasks.workunit.client.0.smithi148.stdout:1/626: creat d16/d17/d4b/d53/d67/fcc x:0 0 0 2024-04-26T23:09:20.036 INFO:tasks.workunit.client.0.smithi148.stdout:7/609: mkdir d7/d75/dc8 0 2024-04-26T23:09:20.040 INFO:tasks.workunit.client.0.smithi148.stdout:1/627: dread d16/d17/d4b/f72 [0,4194304] 0 2024-04-26T23:09:20.041 INFO:tasks.workunit.client.0.smithi148.stdout:4/720: symlink d12/d17/d2a/le2 0 2024-04-26T23:09:20.045 INFO:tasks.workunit.client.0.smithi148.stdout:2/721: creat d5/d8/d9/d3d/fe9 x:0 0 0 2024-04-26T23:09:20.050 INFO:tasks.workunit.client.0.smithi148.stdout:9/642: creat d19/d1d/d25/d78/fdb x:0 0 0 2024-04-26T23:09:20.050 INFO:tasks.workunit.client.0.smithi148.stdout:9/643: fdatasync d19/d1d/d25/d2f/d4d/d33/daa/fb0 0 2024-04-26T23:09:20.052 INFO:tasks.workunit.client.0.smithi148.stdout:7/610: mknod d7/d11/cc9 0 2024-04-26T23:09:20.053 INFO:tasks.workunit.client.0.smithi148.stdout:7/611: fdatasync d7/d11/d17/d9e/fa8 0 2024-04-26T23:09:20.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/628: creat d16/d17/d77/fcd x:0 0 0 2024-04-26T23:09:20.061 INFO:tasks.workunit.client.0.smithi148.stdout:7/612: symlink d7/d11/d60/d68/lca 0 2024-04-26T23:09:20.064 INFO:tasks.workunit.client.0.smithi148.stdout:1/629: link d16/d17/d4b/d53/d67/cc5 d16/d47/d49/cce 0 2024-04-26T23:09:20.068 INFO:tasks.workunit.client.0.smithi148.stdout:1/630: link d16/d1c/d84/da7/lbe d16/d17/d68/d6b/lcf 0 2024-04-26T23:09:20.071 INFO:tasks.workunit.client.0.smithi148.stdout:2/722: write d5/d8/d15/d43/f49 [768712,50985] 0 2024-04-26T23:09:20.071 INFO:tasks.workunit.client.0.smithi148.stdout:4/721: dwrite d12/d1c/d45/fd6 [0,4194304] 0 2024-04-26T23:09:20.072 INFO:tasks.workunit.client.0.smithi148.stdout:9/644: dread d19/d1d/d25/d2f/d4d/f43 [0,4194304] 0 2024-04-26T23:09:20.073 INFO:tasks.workunit.client.0.smithi148.stdout:1/631: creat d16/d17/d68/fd0 x:0 0 0 2024-04-26T23:09:20.077 INFO:tasks.workunit.client.0.smithi148.stdout:2/723: unlink d5/d8/d4b/d4e/d6d/da0/fde 0 2024-04-26T23:09:20.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/613: dread d7/d11/d17/d2f/f5b [0,4194304] 0 2024-04-26T23:09:20.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/722: creat d12/d1c/d45/d75/fe3 x:0 0 0 2024-04-26T23:09:20.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/723: chown d12/d17/d2a/c9f 107905 1 2024-04-26T23:09:20.096 INFO:tasks.workunit.client.0.smithi148.stdout:7/614: dread d7/f12 [0,4194304] 0 2024-04-26T23:09:20.097 INFO:tasks.workunit.client.0.smithi148.stdout:7/615: truncate d7/d11/d17/d2f/fc7 876967 0 2024-04-26T23:09:20.104 INFO:tasks.workunit.client.0.smithi148.stdout:7/616: mknod d7/d11/d17/ccb 0 2024-04-26T23:09:20.109 INFO:tasks.workunit.client.0.smithi148.stdout:9/645: dwrite d19/d22/f9c [0,4194304] 0 2024-04-26T23:09:20.120 INFO:tasks.workunit.client.0.smithi148.stdout:2/724: dread d5/d8/d9/d3d/fe8 [0,4194304] 0 2024-04-26T23:09:20.120 INFO:tasks.workunit.client.0.smithi148.stdout:1/632: dwrite d16/d17/d4b/d4d/f70 [0,4194304] 0 2024-04-26T23:09:20.120 INFO:tasks.workunit.client.0.smithi148.stdout:1/633: chown d16/d17/d4b/d53/lac 409227 1 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:3/613: sync 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:0/720: sync 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:6/660: truncate d6/d9/d1c/d1d/d68/fa8 884632 0 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:3/614: read - d9/d15/d29/d4d/d68/d8c/fa5 zero size 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:0/721: read - d0/d2e/d8f/d6c/dab/fa7 zero size 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:0/722: dread - d0/d5/ff2 zero size 2024-04-26T23:09:20.127 INFO:tasks.workunit.client.0.smithi148.stdout:8/657: sync 2024-04-26T23:09:20.128 INFO:tasks.workunit.client.0.smithi148.stdout:0/723: chown d0/d2e/d8f/d6c/dab/fe1 1910628806 1 2024-04-26T23:09:20.128 INFO:tasks.workunit.client.0.smithi148.stdout:6/661: write d6/d9/fc3 [249876,93217] 0 2024-04-26T23:09:20.131 INFO:tasks.workunit.client.0.smithi148.stdout:2/725: truncate d5/d8/d9/f69 346999 0 2024-04-26T23:09:20.131 INFO:tasks.workunit.client.0.smithi148.stdout:2/726: chown d5/d8/d15/d43/f5f 650662639 1 2024-04-26T23:09:20.134 INFO:tasks.workunit.client.0.smithi148.stdout:1/634: rename d16/d1c/d82/db2 to d16/d17/d4b/dd1 0 2024-04-26T23:09:20.137 INFO:tasks.workunit.client.0.smithi148.stdout:3/615: unlink d9/la4 0 2024-04-26T23:09:20.142 INFO:tasks.workunit.client.0.smithi148.stdout:0/724: creat d0/d8/d33/d6a/d70/dd6/d9d/df8/ffe x:0 0 0 2024-04-26T23:09:20.146 INFO:tasks.workunit.client.0.smithi148.stdout:6/662: creat d6/d32/fd4 x:0 0 0 2024-04-26T23:09:20.150 INFO:tasks.workunit.client.0.smithi148.stdout:2/727: getdents d5/d8/d15/d43/d8d 0 2024-04-26T23:09:20.150 INFO:tasks.workunit.client.0.smithi148.stdout:2/728: write d5/d8/d4b/f77 [1514651,49036] 0 2024-04-26T23:09:20.151 INFO:tasks.workunit.client.0.smithi148.stdout:7/617: dwrite d7/d11/d29/d2e/d41/d67/d94/d95/fb5 [0,4194304] 0 2024-04-26T23:09:20.151 INFO:tasks.workunit.client.0.smithi148.stdout:7/618: fsync d7/d11/d29/d2e/f72 0 2024-04-26T23:09:20.152 INFO:tasks.workunit.client.0.smithi148.stdout:1/635: mkdir d16/d47/dd2 0 2024-04-26T23:09:20.152 INFO:tasks.workunit.client.0.smithi148.stdout:1/636: write d16/d17/f28 [3692936,51265] 0 2024-04-26T23:09:20.156 INFO:tasks.workunit.client.0.smithi148.stdout:8/658: rename d3/d9/l7e to d3/da/d1c/d7c/d8c/d9f/lca 0 2024-04-26T23:09:20.156 INFO:tasks.workunit.client.0.smithi148.stdout:8/659: read d3/f44 [2049477,28100] 0 2024-04-26T23:09:20.158 INFO:tasks.workunit.client.0.smithi148.stdout:3/616: creat d9/d15/d29/d88/fc4 x:0 0 0 2024-04-26T23:09:20.159 INFO:tasks.workunit.client.0.smithi148.stdout:0/725: getdents d0/d20/d3b 0 2024-04-26T23:09:20.161 INFO:tasks.workunit.client.0.smithi148.stdout:6/663: creat d6/d9/d23/fd5 x:0 0 0 2024-04-26T23:09:20.162 INFO:tasks.workunit.client.0.smithi148.stdout:9/646: dwrite d19/d1d/d25/d2f/d4d/d33/fb3 [4194304,4194304] 0 2024-04-26T23:09:20.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/660: rename d3/d9/d12/l4d to d3/d9/d12/d23/d29/d37/db5/lcb 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:0/726: creat d0/d8/d33/d43/fff x:0 0 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/661: creat d3/d9/d12/d95/fcc x:0 0 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:7/619: dread d7/d19/f35 [0,4194304] 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:7/620: chown d7/d11/d29/d2e/f64 3 1 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/662: write d3/da/d1c/d7c/d8c/f92 [240644,92857] 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/663: write d3/f44 [9363954,72252] 0 2024-04-26T23:09:20.171 INFO:tasks.workunit.client.0.smithi148.stdout:0/727: unlink d0/d20/d3b/c61 0 2024-04-26T23:09:20.172 INFO:tasks.workunit.client.0.smithi148.stdout:7/621: getdents d7/d11/d60 0 2024-04-26T23:09:20.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/622: dread - d7/d11/d17/f86 zero size 2024-04-26T23:09:20.173 INFO:tasks.workunit.client.0.smithi148.stdout:6/664: getdents d6/d9/d1c/d5b 0 2024-04-26T23:09:20.173 INFO:tasks.workunit.client.0.smithi148.stdout:8/664: mkdir d3/d9a/dcd 0 2024-04-26T23:09:20.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/623: mknod d7/d11/d17/d7c/ccc 0 2024-04-26T23:09:20.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/624: fdatasync d7/d11/d29/d2e/f26 0 2024-04-26T23:09:20.179 INFO:tasks.workunit.client.0.smithi148.stdout:7/625: unlink d7/d11/d29/d2e/d41/d67/f6b 0 2024-04-26T23:09:20.187 INFO:tasks.workunit.client.0.smithi148.stdout:7/626: mknod d7/d11/d29/ccd 0 2024-04-26T23:09:20.188 INFO:tasks.workunit.client.0.smithi148.stdout:7/627: creat d7/d19/fce x:0 0 0 2024-04-26T23:09:20.194 INFO:tasks.workunit.client.0.smithi148.stdout:2/729: dwrite d5/d97/fd6 [0,4194304] 0 2024-04-26T23:09:20.196 INFO:tasks.workunit.client.0.smithi148.stdout:1/637: dread d16/d1c/faa [0,4194304] 0 2024-04-26T23:09:20.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/617: dwrite d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:20.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/618: stat d9/c50 0 2024-04-26T23:09:20.196 INFO:tasks.workunit.client.0.smithi148.stdout:2/730: mknod d5/d7f/d86/cea 0 2024-04-26T23:09:20.197 INFO:tasks.workunit.client.0.smithi148.stdout:0/728: write d0/d8/d95/d97/d3a/fa2 [2888508,125899] 0 2024-04-26T23:09:20.198 INFO:tasks.workunit.client.0.smithi148.stdout:0/729: creat d0/d5/d84/f100 x:0 0 0 2024-04-26T23:09:20.199 INFO:tasks.workunit.client.0.smithi148.stdout:2/731: rename d5/d8/d4b/d4e/d6d/da0/l40 to d5/d8/d4b/d4e/d6d/da0/d32/leb 0 2024-04-26T23:09:20.200 INFO:tasks.workunit.client.0.smithi148.stdout:2/732: write d5/d10/f58 [2363727,1139] 0 2024-04-26T23:09:20.200 INFO:tasks.workunit.client.0.smithi148.stdout:0/730: symlink d0/d8/d33/d6a/l101 0 2024-04-26T23:09:20.200 INFO:tasks.workunit.client.0.smithi148.stdout:2/733: readlink d5/d8/d6c/d8f/lb7 0 2024-04-26T23:09:20.200 INFO:tasks.workunit.client.0.smithi148.stdout:0/731: mkdir d0/d5/df7/d102 0 2024-04-26T23:09:20.202 INFO:tasks.workunit.client.0.smithi148.stdout:0/732: rename d0/d8/d52/l2f to d0/d2e/d8f/d6c/l103 0 2024-04-26T23:09:20.208 INFO:tasks.workunit.client.0.smithi148.stdout:1/638: dread d16/f37 [0,4194304] 0 2024-04-26T23:09:20.208 INFO:tasks.workunit.client.0.smithi148.stdout:1/639: chown d16/d17/d4b/d4d 62 1 2024-04-26T23:09:20.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/640: symlink d16/d17/d4b/dd1/ld3 0 2024-04-26T23:09:20.214 INFO:tasks.workunit.client.0.smithi148.stdout:1/641: mknod d16/d17/d4b/d55/cd4 0 2024-04-26T23:09:20.216 INFO:tasks.workunit.client.0.smithi148.stdout:1/642: rename d16/d1c/d84/f88 to d16/d17/d68/d6b/d8b/fd5 0 2024-04-26T23:09:20.223 INFO:tasks.workunit.client.0.smithi148.stdout:2/734: dread d5/d8/d15/f96 [0,4194304] 0 2024-04-26T23:09:20.226 INFO:tasks.workunit.client.0.smithi148.stdout:3/619: write d9/d15/d29/d4d/d7d/f7e [713249,2949] 0 2024-04-26T23:09:20.231 INFO:tasks.workunit.client.0.smithi148.stdout:1/643: dread d16/f4a [0,4194304] 0 2024-04-26T23:09:20.231 INFO:tasks.workunit.client.0.smithi148.stdout:1/644: truncate d16/d17/f25 4459264 0 2024-04-26T23:09:20.236 INFO:tasks.workunit.client.0.smithi148.stdout:1/645: mknod d16/d1c/d84/cd6 0 2024-04-26T23:09:20.237 INFO:tasks.workunit.client.0.smithi148.stdout:1/646: stat d16/d45/d2b/d3e/d5a/f98 0 2024-04-26T23:09:20.240 INFO:tasks.workunit.client.0.smithi148.stdout:8/665: dwrite d3/da/f64 [0,4194304] 0 2024-04-26T23:09:20.240 INFO:tasks.workunit.client.0.smithi148.stdout:8/666: chown d3/da/f18 13422 1 2024-04-26T23:09:20.243 INFO:tasks.workunit.client.0.smithi148.stdout:8/667: symlink d3/d9/d12/d23/d35/dad/dbb/lce 0 2024-04-26T23:09:20.243 INFO:tasks.workunit.client.0.smithi148.stdout:8/668: dread - d3/d9/d12/d23/d29/fbc zero size 2024-04-26T23:09:20.243 INFO:tasks.workunit.client.0.smithi148.stdout:8/669: chown d3/d9/l53 17 1 2024-04-26T23:09:20.246 INFO:tasks.workunit.client.0.smithi148.stdout:8/670: rmdir d3/da 39 2024-04-26T23:09:20.250 INFO:tasks.workunit.client.0.smithi148.stdout:8/671: mkdir d3/da/d1c/d7c/d8c/d9f/dcf 0 2024-04-26T23:09:20.250 INFO:tasks.workunit.client.0.smithi148.stdout:8/672: stat d3/da/d1c/lb0 0 2024-04-26T23:09:20.250 INFO:tasks.workunit.client.0.smithi148.stdout:0/733: dwrite d0/f2 [0,4194304] 0 2024-04-26T23:09:20.252 INFO:tasks.workunit.client.0.smithi148.stdout:8/673: dread d3/d9/d12/d23/d35/d69/f6e [0,4194304] 0 2024-04-26T23:09:20.253 INFO:tasks.workunit.client.0.smithi148.stdout:8/674: fsync d3/d9/d12/d23/d29/d37/f63 0 2024-04-26T23:09:20.254 INFO:tasks.workunit.client.0.smithi148.stdout:8/675: write d3/d9/d12/d23/d29/d77/d91/fba [114235,104181] 0 2024-04-26T23:09:20.256 INFO:tasks.workunit.client.0.smithi148.stdout:8/676: mknod d3/da/d1c/d7c/d8c/cd0 0 2024-04-26T23:09:20.268 INFO:tasks.workunit.client.0.smithi148.stdout:6/665: dwrite d6/d9/d1c/f5d [0,4194304] 0 2024-04-26T23:09:20.270 INFO:tasks.workunit.client.0.smithi148.stdout:1/647: read d16/d1c/f26 [3479842,23698] 0 2024-04-26T23:09:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:7/628: read d7/d11/d29/d2e/f64 [1745033,69857] 0 2024-04-26T23:09:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:9/647: dwrite d19/d1d/d25/d31/d73/f7e [0,4194304] 0 2024-04-26T23:09:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:7/629: readlink d7/d11/d29/d2e/d41/l8c 0 2024-04-26T23:09:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:9/648: chown d19/d1d/d25/d31/d32/dc8/cce 13 1 2024-04-26T23:09:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:7/630: stat d7/d19/f2d 0 2024-04-26T23:09:20.287 INFO:tasks.workunit.client.0.smithi148.stdout:6/666: write d6/d32/d98/fb0 [2238650,108240] 0 2024-04-26T23:09:20.288 INFO:tasks.workunit.client.0.smithi148.stdout:1/648: write d16/d1c/f3c [2376580,9746] 0 2024-04-26T23:09:20.311 INFO:tasks.workunit.client.0.smithi148.stdout:7/631: rename d7/d75/dc8 to d7/d11/d29/d2e/d41/d67/dcf 0 2024-04-26T23:09:20.311 INFO:tasks.workunit.client.0.smithi148.stdout:6/667: rmdir d6 39 2024-04-26T23:09:20.319 INFO:tasks.workunit.client.0.smithi148.stdout:2/735: dwrite d5/d7f/fd2 [0,4194304] 0 2024-04-26T23:09:20.319 INFO:tasks.workunit.client.0.smithi148.stdout:2/736: chown d5/d10/f14 76713 1 2024-04-26T23:09:20.329 INFO:tasks.workunit.client.0.smithi148.stdout:2/737: creat d5/d1c/d38/fec x:0 0 0 2024-04-26T23:09:20.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/632: mknod d7/cd0 0 2024-04-26T23:09:20.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/738: mknod d5/d1c/ced 0 2024-04-26T23:09:20.333 INFO:tasks.workunit.client.0.smithi148.stdout:7/633: creat d7/d75/dad/fd1 x:0 0 0 2024-04-26T23:09:20.335 INFO:tasks.workunit.client.0.smithi148.stdout:2/739: link d5/d8/d11/caf d5/d8/d4b/d4e/d6d/dbe/cee 0 2024-04-26T23:09:20.335 INFO:tasks.workunit.client.0.smithi148.stdout:2/740: truncate d5/d8/d9/d3d/fe9 669604 0 2024-04-26T23:09:20.337 INFO:tasks.workunit.client.0.smithi148.stdout:7/634: rename d7/d11/d60/d68/la3 to d7/d11/d17/d2f/d44/ld2 0 2024-04-26T23:09:20.338 INFO:tasks.workunit.client.0.smithi148.stdout:2/741: getdents d5/d8/d9/d3d 0 2024-04-26T23:09:20.339 INFO:tasks.workunit.client.0.smithi148.stdout:7/635: truncate d7/d11/d29/d2e/d41/d67/d94/f9f 2001702 0 2024-04-26T23:09:20.340 INFO:tasks.workunit.client.0.smithi148.stdout:0/734: dwrite d0/d5/f2c [0,4194304] 0 2024-04-26T23:09:20.340 INFO:tasks.workunit.client.0.smithi148.stdout:0/735: dread - d0/d8/d95/d97/f80 zero size 2024-04-26T23:09:20.344 INFO:tasks.workunit.client.0.smithi148.stdout:2/742: mknod d5/d1c/cef 0 2024-04-26T23:09:20.346 INFO:tasks.workunit.client.0.smithi148.stdout:2/743: link d5/d8/d9/f69 d5/d17/d64/d88/ff0 0 2024-04-26T23:09:20.346 INFO:tasks.workunit.client.0.smithi148.stdout:3/620: dwrite d9/d15/f19 [0,4194304] 0 2024-04-26T23:09:20.346 INFO:tasks.workunit.client.0.smithi148.stdout:3/621: chown d9/d65 204652695 1 2024-04-26T23:09:20.356 INFO:tasks.workunit.client.0.smithi148.stdout:0/736: write d0/d2e/f50 [3666686,40377] 0 2024-04-26T23:09:20.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/744: rename d5/d8/d6c to d5/da6/df1 0 2024-04-26T23:09:20.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/745: fsync d5/d8/d9/d3d/fe8 0 2024-04-26T23:09:20.389 INFO:tasks.workunit.client.0.smithi148.stdout:8/677: dwrite d3/d9/d12/d23/d29/d77/f8a [0,4194304] 0 2024-04-26T23:09:20.392 INFO:tasks.workunit.client.0.smithi148.stdout:9/649: dwrite d19/d1d/f3a [0,4194304] 0 2024-04-26T23:09:20.410 INFO:tasks.workunit.client.0.smithi148.stdout:6/668: dwrite d6/d14/d91/d9f/f73 [0,4194304] 0 2024-04-26T23:09:20.410 INFO:tasks.workunit.client.0.smithi148.stdout:6/669: chown d6/d9/d1c/cbd 359 1 2024-04-26T23:09:20.427 INFO:tasks.workunit.client.0.smithi148.stdout:1/649: dwrite d16/d17/d4b/d53/d67/fae [0,4194304] 0 2024-04-26T23:09:20.435 INFO:tasks.workunit.client.0.smithi148.stdout:7/636: dwrite d7/d11/d29/d2e/d41/d67/d94/fc1 [0,4194304] 0 2024-04-26T23:09:20.436 INFO:tasks.workunit.client.0.smithi148.stdout:3/622: dread d9/d65/f91 [0,4194304] 0 2024-04-26T23:09:20.436 INFO:tasks.workunit.client.0.smithi148.stdout:8/678: read d3/f4b [813024,35337] 0 2024-04-26T23:09:20.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/670: dwrite d6/d9/d1c/dbf/db7/fd1 [0,4194304] 0 2024-04-26T23:09:20.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/671: read - d6/d14/d91/d9f/f85 zero size 2024-04-26T23:09:20.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/672: getdents d6/d32/dd3 0 2024-04-26T23:09:20.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/623: write d9/d15/d29/d4d/f57 [1046173,110526] 0 2024-04-26T23:09:20.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/746: dwrite d5/d8/d4b/d4e/d6d/da0/d32/d4c/f9b [0,4194304] 0 2024-04-26T23:09:20.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/747: chown d5/d8/d4b 243806564 1 2024-04-26T23:09:20.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/748: chown d5/d8/d11/l29 43310359 1 2024-04-26T23:09:20.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/749: stat d5/d17/d64/c9f 0 2024-04-26T23:09:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 msgr2=0x7f1958005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.157:3300/0 conn(0x7f19580036b0 0x7f1958005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f1958006180 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 reap_dead start 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f1958008d70 0x7f1958005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195800af50 con 0x7f19580091f0 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c0c7c20 con 0x7f19580097b0 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> v2:172.21.15.148:3300/0 conn(0x7f1958008d70 0x7f1958005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1973400640 1 -- 172.21.15.148:0/3378769272 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0c8f40 con 0x7f1958008d70 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f197a800640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f19580097b0 legacy=0x7f195800d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.490+0000 7f1978a00640 1 -- 172.21.15.148:0/3378769272 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454406264 0 0) 0x7f195800af50 con 0x7f19580091f0 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.157:6789/0 conn(0x7f19580097b0 legacy=0x7f195800d390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 >> v1:172.21.15.148:6789/0 conn(0x7f19580091f0 legacy=0x7f1958008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1979e00640 1 -- 172.21.15.148:0/3378769272 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1958012e30 con 0x7f1958008d70 2024-04-26T23:09:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1979e00640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1958008d70 0x7f1958005b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f197c0c4550 tx=0x7f196401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e34023d382f3372 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1978a00640 1 -- 172.21.15.148:0/3378769272 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0070 con 0x7f1958008d70 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1978a00640 1 -- 172.21.15.148:0/3378769272 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1964007070 con 0x7f1958008d70 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1978a00640 1 -- 172.21.15.148:0/3378769272 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964007440 con 0x7f1958008d70 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1980a00640 1 -- 172.21.15.148:0/3378769272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1958008d70 msgr2=0x7f1958005b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.494+0000 7f1980a00640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1958008d70 0x7f1958005b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f197c0c4550 tx=0x7f196401c430 comp rx=0 tx=0).stop 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- 172.21.15.148:0/3378769272 shutdown_connections 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 --2- 172.21.15.148:0/3378769272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1958008d70 0x7f1958005b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- 172.21.15.148:0/3378769272 >> 172.21.15.148:0/3378769272 conn(0x7f197c06c380 msgr2=0x7f197c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- 172.21.15.148:0/3378769272 shutdown_connections 2024-04-26T23:09:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- 172.21.15.148:0/3378769272 wait complete. 2024-04-26T23:09:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 Processor -- start 2024-04-26T23:09:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- start start 2024-04-26T23:09:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 0x7f197c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 0x7f197c15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f197c152500 con 0x7f19580091f0 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0c9470 con 0x7f19580097b0 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1980a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f197c152680 con 0x7f1958008d70 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f197a800640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 msgr2=0x7f197c15ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f197a800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 0x7f197c15ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 0x7f197c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59452/0 (socket says 172.21.15.148:59452) 2024-04-26T23:09:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979400640 1 -- 172.21.15.148:0/1747543497 learned_addr learned my addr 172.21.15.148:0/1747543497 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 -- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 msgr2=0x7f197c15ab10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 0x7f197c15ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 -- 172.21.15.148:0/1747543497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 msgr2=0x7f197c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 -- 172.21.15.148:0/1747543497 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c159210 con 0x7f1958008d70 2024-04-26T23:09:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979400640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.498+0000 7f1979e00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 0x7f197c152f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f19640191d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0040 con 0x7f1958008d70 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640ba070 con 0x7f1958008d70 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964005b90 con 0x7f1958008d70 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c1f5b60 con 0x7f1958008d70 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c152a70 con 0x7f1958008d70 2024-04-26T23:09:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c1596f0 con 0x7f1958008d70 2024-04-26T23:09:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19640b5410 con 0x7f1958008d70 2024-04-26T23:09:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 0x7f195806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1964120a50 con 0x7f1958008d70 2024-04-26T23:09:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.502+0000 7f1979400640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 0x7f195806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.506+0000 7f1979400640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 0x7f195806c310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f197c0705e0 tx=0x7f196c00e3f0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.518+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f197c1596f0 con 0x7f1958008d70 2024-04-26T23:09:20.573 INFO:tasks.workunit.client.0.smithi148.stdout:7/637: dwrite d7/d11/d17/fc4 [0,4194304] 0 2024-04-26T23:09:20.587 INFO:tasks.workunit.client.0.smithi148.stdout:7/638: write d7/d11/f88 [1287872,85224] 0 2024-04-26T23:09:20.618 INFO:tasks.workunit.client.0.smithi148.stdout:5/711: sync 2024-04-26T23:09:20.619 INFO:tasks.workunit.client.0.smithi148.stdout:0/737: rename d0/d8/d95/d97/d3a/c83 to d0/d8/d52/c104 0 2024-04-26T23:09:20.619 INFO:tasks.workunit.client.0.smithi148.stdout:9/650: mkdir d19/d1d/d25/d31/d73/ddc 0 2024-04-26T23:09:20.620 INFO:tasks.workunit.client.0.smithi148.stdout:1/650: link d16/d1c/f3c d16/d45/d2b/fd7 0 2024-04-26T23:09:20.624 INFO:tasks.workunit.client.0.smithi148.stdout:6/673: symlink d6/d9/d1c/dbf/ld6 0 2024-04-26T23:09:20.629 INFO:tasks.workunit.client.0.smithi148.stdout:2/750: creat d5/d8/d4b/ff2 x:0 0 0 2024-04-26T23:09:20.629 INFO:tasks.workunit.client.0.smithi148.stdout:2/751: write d5/d7f/d86/d87/f8a [394337,107563] 0 2024-04-26T23:09:20.629 INFO:tasks.workunit.client.0.smithi148.stdout:2/752: stat d5/d8/d4b/d4e/d6d/da0/d78 0 2024-04-26T23:09:20.633 INFO:tasks.workunit.client.0.smithi148.stdout:7/639: unlink d7/cd0 0 2024-04-26T23:09:20.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/712: symlink da/d1b/d5b/d5e/dc5/l104 0 2024-04-26T23:09:20.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/713: dread - da/d68/d69/daa/fb9 zero size 2024-04-26T23:09:20.635 INFO:tasks.workunit.client.0.smithi148.stdout:9/651: creat d19/d39/fdd x:0 0 0 2024-04-26T23:09:20.637 INFO:tasks.workunit.client.0.smithi148.stdout:9/652: chown d19/d1d/d69 14 1 2024-04-26T23:09:20.637 INFO:tasks.workunit.client.0.smithi148.stdout:9/653: stat d19/d39/f44 0 2024-04-26T23:09:20.638 INFO:tasks.workunit.client.0.smithi148.stdout:1/651: rename d16/d17/d4b/fa8 to d16/d45/d2b/d3e/d5a/fd8 0 2024-04-26T23:09:20.638 INFO:tasks.workunit.client.0.smithi148.stdout:1/652: write d16/f37 [914129,113015] 0 2024-04-26T23:09:20.638 INFO:tasks.workunit.client.0.smithi148.stdout:8/679: symlink d3/da/d1c/ld1 0 2024-04-26T23:09:20.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/640: creat d7/d11/d29/d2e/d41/fd3 x:0 0 0 2024-04-26T23:09:20.640 INFO:tasks.workunit.client.0.smithi148.stdout:7/641: read - d7/d11/f71 zero size 2024-04-26T23:09:20.640 INFO:tasks.workunit.client.0.smithi148.stdout:0/738: write d0/d8/d52/f30 [2707421,62458] 0 2024-04-26T23:09:20.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/714: fsync da/d12/d78/faf 0 2024-04-26T23:09:20.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/715: chown da/d1b/d8b/c9a 1 1 2024-04-26T23:09:20.641 INFO:tasks.workunit.client.0.smithi148.stdout:9/654: creat d19/d1d/d25/d31/fde x:0 0 0 2024-04-26T23:09:20.644 INFO:tasks.workunit.client.0.smithi148.stdout:2/753: rename d5/d7f to d5/d8/d4b/d4e/d6d/da0/d78/df3 0 2024-04-26T23:09:20.644 INFO:tasks.workunit.client.0.smithi148.stdout:1/653: truncate d16/d17/f25 2993290 0 2024-04-26T23:09:20.645 INFO:tasks.workunit.client.0.smithi148.stdout:1/654: chown d16/d17/d68/d6b/lcf 1292785 1 2024-04-26T23:09:20.649 INFO:tasks.workunit.client.0.smithi148.stdout:0/739: creat d0/d8/d95/f105 x:0 0 0 2024-04-26T23:09:20.649 INFO:tasks.workunit.client.0.smithi148.stdout:0/740: fdatasync d0/d8/d52/f1f 0 2024-04-26T23:09:20.649 INFO:tasks.workunit.client.0.smithi148.stdout:0/741: chown d0/d20/d54/fb9 659443 1 2024-04-26T23:09:20.650 INFO:tasks.workunit.client.0.smithi148.stdout:5/716: unlink da/d1b/d3b/d72/l86 0 2024-04-26T23:09:20.650 INFO:tasks.workunit.client.0.smithi148.stdout:9/655: dread d19/d39/f44 [0,4194304] 0 2024-04-26T23:09:20.650 INFO:tasks.workunit.client.0.smithi148.stdout:9/656: stat d19/d1d/d25/cb7 0 2024-04-26T23:09:20.650 INFO:tasks.workunit.client.0.smithi148.stdout:9/657: fdatasync d19/d1d/d25/d31/d73/f7a 0 2024-04-26T23:09:20.650 INFO:tasks.workunit.client.0.smithi148.stdout:9/658: chown d19/d1d/d25/d31/d73/dd1 83 1 2024-04-26T23:09:20.651 INFO:tasks.workunit.client.0.smithi148.stdout:2/754: unlink d5/d1c/d38/fb6 0 2024-04-26T23:09:20.651 INFO:tasks.workunit.client.0.smithi148.stdout:1/655: mknod d16/d45/d7d/cd9 0 2024-04-26T23:09:20.652 INFO:tasks.workunit.client.0.smithi148.stdout:0/742: mknod d0/d8/d33/d43/d4e/c106 0 2024-04-26T23:09:20.665 INFO:tasks.workunit.client.0.smithi148.stdout:7/642: read d7/d11/d17/d2f/fab [4108147,31579] 0 2024-04-26T23:09:20.665 INFO:tasks.workunit.client.0.smithi148.stdout:5/717: truncate da/d1f/f26 843080 0 2024-04-26T23:09:20.666 INFO:tasks.workunit.client.0.smithi148.stdout:5/718: fsync da/d12/d78/ffd 0 2024-04-26T23:09:20.666 INFO:tasks.workunit.client.0.smithi148.stdout:4/724: sync 2024-04-26T23:09:20.667 INFO:tasks.workunit.client.0.smithi148.stdout:2/755: rmdir d5/d8/d11/dae 39 2024-04-26T23:09:20.668 INFO:tasks.workunit.client.0.smithi148.stdout:2/756: fsync d5/d8/d15/d43/d5d/f7c 0 2024-04-26T23:09:20.668 INFO:tasks.workunit.client.0.smithi148.stdout:9/659: write d19/d1d/d25/f3e [1022798,61241] 0 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:9/660: truncate d19/d1d/d25/d2f/d4d/d33/daa/d9e/fa8 1409752 0 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:9/661: dread - d19/d1d/d25/d78/fdb zero size 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:9/662: dread - d19/d1d/d25/d2f/d4d/d33/fd7 zero size 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:9/663: write d19/d1d/d69/fca [1042365,99453] 0 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:5/719: mkdir da/d12/d105 0 2024-04-26T23:09:20.669 INFO:tasks.workunit.client.0.smithi148.stdout:5/720: write da/d1b/d3b/db2/fb5 [436955,84566] 0 2024-04-26T23:09:20.673 INFO:tasks.workunit.client.0.smithi148.stdout:0/743: creat d0/d20/f107 x:0 0 0 2024-04-26T23:09:20.673 INFO:tasks.workunit.client.0.smithi148.stdout:0/744: fdatasync d0/d2e/d8f/dd8/f22 0 2024-04-26T23:09:20.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/757: mkdir d5/d8/d4b/df4 0 2024-04-26T23:09:20.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/758: fsync d5/d8/d11/f5e 0 2024-04-26T23:09:20.682 INFO:tasks.workunit.client.0.smithi148.stdout:9/664: symlink d19/d1d/d25/d31/d60/dba/d85/db2/ldf 0 2024-04-26T23:09:20.686 INFO:tasks.workunit.client.0.smithi148.stdout:0/745: truncate d0/f90 3431539 0 2024-04-26T23:09:20.686 INFO:tasks.workunit.client.0.smithi148.stdout:9/665: rmdir d19/d1d/d25/d2f/d4d 39 2024-04-26T23:09:20.687 INFO:tasks.workunit.client.0.smithi148.stdout:2/759: rename d5/d8/d9/f63 to d5/d8/d15/ff5 0 2024-04-26T23:09:20.692 INFO:tasks.workunit.client.0.smithi148.stdout:0/746: unlink d0/d8/d33/d43/d4e/f8b 0 2024-04-26T23:09:20.693 INFO:tasks.workunit.client.0.smithi148.stdout:0/747: readlink d0/d8/d95/d97/l5a 0 2024-04-26T23:09:20.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/760: rmdir d5/d17/d64/dd8 0 2024-04-26T23:09:20.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/761: chown d5/d10/c1f 1443256 1 2024-04-26T23:09:20.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/762: symlink d5/d8/dc8/lf6 0 2024-04-26T23:09:20.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/725: dread d12/d1c/f73 [0,4194304] 0 2024-04-26T23:09:20.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/763: read d5/d8/d15/d43/f5f [2210444,87859] 0 2024-04-26T23:09:20.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/726: fsync d12/d1c/d56/d87/f99 0 2024-04-26T23:09:20.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/680: dwrite d3/da/f64 [0,4194304] 0 2024-04-26T23:09:20.699 INFO:tasks.workunit.client.0.smithi148.stdout:8/681: write d3/d9/d12/d23/d35/f5b [174637,102207] 0 2024-04-26T23:09:20.699 INFO:tasks.workunit.client.0.smithi148.stdout:8/682: readlink d3/d9/l1a 0 2024-04-26T23:09:20.709 INFO:tasks.workunit.client.0.smithi148.stdout:2/764: link d5/d1c/c46 d5/d8/d11/dae/cf7 0 2024-04-26T23:09:20.718 INFO:tasks.workunit.client.0.smithi148.stdout:9/666: write d19/d22/f9c [2506738,8820] 0 2024-04-26T23:09:20.721 INFO:tasks.workunit.client.0.smithi148.stdout:2/765: symlink d5/d8/d15/d7d/dd1/lf8 0 2024-04-26T23:09:20.721 INFO:tasks.workunit.client.0.smithi148.stdout:4/727: creat d12/d17/d2a/d37/fe4 x:0 0 0 2024-04-26T23:09:20.721 INFO:tasks.workunit.client.0.smithi148.stdout:0/748: write d0/d5/f2c [395432,84418] 0 2024-04-26T23:09:20.721 INFO:tasks.workunit.client.0.smithi148.stdout:4/728: write d12/d1c/dc8/fd8 [1475816,124404] 0 2024-04-26T23:09:20.722 INFO:tasks.workunit.client.0.smithi148.stdout:7/643: dwrite d7/d11/d17/f3c [4194304,4194304] 0 2024-04-26T23:09:20.724 INFO:tasks.workunit.client.0.smithi148.stdout:2/766: creat d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/ff9 x:0 0 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/749: unlink d0/d2e/d8f/ff0 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/750: stat d0/d5/d84/cda 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/751: getdents d0/d8/d33/d6a/d70/de5 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/752: readlink d0/d5/ld 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/753: fsync d0/fa4 0 2024-04-26T23:09:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/754: dread - d0/d8/d95/d97/f80 zero size 2024-04-26T23:09:20.728 INFO:tasks.workunit.client.0.smithi148.stdout:5/721: read da/d1b/d1c/d54/fa2 [3707287,112548] 0 2024-04-26T23:09:20.732 INFO:tasks.workunit.client.0.smithi148.stdout:4/729: mknod d12/d1c/ce5 0 2024-04-26T23:09:20.735 INFO:tasks.workunit.client.0.smithi148.stdout:9/667: creat d19/d1d/d25/d31/d73/dd1/fe0 x:0 0 0 2024-04-26T23:09:20.736 INFO:tasks.workunit.client.0.smithi148.stdout:1/656: dwrite d16/d17/d4b/d55/fa9 [0,4194304] 0 2024-04-26T23:09:20.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/683: dread d3/d9/d12/d23/d29/d77/f8a [0,4194304] 0 2024-04-26T23:09:20.736 INFO:tasks.workunit.client.0.smithi148.stdout:1/657: fdatasync d16/d17/d4b/d4d/fad 0 2024-04-26T23:09:20.736 INFO:tasks.workunit.client.0.smithi148.stdout:1/658: chown d16/d17/c65 612927 1 2024-04-26T23:09:20.737 INFO:tasks.workunit.client.0.smithi148.stdout:8/684: fdatasync d3/d9/d12/f3f 0 2024-04-26T23:09:20.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/644: rename d7/d19/fce to d7/d11/fd4 0 2024-04-26T23:09:20.743 INFO:tasks.workunit.client.0.smithi148.stdout:5/722: creat da/d68/d7a/f106 x:0 0 0 2024-04-26T23:09:20.744 INFO:tasks.workunit.client.0.smithi148.stdout:2/767: creat d5/da6/df1/ddc/ffa x:0 0 0 2024-04-26T23:09:20.744 INFO:tasks.workunit.client.0.smithi148.stdout:2/768: chown d5/d8/d4b/d4e/d6d/dbe/cee 1759 1 2024-04-26T23:09:20.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/723: creat da/d1b/d8b/dc7/f107 x:0 0 0 2024-04-26T23:09:20.753 INFO:tasks.workunit.client.0.smithi148.stdout:2/769: symlink d5/d8/d15/d7d/lfb 0 2024-04-26T23:09:20.753 INFO:tasks.workunit.client.0.smithi148.stdout:2/770: dread - d5/da6/df1/ddc/ffa zero size 2024-04-26T23:09:20.754 INFO:tasks.workunit.client.0.smithi148.stdout:8/685: mknod d3/da/d1c/cd2 0 2024-04-26T23:09:20.757 INFO:tasks.workunit.client.0.smithi148.stdout:8/686: mkdir d3/d9/d12/d23/d29/d77/dd3 0 2024-04-26T23:09:20.766 INFO:tasks.workunit.client.0.smithi148.stdout:5/724: dread da/d1a/fbf [0,4194304] 0 2024-04-26T23:09:20.766 INFO:tasks.workunit.client.0.smithi148.stdout:5/725: fdatasync da/d68/d69/daa/fb9 0 2024-04-26T23:09:20.770 INFO:tasks.workunit.client.0.smithi148.stdout:5/726: dread da/d1b/d3b/fd2 [0,4194304] 0 2024-04-26T23:09:20.803 INFO:tasks.workunit.client.0.smithi148.stdout:1/659: dwrite d16/d17/f25 [0,4194304] 0 2024-04-26T23:09:20.812 INFO:tasks.workunit.client.0.smithi148.stdout:7/645: dwrite d7/d11/d17/d2f/d57/f7e [0,4194304] 0 2024-04-26T23:09:20.812 INFO:tasks.workunit.client.0.smithi148.stdout:0/755: dwrite d0/d8/d52/f30 [4194304,4194304] 0 2024-04-26T23:09:20.813 INFO:tasks.workunit.client.0.smithi148.stdout:0/756: truncate d0/d5/f8a 1147032 0 2024-04-26T23:09:20.813 INFO:tasks.workunit.client.0.smithi148.stdout:1/660: symlink d16/d17/lda 0 2024-04-26T23:09:20.813 INFO:tasks.workunit.client.0.smithi148.stdout:0/757: stat d0/d2e/d8f/d6c/l103 0 2024-04-26T23:09:20.821 INFO:tasks.workunit.client.0.smithi148.stdout:0/758: dread d0/fa4 [0,4194304] 0 2024-04-26T23:09:20.823 INFO:tasks.workunit.client.0.smithi148.stdout:0/759: creat d0/d8/d33/d43/f108 x:0 0 0 2024-04-26T23:09:20.823 INFO:tasks.workunit.client.0.smithi148.stdout:0/760: chown d0/d8/d52/f30 4 1 2024-04-26T23:09:20.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.850+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f197c152860 con 0x7f1958008d70 2024-04-26T23:09:20.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.850+0000 7f1972000640 1 -- 172.21.15.148:0/1747543497 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f1964016170 con 0x7f1958008d70 2024-04-26T23:09:20.852 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":36,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:09:20.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 msgr2=0x7f195806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:20.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 0x7f195806c310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f197c0705e0 tx=0x7f196c00e3f0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 msgr2=0x7f197c152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:20.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 0x7f197c152f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f19640191d0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 shutdown_connections 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1958069e50 0x7f195806c310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580097b0 0x7f197c15ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580091f0 0x7f197c1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 --2- 172.21.15.148:0/1747543497 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1958008d70 0x7f197c152f90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 >> 172.21.15.148:0/1747543497 conn(0x7f197c06c380 msgr2=0x7f197c150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 shutdown_connections 2024-04-26T23:09:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:20.854+0000 7f1980a00640 1 -- 172.21.15.148:0/1747543497 wait complete. 2024-04-26T23:09:20.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/661: dwrite f5 [0,4194304] 0 2024-04-26T23:09:20.860 INFO:tasks.workunit.client.0.smithi148.stdout:0/761: dread d0/d8/d33/d43/d4e/fbe [0,4194304] 0 2024-04-26T23:09:20.861 INFO:tasks.workunit.client.0.smithi148.stdout:0/762: read d0/d8/d95/d97/d3a/dd2/fd7 [192185,81169] 0 2024-04-26T23:09:20.863 INFO:tasks.workunit.client.0.smithi148.stdout:0/763: dread d0/d5/f8a [0,4194304] 0 2024-04-26T23:09:20.865 INFO:tasks.workunit.client.0.smithi148.stdout:1/662: creat d16/d45/d2b/d3e/fdb x:0 0 0 2024-04-26T23:09:20.885 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:09:20.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:09:20.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:09:20.901 INFO:tasks.workunit.client.0.smithi148.stdout:1/663: dwrite d16/d17/d4b/d53/f5e [0,4194304] 0 2024-04-26T23:09:20.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/764: write d0/d8/d52/f30 [8250538,113208] 0 2024-04-26T23:09:20.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/664: write d16/f4a [2223779,89367] 0 2024-04-26T23:09:20.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/765: read d0/d5/f8a [275240,70500] 0 2024-04-26T23:09:20.906 INFO:tasks.workunit.client.0.smithi148.stdout:1/665: creat d16/d17/daf/dbd/fdc x:0 0 0 2024-04-26T23:09:20.906 INFO:tasks.workunit.client.0.smithi148.stdout:1/666: chown d16/d17/c65 1987247 1 2024-04-26T23:09:20.907 INFO:tasks.workunit.client.0.smithi148.stdout:0/766: creat d0/d8/d33/d43/d4e/f109 x:0 0 0 2024-04-26T23:09:20.909 INFO:tasks.workunit.client.0.smithi148.stdout:1/667: creat d16/d1c/d84/d94/fdd x:0 0 0 2024-04-26T23:09:20.910 INFO:tasks.workunit.client.0.smithi148.stdout:1/668: chown d16/d17/d4b/d53/d67/fcc 56412383 1 2024-04-26T23:09:20.910 INFO:tasks.workunit.client.0.smithi148.stdout:0/767: mkdir d0/d8/d52/ddd/d10a 0 2024-04-26T23:09:20.912 INFO:tasks.workunit.client.0.smithi148.stdout:1/669: creat d16/d17/d4b/dd1/fde x:0 0 0 2024-04-26T23:09:20.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/768: creat d0/d5/df7/f10b x:0 0 0 2024-04-26T23:09:20.913 INFO:tasks.workunit.client.0.smithi148.stdout:1/670: mknod d16/cdf 0 2024-04-26T23:09:20.915 INFO:tasks.workunit.client.0.smithi148.stdout:0/769: unlink d0/d8/d33/d6a/d70/ccf 0 2024-04-26T23:09:20.918 INFO:tasks.workunit.client.0.smithi148.stdout:1/671: link d16/d85/fb1 d16/d17/d4b/d53/fe0 0 2024-04-26T23:09:20.920 INFO:tasks.workunit.client.0.smithi148.stdout:0/770: creat d0/d8/d95/d97/f10c x:0 0 0 2024-04-26T23:09:20.920 INFO:tasks.workunit.client.0.smithi148.stdout:0/771: chown d0/d8/d95/d9f/leb 6471 1 2024-04-26T23:09:20.920 INFO:tasks.workunit.client.0.smithi148.stdout:0/772: write d0/d8/d95/f105 [760809,5082] 0 2024-04-26T23:09:20.920 INFO:tasks.workunit.client.0.smithi148.stdout:0/773: dread - d0/d8/d33/d6a/d70/dd6/daf/fdb zero size 2024-04-26T23:09:20.932 INFO:tasks.workunit.client.0.smithi148.stdout:0/774: truncate d0/d8/d33/fdc 211808 0 2024-04-26T23:09:20.933 INFO:tasks.workunit.client.0.smithi148.stdout:0/775: dread - d0/d8/d33/d6a/ffc zero size 2024-04-26T23:09:20.933 INFO:tasks.workunit.client.0.smithi148.stdout:0/776: write d0/d8/d5f/fae [4490979,84142] 0 2024-04-26T23:09:20.966 INFO:tasks.workunit.client.0.smithi148.stdout:1/672: dwrite d16/d45/d2b/f46 [0,4194304] 0 2024-04-26T23:09:20.967 INFO:tasks.workunit.client.0.smithi148.stdout:1/673: chown d16/d17/d4b/ca6 6296477 1 2024-04-26T23:09:20.969 INFO:tasks.workunit.client.0.smithi148.stdout:1/674: creat d16/d17/d4b/d59/fe1 x:0 0 0 2024-04-26T23:09:20.985 INFO:tasks.workunit.client.0.smithi148.stdout:0/777: dwrite d0/d8/d33/d6a/d70/dd6/daf/fdb [0,4194304] 0 2024-04-26T23:09:21.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.058+0000 7f67b6400640 1 Processor -- start 2024-04-26T23:09:21.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.058+0000 7f67b6400640 1 -- start start 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67b6400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67b00708a0 0x7f67b00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67b6400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b00c96b0 con 0x7f67b006ff50 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67b6400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b00c93d0 con 0x7f67b0072d20 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67b6400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f67b006fb70 con 0x7f67b00708a0 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67a6a00640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f67b0072d20 legacy=0x7f67b0158d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67b00708a0 0x7f67b00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67b00708a0 0x7f67b00c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59454/0 (socket says 172.21.15.148:59454) 2024-04-26T23:09:21.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 -- 172.21.15.148:0/570476951 learned_addr learned my addr 172.21.15.148:0/570476951 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:21.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 -- 172.21.15.148:0/570476951 >> v1:172.21.15.157:6789/0 conn(0x7f67b0072d20 legacy=0x7f67b0158d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:21.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 -- 172.21.15.148:0/570476951 >> v1:172.21.15.148:6789/0 conn(0x7f67b006ff50 legacy=0x7f67b006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:21.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.062+0000 7f67af400640 1 -- 172.21.15.148:0/570476951 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b00c7bb0 con 0x7f67b00708a0 2024-04-26T23:09:21.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67af400640 1 --2- 172.21.15.148:0/570476951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b00708a0 0x7f67b00c8970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009870 tx=0x7f67a001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1189b84a8b57ad4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67aea00640 1 -- 172.21.15.148:0/570476951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a00b5070 con 0x7f67b00708a0 2024-04-26T23:09:21.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67aea00640 1 -- 172.21.15.148:0/570476951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a00a8a10 con 0x7f67b00708a0 2024-04-26T23:09:21.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67aea00640 1 -- 172.21.15.148:0/570476951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a00a8de0 con 0x7f67b00708a0 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 -- 172.21.15.148:0/570476951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b00708a0 msgr2=0x7f67b00c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 --2- 172.21.15.148:0/570476951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b00708a0 0x7f67b00c8970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009870 tx=0x7f67a001ed10 comp rx=0 tx=0).stop 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 -- 172.21.15.148:0/570476951 shutdown_connections 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 --2- 172.21.15.148:0/570476951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b00708a0 0x7f67b00c8970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 -- 172.21.15.148:0/570476951 >> 172.21.15.148:0/570476951 conn(0x7f67b00c9d10 msgr2=0x7f67b00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 -- 172.21.15.148:0/570476951 shutdown_connections 2024-04-26T23:09:21.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.066+0000 7f67b6400640 1 -- 172.21.15.148:0/570476951 wait complete. 2024-04-26T23:09:21.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.070+0000 7f67b6400640 1 Processor -- start 2024-04-26T23:09:21.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.070+0000 7f67b6400640 1 -- start start 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67b006ff50 0x7f67b006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b00708a0 0x7f67b01eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0072d20 0x7f67b01ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0073160 con 0x7f67b0072d20 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67b00c84e0 con 0x7f67b00708a0 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67b00c8170 con 0x7f67b006ff50 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67a6a00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b00708a0 msgr2=0x7f67b01eedc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:21.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b00708a0 0x7f67b01eedc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67af400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67b006ff50 0x7f67b006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0072d20 0x7f67b01ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67af400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67b006ff50 0x7f67b006c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:55704/0 (socket says 172.21.15.148:55704) 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67af400640 1 -- 172.21.15.148:0/3456567919 learned_addr learned my addr 172.21.15.148:0/3456567919 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67b006ff50 msgr2=0x7f67b006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67b006ff50 0x7f67b006c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b00708a0 msgr2=0x7f67b01eedc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b00708a0 0x7f67b01eedc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b0147d30 con 0x7f67b0072d20 2024-04-26T23:09:21.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67afe00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0072d20 0x7f67b01ef300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c730 tx=0x7f67a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8016020 con 0x7f67b0072d20 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a8006d60 con 0x7f67b0072d20 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8003bc0 con 0x7f67b0072d20 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b0148010 con 0x7f67b0072d20 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.074+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b01485d0 con 0x7f67b0072d20 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67b6400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 0x7f67b01e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f67b01ee740 con 0x7f67b01e3f10 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67af400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 0x7f67b01e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67af400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67b014ad20 con 0x7f67b01e3f10 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67af400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 0x7f67b01e42f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67a001c940 tx=0x7f67a001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.078+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67a80050d0 con 0x7f67b0072d20 2024-04-26T23:09:21.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f678c06c740 0x7f678c06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f67a80868c0 con 0x7f67b0072d20 2024-04-26T23:09:21.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a6a00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f678c06c740 0x7f678c06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a00b5040 con 0x7f67b01e3f10 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f67a00ba720 con 0x7f67b01e3f10 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 msgr2=0x7f67b01e42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 0x7f67b01e42f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67a001c940 tx=0x7f67a001d550 comp rx=0 tx=0).stop 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 msgr2=0x7f67b01e42f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a7e00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b01e3f10 0x7f67b01e42f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.082+0000 7f67a6a00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f678c06c740 0x7f678c06ec00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67b015c940 tx=0x7f6798006d90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.086+0000 7f67b6400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 0x7f67b0144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.086+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f67b00748b0 con 0x7f67b0144a30 2024-04-26T23:09:21.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.086+0000 7f67af400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 0x7f67b0144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67af400640 1 -- 172.21.15.148:0/3456567919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f67b01e4830 con 0x7f67b0144a30 2024-04-26T23:09:21.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67af400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 0x7f67b0144e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67b0148da0 tx=0x7f67a001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a00b5040 con 0x7f67b0144a30 2024-04-26T23:09:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5059 (secure 0 0 0) 0x7f67a0003d20 con 0x7f67b0144a30 2024-04-26T23:09:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 msgr2=0x7f67b0144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 0x7f67b0144e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67b0148da0 tx=0x7f67a001bab0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 msgr2=0x7f67b0144e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67a7e00640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0144a30 0x7f67b0144e40 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67b0148da0 tx=0x7f67a001bab0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 36, 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 37903, 2024-04-26T23:09:21.090 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.091 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.092 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:21.093 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.094 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.095 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:09:21.096 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.100 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.101 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.102 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:09:21.103 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f678c06c740 msgr2=0x7f678c06ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f678c06c740 0x7f678c06ec00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67b015c940 tx=0x7f6798006d90 comp rx=0 tx=0).stop 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0072d20 msgr2=0x7f67b01ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 --2- 172.21.15.148:0/3456567919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67b0072d20 0x7f67b01ef300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c730 tx=0x7f67a800cbf0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67afe00640 1 -- 172.21.15.148:0/3456567919 reap_dead start 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67afe00640 1 -- 172.21.15.148:0/3456567919 reap_dead start 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 shutdown_connections 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 >> 172.21.15.148:0/3456567919 conn(0x7f67b00c9d10 msgr2=0x7f67b00c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 shutdown_connections 2024-04-26T23:09:21.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.090+0000 7f67b6400640 1 -- 172.21.15.148:0/3456567919 wait complete. 2024-04-26T23:09:21.105 INFO:tasks.workunit.client.0.smithi148.stdout:4/730: dwrite d12/fcd [0,4194304] 0 2024-04-26T23:09:21.105 INFO:tasks.workunit.client.0.smithi148.stdout:4/731: fsync d12/d1c/d45/fd6 0 2024-04-26T23:09:21.105 INFO:tasks.workunit.client.0.smithi148.stdout:4/732: chown d12/d1c/d56/d87/d9c/da1/da9/cc4 61007508 1 2024-04-26T23:09:21.109 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:09:21.109 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:09:21.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:09:21.127 INFO:tasks.workunit.client.0.smithi148.stdout:9/668: dread d19/d9f/faf [0,4194304] 0 2024-04-26T23:09:21.127 INFO:tasks.workunit.client.0.smithi148.stdout:9/669: dread - d19/d1d/d25/d78/db6/fd0 zero size 2024-04-26T23:09:21.131 INFO:tasks.workunit.client.0.smithi148.stdout:8/687: dwrite d3/d9/fc2 [0,4194304] 0 2024-04-26T23:09:21.131 INFO:tasks.workunit.client.0.smithi148.stdout:2/771: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:09:21.131 INFO:tasks.workunit.client.0.smithi148.stdout:2/772: chown d5/d8/d4b/d4e/d6d/da0/d78/c94 9 1 2024-04-26T23:09:21.136 INFO:tasks.workunit.client.0.smithi148.stdout:5/727: dread da/d1b/d1c/d54/f6b [0,4194304] 0 2024-04-26T23:09:21.138 INFO:tasks.workunit.client.0.smithi148.stdout:5/728: dread da/d68/f80 [0,4194304] 0 2024-04-26T23:09:21.142 INFO:tasks.workunit.client.0.smithi148.stdout:7/646: dwrite d7/d11/d29/d2e/d41/d67/fb9 [0,4194304] 0 2024-04-26T23:09:21.230 INFO:tasks.workunit.client.0.smithi148.stdout:1/675: symlink d16/d17/le2 0 2024-04-26T23:09:21.234 INFO:tasks.workunit.client.0.smithi148.stdout:0/778: truncate d0/d8/d33/d68/def/f77 1120349 0 2024-04-26T23:09:21.234 INFO:tasks.workunit.client.0.smithi148.stdout:0/779: dread - d0/d8/d5f/fde zero size 2024-04-26T23:09:21.240 INFO:tasks.workunit.client.0.smithi148.stdout:4/733: creat d12/d1c/d45/d8c/fe6 x:0 0 0 2024-04-26T23:09:21.251 INFO:tasks.workunit.client.0.smithi148.stdout:8/688: symlink d3/d9/d12/d23/d29/d37/d5e/ld4 0 2024-04-26T23:09:21.253 INFO:tasks.workunit.client.0.smithi148.stdout:2/773: link d5/d1c/cd9 d5/d7/d73/cfc 0 2024-04-26T23:09:21.253 INFO:tasks.workunit.client.0.smithi148.stdout:2/774: write d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/fe4 [14529,70040] 0 2024-04-26T23:09:21.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.282+0000 7fea47e00640 1 Processor -- start 2024-04-26T23:09:21.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.282+0000 7fea47e00640 1 -- start start 2024-04-26T23:09:21.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea47e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea40153fc0 0x7fea400c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea47e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 0x7fea400c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea47e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea400cb080 con 0x7fea400c7ff0 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea47e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fea401543a0 con 0x7fea40153fc0 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea47e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fea400cae30 con 0x7fea400cec90 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45e00640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7fea400c7ff0 legacy=0x7fea40159ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea44a00640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 msgr2=0x7fea400c7ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea40153fc0 0x7fea400c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea44a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 0x7fea400c7ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea40153fc0 0x7fea400c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59474/0 (socket says 172.21.15.148:59474) 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 -- 172.21.15.148:0/3700297830 learned_addr learned my addr 172.21.15.148:0/3700297830 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 -- 172.21.15.148:0/3700297830 >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 msgr2=0x7fea400c7ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 --2- 172.21.15.148:0/3700297830 >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 0x7fea400c7ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 -- 172.21.15.148:0/3700297830 >> v1:172.21.15.157:6789/0 conn(0x7fea400c7ff0 legacy=0x7fea40159ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:09:21.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 -- 172.21.15.148:0/3700297830 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea400cb360 con 0x7fea40153fc0 2024-04-26T23:09:21.287 INFO:tasks.workunit.client.0.smithi148.stdout:5/729: creat da/d1f/f108 x:0 0 0 2024-04-26T23:09:21.287 INFO:tasks.workunit.client.0.smithi148.stdout:5/730: readlink da/d1b/d5b/d5e/dc5/l104 0 2024-04-26T23:09:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.286+0000 7fea45400640 1 --2- 172.21.15.148:0/3700297830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40153fc0 0x7fea400c8da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea400708e0 tx=0x7fea3401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6928b362b990f615 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea3fe00640 1 -- 172.21.15.148:0/3700297830 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340b0070 con 0x7fea40153fc0 2024-04-26T23:09:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea3fe00640 1 -- 172.21.15.148:0/3700297830 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340ab600 con 0x7fea40153fc0 2024-04-26T23:09:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea3fe00640 1 -- 172.21.15.148:0/3700297830 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340ab9d0 con 0x7fea40153fc0 2024-04-26T23:09:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- 172.21.15.148:0/3700297830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40153fc0 msgr2=0x7fea400c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- 172.21.15.148:0/3700297830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40153fc0 0x7fea400c8da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea400708e0 tx=0x7fea3401c500 comp rx=0 tx=0).stop 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- 172.21.15.148:0/3700297830 shutdown_connections 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- 172.21.15.148:0/3700297830 >> v2:172.21.15.157:3300/0 conn(0x7fea400cec90 0x7fea400c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- 172.21.15.148:0/3700297830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40153fc0 0x7fea400c8da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- 172.21.15.148:0/3700297830 >> 172.21.15.148:0/3700297830 conn(0x7fea40073240 msgr2=0x7fea40073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- 172.21.15.148:0/3700297830 shutdown_connections 2024-04-26T23:09:21.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- 172.21.15.148:0/3700297830 wait complete. 2024-04-26T23:09:21.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 Processor -- start 2024-04-26T23:09:21.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- start start 2024-04-26T23:09:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 0x7fea401471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea400cec90 0x7fea40158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea40153fc0 0x7fea401464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fea400c9460 con 0x7fea400c7ff0 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fea400c92e0 con 0x7fea400cec90 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea47e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fea40166ce0 con 0x7fea40153fc0 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea45400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 0x7fea401471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea44a00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea400cec90 msgr2=0x7fea40158d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea44a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea400cec90 0x7fea40158d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea45400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 0x7fea401471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59478/0 (socket says 172.21.15.148:59478) 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.290+0000 7fea45400640 1 -- 172.21.15.148:0/4268055944 learned_addr learned my addr 172.21.15.148:0/4268055944 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea40153fc0 msgr2=0x7fea401464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea40153fc0 0x7fea401464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea400cec90 msgr2=0x7fea40158d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea400cec90 0x7fea40158d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea40150240 con 0x7fea400c7ff0 2024-04-26T23:09:21.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea45400640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 0x7fea401471e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea340ae040 tx=0x7fea340192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340b0040 con 0x7fea400c7ff0 2024-04-26T23:09:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340b9070 con 0x7fea400c7ff0 2024-04-26T23:09:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340b4880 con 0x7fea400c7ff0 2024-04-26T23:09:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea40147840 con 0x7fea400c7ff0 2024-04-26T23:09:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea401f8770 con 0x7fea400c7ff0 2024-04-26T23:09:21.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/647: symlink d7/d11/ld5 0 2024-04-26T23:09:21.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/648: fdatasync d7/d11/d17/d2f/f54 0 2024-04-26T23:09:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea47e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 0x7fea401f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fea40069c00 con 0x7fea401469f0 2024-04-26T23:09:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea44a00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 0x7fea401f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea340ab4c0 con 0x7fea400c7ff0 2024-04-26T23:09:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.294+0000 7fea44a00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea40146dd0 con 0x7fea401469f0 2024-04-26T23:09:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea44a00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 0x7fea401f89b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea40150f00 tx=0x7fea2c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea20068360 0x7fea2006a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fea341209a0 con 0x7fea400c7ff0 2024-04-26T23:09:21.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c003e20 con 0x7fea401469f0 2024-04-26T23:09:21.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea45e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea20068360 0x7fea2006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fea2c015070 con 0x7fea401469f0 2024-04-26T23:09:21.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 msgr2=0x7fea401f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 0x7fea401f89b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea40150f00 tx=0x7fea2c00b8e0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 msgr2=0x7fea401f89b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.298+0000 7fea3d600640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401469f0 0x7fea401f89b0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea40150f00 tx=0x7fea2c00b8e0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.300 INFO:tasks.workunit.client.0.smithi148.stdout:1/676: symlink d16/d17/daf/dbd/le3 0 2024-04-26T23:09:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.302+0000 7fea45e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea20068360 0x7fea2006a820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea38003cc0 tx=0x7fea38009270 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.307 INFO:tasks.workunit.client.0.smithi148.stdout:2/775: dwrite d5/d17/d64/d88/fc6 [0,4194304] 0 2024-04-26T23:09:21.307 INFO:tasks.workunit.client.0.smithi148.stdout:2/776: chown d5/d8/d15/d43/c82 377604 1 2024-04-26T23:09:21.308 INFO:tasks.workunit.client.0.smithi148.stdout:2/777: chown d5/d8/d11/dae/l5a 1 1 2024-04-26T23:09:21.308 INFO:tasks.workunit.client.0.smithi148.stdout:0/780: creat d0/d8/d52/ddd/f10d x:0 0 0 2024-04-26T23:09:21.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.306+0000 7fea47e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 0x7fea401f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:21.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.306+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fea40077c20 con 0x7fea401f4e80 2024-04-26T23:09:21.309 INFO:tasks.workunit.client.0.smithi148.stdout:9/670: write d19/d39/fbd [661657,21464] 0 2024-04-26T23:09:21.309 INFO:tasks.workunit.client.0.smithi148.stdout:9/671: fdatasync d19/d1d/d25/d2f/d4d/d33/daa/d9e/fa8 0 2024-04-26T23:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea44a00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 0x7fea401f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:21.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/734: symlink d12/d1c/dc8/le7 0 2024-04-26T23:09:21.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/735: chown d12/d1c/d56/d87/d9a/d9d/f57 574185 1 2024-04-26T23:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea44a00640 1 -- 172.21.15.148:0/4268055944 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fea4014df10 con 0x7fea401f4e80 2024-04-26T23:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea44a00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 0x7fea401f5260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea4014dee0 tx=0x7fea2c005a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0055d0 con 0x7fea401f4e80 2024-04-26T23:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5201 (secure 0 0 0) 0x7fea2c0055d0 con 0x7fea401f4e80 2024-04-26T23:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 msgr2=0x7fea401f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 0x7fea401f5260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea4014dee0 tx=0x7fea2c005a30 comp rx=0 tx=0).stop 2024-04-26T23:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 msgr2=0x7fea401f5260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea3d600640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea401f4e80 0x7fea401f5260 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea4014dee0 tx=0x7fea2c005a30 comp rx=0 tx=0).stop 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 36, 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 304161, 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:09:21.312 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.313 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.314 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:09:21.315 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:09:21.316 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:09:21.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:09:21.318 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.319 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:09:21.320 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:21.322 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.323 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.324 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:21.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:21.326 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:09:21.326 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:09:21.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea20068360 msgr2=0x7fea2006a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea20068360 0x7fea2006a820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea38003cc0 tx=0x7fea38009270 comp rx=0 tx=0).stop 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 msgr2=0x7fea401471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 --2- 172.21.15.148:0/4268055944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea400c7ff0 0x7fea401471e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea340ae040 tx=0x7fea340192a0 comp rx=0 tx=0).stop 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea45e00640 1 -- 172.21.15.148:0/4268055944 reap_dead start 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea45e00640 1 -- 172.21.15.148:0/4268055944 reap_dead start 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 shutdown_connections 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 >> 172.21.15.148:0/4268055944 conn(0x7fea40073240 msgr2=0x7fea4006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.310+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 shutdown_connections 2024-04-26T23:09:21.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:21.314+0000 7fea47e00640 1 -- 172.21.15.148:0/4268055944 wait complete. 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:8/689: symlink d3/da/d1c/d7c/d8c/d9f/dcf/ld5 0 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:5/731: mknod da/d68/c109 0 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:5/732: fsync da/d12/d78/ffd 0 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:1/677: stat d16/d17/d77/la4 0 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:2/778: mkdir d5/d97/dfd 0 2024-04-26T23:09:21.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/781: dread d0/d2e/d8f/dd8/faa [0,4194304] 0 2024-04-26T23:09:21.332 INFO:tasks.workunit.client.0.smithi148.stdout:9/672: truncate d19/d39/f54 3280774 0 2024-04-26T23:09:21.337 INFO:tasks.workunit.client.0.smithi148.stdout:0/782: unlink d0/d8/d33/l8e 0 2024-04-26T23:09:21.343 INFO:tasks.workunit.client.0.smithi148.stdout:9/673: rename d19/d1d/d25/d2f/d4d/d33/fac to d19/d1d/d25/fe1 0 2024-04-26T23:09:21.346 INFO:tasks.workunit.client.0.smithi148.stdout:9/674: truncate d19/d1d/f8b 3775735 0 2024-04-26T23:09:21.346 INFO:tasks.workunit.client.0.smithi148.stdout:9/675: write d19/d39/f59 [4652841,18285] 0 2024-04-26T23:09:21.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/676: getdents d19/d9f/dbb 0 2024-04-26T23:09:21.352 INFO:tasks.workunit.client.0.smithi148.stdout:7/649: dwrite d7/d75/f85 [0,4194304] 0 2024-04-26T23:09:21.355 INFO:tasks.workunit.client.0.smithi148.stdout:7/650: chown d7/d11/d29/l78 0 1 2024-04-26T23:09:21.355 INFO:tasks.workunit.client.0.smithi148.stdout:9/677: unlink d19/d1d/d25/d31/d48/c4f 0 2024-04-26T23:09:21.355 INFO:tasks.workunit.client.0.smithi148.stdout:9/678: write d19/d39/f59 [4814894,45699] 0 2024-04-26T23:09:21.356 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:09:21.356 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:09:21.358 INFO:tasks.workunit.client.0.smithi148.stdout:7/651: symlink d7/d11/d17/d2f/d44/ld6 0 2024-04-26T23:09:21.358 INFO:tasks.workunit.client.0.smithi148.stdout:7/652: write d7/d75/f93 [315909,119378] 0 2024-04-26T23:09:21.359 INFO:tasks.workunit.client.0.smithi148.stdout:9/679: symlink d19/d1d/d25/d78/le2 0 2024-04-26T23:09:21.364 INFO:tasks.workunit.client.0.smithi148.stdout:9/680: rename d19/d1d/d25/d31/d73/f7a to d19/d1d/d25/d31/d73/dd1/fe3 0 2024-04-26T23:09:21.365 INFO:tasks.workunit.client.0.smithi148.stdout:9/681: mkdir d19/d1d/d25/d31/d73/ddc/de4 0 2024-04-26T23:09:21.366 INFO:tasks.workunit.client.0.smithi148.stdout:9/682: mkdir d19/d1d/d25/d78/db6/dcb/de5 0 2024-04-26T23:09:21.366 INFO:tasks.workunit.client.0.smithi148.stdout:9/683: readlink d19/d1d/d25/d31/d60/dba/d85/db2/ldf 0 2024-04-26T23:09:21.366 INFO:tasks.workunit.client.0.smithi148.stdout:9/684: write d19/d1d/d25/d31/fde [936049,91692] 0 2024-04-26T23:09:21.387 INFO:tasks.workunit.client.0.smithi148.stdout:1/678: dread d16/d17/f93 [0,4194304] 0 2024-04-26T23:09:21.392 INFO:tasks.workunit.client.0.smithi148.stdout:1/679: link d16/d47/d49/fb8 d16/d17/d68/d6b/d8b/fe4 0 2024-04-26T23:09:21.393 INFO:tasks.workunit.client.0.smithi148.stdout:8/690: dread d3/d9/d12/f46 [0,4194304] 0 2024-04-26T23:09:21.394 INFO:tasks.workunit.client.0.smithi148.stdout:1/680: unlink d16/d17/d68/d6b/l71 0 2024-04-26T23:09:21.395 INFO:tasks.workunit.client.0.smithi148.stdout:5/733: dwrite da/d12/f13 [0,4194304] 0 2024-04-26T23:09:21.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/734: creat da/d1b/d5b/d5e/d6a/de4/f10a x:0 0 0 2024-04-26T23:09:21.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/735: write da/d1b/d3b/d73/d97/fad [1261691,122333] 0 2024-04-26T23:09:21.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/736: creat da/d68/d69/dc9/f10b x:0 0 0 2024-04-26T23:09:21.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/737: read da/d12/f17 [416442,32631] 0 2024-04-26T23:09:21.405 INFO:tasks.workunit.client.0.smithi148.stdout:4/736: dwrite d12/d1c/d45/fd6 [0,4194304] 0 2024-04-26T23:09:21.405 INFO:tasks.workunit.client.0.smithi148.stdout:4/737: chown d12/d1c/f85 219 1 2024-04-26T23:09:21.405 INFO:tasks.workunit.client.0.smithi148.stdout:5/738: link da/d1b/d5b/d5e/dc5/l104 da/d1b/d1c/d54/df0/l10c 0 2024-04-26T23:09:21.405 INFO:tasks.workunit.client.0.smithi148.stdout:5/739: fdatasync da/d1f/d47/fba 0 2024-04-26T23:09:21.406 INFO:tasks.workunit.client.0.smithi148.stdout:5/740: creat da/d12/d78/f10d x:0 0 0 2024-04-26T23:09:21.406 INFO:tasks.workunit.client.0.smithi148.stdout:5/741: readlink da/d1b/d3b/db2/lcd 0 2024-04-26T23:09:21.408 INFO:tasks.workunit.client.0.smithi148.stdout:4/738: dread d12/d17/f7c [0,4194304] 0 2024-04-26T23:09:21.418 INFO:tasks.workunit.client.0.smithi148.stdout:0/783: dwrite d0/f2 [4194304,4194304] 0 2024-04-26T23:09:21.429 INFO:tasks.workunit.client.0.smithi148.stdout:7/653: dwrite d7/d11/d29/d2e/d41/d67/d94/d95/fbe [0,4194304] 0 2024-04-26T23:09:21.430 INFO:tasks.workunit.client.0.smithi148.stdout:4/739: write d12/d17/d2a/d37/f62 [335933,43798] 0 2024-04-26T23:09:21.430 INFO:tasks.workunit.client.0.smithi148.stdout:4/740: dread - d12/d1c/d56/d87/d9a/f8d zero size 2024-04-26T23:09:21.431 INFO:tasks.workunit.client.0.smithi148.stdout:7/654: mknod d7/d75/dad/cd7 0 2024-04-26T23:09:21.431 INFO:tasks.workunit.client.0.smithi148.stdout:4/741: creat d12/d1c/dc0/fe8 x:0 0 0 2024-04-26T23:09:21.433 INFO:tasks.workunit.client.0.smithi148.stdout:7/655: rename d7/d11/d17/d2f/f5b to d7/d11/fd8 0 2024-04-26T23:09:21.434 INFO:tasks.workunit.client.0.smithi148.stdout:7/656: fsync d7/d11/d29/d2e/f26 0 2024-04-26T23:09:21.436 INFO:tasks.workunit.client.0.smithi148.stdout:7/657: creat d7/d11/d29/d2e/d41/d67/fd9 x:0 0 0 2024-04-26T23:09:21.436 INFO:tasks.workunit.client.0.smithi148.stdout:9/685: dwrite d19/d1d/f3b [0,4194304] 0 2024-04-26T23:09:21.464 INFO:tasks.workunit.client.0.smithi148.stdout:0/784: dwrite d0/d2e/d8f/dd8/faa [0,4194304] 0 2024-04-26T23:09:21.464 INFO:tasks.workunit.client.0.smithi148.stdout:0/785: write d0/d2e/f35 [1003912,35874] 0 2024-04-26T23:09:21.485 INFO:tasks.workunit.client.0.smithi148.stdout:1/681: dwrite d16/d17/d4b/d55/fa9 [0,4194304] 0 2024-04-26T23:09:21.486 INFO:tasks.workunit.client.0.smithi148.stdout:8/691: dread d3/d9/d12/d23/d35/faf [0,4194304] 0 2024-04-26T23:09:21.490 INFO:tasks.workunit.client.0.smithi148.stdout:9/686: dwrite d19/d1d/d69/fca [0,4194304] 0 2024-04-26T23:09:21.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/624: sync 2024-04-26T23:09:21.501 INFO:tasks.workunit.client.0.smithi148.stdout:6/674: sync 2024-04-26T23:09:21.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/625: fsync d9/d15/f92 0 2024-04-26T23:09:21.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/626: fsync d9/d4c/f8a 0 2024-04-26T23:09:21.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/627: truncate d9/d65/d80/d83/f89 382365 0 2024-04-26T23:09:21.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/628: chown d9/d65/d80/ca8 419928 1 2024-04-26T23:09:21.502 INFO:tasks.workunit.client.0.smithi148.stdout:6/675: creat d6/d9/d1c/fd7 x:0 0 0 2024-04-26T23:09:21.505 INFO:tasks.workunit.client.0.smithi148.stdout:3/629: unlink d9/f86 0 2024-04-26T23:09:21.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/630: write d9/d31/f95 [812243,50123] 0 2024-04-26T23:09:21.508 INFO:tasks.workunit.client.0.smithi148.stdout:9/687: write d19/d1d/d25/d31/d73/f7e [2789282,21705] 0 2024-04-26T23:09:21.508 INFO:tasks.workunit.client.0.smithi148.stdout:9/688: dread - d19/d1d/d25/d31/d73/dd1/fe0 zero size 2024-04-26T23:09:21.513 INFO:tasks.workunit.client.0.smithi148.stdout:6/676: dread d6/d9/f7e [0,4194304] 0 2024-04-26T23:09:21.519 INFO:tasks.workunit.client.0.smithi148.stdout:3/631: dread d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:21.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/632: symlink d9/d15/d29/d88/lc5 0 2024-04-26T23:09:21.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/633: truncate d9/d31/f32 4661257 0 2024-04-26T23:09:21.522 INFO:tasks.workunit.client.0.smithi148.stdout:3/634: creat d9/d65/fc6 x:0 0 0 2024-04-26T23:09:21.523 INFO:tasks.workunit.client.0.smithi148.stdout:3/635: getdents d9/d15/d29/d4d 0 2024-04-26T23:09:21.525 INFO:tasks.workunit.client.0.smithi148.stdout:3/636: symlink d9/d15/d29/d88/d9f/lc7 0 2024-04-26T23:09:21.525 INFO:tasks.workunit.client.0.smithi148.stdout:3/637: mknod d9/d4c/cc8 0 2024-04-26T23:09:21.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/638: symlink d9/d65/d80/d83/db9/lc9 0 2024-04-26T23:09:21.530 INFO:tasks.workunit.client.0.smithi148.stdout:3/639: rename d9/d15/d29/d4d/d68/d8c to d9/d31/dc3/dca 0 2024-04-26T23:09:21.581 INFO:tasks.workunit.client.0.smithi148.stdout:5/742: write da/d68/d69/fa7 [37569,36884] 0 2024-04-26T23:09:21.582 INFO:tasks.workunit.client.0.smithi148.stdout:4/742: dwrite d12/d1c/f4b [0,4194304] 0 2024-04-26T23:09:21.582 INFO:tasks.workunit.client.0.smithi148.stdout:4/743: chown l6 10 1 2024-04-26T23:09:21.584 INFO:tasks.workunit.client.0.smithi148.stdout:8/692: dwrite d3/da/d1c/d7c/d8c/d9f/f20 [4194304,4194304] 0 2024-04-26T23:09:21.592 INFO:tasks.workunit.client.0.smithi148.stdout:5/743: mkdir da/d1b/d3b/d73/ddd/de5/d10e 0 2024-04-26T23:09:21.621 INFO:tasks.workunit.client.0.smithi148.stdout:4/744: rename d12/d17/f5a to d12/d1c/d56/d87/d9c/da1/dc3/fe9 0 2024-04-26T23:09:21.621 INFO:tasks.workunit.client.0.smithi148.stdout:4/745: fdatasync d12/f35 0 2024-04-26T23:09:21.621 INFO:tasks.workunit.client.0.smithi148.stdout:7/658: dwrite d7/d11/d29/d2e/d41/d67/d94/fc1 [0,4194304] 0 2024-04-26T23:09:21.621 INFO:tasks.workunit.client.0.smithi148.stdout:0/786: dwrite d0/d8/d5f/fde [0,4194304] 0 2024-04-26T23:09:21.634 INFO:tasks.workunit.client.0.smithi148.stdout:0/787: mkdir d0/d8/d95/d9f/d10e 0 2024-04-26T23:09:21.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/659: symlink d7/d11/d17/d2f/d57/lda 0 2024-04-26T23:09:21.652 INFO:tasks.workunit.client.0.smithi148.stdout:7/660: symlink d7/d11/d60/d68/ldb 0 2024-04-26T23:09:21.655 INFO:tasks.workunit.client.0.smithi148.stdout:7/661: unlink d7/d11/l3e 0 2024-04-26T23:09:21.656 INFO:tasks.workunit.client.0.smithi148.stdout:7/662: symlink d7/d75/ldc 0 2024-04-26T23:09:21.658 INFO:tasks.workunit.client.0.smithi148.stdout:7/663: link d7/d11/d17/d9e/da9/cb7 d7/d11/d17/cdd 0 2024-04-26T23:09:21.658 INFO:tasks.workunit.client.0.smithi148.stdout:7/664: readlink d7/d75/ldc 0 2024-04-26T23:09:21.658 INFO:tasks.workunit.client.0.smithi148.stdout:7/665: truncate d7/d11/f71 362787 0 2024-04-26T23:09:21.659 INFO:tasks.workunit.client.0.smithi148.stdout:7/666: symlink d7/d11/d17/d2f/lde 0 2024-04-26T23:09:21.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/667: creat d7/d11/d60/fdf x:0 0 0 2024-04-26T23:09:21.664 INFO:tasks.workunit.client.0.smithi148.stdout:7/668: creat d7/d19/fe0 x:0 0 0 2024-04-26T23:09:21.667 INFO:tasks.workunit.client.0.smithi148.stdout:7/669: link d7/d19/f83 d7/d11/d29/fe1 0 2024-04-26T23:09:21.668 INFO:tasks.workunit.client.0.smithi148.stdout:7/670: getdents d7/d11/d17/d9e/da9 0 2024-04-26T23:09:21.668 INFO:tasks.workunit.client.0.smithi148.stdout:7/671: fsync d7/d11/d17/d9e/fa8 0 2024-04-26T23:09:21.680 INFO:tasks.workunit.client.0.smithi148.stdout:8/693: dwrite d3/d9a/f9d [0,4194304] 0 2024-04-26T23:09:21.684 INFO:tasks.workunit.client.0.smithi148.stdout:0/788: dwrite d0/f62 [0,4194304] 0 2024-04-26T23:09:21.685 INFO:tasks.workunit.client.0.smithi148.stdout:0/789: truncate d0/d8/d33/d43/d4e/f109 559369 0 2024-04-26T23:09:21.686 INFO:tasks.workunit.client.0.smithi148.stdout:0/790: mkdir d0/d2e/d10f 0 2024-04-26T23:09:21.688 INFO:tasks.workunit.client.0.smithi148.stdout:0/791: rmdir d0/d8/d52/ddd/d10a 0 2024-04-26T23:09:21.699 INFO:tasks.workunit.client.0.smithi148.stdout:1/682: dread d16/d17/d4b/d55/f9a [0,4194304] 0 2024-04-26T23:09:21.699 INFO:tasks.workunit.client.0.smithi148.stdout:1/683: write d16/d45/d2b/d3e/fdb [995172,79806] 0 2024-04-26T23:09:21.699 INFO:tasks.workunit.client.0.smithi148.stdout:1/684: chown d16/f1d 427982414 1 2024-04-26T23:09:21.700 INFO:tasks.workunit.client.0.smithi148.stdout:1/685: unlink d16/d17/d68/d6b/d8b/fd5 0 2024-04-26T23:09:21.706 INFO:tasks.workunit.client.0.smithi148.stdout:1/686: mknod d16/d45/d2b/ce5 0 2024-04-26T23:09:21.707 INFO:tasks.workunit.client.0.smithi148.stdout:1/687: creat d16/d45/d7d/fe6 x:0 0 0 2024-04-26T23:09:21.707 INFO:tasks.workunit.client.0.smithi148.stdout:1/688: readlink lc 0 2024-04-26T23:09:21.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/689: write fd [2972729,47158] 0 2024-04-26T23:09:21.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/690: getdents d16/d17/d68 0 2024-04-26T23:09:21.709 INFO:tasks.workunit.client.0.smithi148.stdout:1/691: creat d16/d1c/d84/d94/fe7 x:0 0 0 2024-04-26T23:09:21.710 INFO:tasks.workunit.client.0.smithi148.stdout:1/692: creat d16/fe8 x:0 0 0 2024-04-26T23:09:21.711 INFO:tasks.workunit.client.0.smithi148.stdout:1/693: creat d16/d17/daf/fe9 x:0 0 0 2024-04-26T23:09:21.713 INFO:tasks.workunit.client.0.smithi148.stdout:4/746: dwrite d12/f8f [0,4194304] 0 2024-04-26T23:09:21.713 INFO:tasks.workunit.client.0.smithi148.stdout:1/694: mknod d16/d45/d2b/cea 0 2024-04-26T23:09:21.714 INFO:tasks.workunit.client.0.smithi148.stdout:4/747: creat d12/d1c/d45/d8c/fea x:0 0 0 2024-04-26T23:09:21.715 INFO:tasks.workunit.client.0.smithi148.stdout:4/748: truncate d12/d1c/d56/d87/d9a/d9d/f4e 1737872 0 2024-04-26T23:09:21.729 INFO:tasks.workunit.client.0.smithi148.stdout:0/792: dwrite d0/d2e/d8f/d6c/dab/fa7 [0,4194304] 0 2024-04-26T23:09:21.740 INFO:tasks.workunit.client.0.smithi148.stdout:1/695: getdents d16/d45/d2b 0 2024-04-26T23:09:21.742 INFO:tasks.workunit.client.0.smithi148.stdout:0/793: write d0/d8/d52/f1f [4419670,14206] 0 2024-04-26T23:09:21.742 INFO:tasks.workunit.client.0.smithi148.stdout:1/696: rename d16/d47/l61 to d16/d1c/d82/leb 0 2024-04-26T23:09:21.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/697: mknod d16/d1c/d84/d94/cec 0 2024-04-26T23:09:21.745 INFO:tasks.workunit.client.0.smithi148.stdout:1/698: rename d16/c27 to d16/d45/d2b/d6e/ced 0 2024-04-26T23:09:21.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/699: write d16/f37 [644373,34434] 0 2024-04-26T23:09:21.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/700: truncate d16/d1c/f32 1283412 0 2024-04-26T23:09:21.756 INFO:tasks.workunit.client.0.smithi148.stdout:0/794: dread d0/d8/d33/d6a/d70/dd6/d9d/db4/fb5 [0,4194304] 0 2024-04-26T23:09:21.763 INFO:tasks.workunit.client.0.smithi148.stdout:0/795: dread d0/d8/d33/d6a/d70/dd6/f60 [0,4194304] 0 2024-04-26T23:09:21.808 INFO:tasks.workunit.client.0.smithi148.stdout:1/701: write d16/d17/f1a [1889635,45153] 0 2024-04-26T23:09:21.809 INFO:tasks.workunit.client.0.smithi148.stdout:4/749: dwrite d12/d1c/d56/fb6 [0,4194304] 0 2024-04-26T23:09:21.812 INFO:tasks.workunit.client.0.smithi148.stdout:1/702: creat d16/d17/fee x:0 0 0 2024-04-26T23:09:21.812 INFO:tasks.workunit.client.0.smithi148.stdout:1/703: chown d16/d17/d4b/d53/fe0 0 1 2024-04-26T23:09:21.812 INFO:tasks.workunit.client.0.smithi148.stdout:1/704: write d16/d1c/d84/fa1 [688180,128933] 0 2024-04-26T23:09:21.812 INFO:tasks.workunit.client.0.smithi148.stdout:1/705: stat d16/d17/d4b/dd1/fc9 0 2024-04-26T23:09:21.861 INFO:tasks.workunit.client.0.smithi148.stdout:0/796: dwrite d0/d2e/d8f/f7c [0,4194304] 0 2024-04-26T23:09:21.883 INFO:tasks.workunit.client.0.smithi148.stdout:0/797: dread d0/d2e/d8f/f7c [0,4194304] 0 2024-04-26T23:09:21.883 INFO:tasks.workunit.client.0.smithi148.stdout:0/798: write d0/f7b [520967,106896] 0 2024-04-26T23:09:21.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/750: dwrite d12/d1c/d45/d75/fa6 [0,4194304] 0 2024-04-26T23:09:21.887 INFO:tasks.workunit.client.0.smithi148.stdout:4/751: creat d12/d1c/d56/d87/d9c/da1/feb x:0 0 0 2024-04-26T23:09:21.897 INFO:tasks.workunit.client.0.smithi148.stdout:0/799: write d0/f62 [2297047,40396] 0 2024-04-26T23:09:21.902 INFO:tasks.workunit.client.0.smithi148.stdout:4/752: dread d12/d17/f3e [0,4194304] 0 2024-04-26T23:09:21.925 INFO:tasks.workunit.client.0.smithi148.stdout:9/689: dwrite d19/d1d/d25/d31/f55 [0,4194304] 0 2024-04-26T23:09:21.931 INFO:tasks.workunit.client.0.smithi148.stdout:3/640: dwrite d9/d15/f92 [0,4194304] 0 2024-04-26T23:09:21.932 INFO:tasks.workunit.client.0.smithi148.stdout:9/690: rename d19/d22/c58 to d19/d1d/d25/d31/d32/db9/ce6 0 2024-04-26T23:09:21.941 INFO:tasks.workunit.client.0.smithi148.stdout:3/641: dread d9/ff [0,4194304] 0 2024-04-26T23:09:21.943 INFO:tasks.workunit.client.0.smithi148.stdout:0/800: dwrite d0/d2e/d8f/dd8/f22 [0,4194304] 0 2024-04-26T23:09:21.943 INFO:tasks.workunit.client.0.smithi148.stdout:9/691: dread d19/f2d [0,4194304] 0 2024-04-26T23:09:21.944 INFO:tasks.workunit.client.0.smithi148.stdout:9/692: chown d19/d1d/d25/d2f/lc7 4 1 2024-04-26T23:09:21.949 INFO:tasks.workunit.client.0.smithi148.stdout:3/642: link d9/d15/d29/d88/fc4 d9/d31/dc3/fcb 0 2024-04-26T23:09:21.949 INFO:tasks.workunit.client.0.smithi148.stdout:3/643: dread - d9/d31/dc3/dca/fba zero size 2024-04-26T23:09:21.956 INFO:tasks.workunit.client.0.smithi148.stdout:0/801: creat d0/d8/d33/d6a/d70/dd6/d9d/df8/f110 x:0 0 0 2024-04-26T23:09:21.956 INFO:tasks.workunit.client.0.smithi148.stdout:9/693: truncate d19/f2d 355569 0 2024-04-26T23:09:21.959 INFO:tasks.workunit.client.0.smithi148.stdout:0/802: creat d0/d8/d33/d43/d4e/f111 x:0 0 0 2024-04-26T23:09:21.959 INFO:tasks.workunit.client.0.smithi148.stdout:0/803: fsync d0/d2e/d8f/f7c 0 2024-04-26T23:09:21.959 INFO:tasks.workunit.client.0.smithi148.stdout:9/694: mkdir d19/d1d/d25/d2f/de7 0 2024-04-26T23:09:21.959 INFO:tasks.workunit.client.0.smithi148.stdout:5/744: dwrite da/d1b/fed [0,4194304] 0 2024-04-26T23:09:21.971 INFO:tasks.workunit.client.0.smithi148.stdout:9/695: mknod d19/d1d/d25/d78/db6/dcb/de5/ce8 0 2024-04-26T23:09:21.971 INFO:tasks.workunit.client.0.smithi148.stdout:9/696: chown f2 2 1 2024-04-26T23:09:21.973 INFO:tasks.workunit.client.0.smithi148.stdout:3/644: dread d9/d31/f55 [0,4194304] 0 2024-04-26T23:09:21.978 INFO:tasks.workunit.client.0.smithi148.stdout:9/697: getdents d19/d1d/d25/d2f/d4d 0 2024-04-26T23:09:21.981 INFO:tasks.workunit.client.0.smithi148.stdout:9/698: symlink d19/d1d/d25/d31/d32/dc8/le9 0 2024-04-26T23:09:21.981 INFO:tasks.workunit.client.0.smithi148.stdout:9/699: write d19/d39/f59 [286421,98780] 0 2024-04-26T23:09:21.989 INFO:tasks.workunit.client.0.smithi148.stdout:9/700: creat d19/d1d/d25/d78/db6/dcb/fea x:0 0 0 2024-04-26T23:09:21.990 INFO:tasks.workunit.client.0.smithi148.stdout:9/701: mknod d19/d1d/d25/d2f/d4d/d33/daa/d9e/ceb 0 2024-04-26T23:09:21.996 INFO:tasks.workunit.client.0.smithi148.stdout:9/702: getdents d19/d1d/d25/d2f/de7 0 2024-04-26T23:09:21.996 INFO:tasks.workunit.client.0.smithi148.stdout:9/703: fsync d19/d1d/d25/d2f/d4d/d33/fb3 0 2024-04-26T23:09:21.996 INFO:tasks.workunit.client.0.smithi148.stdout:7/672: dwrite d7/d11/d29/d2e/d41/d67/d94/f9f [0,4194304] 0 2024-04-26T23:09:21.996 INFO:tasks.workunit.client.0.smithi148.stdout:7/673: mknod d7/d11/d17/d2f/d57/ce2 0 2024-04-26T23:09:21.997 INFO:tasks.workunit.client.0.smithi148.stdout:8/694: dread d3/da/d1c/f45 [0,4194304] 0 2024-04-26T23:09:21.998 INFO:tasks.workunit.client.0.smithi148.stdout:8/695: creat d3/d9/d12/d23/d35/fd6 x:0 0 0 2024-04-26T23:09:22.000 INFO:tasks.workunit.client.0.smithi148.stdout:8/696: symlink d3/d9a/ld7 0 2024-04-26T23:09:22.002 INFO:tasks.workunit.client.0.smithi148.stdout:8/697: mknod d3/d9/d12/d23/d29/cd8 0 2024-04-26T23:09:22.004 INFO:tasks.workunit.client.0.smithi148.stdout:5/745: dread da/d1b/d1c/d7f/fcb [0,4194304] 0 2024-04-26T23:09:22.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/746: creat da/d1b/d3b/d73/d97/db0/f10f x:0 0 0 2024-04-26T23:09:22.005 INFO:tasks.workunit.client.0.smithi148.stdout:4/753: dwrite d12/d1c/d56/d87/d9a/f3d [0,4194304] 0 2024-04-26T23:09:22.006 INFO:tasks.workunit.client.0.smithi148.stdout:5/747: getdents da/d1b/d5b/d5e/dc5 0 2024-04-26T23:09:22.007 INFO:tasks.workunit.client.0.smithi148.stdout:0/804: dwrite d0/d20/f107 [0,4194304] 0 2024-04-26T23:09:22.007 INFO:tasks.workunit.client.0.smithi148.stdout:9/704: dread d19/d1d/d25/d31/fde [0,4194304] 0 2024-04-26T23:09:22.008 INFO:tasks.workunit.client.0.smithi148.stdout:0/805: truncate d0/d8/d33/d6a/d70/dd6/d9d/fdf 239220 0 2024-04-26T23:09:22.008 INFO:tasks.workunit.client.0.smithi148.stdout:4/754: mkdir d12/d17/d2a/d37/d97/dec 0 2024-04-26T23:09:22.010 INFO:tasks.workunit.client.0.smithi148.stdout:0/806: mknod d0/d20/d3b/c112 0 2024-04-26T23:09:22.017 INFO:tasks.workunit.client.0.smithi148.stdout:9/705: creat d19/d1d/d25/d31/d60/fec x:0 0 0 2024-04-26T23:09:22.020 INFO:tasks.workunit.client.0.smithi148.stdout:9/706: symlink d19/d1d/d25/d2f/d4d/d33/daa/d9e/led 0 2024-04-26T23:09:22.021 INFO:tasks.workunit.client.0.smithi148.stdout:9/707: symlink d19/d1d/d25/d2f/d4d/d33/d50/lee 0 2024-04-26T23:09:22.032 INFO:tasks.workunit.client.0.smithi148.stdout:7/674: dread d7/d11/d29/f53 [0,4194304] 0 2024-04-26T23:09:22.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/807: dread d0/d8/d33/d43/d4e/f109 [0,4194304] 0 2024-04-26T23:09:22.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/808: dread - d0/ff6 zero size 2024-04-26T23:09:22.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/809: truncate d0/d8/d5f/fde 4861260 0 2024-04-26T23:09:22.032 INFO:tasks.workunit.client.0.smithi148.stdout:7/675: mknod d7/d11/d17/d2f/d44/d9b/da1/ce3 0 2024-04-26T23:09:22.038 INFO:tasks.workunit.client.0.smithi148.stdout:7/676: dread d7/f15 [0,4194304] 0 2024-04-26T23:09:22.041 INFO:tasks.workunit.client.0.smithi148.stdout:7/677: unlink d7/f90 0 2024-04-26T23:09:22.041 INFO:tasks.workunit.client.0.smithi148.stdout:0/810: write d0/d2e/d8f/d6c/fa6 [88600,47039] 0 2024-04-26T23:09:22.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/811: dread d0/d5/f8a [0,4194304] 0 2024-04-26T23:09:22.043 INFO:tasks.workunit.client.0.smithi148.stdout:0/812: write d0/d8/d33/d6a/d70/dd6/d9d/df8/ffe [1018173,67159] 0 2024-04-26T23:09:22.043 INFO:tasks.workunit.client.0.smithi148.stdout:7/678: rename d7/d11/d60 to d7/d11/d17/d2f/d44/de4 0 2024-04-26T23:09:22.043 INFO:tasks.workunit.client.0.smithi148.stdout:4/755: dwrite d12/d1c/d56/d87/d9a/f76 [4194304,4194304] 0 2024-04-26T23:09:22.045 INFO:tasks.workunit.client.0.smithi148.stdout:7/679: creat d7/d11/d17/d2f/d44/d9b/fe5 x:0 0 0 2024-04-26T23:09:22.045 INFO:tasks.workunit.client.0.smithi148.stdout:7/680: getdents d7/d11/d29/d2e/dc6 0 2024-04-26T23:09:22.058 INFO:tasks.workunit.client.0.smithi148.stdout:7/681: getdents d7/d11/d17/d2f/d44 0 2024-04-26T23:09:22.062 INFO:tasks.workunit.client.0.smithi148.stdout:8/698: dwrite d3/d9/d12/d23/d29/d77/d91/fba [0,4194304] 0 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:8/699: read - d3/d9/d12/d23/d65/fbd zero size 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:0/813: write d0/d20/d3b/f3c [448239,2793] 0 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:9/708: dread d19/d1d/d25/d31/d73/f7e [0,4194304] 0 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:5/748: dwrite da/d1a/f1e [0,4194304] 0 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:5/749: chown da/d1b/d1c/fb4 0 1 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:0/814: truncate d0/d2e/d8f/d6c/dab/fa7 100635 0 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:9/709: rmdir d19/d1d/d25/d31/d32 39 2024-04-26T23:09:22.069 INFO:tasks.workunit.client.0.smithi148.stdout:0/815: creat d0/d20/d3b/f113 x:0 0 0 2024-04-26T23:09:22.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/816: symlink d0/d8/d33/d68/def/dd1/l114 0 2024-04-26T23:09:22.073 INFO:tasks.workunit.client.0.smithi148.stdout:0/817: write d0/d8/d33/d6a/d70/dd6/d9d/db4/fb5 [4315145,97825] 0 2024-04-26T23:09:22.073 INFO:tasks.workunit.client.0.smithi148.stdout:0/818: chown d0/d8/d95/d9f/fb7 7 1 2024-04-26T23:09:22.076 INFO:tasks.workunit.client.0.smithi148.stdout:0/819: creat d0/d2e/d10f/f115 x:0 0 0 2024-04-26T23:09:22.076 INFO:tasks.workunit.client.0.smithi148.stdout:0/820: write d0/d8/d95/d97/d3a/dd2/fd7 [1397247,78664] 0 2024-04-26T23:09:22.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/821: creat d0/d8/f116 x:0 0 0 2024-04-26T23:09:22.081 INFO:tasks.workunit.client.0.smithi148.stdout:0/822: mknod d0/d8/d52/ddd/c117 0 2024-04-26T23:09:22.082 INFO:tasks.workunit.client.0.smithi148.stdout:0/823: creat d0/d8/d33/d6a/f118 x:0 0 0 2024-04-26T23:09:22.084 INFO:tasks.workunit.client.0.smithi148.stdout:4/756: dwrite d12/d1c/d56/d87/d9a/d9d/f90 [0,4194304] 0 2024-04-26T23:09:22.085 INFO:tasks.workunit.client.0.smithi148.stdout:4/757: mkdir d12/d17/d2a/d37/ded 0 2024-04-26T23:09:22.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/758: mknod d12/d17/d2a/cee 0 2024-04-26T23:09:22.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/759: chown d12/c1b 1 1 2024-04-26T23:09:22.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/760: write d12/fdb [980671,19735] 0 2024-04-26T23:09:22.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/761: rmdir d12/d1c/d56 39 2024-04-26T23:09:22.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/762: mknod d12/d17/d2a/d37/d97/cef 0 2024-04-26T23:09:22.095 INFO:tasks.workunit.client.0.smithi148.stdout:4/763: creat d12/d17/d2a/d37/d97/dc1/ff0 x:0 0 0 2024-04-26T23:09:22.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/750: dwrite da/d1b/d2d/f7b [0,4194304] 0 2024-04-26T23:09:22.112 INFO:tasks.workunit.client.0.smithi148.stdout:5/751: mkdir da/d1b/d8b/d110 0 2024-04-26T23:09:22.112 INFO:tasks.workunit.client.0.smithi148.stdout:5/752: chown da/d1b/d3b/d73/ddd/de5 733827123 1 2024-04-26T23:09:22.112 INFO:tasks.workunit.client.0.smithi148.stdout:5/753: creat da/d1b/d3b/d72/f111 x:0 0 0 2024-04-26T23:09:22.113 INFO:tasks.workunit.client.0.smithi148.stdout:5/754: write da/d1b/d1c/d54/f6b [4916164,102037] 0 2024-04-26T23:09:22.118 INFO:tasks.workunit.client.0.smithi148.stdout:5/755: rmdir da/d1b 39 2024-04-26T23:09:22.118 INFO:tasks.workunit.client.0.smithi148.stdout:5/756: getdents da/d1b/d1c/df2 0 2024-04-26T23:09:22.137 INFO:tasks.workunit.client.0.smithi148.stdout:9/710: dwrite d19/d1d/f8b [0,4194304] 0 2024-04-26T23:09:22.163 INFO:tasks.workunit.client.0.smithi148.stdout:0/824: dwrite d0/d8/d95/d97/d3a/dd2/fd5 [0,4194304] 0 2024-04-26T23:09:22.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/682: dwrite d7/d11/d29/d2e/d41/d67/d94/d95/fbe [4194304,4194304] 0 2024-04-26T23:09:22.163 INFO:tasks.workunit.client.0.smithi148.stdout:5/757: dread da/d68/d7a/f8c [0,4194304] 0 2024-04-26T23:09:22.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/700: write d3/d9/d12/d23/f7b [7158751,100813] 0 2024-04-26T23:09:22.164 INFO:tasks.workunit.client.0.smithi148.stdout:5/758: dread - da/d1b/d3b/d73/ddd/de5/ffa zero size 2024-04-26T23:09:22.177 INFO:tasks.workunit.client.0.smithi148.stdout:5/759: rename da/d12/lc1 to da/d1b/d3b/d73/l112 0 2024-04-26T23:09:22.179 INFO:tasks.workunit.client.0.smithi148.stdout:2/779: sync 2024-04-26T23:09:22.182 INFO:tasks.workunit.client.0.smithi148.stdout:5/760: symlink da/d1b/d1c/l113 0 2024-04-26T23:09:22.184 INFO:tasks.workunit.client.0.smithi148.stdout:2/780: creat d5/ffe x:0 0 0 2024-04-26T23:09:22.186 INFO:tasks.workunit.client.0.smithi148.stdout:8/701: write d3/d9/d12/d23/d65/f68 [1569296,24079] 0 2024-04-26T23:09:22.187 INFO:tasks.workunit.client.0.smithi148.stdout:8/702: truncate d3/d9/f49 513191 0 2024-04-26T23:09:22.192 INFO:tasks.workunit.client.0.smithi148.stdout:8/703: write d3/d9/f62 [4268505,24791] 0 2024-04-26T23:09:22.193 INFO:tasks.workunit.client.0.smithi148.stdout:8/704: fdatasync d3/d9/d12/d23/d29/d77/d91/fba 0 2024-04-26T23:09:22.193 INFO:tasks.workunit.client.0.smithi148.stdout:8/705: chown d3/d9/d12/d23/d54 372147843 1 2024-04-26T23:09:22.218 INFO:tasks.workunit.client.0.smithi148.stdout:4/764: dwrite d12/d17/f5d [4194304,4194304] 0 2024-04-26T23:09:22.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/765: creat d12/dbd/ff1 x:0 0 0 2024-04-26T23:09:22.223 INFO:tasks.workunit.client.0.smithi148.stdout:4/766: creat d12/d1c/d56/d87/d9c/da1/ff2 x:0 0 0 2024-04-26T23:09:22.223 INFO:tasks.workunit.client.0.smithi148.stdout:4/767: truncate d12/d17/d2a/d37/f42 796062 0 2024-04-26T23:09:22.224 INFO:tasks.workunit.client.0.smithi148.stdout:8/706: dread d3/da/f18 [0,4194304] 0 2024-04-26T23:09:22.225 INFO:tasks.workunit.client.0.smithi148.stdout:4/768: link d12/d1c/d56/l8a d12/d1c/d45/dc2/lf3 0 2024-04-26T23:09:22.227 INFO:tasks.workunit.client.0.smithi148.stdout:4/769: mkdir d12/d17/d2a/df4 0 2024-04-26T23:09:22.227 INFO:tasks.workunit.client.0.smithi148.stdout:4/770: chown d12/d1c/d56/d87/d9a/f23 3162374 1 2024-04-26T23:09:22.229 INFO:tasks.workunit.client.0.smithi148.stdout:4/771: rename d12/c58 to d12/d1c/cf5 0 2024-04-26T23:09:22.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/825: dwrite d0/d2e/d8f/fed [0,4194304] 0 2024-04-26T23:09:22.231 INFO:tasks.workunit.client.0.smithi148.stdout:2/781: dwrite d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/f9a [0,4194304] 0 2024-04-26T23:09:22.232 INFO:tasks.workunit.client.0.smithi148.stdout:2/782: write d5/d8/d15/d7d/f84 [1519070,51991] 0 2024-04-26T23:09:22.233 INFO:tasks.workunit.client.0.smithi148.stdout:0/826: creat d0/d8/d33/d68/def/f119 x:0 0 0 2024-04-26T23:09:22.235 INFO:tasks.workunit.client.0.smithi148.stdout:0/827: link d0/f2 d0/d20/d3b/f11a 0 2024-04-26T23:09:22.235 INFO:tasks.workunit.client.0.smithi148.stdout:0/828: stat d0/d5/d84/f100 0 2024-04-26T23:09:22.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/829: dwrite d0/d8/fee [0,4194304] 0 2024-04-26T23:09:22.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/830: chown d0/d8/d33/d6a/d70/de5 184 1 2024-04-26T23:09:22.275 INFO:tasks.workunit.client.0.smithi148.stdout:0/831: mknod d0/d8/d33/d6a/d70/c11b 0 2024-04-26T23:09:22.275 INFO:tasks.workunit.client.0.smithi148.stdout:0/832: rename d0 to d0/d5/df7/d102/d11c 22 2024-04-26T23:09:22.276 INFO:tasks.workunit.client.0.smithi148.stdout:0/833: write d0/d8/d95/d97/f10c [618600,66223] 0 2024-04-26T23:09:22.276 INFO:tasks.workunit.client.0.smithi148.stdout:0/834: chown d0/d5/d84 1008654157 1 2024-04-26T23:09:22.276 INFO:tasks.workunit.client.0.smithi148.stdout:0/835: write d0/d2e/d10f/f115 [478030,12843] 0 2024-04-26T23:09:22.277 INFO:tasks.workunit.client.0.smithi148.stdout:0/836: rmdir d0/d8/d95/d97/d3a/dd2 39 2024-04-26T23:09:22.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/837: mknod d0/d8/d33/d43/d4e/c11d 0 2024-04-26T23:09:22.298 INFO:tasks.workunit.client.0.smithi148.stdout:4/772: dwrite d12/d1c/d56/d87/d9c/da1/feb [0,4194304] 0 2024-04-26T23:09:22.299 INFO:tasks.workunit.client.0.smithi148.stdout:2/783: dwrite d5/d8/d9/d3d/fe9 [0,4194304] 0 2024-04-26T23:09:22.304 INFO:tasks.workunit.client.0.smithi148.stdout:4/773: mkdir d12/d1c/d56/d87/d9c/da1/df6 0 2024-04-26T23:09:22.308 INFO:tasks.workunit.client.0.smithi148.stdout:2/784: creat d5/d8/d4b/d4e/d6d/fff x:0 0 0 2024-04-26T23:09:22.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/774: symlink d12/d17/lf7 0 2024-04-26T23:09:22.335 INFO:tasks.workunit.client.0.smithi148.stdout:7/683: dwrite d7/d19/f20 [0,4194304] 0 2024-04-26T23:09:22.340 INFO:tasks.workunit.client.0.smithi148.stdout:7/684: getdents d7/d75/dad 0 2024-04-26T23:09:22.342 INFO:tasks.workunit.client.0.smithi148.stdout:7/685: mkdir d7/d75/de6 0 2024-04-26T23:09:22.345 INFO:tasks.workunit.client.0.smithi148.stdout:7/686: mkdir d7/d11/d29/d2e/dc6/de7 0 2024-04-26T23:09:22.349 INFO:tasks.workunit.client.0.smithi148.stdout:7/687: stat d7/d11/d29/d2e/d41/d67/d94 0 2024-04-26T23:09:22.349 INFO:tasks.workunit.client.0.smithi148.stdout:0/838: dwrite d0/d8/d33/d43/d4e/fe9 [0,4194304] 0 2024-04-26T23:09:22.349 INFO:tasks.workunit.client.0.smithi148.stdout:7/688: dread - d7/d11/d29/d2e/d41/d67/fd9 zero size 2024-04-26T23:09:22.351 INFO:tasks.workunit.client.0.smithi148.stdout:0/839: mknod d0/d5/df7/c11e 0 2024-04-26T23:09:22.351 INFO:tasks.workunit.client.0.smithi148.stdout:0/840: chown d0/d2e/d8f/dd8 19 1 2024-04-26T23:09:22.356 INFO:tasks.workunit.client.0.smithi148.stdout:4/775: dwrite d12/d1c/d45/d8c/f26 [0,4194304] 0 2024-04-26T23:09:22.363 INFO:tasks.workunit.client.0.smithi148.stdout:7/689: read d7/d11/d29/d2e/d41/d67/fb2 [3323301,74323] 0 2024-04-26T23:09:22.377 INFO:tasks.workunit.client.0.smithi148.stdout:4/776: write d12/d1c/d45/fd6 [729344,36940] 0 2024-04-26T23:09:22.377 INFO:tasks.workunit.client.0.smithi148.stdout:4/777: read d12/d1c/d45/d8c/f3c [1374673,96628] 0 2024-04-26T23:09:22.379 INFO:tasks.workunit.client.0.smithi148.stdout:4/778: mkdir d12/dbd/df8 0 2024-04-26T23:09:22.379 INFO:tasks.workunit.client.0.smithi148.stdout:7/690: dread d7/d11/d29/d2e/d41/d67/d94/d95/fbe [0,4194304] 0 2024-04-26T23:09:22.381 INFO:tasks.workunit.client.0.smithi148.stdout:4/779: symlink d12/d1c/d45/dc2/lf9 0 2024-04-26T23:09:22.381 INFO:tasks.workunit.client.0.smithi148.stdout:7/691: stat d7/l3f 0 2024-04-26T23:09:22.382 INFO:tasks.workunit.client.0.smithi148.stdout:4/780: mknod d12/d1c/d45/cfa 0 2024-04-26T23:09:22.383 INFO:tasks.workunit.client.0.smithi148.stdout:7/692: creat d7/d11/d29/d2e/dc6/fe8 x:0 0 0 2024-04-26T23:09:22.383 INFO:tasks.workunit.client.0.smithi148.stdout:7/693: readlink d7/d11/d17/d2f/d44/ld6 0 2024-04-26T23:09:22.400 INFO:tasks.workunit.client.0.smithi148.stdout:0/841: write d0/d8/d33/d6a/d70/dd6/daf/fdb [3549459,27661] 0 2024-04-26T23:09:22.401 INFO:tasks.workunit.client.0.smithi148.stdout:8/707: dwrite d3/f42 [4194304,4194304] 0 2024-04-26T23:09:22.401 INFO:tasks.workunit.client.0.smithi148.stdout:0/842: dread - d0/d8/d33/d6a/d70/dd6/daf/fc3 zero size 2024-04-26T23:09:22.401 INFO:tasks.workunit.client.0.smithi148.stdout:2/785: dwrite d5/d17/d64/d88/fc6 [0,4194304] 0 2024-04-26T23:09:22.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/708: truncate d3/d9/d12/d23/d35/f4e 104611 0 2024-04-26T23:09:22.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/709: fsync d3/d9/d12/d23/d29/fbc 0 2024-04-26T23:09:22.405 INFO:tasks.workunit.client.0.smithi148.stdout:2/786: rename d5/da6 to d5/d8/d4b/d4e/d6d/da0/d100 0 2024-04-26T23:09:22.407 INFO:tasks.workunit.client.0.smithi148.stdout:2/787: creat d5/d8/d15/d43/dd4/f101 x:0 0 0 2024-04-26T23:09:22.409 INFO:tasks.workunit.client.0.smithi148.stdout:8/710: rename d3/da/c5d to d3/d9/d12/d23/d29/d37/db5/cd9 0 2024-04-26T23:09:22.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/788: rename d5/d8/d15/d43/f5f to d5/d97/dfd/f102 0 2024-04-26T23:09:22.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/789: chown d5/d17/d64/f72 60975 1 2024-04-26T23:09:22.419 INFO:tasks.workunit.client.0.smithi148.stdout:7/694: dread d7/f12 [0,4194304] 0 2024-04-26T23:09:22.419 INFO:tasks.workunit.client.0.smithi148.stdout:7/695: dread - d7/d11/fd4 zero size 2024-04-26T23:09:22.423 INFO:tasks.workunit.client.0.smithi148.stdout:9/711: sync 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:6/677: sync 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:5/761: sync 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:3/645: sync 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:3/646: chown d9/c2c 15 1 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:5/762: stat da/d1b/d1c/f22 0 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:1/706: sync 2024-04-26T23:09:22.424 INFO:tasks.workunit.client.0.smithi148.stdout:1/707: chown cf 62 1 2024-04-26T23:09:22.427 INFO:tasks.workunit.client.0.smithi148.stdout:3/647: getdents d9/d4c 0 2024-04-26T23:09:22.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/763: creat da/d1b/d5b/f114 x:0 0 0 2024-04-26T23:09:22.428 INFO:tasks.workunit.client.0.smithi148.stdout:9/712: rename d19/d1d/d25/d31/fde to d19/d1d/d25/d78/db6/dcb/fef 0 2024-04-26T23:09:22.429 INFO:tasks.workunit.client.0.smithi148.stdout:9/713: chown d19/d1d/d25/d2f/d4d/d33/d50/lee 1038701 1 2024-04-26T23:09:22.429 INFO:tasks.workunit.client.0.smithi148.stdout:9/714: write d19/d22/f26 [2130052,96490] 0 2024-04-26T23:09:22.429 INFO:tasks.workunit.client.0.smithi148.stdout:9/715: chown d19/d1d/d25/d2f/f3d 27763 1 2024-04-26T23:09:22.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/716: creat d19/d1d/d25/d31/d73/ddc/ff0 x:0 0 0 2024-04-26T23:09:22.434 INFO:tasks.workunit.client.0.smithi148.stdout:4/781: dwrite d12/d1c/d56/d87/d9a/f6d [0,4194304] 0 2024-04-26T23:09:22.465 INFO:tasks.workunit.client.0.smithi148.stdout:6/678: read d6/d9/fc4 [568765,5170] 0 2024-04-26T23:09:22.477 INFO:tasks.workunit.client.0.smithi148.stdout:6/679: mknod d6/d9/d23/dc1/cd8 0 2024-04-26T23:09:22.477 INFO:tasks.workunit.client.0.smithi148.stdout:6/680: truncate d6/dc/f45 4633175 0 2024-04-26T23:09:22.482 INFO:tasks.workunit.client.0.smithi148.stdout:6/681: rename d6/d9/d1c/f96 to d6/d14/fd9 0 2024-04-26T23:09:22.484 INFO:tasks.workunit.client.0.smithi148.stdout:2/790: dwrite d5/d8/d15/d7d/f84 [0,4194304] 0 2024-04-26T23:09:22.484 INFO:tasks.workunit.client.0.smithi148.stdout:7/696: dwrite d7/d11/d29/d2e/d41/f48 [0,4194304] 0 2024-04-26T23:09:22.486 INFO:tasks.workunit.client.0.smithi148.stdout:4/782: dwrite d12/d17/f7c [0,4194304] 0 2024-04-26T23:09:22.486 INFO:tasks.workunit.client.0.smithi148.stdout:4/783: readlink d12/d1c/l63 0 2024-04-26T23:09:22.488 INFO:tasks.workunit.client.0.smithi148.stdout:6/682: mknod d6/d9/d1c/d5b/cda 0 2024-04-26T23:09:22.489 INFO:tasks.workunit.client.0.smithi148.stdout:1/708: dwrite f15 [0,4194304] 0 2024-04-26T23:09:22.490 INFO:tasks.workunit.client.0.smithi148.stdout:7/697: symlink d7/d11/d29/d2e/d41/le9 0 2024-04-26T23:09:22.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/784: creat d12/d1c/d56/d87/d9c/ffb x:0 0 0 2024-04-26T23:09:22.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/785: truncate d12/d17/d2a/d37/f62 1480872 0 2024-04-26T23:09:22.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/786: chown d12/d1c/d56/d87/d9a/f23 7078 1 2024-04-26T23:09:22.491 INFO:tasks.workunit.client.0.smithi148.stdout:6/683: creat d6/d9/d1e/fdb x:0 0 0 2024-04-26T23:09:22.495 INFO:tasks.workunit.client.0.smithi148.stdout:1/709: dread d16/d45/d2b/d6e/f75 [0,4194304] 0 2024-04-26T23:09:22.496 INFO:tasks.workunit.client.0.smithi148.stdout:1/710: write d16/d85/fb1 [761823,70531] 0 2024-04-26T23:09:22.497 INFO:tasks.workunit.client.0.smithi148.stdout:7/698: creat d7/d75/fea x:0 0 0 2024-04-26T23:09:22.502 INFO:tasks.workunit.client.0.smithi148.stdout:1/711: creat d16/d17/fef x:0 0 0 2024-04-26T23:09:22.502 INFO:tasks.workunit.client.0.smithi148.stdout:2/791: dread d5/d1c/d38/f47 [0,4194304] 0 2024-04-26T23:09:22.503 INFO:tasks.workunit.client.0.smithi148.stdout:2/792: write d5/d8/d4b/f55 [1625427,57566] 0 2024-04-26T23:09:22.503 INFO:tasks.workunit.client.0.smithi148.stdout:7/699: creat d7/d11/d29/d2e/dc6/de7/feb x:0 0 0 2024-04-26T23:09:22.503 INFO:tasks.workunit.client.0.smithi148.stdout:2/793: symlink d5/d8/d15/d7d/l103 0 2024-04-26T23:09:22.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/648: dread d9/d52/f5c [0,4194304] 0 2024-04-26T23:09:22.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/649: dread - d9/d15/d29/d4d/d5b/f7b zero size 2024-04-26T23:09:22.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/650: chown d9/d31/lb7 1873754 1 2024-04-26T23:09:22.509 INFO:tasks.workunit.client.0.smithi148.stdout:7/700: creat d7/d11/d29/d2e/d41/d67/d94/fec x:0 0 0 2024-04-26T23:09:22.515 INFO:tasks.workunit.client.0.smithi148.stdout:6/684: write d6/d32/f62 [5066036,27963] 0 2024-04-26T23:09:22.515 INFO:tasks.workunit.client.0.smithi148.stdout:6/685: readlink d6/d9/d23/d4a/d95/lc7 0 2024-04-26T23:09:22.517 INFO:tasks.workunit.client.0.smithi148.stdout:3/651: rename d9/d4c/ca0 to d9/d52/ccc 0 2024-04-26T23:09:22.517 INFO:tasks.workunit.client.0.smithi148.stdout:3/652: fsync d9/d15/d29/d4d/d5b/fa6 0 2024-04-26T23:09:22.524 INFO:tasks.workunit.client.0.smithi148.stdout:6/686: mkdir d6/dbe/ddc 0 2024-04-26T23:09:22.525 INFO:tasks.workunit.client.0.smithi148.stdout:7/701: dread d7/d11/d29/f53 [0,4194304] 0 2024-04-26T23:09:22.525 INFO:tasks.workunit.client.0.smithi148.stdout:6/687: write d6/d9/d23/d4a/f92 [1202643,104856] 0 2024-04-26T23:09:22.525 INFO:tasks.workunit.client.0.smithi148.stdout:6/688: write d6/d9/d1e/d69/fcf [342996,20435] 0 2024-04-26T23:09:22.525 INFO:tasks.workunit.client.0.smithi148.stdout:7/702: creat d7/d11/d29/d2e/d41/fed x:0 0 0 2024-04-26T23:09:22.526 INFO:tasks.workunit.client.0.smithi148.stdout:6/689: mknod d6/cdd 0 2024-04-26T23:09:22.534 INFO:tasks.workunit.client.0.smithi148.stdout:4/787: dwrite d12/d1c/d56/d87/d9c/da1/ff2 [0,4194304] 0 2024-04-26T23:09:22.535 INFO:tasks.workunit.client.0.smithi148.stdout:6/690: symlink d6/d9/d1c/d1d/lde 0 2024-04-26T23:09:22.535 INFO:tasks.workunit.client.0.smithi148.stdout:7/703: read d7/d75/f1f [151816,17010] 0 2024-04-26T23:09:22.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/788: creat d12/d1c/d45/dc2/dd4/ffc x:0 0 0 2024-04-26T23:09:22.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/789: write d12/d17/f68 [1877739,75475] 0 2024-04-26T23:09:22.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/790: readlink d12/d1c/d56/d87/d9c/da7/lcb 0 2024-04-26T23:09:22.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/791: stat d12/d17/c91 0 2024-04-26T23:09:22.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/691: creat d6/d32/fdf x:0 0 0 2024-04-26T23:09:22.538 INFO:tasks.workunit.client.0.smithi148.stdout:7/704: symlink d7/d11/d17/d2f/lee 0 2024-04-26T23:09:22.538 INFO:tasks.workunit.client.0.smithi148.stdout:7/705: write d7/d11/d17/f86 [619951,121748] 0 2024-04-26T23:09:22.568 INFO:tasks.workunit.client.0.smithi148.stdout:3/653: dwrite d9/d15/d29/f73 [0,4194304] 0 2024-04-26T23:09:22.599 INFO:tasks.workunit.client.0.smithi148.stdout:4/792: dwrite d12/d1c/d45/fd6 [4194304,4194304] 0 2024-04-26T23:09:22.599 INFO:tasks.workunit.client.0.smithi148.stdout:4/793: write d12/d1c/d45/d8c/f3c [178707,130591] 0 2024-04-26T23:09:22.600 INFO:tasks.workunit.client.0.smithi148.stdout:7/706: unlink d7/d11/d17/d2f/lde 0 2024-04-26T23:09:22.602 INFO:tasks.workunit.client.0.smithi148.stdout:4/794: creat d12/d1c/d56/d87/d9c/ffd x:0 0 0 2024-04-26T23:09:22.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/707: rename d7/d19/f2d to d7/d19/fef 0 2024-04-26T23:09:22.605 INFO:tasks.workunit.client.0.smithi148.stdout:4/795: unlink d12/d17/l19 0 2024-04-26T23:09:22.618 INFO:tasks.workunit.client.0.smithi148.stdout:7/708: mkdir d7/d11/d17/d43/df0 0 2024-04-26T23:09:22.618 INFO:tasks.workunit.client.0.smithi148.stdout:7/709: truncate d7/d75/fea 411712 0 2024-04-26T23:09:22.626 INFO:tasks.workunit.client.0.smithi148.stdout:3/654: dwrite d9/d15/d29/d88/fa1 [0,4194304] 0 2024-04-26T23:09:22.632 INFO:tasks.workunit.client.0.smithi148.stdout:6/692: dwrite d6/f6f [0,4194304] 0 2024-04-26T23:09:22.632 INFO:tasks.workunit.client.0.smithi148.stdout:8/711: dwrite d3/f88 [0,4194304] 0 2024-04-26T23:09:22.638 INFO:tasks.workunit.client.0.smithi148.stdout:7/710: truncate d7/d75/fea 248509 0 2024-04-26T23:09:22.640 INFO:tasks.workunit.client.0.smithi148.stdout:4/796: dread d12/d1c/faf [0,4194304] 0 2024-04-26T23:09:22.640 INFO:tasks.workunit.client.0.smithi148.stdout:4/797: fsync d12/d17/f5d 0 2024-04-26T23:09:22.641 INFO:tasks.workunit.client.0.smithi148.stdout:4/798: chown d12/d17/d2a/c4f 0 1 2024-04-26T23:09:22.641 INFO:tasks.workunit.client.0.smithi148.stdout:4/799: write d12/d1c/d56/d87/d9a/d9d/fbc [1517847,31607] 0 2024-04-26T23:09:22.642 INFO:tasks.workunit.client.0.smithi148.stdout:4/800: mknod d12/d17/d2a/d37/d97/dc1/cfe 0 2024-04-26T23:09:22.642 INFO:tasks.workunit.client.0.smithi148.stdout:4/801: chown d12/d17/d2a/le2 959 1 2024-04-26T23:09:22.643 INFO:tasks.workunit.client.0.smithi148.stdout:6/693: write d6/d14/d91/d9f/f78 [575836,102546] 0 2024-04-26T23:09:22.646 INFO:tasks.workunit.client.0.smithi148.stdout:4/802: creat d12/dbd/fff x:0 0 0 2024-04-26T23:09:22.647 INFO:tasks.workunit.client.0.smithi148.stdout:4/803: write d12/d1c/d45/dc2/dd4/ffc [565341,35768] 0 2024-04-26T23:09:22.647 INFO:tasks.workunit.client.0.smithi148.stdout:4/804: chown d12/d1c/d56/d87/d9a/c5e 334091692 1 2024-04-26T23:09:22.647 INFO:tasks.workunit.client.0.smithi148.stdout:4/805: chown d12/d1c/d56/d87/d9a/d9d/f90 83 1 2024-04-26T23:09:22.647 INFO:tasks.workunit.client.0.smithi148.stdout:6/694: symlink d6/d32/d98/le0 0 2024-04-26T23:09:22.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/806: link d12/dbd/ff1 d12/d1c/d56/d87/d9c/da7/f100 0 2024-04-26T23:09:22.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/807: write d12/d1c/d56/d87/d9a/f8d [308171,20839] 0 2024-04-26T23:09:22.653 INFO:tasks.workunit.client.0.smithi148.stdout:6/695: mkdir d6/d32/de1 0 2024-04-26T23:09:22.654 INFO:tasks.workunit.client.0.smithi148.stdout:8/712: dread d3/f42 [4194304,4194304] 0 2024-04-26T23:09:22.655 INFO:tasks.workunit.client.0.smithi148.stdout:8/713: symlink d3/d9/d12/d23/d29/d77/lda 0 2024-04-26T23:09:22.658 INFO:tasks.workunit.client.0.smithi148.stdout:8/714: symlink d3/d9/da0/ldb 0 2024-04-26T23:09:22.660 INFO:tasks.workunit.client.0.smithi148.stdout:8/715: creat d3/d9/d12/d23/d35/d69/fdc x:0 0 0 2024-04-26T23:09:22.660 INFO:tasks.workunit.client.0.smithi148.stdout:8/716: chown d3/d9/l53 12 1 2024-04-26T23:09:22.663 INFO:tasks.workunit.client.0.smithi148.stdout:8/717: truncate d3/d9/fc2 1788476 0 2024-04-26T23:09:22.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/718: creat d3/fdd x:0 0 0 2024-04-26T23:09:22.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/719: chown d3/d9/da0 1 1 2024-04-26T23:09:22.668 INFO:tasks.workunit.client.0.smithi148.stdout:8/720: symlink d3/da/db6/d79/lde 0 2024-04-26T23:09:22.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/721: creat d3/da/d1c/d7c/d8c/d9f/fdf x:0 0 0 2024-04-26T23:09:22.671 INFO:tasks.workunit.client.0.smithi148.stdout:5/764: dread da/d1b/d1c/d7f/fcb [0,4194304] 0 2024-04-26T23:09:22.672 INFO:tasks.workunit.client.0.smithi148.stdout:8/722: stat d3/d9/l1d 0 2024-04-26T23:09:22.673 INFO:tasks.workunit.client.0.smithi148.stdout:8/723: chown d3/d9/d12/d23/dc4 14007058 1 2024-04-26T23:09:22.674 INFO:tasks.workunit.client.0.smithi148.stdout:8/724: mknod d3/da/d1c/ce0 0 2024-04-26T23:09:22.676 INFO:tasks.workunit.client.0.smithi148.stdout:8/725: creat d3/d9/d12/d23/d35/dad/fe1 x:0 0 0 2024-04-26T23:09:22.678 INFO:tasks.workunit.client.0.smithi148.stdout:4/808: dread d12/d17/f5d [0,4194304] 0 2024-04-26T23:09:22.678 INFO:tasks.workunit.client.0.smithi148.stdout:8/726: write d3/d9/fc2 [2144209,7764] 0 2024-04-26T23:09:22.679 INFO:tasks.workunit.client.0.smithi148.stdout:2/794: write d5/d8/d15/d43/d8d/fbb [3013822,64407] 0 2024-04-26T23:09:22.679 INFO:tasks.workunit.client.0.smithi148.stdout:9/717: dwrite d19/f2d [0,4194304] 0 2024-04-26T23:09:22.679 INFO:tasks.workunit.client.0.smithi148.stdout:4/809: symlink d12/d17/d2a/d37/d97/dec/l101 0 2024-04-26T23:09:22.681 INFO:tasks.workunit.client.0.smithi148.stdout:8/727: stat d3/da/d1c/d7c/d8c/d9f/lca 0 2024-04-26T23:09:22.681 INFO:tasks.workunit.client.0.smithi148.stdout:8/728: write d3/da/d1c/d7a/fa9 [514298,26445] 0 2024-04-26T23:09:22.682 INFO:tasks.workunit.client.0.smithi148.stdout:2/795: rmdir d5/d8/db9 39 2024-04-26T23:09:22.686 INFO:tasks.workunit.client.0.smithi148.stdout:3/655: dwrite d9/d15/db1/fbd [0,4194304] 0 2024-04-26T23:09:22.686 INFO:tasks.workunit.client.0.smithi148.stdout:3/656: stat d9/d15/d29/d88/d9f/lc7 0 2024-04-26T23:09:22.691 INFO:tasks.workunit.client.0.smithi148.stdout:5/765: read da/d1a/fbf [3559858,58070] 0 2024-04-26T23:09:22.692 INFO:tasks.workunit.client.0.smithi148.stdout:8/729: rmdir d3/da 39 2024-04-26T23:09:22.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/796: rename d5/d7/d73/cfc to d5/d97/dfd/c104 0 2024-04-26T23:09:22.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/797: stat d5/d8/d11/f44 0 2024-04-26T23:09:22.695 INFO:tasks.workunit.client.0.smithi148.stdout:3/657: mknod d9/d15/d29/ccd 0 2024-04-26T23:09:22.700 INFO:tasks.workunit.client.0.smithi148.stdout:5/766: mknod da/d68/d69/dc9/df6/c115 0 2024-04-26T23:09:22.700 INFO:tasks.workunit.client.0.smithi148.stdout:6/696: dread d6/dc/f42 [0,4194304] 0 2024-04-26T23:09:22.701 INFO:tasks.workunit.client.0.smithi148.stdout:6/697: chown d6/d9/d1c/dbf/db7/dd2 2 1 2024-04-26T23:09:22.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/730: creat d3/d9/d12/d23/d54/fe2 x:0 0 0 2024-04-26T23:09:22.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/731: chown d3/d87/f93 2023 1 2024-04-26T23:09:22.702 INFO:tasks.workunit.client.0.smithi148.stdout:6/698: mkdir d6/d32/d98/de2 0 2024-04-26T23:09:22.702 INFO:tasks.workunit.client.0.smithi148.stdout:6/699: chown d6/d9/d1c/d1d/d1f/l83 29 1 2024-04-26T23:09:22.706 INFO:tasks.workunit.client.0.smithi148.stdout:8/732: mkdir d3/d9/d12/d23/d29/db2/de3 0 2024-04-26T23:09:22.707 INFO:tasks.workunit.client.0.smithi148.stdout:8/733: chown d3/d9/d12/d23/d54/l6c 39 1 2024-04-26T23:09:22.714 INFO:tasks.workunit.client.0.smithi148.stdout:4/810: read d12/d1c/f4b [3968262,43678] 0 2024-04-26T23:09:22.715 INFO:tasks.workunit.client.0.smithi148.stdout:4/811: creat d12/d17/d2a/df4/f102 x:0 0 0 2024-04-26T23:09:22.716 INFO:tasks.workunit.client.0.smithi148.stdout:2/798: dread d5/d8/d15/d43/dd4/fc1 [0,4194304] 0 2024-04-26T23:09:22.716 INFO:tasks.workunit.client.0.smithi148.stdout:4/812: mkdir d12/dbd/d103 0 2024-04-26T23:09:22.716 INFO:tasks.workunit.client.0.smithi148.stdout:2/799: dread - d5/d8/d4b/d4e/d6d/da0/d100/df1/ddc/ffa zero size 2024-04-26T23:09:22.718 INFO:tasks.workunit.client.0.smithi148.stdout:2/800: rename d5/d8/d11/dae/lad to d5/d7/d73/l105 0 2024-04-26T23:09:22.721 INFO:tasks.workunit.client.0.smithi148.stdout:6/700: dread d6/d9/d1c/f5d [0,4194304] 0 2024-04-26T23:09:22.721 INFO:tasks.workunit.client.0.smithi148.stdout:6/701: write d6/d14/d91/d9f/f85 [900884,69636] 0 2024-04-26T23:09:22.723 INFO:tasks.workunit.client.0.smithi148.stdout:5/767: dread da/d1b/d1c/f66 [0,4194304] 0 2024-04-26T23:09:22.723 INFO:tasks.workunit.client.0.smithi148.stdout:5/768: write da/d12/d78/fd3 [96537,22736] 0 2024-04-26T23:09:22.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/769: write da/d70/f77 [290138,53631] 0 2024-04-26T23:09:22.739 INFO:tasks.workunit.client.0.smithi148.stdout:9/718: dwrite d19/d39/f59 [0,4194304] 0 2024-04-26T23:09:22.740 INFO:tasks.workunit.client.0.smithi148.stdout:9/719: read d19/d22/f9c [477752,102586] 0 2024-04-26T23:09:22.740 INFO:tasks.workunit.client.0.smithi148.stdout:9/720: symlink d19/d1d/d69/lf1 0 2024-04-26T23:09:22.741 INFO:tasks.workunit.client.0.smithi148.stdout:9/721: symlink d19/d4b/dc4/lf2 0 2024-04-26T23:09:22.742 INFO:tasks.workunit.client.0.smithi148.stdout:9/722: getdents d19/d1d/d25/d78/db6 0 2024-04-26T23:09:22.743 INFO:tasks.workunit.client.0.smithi148.stdout:9/723: mkdir d19/d1d/d25/d31/d32/df3 0 2024-04-26T23:09:22.744 INFO:tasks.workunit.client.0.smithi148.stdout:9/724: creat d19/d9f/dbb/ff4 x:0 0 0 2024-04-26T23:09:22.769 INFO:tasks.workunit.client.0.smithi148.stdout:8/734: dread d3/d9/d12/d23/f7b [4194304,4194304] 0 2024-04-26T23:09:22.769 INFO:tasks.workunit.client.0.smithi148.stdout:6/702: dwrite d6/d9/d23/f57 [4194304,4194304] 0 2024-04-26T23:09:22.769 INFO:tasks.workunit.client.0.smithi148.stdout:6/703: chown d6/d9/d1c/d1d/d1f/l83 210489381 1 2024-04-26T23:09:22.769 INFO:tasks.workunit.client.0.smithi148.stdout:6/704: write d6/d32/d98/fb0 [415134,130214] 0 2024-04-26T23:09:22.775 INFO:tasks.workunit.client.0.smithi148.stdout:8/735: creat d3/da/db6/fe4 x:0 0 0 2024-04-26T23:09:22.775 INFO:tasks.workunit.client.0.smithi148.stdout:8/736: write d3/d9a/f9d [4926078,99188] 0 2024-04-26T23:09:22.777 INFO:tasks.workunit.client.0.smithi148.stdout:6/705: mkdir d6/d9/d1c/d1d/de3 0 2024-04-26T23:09:22.777 INFO:tasks.workunit.client.0.smithi148.stdout:6/706: chown d6/d9/d23/l48 64159258 1 2024-04-26T23:09:22.779 INFO:tasks.workunit.client.0.smithi148.stdout:8/737: rename d3/d9a/f8d to d3/d9/fe5 0 2024-04-26T23:09:22.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/707: creat d6/d9/d1c/d1d/fe4 x:0 0 0 2024-04-26T23:09:22.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/708: truncate d6/d32/d8a/fcb 215591 0 2024-04-26T23:09:22.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/709: fsync d6/d9/d23/d4a/f92 0 2024-04-26T23:09:22.782 INFO:tasks.workunit.client.0.smithi148.stdout:6/710: stat d6/dc/c3d 0 2024-04-26T23:09:22.782 INFO:tasks.workunit.client.0.smithi148.stdout:0/843: sync 2024-04-26T23:09:22.782 INFO:tasks.workunit.client.0.smithi148.stdout:8/738: creat d3/da/d1c/fe6 x:0 0 0 2024-04-26T23:09:22.783 INFO:tasks.workunit.client.0.smithi148.stdout:6/711: creat d6/fe5 x:0 0 0 2024-04-26T23:09:22.788 INFO:tasks.workunit.client.0.smithi148.stdout:8/739: link d3/d9/d12/d23/d29/d37/f63 d3/d9/da0/fe7 0 2024-04-26T23:09:22.789 INFO:tasks.workunit.client.0.smithi148.stdout:8/740: chown d3/da/ce 10254740 1 2024-04-26T23:09:22.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/844: unlink d0/d20/ca0 0 2024-04-26T23:09:22.790 INFO:tasks.workunit.client.0.smithi148.stdout:8/741: symlink d3/d9/d12/d23/d29/d77/le8 0 2024-04-26T23:09:22.791 INFO:tasks.workunit.client.0.smithi148.stdout:0/845: creat d0/d2e/d8f/d6c/dab/f11f x:0 0 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/742: mkdir d3/d9/d12/d23/d35/de9 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/743: readlink d3/d9a/ld7 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/744: fdatasync d3/d9/d12/d23/d54/fb8 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/745: truncate d3/d9/d12/d23/d65/fac 12912 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/746: readlink d3/d87/l8b 0 2024-04-26T23:09:22.792 INFO:tasks.workunit.client.0.smithi148.stdout:0/846: creat d0/d8/d33/d68/def/dd1/f120 x:0 0 0 2024-04-26T23:09:22.793 INFO:tasks.workunit.client.0.smithi148.stdout:8/747: mknod d3/da/d1c/d7c/d8c/d9f/cea 0 2024-04-26T23:09:22.793 INFO:tasks.workunit.client.0.smithi148.stdout:8/748: write d3/da/d1c/d7c/d8c/f92 [610666,1800] 0 2024-04-26T23:09:22.793 INFO:tasks.workunit.client.0.smithi148.stdout:0/847: symlink d0/d5/df7/d102/l121 0 2024-04-26T23:09:22.794 INFO:tasks.workunit.client.0.smithi148.stdout:0/848: chown d0/d5/dd4 6 1 2024-04-26T23:09:22.794 INFO:tasks.workunit.client.0.smithi148.stdout:2/801: dread d5/d8/d9/f2a [0,4194304] 0 2024-04-26T23:09:22.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/749: mkdir d3/d9/d12/d23/d29/d77/deb 0 2024-04-26T23:09:22.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/750: write d3/d9/d12/d23/d35/f4e [331246,17153] 0 2024-04-26T23:09:22.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/751: fdatasync d3/d9/d12/d23/d29/d37/f3e 0 2024-04-26T23:09:22.796 INFO:tasks.workunit.client.0.smithi148.stdout:0/849: creat d0/d8/d95/d97/d3a/f122 x:0 0 0 2024-04-26T23:09:22.796 INFO:tasks.workunit.client.0.smithi148.stdout:0/850: readlink d0/d8/d95/d97/d3a/l92 0 2024-04-26T23:09:22.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/851: fdatasync d0/d2e/d10f/f115 0 2024-04-26T23:09:22.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/852: dread - d0/d8/d33/f45 zero size 2024-04-26T23:09:22.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/853: chown d0/d20/d54/c7d 18604 1 2024-04-26T23:09:22.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/854: chown d0/d5/df7/d102 864958 1 2024-04-26T23:09:22.798 INFO:tasks.workunit.client.0.smithi148.stdout:0/855: mknod d0/d8/d33/c123 0 2024-04-26T23:09:22.798 INFO:tasks.workunit.client.0.smithi148.stdout:0/856: chown d0/d8/d33/d6a/d70/dd6/d9d/db4/le7 2031779457 1 2024-04-26T23:09:22.801 INFO:tasks.workunit.client.0.smithi148.stdout:0/857: mkdir d0/d2e/d8f/dd8/d124 0 2024-04-26T23:09:22.802 INFO:tasks.workunit.client.0.smithi148.stdout:0/858: getdents d0/d2e/d8f/d6c 0 2024-04-26T23:09:22.804 INFO:tasks.workunit.client.0.smithi148.stdout:0/859: creat d0/d8/d33/d6a/d70/dd6/f125 x:0 0 0 2024-04-26T23:09:22.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/860: unlink d0/d2e/d10f/f115 0 2024-04-26T23:09:22.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/861: dread - d0/d8/d33/d6a/f118 zero size 2024-04-26T23:09:22.808 INFO:tasks.workunit.client.0.smithi148.stdout:0/862: mknod d0/d8/d33/d6a/d70/dd6/d9d/db4/c126 0 2024-04-26T23:09:22.810 INFO:tasks.workunit.client.0.smithi148.stdout:8/752: dread d3/da/d1c/d7c/d8c/d9f/f20 [4194304,4194304] 0 2024-04-26T23:09:22.812 INFO:tasks.workunit.client.0.smithi148.stdout:8/753: creat d3/d9/d12/fec x:0 0 0 2024-04-26T23:09:22.820 INFO:tasks.workunit.client.0.smithi148.stdout:8/754: dread d3/d9/d12/d23/d35/f90 [0,4194304] 0 2024-04-26T23:09:22.821 INFO:tasks.workunit.client.0.smithi148.stdout:6/712: dwrite d6/dc/f42 [4194304,4194304] 0 2024-04-26T23:09:22.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/813: dwrite d12/d1c/d56/d87/d9a/f76 [0,4194304] 0 2024-04-26T23:09:22.850 INFO:tasks.workunit.client.0.smithi148.stdout:8/755: dwrite d3/d9/d12/d23/d29/d77/d91/fba [4194304,4194304] 0 2024-04-26T23:09:22.862 INFO:tasks.workunit.client.0.smithi148.stdout:8/756: mknod d3/da/d1c/d7c/d8c/d9f/ced 0 2024-04-26T23:09:22.873 INFO:tasks.workunit.client.0.smithi148.stdout:8/757: dread d3/da/d1c/d7c/d8c/f92 [0,4194304] 0 2024-04-26T23:09:22.902 INFO:tasks.workunit.client.0.smithi148.stdout:5/770: dwrite da/f5c [0,4194304] 0 2024-04-26T23:09:22.902 INFO:tasks.workunit.client.0.smithi148.stdout:2/802: dwrite d5/d8/d4b/d4e/d6d/da0/d100/fe3 [0,4194304] 0 2024-04-26T23:09:22.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/863: dread d0/d8/d33/d6a/d70/dd6/d9d/fdf [0,4194304] 0 2024-04-26T23:09:22.903 INFO:tasks.workunit.client.0.smithi148.stdout:0/864: chown d0/d8/d33/d6a/d70/dd6/d9d/cd0 2176 1 2024-04-26T23:09:22.906 INFO:tasks.workunit.client.0.smithi148.stdout:2/803: mkdir d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/d106 0 2024-04-26T23:09:22.906 INFO:tasks.workunit.client.0.smithi148.stdout:2/804: readlink d5/d1c/l66 0 2024-04-26T23:09:22.907 INFO:tasks.workunit.client.0.smithi148.stdout:0/865: link d0/d5/d84/le8 d0/d8/d33/d43/l127 0 2024-04-26T23:09:22.908 INFO:tasks.workunit.client.0.smithi148.stdout:2/805: creat d5/d97/dfd/f107 x:0 0 0 2024-04-26T23:09:22.908 INFO:tasks.workunit.client.0.smithi148.stdout:5/771: dread da/d1f/f26 [0,4194304] 0 2024-04-26T23:09:22.909 INFO:tasks.workunit.client.0.smithi148.stdout:0/866: rename d0/d2e/d8f/d6c/dab/lbc to d0/d8/d33/d68/def/l128 0 2024-04-26T23:09:22.909 INFO:tasks.workunit.client.0.smithi148.stdout:0/867: fsync d0/d20/d54/fb9 0 2024-04-26T23:09:22.909 INFO:tasks.workunit.client.0.smithi148.stdout:2/806: creat d5/d8/db9/f108 x:0 0 0 2024-04-26T23:09:22.910 INFO:tasks.workunit.client.0.smithi148.stdout:5/772: creat da/d1b/d1c/d7f/d90/f116 x:0 0 0 2024-04-26T23:09:22.911 INFO:tasks.workunit.client.0.smithi148.stdout:2/807: truncate d5/d7/f20 2850921 0 2024-04-26T23:09:22.912 INFO:tasks.workunit.client.0.smithi148.stdout:5/773: unlink da/d1f/f108 0 2024-04-26T23:09:22.914 INFO:tasks.workunit.client.0.smithi148.stdout:2/808: rename d5/d8/d11/dae/f6e to d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/f109 0 2024-04-26T23:09:22.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/774: rename da/d1b/d3b/d72 to da/d1b/d5b/d117 0 2024-04-26T23:09:22.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/775: chown da/d1f/d67 27003 1 2024-04-26T23:09:22.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/776: write da/d1b/d1c/d54/f74 [515673,121494] 0 2024-04-26T23:09:22.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/777: fdatasync da/d70/f77 0 2024-04-26T23:09:22.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/778: fdatasync da/d68/d7a/f106 0 2024-04-26T23:09:22.921 INFO:tasks.workunit.client.0.smithi148.stdout:5/779: symlink da/d1b/d3b/d73/ddd/de5/l118 0 2024-04-26T23:09:22.923 INFO:tasks.workunit.client.0.smithi148.stdout:5/780: symlink da/d12/d105/l119 0 2024-04-26T23:09:22.923 INFO:tasks.workunit.client.0.smithi148.stdout:5/781: chown da/d1f/d67/d71/l7e 34307819 1 2024-04-26T23:09:22.924 INFO:tasks.workunit.client.0.smithi148.stdout:6/713: dwrite d6/d9/d1e/f5f [0,4194304] 0 2024-04-26T23:09:22.928 INFO:tasks.workunit.client.0.smithi148.stdout:5/782: creat da/d1b/f11a x:0 0 0 2024-04-26T23:09:22.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/783: mkdir da/d68/d69/daa/dc0/d11b 0 2024-04-26T23:09:22.932 INFO:tasks.workunit.client.0.smithi148.stdout:2/809: write d5/d8/d11/f62 [3012786,20897] 0 2024-04-26T23:09:22.932 INFO:tasks.workunit.client.0.smithi148.stdout:5/784: mkdir da/d1b/d2d/da8/d11c 0 2024-04-26T23:09:22.932 INFO:tasks.workunit.client.0.smithi148.stdout:8/758: dwrite d3/d9/d12/d23/d35/f94 [0,4194304] 0 2024-04-26T23:09:22.935 INFO:tasks.workunit.client.0.smithi148.stdout:2/810: creat d5/d8/dc8/f10a x:0 0 0 2024-04-26T23:09:22.935 INFO:tasks.workunit.client.0.smithi148.stdout:2/811: truncate d5/d17/d64/d88/fe2 253981 0 2024-04-26T23:09:22.936 INFO:tasks.workunit.client.0.smithi148.stdout:2/812: stat d5/d10/c1f 0 2024-04-26T23:09:22.936 INFO:tasks.workunit.client.0.smithi148.stdout:5/785: unlink da/d68/d69/dc9/f10b 0 2024-04-26T23:09:22.938 INFO:tasks.workunit.client.0.smithi148.stdout:8/759: unlink d3/da/d1c/l9b 0 2024-04-26T23:09:22.940 INFO:tasks.workunit.client.0.smithi148.stdout:8/760: write d3/da/d1c/d7a/f98 [46796,99784] 0 2024-04-26T23:09:22.940 INFO:tasks.workunit.client.0.smithi148.stdout:8/761: stat d3/d9/d12/d23/d54/fb8 0 2024-04-26T23:09:22.940 INFO:tasks.workunit.client.0.smithi148.stdout:2/813: creat d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/d106/f10b x:0 0 0 2024-04-26T23:09:22.941 INFO:tasks.workunit.client.0.smithi148.stdout:4/814: dwrite d12/d17/d2a/d37/f64 [4194304,4194304] 0 2024-04-26T23:09:22.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/762: rename d3/d9/d12/f21 to d3/da/d1c/d7c/d8c/d9f/fee 0 2024-04-26T23:09:22.950 INFO:tasks.workunit.client.0.smithi148.stdout:4/815: creat d12/d1c/d56/d87/f104 x:0 0 0 2024-04-26T23:09:22.951 INFO:tasks.workunit.client.0.smithi148.stdout:2/814: dread d5/d97/dfd/f102 [0,4194304] 0 2024-04-26T23:09:22.956 INFO:tasks.workunit.client.0.smithi148.stdout:8/763: symlink d3/d9/lef 0 2024-04-26T23:09:22.958 INFO:tasks.workunit.client.0.smithi148.stdout:8/764: mkdir d3/da/d1c/d7a/df0 0 2024-04-26T23:09:22.959 INFO:tasks.workunit.client.0.smithi148.stdout:8/765: mknod d3/d9/d12/d23/d54/cf1 0 2024-04-26T23:09:22.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/766: symlink d3/d9a/dcd/lf2 0 2024-04-26T23:09:22.961 INFO:tasks.workunit.client.0.smithi148.stdout:8/767: chown d3/da/d1c/c6b 51894061 1 2024-04-26T23:09:22.962 INFO:tasks.workunit.client.0.smithi148.stdout:8/768: unlink d3/da/f74 0 2024-04-26T23:09:22.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/769: rmdir d3/d9/d12/d23/d29/d77/d91 39 2024-04-26T23:09:22.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/770: chown d3/d9/d12/d23/dc4 2114 1 2024-04-26T23:09:22.964 INFO:tasks.workunit.client.0.smithi148.stdout:1/712: sync 2024-04-26T23:09:22.965 INFO:tasks.workunit.client.0.smithi148.stdout:8/771: creat d3/d9/d12/d23/d35/ff3 x:0 0 0 2024-04-26T23:09:22.967 INFO:tasks.workunit.client.0.smithi148.stdout:1/713: link f15 d16/d17/d4b/d4d/ff0 0 2024-04-26T23:09:22.967 INFO:tasks.workunit.client.0.smithi148.stdout:8/772: rmdir d3/d87 39 2024-04-26T23:09:22.967 INFO:tasks.workunit.client.0.smithi148.stdout:8/773: write d3/d9/d12/d95/fcc [169472,42533] 0 2024-04-26T23:09:22.967 INFO:tasks.workunit.client.0.smithi148.stdout:1/714: mkdir d16/d17/daf/dbd/df1 0 2024-04-26T23:09:22.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/774: rmdir d3/d9/d12/d23/d35/d69 39 2024-04-26T23:09:22.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/775: dread - d3/da/d1c/d7c/fbe zero size 2024-04-26T23:09:22.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/776: readlink d3/d9/d12/d23/d65/laa 0 2024-04-26T23:09:22.969 INFO:tasks.workunit.client.0.smithi148.stdout:1/715: link l0 d16/d45/d2b/lf2 0 2024-04-26T23:09:22.969 INFO:tasks.workunit.client.0.smithi148.stdout:8/777: mknod d3/d9/d12/d23/d29/d37/d5e/cf4 0 2024-04-26T23:09:22.970 INFO:tasks.workunit.client.0.smithi148.stdout:1/716: mkdir d16/d47/d49/df3 0 2024-04-26T23:09:22.981 INFO:tasks.workunit.client.0.smithi148.stdout:5/786: write da/d68/d69/f89 [277386,39917] 0 2024-04-26T23:09:22.986 INFO:tasks.workunit.client.0.smithi148.stdout:5/787: creat da/d1b/d1c/f11d x:0 0 0 2024-04-26T23:09:22.986 INFO:tasks.workunit.client.0.smithi148.stdout:5/788: fdatasync da/d1b/d1c/f22 0 2024-04-26T23:09:22.986 INFO:tasks.workunit.client.0.smithi148.stdout:5/789: write da/d1b/d2d/d82/f103 [560412,66642] 0 2024-04-26T23:09:22.987 INFO:tasks.workunit.client.0.smithi148.stdout:5/790: creat da/d1b/d8b/d110/f11e x:0 0 0 2024-04-26T23:09:22.989 INFO:tasks.workunit.client.0.smithi148.stdout:0/868: dread d0/d8/d95/d97/d3a/fa2 [0,4194304] 0 2024-04-26T23:09:22.992 INFO:tasks.workunit.client.0.smithi148.stdout:2/815: write d5/d8/d9/d3d/fe9 [282942,108090] 0 2024-04-26T23:09:22.994 INFO:tasks.workunit.client.0.smithi148.stdout:4/816: dwrite d12/d1c/d45/d8c/f46 [0,4194304] 0 2024-04-26T23:09:22.994 INFO:tasks.workunit.client.0.smithi148.stdout:2/816: creat d5/d8/d4b/d4e/d6d/da0/d78/df3/f10c x:0 0 0 2024-04-26T23:09:22.997 INFO:tasks.workunit.client.0.smithi148.stdout:2/817: unlink d5/d1c/l66 0 2024-04-26T23:09:22.998 INFO:tasks.workunit.client.0.smithi148.stdout:2/818: link d5/d97/dfd/f102 d5/d7/f10d 0 2024-04-26T23:09:23.018 INFO:tasks.workunit.client.0.smithi148.stdout:8/778: dwrite d3/d9/d12/d23/d35/fd6 [0,4194304] 0 2024-04-26T23:09:23.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/869: dread d0/d5/f7 [0,4194304] 0 2024-04-26T23:09:23.048 INFO:tasks.workunit.client.0.smithi148.stdout:1/717: dwrite d16/d17/daf/fe9 [0,4194304] 0 2024-04-26T23:09:23.048 INFO:tasks.workunit.client.0.smithi148.stdout:1/718: chown f10 56 1 2024-04-26T23:09:23.094 INFO:tasks.workunit.client.0.smithi148.stdout:2/819: dwrite d5/d8/d4b/d4e/d6d/da0/d32/d4c/f9b [0,4194304] 0 2024-04-26T23:09:23.098 INFO:tasks.workunit.client.0.smithi148.stdout:1/719: dwrite d16/d1c/f57 [0,4194304] 0 2024-04-26T23:09:23.138 INFO:tasks.workunit.client.0.smithi148.stdout:4/817: dwrite d12/d1c/d56/d87/d9a/f8d [0,4194304] 0 2024-04-26T23:09:23.159 INFO:tasks.workunit.client.0.smithi148.stdout:0/870: dwrite d0/d8/d52/f1f [0,4194304] 0 2024-04-26T23:09:23.180 INFO:tasks.workunit.client.0.smithi148.stdout:4/818: dwrite d12/d1c/d56/d87/f96 [0,4194304] 0 2024-04-26T23:09:23.180 INFO:tasks.workunit.client.0.smithi148.stdout:4/819: fsync d12/d1c/d56/d87/d9c/da7/f100 0 2024-04-26T23:09:23.181 INFO:tasks.workunit.client.0.smithi148.stdout:8/779: dwrite d3/d9a/fa8 [0,4194304] 0 2024-04-26T23:09:23.305 INFO:tasks.workunit.client.0.smithi148.stdout:2/820: mknod d5/d97/dfd/c10e 0 2024-04-26T23:09:23.305 INFO:tasks.workunit.client.0.smithi148.stdout:2/821: readlink d5/d10/le1 0 2024-04-26T23:09:23.307 INFO:tasks.workunit.client.0.smithi148.stdout:1/720: mknod d16/d17/daf/cf4 0 2024-04-26T23:09:23.309 INFO:tasks.workunit.client.0.smithi148.stdout:2/822: dread d5/d17/d64/f6b [0,4194304] 0 2024-04-26T23:09:23.313 INFO:tasks.workunit.client.0.smithi148.stdout:0/871: creat d0/d5/f129 x:0 0 0 2024-04-26T23:09:23.319 INFO:tasks.workunit.client.0.smithi148.stdout:4/820: rmdir d12/d17/d2a 39 2024-04-26T23:09:23.324 INFO:tasks.workunit.client.0.smithi148.stdout:0/872: write d0/d8/d33/d6a/f6e [807480,102425] 0 2024-04-26T23:09:23.335 INFO:tasks.workunit.client.0.smithi148.stdout:9/725: sync 2024-04-26T23:09:23.335 INFO:tasks.workunit.client.0.smithi148.stdout:7/711: sync 2024-04-26T23:09:23.335 INFO:tasks.workunit.client.0.smithi148.stdout:3/658: sync 2024-04-26T23:09:23.335 INFO:tasks.workunit.client.0.smithi148.stdout:5/791: sync 2024-04-26T23:09:23.336 INFO:tasks.workunit.client.0.smithi148.stdout:6/714: sync 2024-04-26T23:09:23.336 INFO:tasks.workunit.client.0.smithi148.stdout:6/715: truncate d6/faa 652456 0 2024-04-26T23:09:23.336 INFO:tasks.workunit.client.0.smithi148.stdout:6/716: write d6/d32/d8a/f97 [194565,16067] 0 2024-04-26T23:09:23.336 INFO:tasks.workunit.client.0.smithi148.stdout:7/712: write d7/d75/f8e [5206956,78015] 0 2024-04-26T23:09:23.338 INFO:tasks.workunit.client.0.smithi148.stdout:8/780: creat d3/d9/d12/d23/d54/ff5 x:0 0 0 2024-04-26T23:09:23.341 INFO:tasks.workunit.client.0.smithi148.stdout:1/721: mkdir d16/d47/d73/df5 0 2024-04-26T23:09:23.342 INFO:tasks.workunit.client.0.smithi148.stdout:4/821: dread d12/f4a [0,4194304] 0 2024-04-26T23:09:23.344 INFO:tasks.workunit.client.0.smithi148.stdout:2/823: creat d5/d7/d73/f10f x:0 0 0 2024-04-26T23:09:23.344 INFO:tasks.workunit.client.0.smithi148.stdout:2/824: fsync d5/d8/d15/d43/fa9 0 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/825: readlink d5/d8/d9/lf 0 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/826: dread - d5/d8/d4b/d4e/d6d/da0/d100/df1/ddc/ffa zero size 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/827: dread - d5/d1c/d38/f6f zero size 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/828: chown d5/ffe 109503504 1 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/829: write d5/d8/d4b/d4e/d6d/da0/d32/f80 [827507,1713] 0 2024-04-26T23:09:23.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/830: write d5/ffe [635504,105619] 0 2024-04-26T23:09:23.348 INFO:tasks.workunit.client.0.smithi148.stdout:0/873: rename d0/d8/d33/d6a/l91 to d0/d8/d33/d6a/d70/l12a 0 2024-04-26T23:09:23.349 INFO:tasks.workunit.client.0.smithi148.stdout:0/874: chown d0/d5 1184852 1 2024-04-26T23:09:23.352 INFO:tasks.workunit.client.0.smithi148.stdout:3/659: truncate d9/d15/f25 78574 0 2024-04-26T23:09:23.357 INFO:tasks.workunit.client.0.smithi148.stdout:9/726: link d19/d1d/d25/d2f/d4d/c67 d19/d1d/d25/d31/d60/cf5 0 2024-04-26T23:09:23.358 INFO:tasks.workunit.client.0.smithi148.stdout:9/727: write d19/d22/f26 [2662122,51452] 0 2024-04-26T23:09:23.358 INFO:tasks.workunit.client.0.smithi148.stdout:9/728: write d19/d9f/faf [661304,112954] 0 2024-04-26T23:09:23.362 INFO:tasks.workunit.client.0.smithi148.stdout:5/792: creat da/d1b/d3b/d73/ddd/f11f x:0 0 0 2024-04-26T23:09:23.363 INFO:tasks.workunit.client.0.smithi148.stdout:0/875: write d0/d8/d33/d43/d4e/fbe [965152,15522] 0 2024-04-26T23:09:23.364 INFO:tasks.workunit.client.0.smithi148.stdout:6/717: symlink d6/d32/d98/de2/le6 0 2024-04-26T23:09:23.366 INFO:tasks.workunit.client.0.smithi148.stdout:7/713: creat d7/d11/d17/d2f/ff1 x:0 0 0 2024-04-26T23:09:23.380 INFO:tasks.workunit.client.0.smithi148.stdout:1/722: unlink d16/d1c/d84/da7/lbe 0 2024-04-26T23:09:23.381 INFO:tasks.workunit.client.0.smithi148.stdout:8/781: creat d3/d9a/dcd/ff6 x:0 0 0 2024-04-26T23:09:23.381 INFO:tasks.workunit.client.0.smithi148.stdout:4/822: creat d12/d1c/d45/d8c/f105 x:0 0 0 2024-04-26T23:09:23.381 INFO:tasks.workunit.client.0.smithi148.stdout:3/660: creat d9/d15/d29/d4d/d9a/fce x:0 0 0 2024-04-26T23:09:23.381 INFO:tasks.workunit.client.0.smithi148.stdout:4/823: chown d12/d1c/d56/d87/d9c/da1/da9/cc4 502384 1 2024-04-26T23:09:23.382 INFO:tasks.workunit.client.0.smithi148.stdout:5/793: creat da/f120 x:0 0 0 2024-04-26T23:09:23.383 INFO:tasks.workunit.client.0.smithi148.stdout:5/794: readlink da/d70/ld0 0 2024-04-26T23:09:23.410 INFO:tasks.workunit.client.0.smithi148.stdout:5/795: write da/d1b/d1c/ff1 [798412,124917] 0 2024-04-26T23:09:23.410 INFO:tasks.workunit.client.0.smithi148.stdout:8/782: mkdir d3/d9/d12/d23/d54/d60/df7 0 2024-04-26T23:09:23.410 INFO:tasks.workunit.client.0.smithi148.stdout:6/718: link d6/f33 d6/d9/d1c/dbf/fe7 0 2024-04-26T23:09:23.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/719: write d6/d9/f52 [568895,79306] 0 2024-04-26T23:09:23.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/824: mknod d12/d1c/dc8/c106 0 2024-04-26T23:09:23.416 INFO:tasks.workunit.client.0.smithi148.stdout:8/783: mkdir d3/d9/d12/d23/d65/df8 0 2024-04-26T23:09:23.416 INFO:tasks.workunit.client.0.smithi148.stdout:6/720: mknod d6/d9/d23/dc1/ce8 0 2024-04-26T23:09:23.416 INFO:tasks.workunit.client.0.smithi148.stdout:8/784: chown d3/d9/d12/d23/d29/d37/f3e 257193795 1 2024-04-26T23:09:23.416 INFO:tasks.workunit.client.0.smithi148.stdout:6/721: dread - d6/d9/d1c/d1d/fa0 zero size 2024-04-26T23:09:23.419 INFO:tasks.workunit.client.0.smithi148.stdout:6/722: creat d6/d32/d8a/fe9 x:0 0 0 2024-04-26T23:09:23.420 INFO:tasks.workunit.client.0.smithi148.stdout:6/723: write d6/f33 [634189,84804] 0 2024-04-26T23:09:23.436 INFO:tasks.workunit.client.0.smithi148.stdout:6/724: rename d6/f43 to d6/d9/d1c/d1d/de3/fea 0 2024-04-26T23:09:23.436 INFO:tasks.workunit.client.0.smithi148.stdout:1/723: dread d16/d17/d4b/f72 [0,4194304] 0 2024-04-26T23:09:23.445 INFO:tasks.workunit.client.0.smithi148.stdout:5/796: dread f3 [0,4194304] 0 2024-04-26T23:09:23.446 INFO:tasks.workunit.client.0.smithi148.stdout:5/797: chown da/d1b/d5b/d5e 64091221 1 2024-04-26T23:09:23.446 INFO:tasks.workunit.client.0.smithi148.stdout:5/798: chown da/d12 0 1 2024-04-26T23:09:23.448 INFO:tasks.workunit.client.0.smithi148.stdout:2/831: dwrite d5/d1c/d38/fec [0,4194304] 0 2024-04-26T23:09:23.448 INFO:tasks.workunit.client.0.smithi148.stdout:2/832: chown d5/d97/fd6 152358 1 2024-04-26T23:09:23.449 INFO:tasks.workunit.client.0.smithi148.stdout:5/799: unlink da/d1f/d67/la1 0 2024-04-26T23:09:23.449 INFO:tasks.workunit.client.0.smithi148.stdout:5/800: chown da/d1b/d3b/d73/ddd/de5/ffa 240082 1 2024-04-26T23:09:23.457 INFO:tasks.workunit.client.0.smithi148.stdout:5/801: mknod da/d1a/c121 0 2024-04-26T23:09:23.462 INFO:tasks.workunit.client.0.smithi148.stdout:1/724: read d16/d45/f35 [1863251,50802] 0 2024-04-26T23:09:23.462 INFO:tasks.workunit.client.0.smithi148.stdout:1/725: chown d16/d17/d4b/d53/d67/fcc 123408 1 2024-04-26T23:09:23.470 INFO:tasks.workunit.client.0.smithi148.stdout:2/833: dread d5/d8/d15/d43/fa9 [0,4194304] 0 2024-04-26T23:09:23.471 INFO:tasks.workunit.client.0.smithi148.stdout:2/834: chown d5/d8/d15/d7d/l103 9770360 1 2024-04-26T23:09:23.471 INFO:tasks.workunit.client.0.smithi148.stdout:2/835: chown d5/d8/d4b 27521557 1 2024-04-26T23:09:23.479 INFO:tasks.workunit.client.0.smithi148.stdout:2/836: rename d5/d8/d15/cda to d5/d8/d15/d7d/c110 0 2024-04-26T23:09:23.481 INFO:tasks.workunit.client.0.smithi148.stdout:9/729: dwrite d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:23.481 INFO:tasks.workunit.client.0.smithi148.stdout:9/730: chown d19/d1d/d25/d2f/d4d/d33/d50/dd9 62 1 2024-04-26T23:09:23.483 INFO:tasks.workunit.client.0.smithi148.stdout:2/837: getdents d5/d8/d15/d43 0 2024-04-26T23:09:23.483 INFO:tasks.workunit.client.0.smithi148.stdout:2/838: write d5/d8/d15/d43/d8d/fbd [748188,124056] 0 2024-04-26T23:09:23.484 INFO:tasks.workunit.client.0.smithi148.stdout:2/839: write d5/d8/d9/fc [1860831,58671] 0 2024-04-26T23:09:23.487 INFO:tasks.workunit.client.0.smithi148.stdout:9/731: creat d19/d1d/d25/d78/db6/dcb/ff6 x:0 0 0 2024-04-26T23:09:23.490 INFO:tasks.workunit.client.0.smithi148.stdout:2/840: stat d5/d7/d73/l105 0 2024-04-26T23:09:23.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/732: mknod d19/d1d/cf7 0 2024-04-26T23:09:23.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/733: read - d19/d1d/d69/fc2 zero size 2024-04-26T23:09:23.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/734: chown d19/d1d/d25/d31/d32/f91 510 1 2024-04-26T23:09:23.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/735: chown d19/d1d/d25/d31/d73/c84 74109742 1 2024-04-26T23:09:23.498 INFO:tasks.workunit.client.0.smithi148.stdout:2/841: unlink d5/d8/d15/d7d/l91 0 2024-04-26T23:09:23.504 INFO:tasks.workunit.client.0.smithi148.stdout:0/876: dwrite d0/d8/fad [0,4194304] 0 2024-04-26T23:09:23.512 INFO:tasks.workunit.client.0.smithi148.stdout:0/877: mknod d0/d2e/d8f/dd8/c12b 0 2024-04-26T23:09:23.512 INFO:tasks.workunit.client.0.smithi148.stdout:2/842: dread d5/d8/d9/d3d/fe8 [0,4194304] 0 2024-04-26T23:09:23.524 INFO:tasks.workunit.client.0.smithi148.stdout:2/843: write d5/d8/d15/f96 [4083319,114737] 0 2024-04-26T23:09:23.535 INFO:tasks.workunit.client.0.smithi148.stdout:3/661: dwrite d9/d15/d29/d4d/d9a/fce [0,4194304] 0 2024-04-26T23:09:23.535 INFO:tasks.workunit.client.0.smithi148.stdout:0/878: dread d0/d8/d5f/fde [0,4194304] 0 2024-04-26T23:09:23.535 INFO:tasks.workunit.client.0.smithi148.stdout:0/879: write d0/d8/d33/d6a/d70/dd6/f60 [1327997,92810] 0 2024-04-26T23:09:23.546 INFO:tasks.workunit.client.0.smithi148.stdout:2/844: dread d5/d8/d9/f2a [0,4194304] 0 2024-04-26T23:09:23.546 INFO:tasks.workunit.client.0.smithi148.stdout:2/845: chown d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/d106/f10b 1256 1 2024-04-26T23:09:23.552 INFO:tasks.workunit.client.0.smithi148.stdout:3/662: symlink d9/d65/d80/d83/db9/lcf 0 2024-04-26T23:09:23.552 INFO:tasks.workunit.client.0.smithi148.stdout:3/663: dread - d9/d31/dc3/dca/fac zero size 2024-04-26T23:09:23.554 INFO:tasks.workunit.client.0.smithi148.stdout:6/725: write d6/d9/d1e/f5f [604083,118726] 0 2024-04-26T23:09:23.554 INFO:tasks.workunit.client.0.smithi148.stdout:7/714: dwrite d7/d11/d29/d2e/d41/d67/fb9 [4194304,4194304] 0 2024-04-26T23:09:23.554 INFO:tasks.workunit.client.0.smithi148.stdout:6/726: write d6/d9/d1e/f5f [4893547,77974] 0 2024-04-26T23:09:23.554 INFO:tasks.workunit.client.0.smithi148.stdout:0/880: truncate d0/d8/d33/d68/f9e 3737806 0 2024-04-26T23:09:23.555 INFO:tasks.workunit.client.0.smithi148.stdout:0/881: chown d0/d8/d33/d6a/d70/dd6/fd3 14984988 1 2024-04-26T23:09:23.559 INFO:tasks.workunit.client.0.smithi148.stdout:2/846: mkdir d5/d8/d15/d7d/d111 0 2024-04-26T23:09:23.570 INFO:tasks.workunit.client.0.smithi148.stdout:6/727: creat d6/d9/d23/d4a/d95/feb x:0 0 0 2024-04-26T23:09:23.570 INFO:tasks.workunit.client.0.smithi148.stdout:6/728: chown d6/d14 6672835 1 2024-04-26T23:09:23.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/729: rmdir d6/d9/d1c/dbf/db7 39 2024-04-26T23:09:23.578 INFO:tasks.workunit.client.0.smithi148.stdout:8/785: dread d3/da/d1c/d7c/d8c/d9f/f51 [0,4194304] 0 2024-04-26T23:09:23.582 INFO:tasks.workunit.client.0.smithi148.stdout:2/847: write d5/d8/d9/fc [318778,82702] 0 2024-04-26T23:09:23.583 INFO:tasks.workunit.client.0.smithi148.stdout:8/786: creat d3/d9/d12/d23/d29/ff9 x:0 0 0 2024-04-26T23:09:23.584 INFO:tasks.workunit.client.0.smithi148.stdout:6/730: dread d6/d32/d8a/fcb [0,4194304] 0 2024-04-26T23:09:23.584 INFO:tasks.workunit.client.0.smithi148.stdout:2/848: truncate d5/d8/d15/d43/f49 3626997 0 2024-04-26T23:09:23.585 INFO:tasks.workunit.client.0.smithi148.stdout:6/731: mkdir d6/d9/d1c/dbf/dec 0 2024-04-26T23:09:23.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/732: chown d6/d9/d23/d4a/f67 53 1 2024-04-26T23:09:23.587 INFO:tasks.workunit.client.0.smithi148.stdout:2/849: symlink d5/l112 0 2024-04-26T23:09:23.587 INFO:tasks.workunit.client.0.smithi148.stdout:2/850: fsync d5/d8/d15/ff5 0 2024-04-26T23:09:23.589 INFO:tasks.workunit.client.0.smithi148.stdout:2/851: rename d5/d8/d11/f5e to d5/d8/db9/f113 0 2024-04-26T23:09:23.591 INFO:tasks.workunit.client.0.smithi148.stdout:2/852: unlink d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/fc7 0 2024-04-26T23:09:23.604 INFO:tasks.workunit.client.0.smithi148.stdout:1/726: dwrite d16/d17/d4b/d55/f69 [0,4194304] 0 2024-04-26T23:09:23.605 INFO:tasks.workunit.client.0.smithi148.stdout:2/853: dread d5/d17/d64/d88/ff0 [0,4194304] 0 2024-04-26T23:09:23.605 INFO:tasks.workunit.client.0.smithi148.stdout:2/854: fsync d5/d8/d11/f6a 0 2024-04-26T23:09:23.605 INFO:tasks.workunit.client.0.smithi148.stdout:2/855: dread - d5/d97/dfd/f107 zero size 2024-04-26T23:09:23.612 INFO:tasks.workunit.client.0.smithi148.stdout:0/882: dwrite d0/d20/f40 [4194304,4194304] 0 2024-04-26T23:09:23.612 INFO:tasks.workunit.client.0.smithi148.stdout:1/727: dread d16/d45/f35 [0,4194304] 0 2024-04-26T23:09:23.615 INFO:tasks.workunit.client.0.smithi148.stdout:0/883: fsync d0/d8/d33/d68/f9e 0 2024-04-26T23:09:23.615 INFO:tasks.workunit.client.0.smithi148.stdout:1/728: write d16/d17/d4b/dd1/fde [534982,49825] 0 2024-04-26T23:09:23.627 INFO:tasks.workunit.client.0.smithi148.stdout:2/856: dread d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:09:23.638 INFO:tasks.workunit.client.0.smithi148.stdout:6/733: dread d6/d9/d1c/d1d/d1f/fa2 [0,4194304] 0 2024-04-26T23:09:23.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/715: dwrite d7/d11/d29/d2e/dc6/fe8 [0,4194304] 0 2024-04-26T23:09:23.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/716: rmdir d7/d11/d29/d2e/d41/d67/dcf 0 2024-04-26T23:09:23.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/717: mkdir d7/d11/d29/d2e/d41/d67/d94/d95/df2 0 2024-04-26T23:09:23.641 INFO:tasks.workunit.client.0.smithi148.stdout:7/718: creat d7/d11/d29/d2e/d41/d67/d94/d95/ff3 x:0 0 0 2024-04-26T23:09:23.641 INFO:tasks.workunit.client.0.smithi148.stdout:7/719: mknod d7/d11/d17/d2f/d57/cf4 0 2024-04-26T23:09:23.648 INFO:tasks.workunit.client.0.smithi148.stdout:8/787: write d3/d9/d12/f46 [2049676,83214] 0 2024-04-26T23:09:23.649 INFO:tasks.workunit.client.0.smithi148.stdout:1/729: dread d16/d45/d2b/f46 [0,4194304] 0 2024-04-26T23:09:23.650 INFO:tasks.workunit.client.0.smithi148.stdout:2/857: write d5/d8/d15/d7d/f84 [954608,27080] 0 2024-04-26T23:09:23.656 INFO:tasks.workunit.client.0.smithi148.stdout:7/720: rmdir d7 39 2024-04-26T23:09:23.658 INFO:tasks.workunit.client.0.smithi148.stdout:8/788: mknod d3/d9/d12/d95/cfa 0 2024-04-26T23:09:23.659 INFO:tasks.workunit.client.0.smithi148.stdout:2/858: rename d5/db8 to d5/d8/d11/d114 0 2024-04-26T23:09:23.660 INFO:tasks.workunit.client.0.smithi148.stdout:2/859: creat d5/d8/d15/d43/dd4/f115 x:0 0 0 2024-04-26T23:09:23.668 INFO:tasks.workunit.client.0.smithi148.stdout:7/721: rename d7/d11/d17/d2f/d44/d9b/da1 to d7/df5 0 2024-04-26T23:09:23.668 INFO:tasks.workunit.client.0.smithi148.stdout:2/860: mknod d5/d8/c116 0 2024-04-26T23:09:23.670 INFO:tasks.workunit.client.0.smithi148.stdout:8/789: rename d3/d9/da0 to d3/da/db6/dfb 0 2024-04-26T23:09:23.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/722: creat d7/d75/ff6 x:0 0 0 2024-04-26T23:09:23.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/723: chown d7/l10 1 1 2024-04-26T23:09:23.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/861: link d5/d1c/d38/fec d5/d8/d15/d7d/dd1/f117 0 2024-04-26T23:09:23.672 INFO:tasks.workunit.client.0.smithi148.stdout:8/790: rmdir d3/d9/d12/d23/d54/d60 39 2024-04-26T23:09:23.675 INFO:tasks.workunit.client.0.smithi148.stdout:7/724: truncate d7/d11/d17/d43/f52 821834 0 2024-04-26T23:09:23.675 INFO:tasks.workunit.client.0.smithi148.stdout:8/791: truncate d3/da/d1c/d7c/d8c/d9f/f6d 148592 0 2024-04-26T23:09:23.676 INFO:tasks.workunit.client.0.smithi148.stdout:7/725: getdents d7/d11/d17 0 2024-04-26T23:09:23.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/726: write d7/d11/d29/d2e/d41/d67/d94/d95/ff3 [396943,98617] 0 2024-04-26T23:09:23.677 INFO:tasks.workunit.client.0.smithi148.stdout:8/792: mknod d3/da/d1c/d7a/df0/cfc 0 2024-04-26T23:09:23.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/727: truncate d7/d11/d29/d2e/d41/d67/d94/d95/ff3 1263123 0 2024-04-26T23:09:23.677 INFO:tasks.workunit.client.0.smithi148.stdout:8/793: dread - d3/d9/d12/d23/d54/d60/f61 zero size 2024-04-26T23:09:23.678 INFO:tasks.workunit.client.0.smithi148.stdout:8/794: link d3/da/d28/cb9 d3/da/d1c/d7c/cfd 0 2024-04-26T23:09:23.694 INFO:tasks.workunit.client.0.smithi148.stdout:7/728: write d7/d11/d29/fe1 [1224690,15912] 0 2024-04-26T23:09:23.694 INFO:tasks.workunit.client.0.smithi148.stdout:7/729: readlink d7/d75/ldc 0 2024-04-26T23:09:23.694 INFO:tasks.workunit.client.0.smithi148.stdout:7/730: write d7/d11/d17/d2f/d44/d9b/fbd [894923,126824] 0 2024-04-26T23:09:23.738 INFO:tasks.workunit.client.0.smithi148.stdout:2/862: dwrite d5/d1c/d38/fec [0,4194304] 0 2024-04-26T23:09:23.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/731: mkdir d7/d11/d29/d2e/d41/d67/d94/d95/df7 0 2024-04-26T23:09:23.741 INFO:tasks.workunit.client.0.smithi148.stdout:2/863: symlink d5/d8/dc8/l118 0 2024-04-26T23:09:23.814 INFO:tasks.workunit.client.0.smithi148.stdout:1/730: dwrite d16/d17/d4b/d55/f9a [4194304,4194304] 0 2024-04-26T23:09:23.815 INFO:tasks.workunit.client.0.smithi148.stdout:6/734: dwrite d6/d9/fc3 [0,4194304] 0 2024-04-26T23:09:23.817 INFO:tasks.workunit.client.0.smithi148.stdout:2/864: mknod d5/d17/d64/d88/c119 0 2024-04-26T23:09:23.819 INFO:tasks.workunit.client.0.smithi148.stdout:1/731: mkdir d16/d45/d2b/df6 0 2024-04-26T23:09:23.821 INFO:tasks.workunit.client.0.smithi148.stdout:6/735: getdents d6/d32/d98/de2 0 2024-04-26T23:09:23.824 INFO:tasks.workunit.client.0.smithi148.stdout:2/865: creat d5/d8/d4b/d4e/d6d/da0/d32/f11a x:0 0 0 2024-04-26T23:09:23.825 INFO:tasks.workunit.client.0.smithi148.stdout:1/732: mknod d16/d17/d4b/d59/cf7 0 2024-04-26T23:09:23.829 INFO:tasks.workunit.client.0.smithi148.stdout:6/736: link d6/d9/d1c/c3a d6/d9/d23/dc1/ced 0 2024-04-26T23:09:23.831 INFO:tasks.workunit.client.0.smithi148.stdout:2/866: creat d5/d8/d9/d3d/f11b x:0 0 0 2024-04-26T23:09:23.833 INFO:tasks.workunit.client.0.smithi148.stdout:1/733: creat d16/d85/ff8 x:0 0 0 2024-04-26T23:09:23.835 INFO:tasks.workunit.client.0.smithi148.stdout:6/737: mkdir d6/d32/dee 0 2024-04-26T23:09:23.836 INFO:tasks.workunit.client.0.smithi148.stdout:6/738: write d6/d9/d1e/d69/f88 [4841181,3512] 0 2024-04-26T23:09:23.836 INFO:tasks.workunit.client.0.smithi148.stdout:2/867: dread d5/d8/d9/fc [0,4194304] 0 2024-04-26T23:09:23.837 INFO:tasks.workunit.client.0.smithi148.stdout:7/732: dwrite d7/f15 [0,4194304] 0 2024-04-26T23:09:23.841 INFO:tasks.workunit.client.0.smithi148.stdout:1/734: getdents d16/d45/d2b 0 2024-04-26T23:09:23.843 INFO:tasks.workunit.client.0.smithi148.stdout:6/739: mknod d6/d9/d1c/dbf/cef 0 2024-04-26T23:09:23.845 INFO:tasks.workunit.client.0.smithi148.stdout:2/868: creat d5/d8/d15/d43/d5d/f11c x:0 0 0 2024-04-26T23:09:23.852 INFO:tasks.workunit.client.0.smithi148.stdout:6/740: symlink d6/d9/d1c/d5b/lf0 0 2024-04-26T23:09:23.854 INFO:tasks.workunit.client.0.smithi148.stdout:4/825: sync 2024-04-26T23:09:23.856 INFO:tasks.workunit.client.0.smithi148.stdout:2/869: link d5/d8/d9/d3d/fe9 d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/f11d 0 2024-04-26T23:09:23.860 INFO:tasks.workunit.client.0.smithi148.stdout:6/741: mknod d6/d9/d23/d4a/cf1 0 2024-04-26T23:09:23.861 INFO:tasks.workunit.client.0.smithi148.stdout:6/742: write d6/d9/d23/d4a/f70 [5165268,100596] 0 2024-04-26T23:09:23.861 INFO:tasks.workunit.client.0.smithi148.stdout:4/826: getdents d12/d17/d2a/d37 0 2024-04-26T23:09:23.867 INFO:tasks.workunit.client.0.smithi148.stdout:6/743: symlink d6/d9/lf2 0 2024-04-26T23:09:23.867 INFO:tasks.workunit.client.0.smithi148.stdout:6/744: truncate d6/d9/d1c/f94 853627 0 2024-04-26T23:09:23.873 INFO:tasks.workunit.client.0.smithi148.stdout:4/827: mknod d12/d17/d2a/d37/d97/dec/c107 0 2024-04-26T23:09:23.873 INFO:tasks.workunit.client.0.smithi148.stdout:4/828: stat d12/d1c/d56/d87/d9c/da7/fb1 0 2024-04-26T23:09:23.878 INFO:tasks.workunit.client.0.smithi148.stdout:7/733: dwrite d7/d11/d17/d2f/d57/f63 [0,4194304] 0 2024-04-26T23:09:23.878 INFO:tasks.workunit.client.0.smithi148.stdout:7/734: truncate d7/d75/f93 1047441 0 2024-04-26T23:09:23.879 INFO:tasks.workunit.client.0.smithi148.stdout:6/745: rename d6/d9/d1c/c3a to d6/d9/d1c/cf3 0 2024-04-26T23:09:23.888 INFO:tasks.workunit.client.0.smithi148.stdout:7/735: dread d7/d75/f93 [0,4194304] 0 2024-04-26T23:09:23.888 INFO:tasks.workunit.client.0.smithi148.stdout:7/736: fdatasync d7/d11/d17/d9e/fa8 0 2024-04-26T23:09:23.898 INFO:tasks.workunit.client.0.smithi148.stdout:9/736: sync 2024-04-26T23:09:23.898 INFO:tasks.workunit.client.0.smithi148.stdout:5/802: sync 2024-04-26T23:09:23.898 INFO:tasks.workunit.client.0.smithi148.stdout:3/664: sync 2024-04-26T23:09:23.899 INFO:tasks.workunit.client.0.smithi148.stdout:3/665: readlink d9/d15/d29/l53 0 2024-04-26T23:09:23.902 INFO:tasks.workunit.client.0.smithi148.stdout:6/746: link d6/d14/fd9 d6/d9/d1c/ff4 0 2024-04-26T23:09:23.903 INFO:tasks.workunit.client.0.smithi148.stdout:5/803: mkdir da/d1b/d3b/d73/d97/d122 0 2024-04-26T23:09:23.904 INFO:tasks.workunit.client.0.smithi148.stdout:5/804: chown da/d68/d7a 49914588 1 2024-04-26T23:09:23.904 INFO:tasks.workunit.client.0.smithi148.stdout:5/805: fdatasync da/d1f/d67/fb6 0 2024-04-26T23:09:23.904 INFO:tasks.workunit.client.0.smithi148.stdout:5/806: fdatasync da/d1b/d3b/d73/d97/db0/f10f 0 2024-04-26T23:09:23.904 INFO:tasks.workunit.client.0.smithi148.stdout:5/807: readlink da/d1b/d1c/d54/df0/l10c 0 2024-04-26T23:09:23.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/737: link d19/d1d/d25/cb7 d19/d1d/d25/d31/d73/dd1/cf8 0 2024-04-26T23:09:23.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/738: stat d19/d1d/d25/d31/f55 0 2024-04-26T23:09:23.906 INFO:tasks.workunit.client.0.smithi148.stdout:6/747: mknod d6/dbe/ddc/cf5 0 2024-04-26T23:09:23.908 INFO:tasks.workunit.client.0.smithi148.stdout:5/808: truncate da/d1f/f49 4058361 0 2024-04-26T23:09:23.908 INFO:tasks.workunit.client.0.smithi148.stdout:5/809: chown da/d1b/d2d/c4f 93506750 1 2024-04-26T23:09:23.910 INFO:tasks.workunit.client.0.smithi148.stdout:6/748: creat d6/d9/d1c/dbf/ff6 x:0 0 0 2024-04-26T23:09:23.911 INFO:tasks.workunit.client.0.smithi148.stdout:6/749: read - d6/d9/d1e/fdb zero size 2024-04-26T23:09:23.917 INFO:tasks.workunit.client.0.smithi148.stdout:1/735: dwrite d16/d47/fa0 [0,4194304] 0 2024-04-26T23:09:23.922 INFO:tasks.workunit.client.0.smithi148.stdout:4/829: dwrite d12/f41 [0,4194304] 0 2024-04-26T23:09:23.922 INFO:tasks.workunit.client.0.smithi148.stdout:6/750: unlink d6/d9/d23/c30 0 2024-04-26T23:09:23.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/739: dread d19/d1d/f3b [0,4194304] 0 2024-04-26T23:09:23.924 INFO:tasks.workunit.client.0.smithi148.stdout:1/736: symlink d16/d17/d77/lf9 0 2024-04-26T23:09:23.925 INFO:tasks.workunit.client.0.smithi148.stdout:1/737: fdatasync d16/d1c/f32 0 2024-04-26T23:09:23.926 INFO:tasks.workunit.client.0.smithi148.stdout:2/870: dwrite d5/d8/f54 [0,4194304] 0 2024-04-26T23:09:23.927 INFO:tasks.workunit.client.0.smithi148.stdout:4/830: link d12/d1c/dc8/fd8 d12/dbd/d103/f108 0 2024-04-26T23:09:23.928 INFO:tasks.workunit.client.0.smithi148.stdout:6/751: creat d6/d9/d23/ff7 x:0 0 0 2024-04-26T23:09:23.929 INFO:tasks.workunit.client.0.smithi148.stdout:6/752: write d6/d14/d91/d9f/f7d [3389999,830] 0 2024-04-26T23:09:23.929 INFO:tasks.workunit.client.0.smithi148.stdout:6/753: readlink d6/d9/d1c/d1d/lc5 0 2024-04-26T23:09:23.931 INFO:tasks.workunit.client.0.smithi148.stdout:9/740: symlink d19/d1d/d25/d78/db6/dcb/lf9 0 2024-04-26T23:09:23.931 INFO:tasks.workunit.client.0.smithi148.stdout:9/741: readlink d19/d1d/d25/d31/d32/dc8/le9 0 2024-04-26T23:09:23.933 INFO:tasks.workunit.client.0.smithi148.stdout:5/810: read da/d1b/f93 [3990858,14849] 0 2024-04-26T23:09:23.937 INFO:tasks.workunit.client.0.smithi148.stdout:1/738: creat d16/d1c/d84/d94/ffa x:0 0 0 2024-04-26T23:09:23.939 INFO:tasks.workunit.client.0.smithi148.stdout:3/666: dwrite d9/d4c/f5f [0,4194304] 0 2024-04-26T23:09:23.939 INFO:tasks.workunit.client.0.smithi148.stdout:3/667: chown d9/d31/c4b 542925 1 2024-04-26T23:09:23.972 INFO:tasks.workunit.client.0.smithi148.stdout:1/739: dwrite d16/d17/d4b/d4d/f70 [0,4194304] 0 2024-04-26T23:09:23.972 INFO:tasks.workunit.client.0.smithi148.stdout:1/740: chown d16/d1c/fc6 48408286 1 2024-04-26T23:09:23.972 INFO:tasks.workunit.client.0.smithi148.stdout:1/741: fsync d16/d1c/d84/da7/fc8 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:2/871: creat d5/d97/dfd/f11e x:0 0 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/831: unlink d12/cb0 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:6/754: mkdir d6/d9/d23/dc1/df8 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:6/755: chown d6/d9/d23/d4a/f92 496015 1 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:9/742: mkdir d19/d1d/d25/d2f/d4d/d33/d50/dd9/dfa 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:5/811: creat da/d1a/f123 x:0 0 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:6/756: write d6/d9/d1e/fdb [632523,84581] 0 2024-04-26T23:09:24.191 INFO:tasks.workunit.client.0.smithi148.stdout:5/812: write da/d1b/d1c/d54/df0/fff [71137,24179] 0 2024-04-26T23:09:24.193 INFO:tasks.workunit.client.0.smithi148.stdout:3/668: creat d9/d31/d8f/fd0 x:0 0 0 2024-04-26T23:09:24.195 INFO:tasks.workunit.client.0.smithi148.stdout:0/884: sync 2024-04-26T23:09:24.196 INFO:tasks.workunit.client.0.smithi148.stdout:8/795: sync 2024-04-26T23:09:24.196 INFO:tasks.workunit.client.0.smithi148.stdout:0/885: stat d0/l4 0 2024-04-26T23:09:24.197 INFO:tasks.workunit.client.0.smithi148.stdout:1/742: creat d16/d17/d68/ffb x:0 0 0 2024-04-26T23:09:24.197 INFO:tasks.workunit.client.0.smithi148.stdout:1/743: read - d16/d45/d2b/fcb zero size 2024-04-26T23:09:24.198 INFO:tasks.workunit.client.0.smithi148.stdout:1/744: write d16/f87 [2961702,101182] 0 2024-04-26T23:09:24.200 INFO:tasks.workunit.client.0.smithi148.stdout:2/872: truncate d5/d97/dfd/f102 709002 0 2024-04-26T23:09:24.203 INFO:tasks.workunit.client.0.smithi148.stdout:9/743: truncate d19/f9a 2444661 0 2024-04-26T23:09:24.207 INFO:tasks.workunit.client.0.smithi148.stdout:6/757: creat d6/d9/d1c/d1d/d68/dbc/ff9 x:0 0 0 2024-04-26T23:09:24.212 INFO:tasks.workunit.client.0.smithi148.stdout:4/832: creat d12/d1c/d56/d87/d9c/da1/f109 x:0 0 0 2024-04-26T23:09:24.212 INFO:tasks.workunit.client.0.smithi148.stdout:4/833: stat d12/d1c/dc8/dda 0 2024-04-26T23:09:24.216 INFO:tasks.workunit.client.0.smithi148.stdout:8/796: creat d3/da/db6/d79/ffe x:0 0 0 2024-04-26T23:09:24.219 INFO:tasks.workunit.client.0.smithi148.stdout:0/886: getdents d0/d5/df7/d102 0 2024-04-26T23:09:24.220 INFO:tasks.workunit.client.0.smithi148.stdout:7/737: sync 2024-04-26T23:09:24.220 INFO:tasks.workunit.client.0.smithi148.stdout:7/738: fdatasync d7/d11/d17/d2f/fab 0 2024-04-26T23:09:24.272 INFO:tasks.workunit.client.0.smithi148.stdout:2/873: dwrite d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/fe4 [0,4194304] 0 2024-04-26T23:09:24.273 INFO:tasks.workunit.client.0.smithi148.stdout:7/739: dwrite d7/f15 [0,4194304] 0 2024-04-26T23:09:24.278 INFO:tasks.workunit.client.0.smithi148.stdout:5/813: dwrite da/f3f [0,4194304] 0 2024-04-26T23:09:24.278 INFO:tasks.workunit.client.0.smithi148.stdout:5/814: fdatasync da/f120 0 2024-04-26T23:09:24.278 INFO:tasks.workunit.client.0.smithi148.stdout:5/815: write da/d1b/d1c/d54/df0/fff [315102,48893] 0 2024-04-26T23:09:24.282 INFO:tasks.workunit.client.0.smithi148.stdout:1/745: creat d16/d17/daf/dbd/ffc x:0 0 0 2024-04-26T23:09:24.291 INFO:tasks.workunit.client.0.smithi148.stdout:6/758: creat d6/d9/d23/d4a/d95/ffa x:0 0 0 2024-04-26T23:09:24.291 INFO:tasks.workunit.client.0.smithi148.stdout:6/759: chown d6/d9/d1e/d69 1521112 1 2024-04-26T23:09:24.293 INFO:tasks.workunit.client.0.smithi148.stdout:4/834: creat d12/dbd/d103/f10a x:0 0 0 2024-04-26T23:09:24.293 INFO:tasks.workunit.client.0.smithi148.stdout:4/835: chown d12/d17/d2a/d37/d97/dc1/cfe 138045245 1 2024-04-26T23:09:24.295 INFO:tasks.workunit.client.0.smithi148.stdout:8/797: getdents d3/d87 0 2024-04-26T23:09:24.296 INFO:tasks.workunit.client.0.smithi148.stdout:0/887: getdents d0/d8/d33/d43/d4e 0 2024-04-26T23:09:24.296 INFO:tasks.workunit.client.0.smithi148.stdout:0/888: chown d0/d20/d3b/ccc 117 1 2024-04-26T23:09:24.297 INFO:tasks.workunit.client.0.smithi148.stdout:5/816: write f3 [3555805,15004] 0 2024-04-26T23:09:24.301 INFO:tasks.workunit.client.0.smithi148.stdout:2/874: symlink d5/d8/d15/d43/d5d/l11f 0 2024-04-26T23:09:24.301 INFO:tasks.workunit.client.0.smithi148.stdout:2/875: truncate d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/ff9 907096 0 2024-04-26T23:09:24.310 INFO:tasks.workunit.client.0.smithi148.stdout:1/746: creat d16/d47/d73/ffd x:0 0 0 2024-04-26T23:09:24.310 INFO:tasks.workunit.client.0.smithi148.stdout:1/747: fdatasync d16/d17/d4b/f9e 0 2024-04-26T23:09:24.311 INFO:tasks.workunit.client.0.smithi148.stdout:6/760: mkdir d6/d9/d23/dc1/df8/dfb 0 2024-04-26T23:09:24.313 INFO:tasks.workunit.client.0.smithi148.stdout:8/798: creat d3/d9a/dcd/fff x:0 0 0 2024-04-26T23:09:24.314 INFO:tasks.workunit.client.0.smithi148.stdout:8/799: fdatasync d3/da/d1c/d7c/d8c/d9f/f17 0 2024-04-26T23:09:24.315 INFO:tasks.workunit.client.0.smithi148.stdout:0/889: creat d0/d5/df7/f12c x:0 0 0 2024-04-26T23:09:24.316 INFO:tasks.workunit.client.0.smithi148.stdout:5/817: truncate da/d1f/fd5 2646946 0 2024-04-26T23:09:24.316 INFO:tasks.workunit.client.0.smithi148.stdout:5/818: dread - da/d68/d7a/feb zero size 2024-04-26T23:09:24.320 INFO:tasks.workunit.client.0.smithi148.stdout:0/890: mknod d0/d8/d95/d9f/c12d 0 2024-04-26T23:09:24.323 INFO:tasks.workunit.client.0.smithi148.stdout:0/891: truncate d0/d8/d33/d6a/d70/dd6/daf/fdb 1844119 0 2024-04-26T23:09:24.337 INFO:tasks.workunit.client.0.smithi148.stdout:5/819: dread da/d1f/d67/ffb [0,4194304] 0 2024-04-26T23:09:24.337 INFO:tasks.workunit.client.0.smithi148.stdout:5/820: readlink da/d1b/d5b/l4e 0 2024-04-26T23:09:24.344 INFO:tasks.workunit.client.0.smithi148.stdout:5/821: dread da/d12/d78/faf [0,4194304] 0 2024-04-26T23:09:24.355 INFO:tasks.workunit.client.0.smithi148.stdout:5/822: dread da/f3e [0,4194304] 0 2024-04-26T23:09:24.355 INFO:tasks.workunit.client.0.smithi148.stdout:9/744: write d19/d1d/d25/d31/f56 [3397257,123274] 0 2024-04-26T23:09:24.357 INFO:tasks.workunit.client.0.smithi148.stdout:5/823: creat da/d68/d69/daa/dc0/d11b/f124 x:0 0 0 2024-04-26T23:09:24.359 INFO:tasks.workunit.client.0.smithi148.stdout:9/745: unlink d19/d1d/d25/d78/le2 0 2024-04-26T23:09:24.359 INFO:tasks.workunit.client.0.smithi148.stdout:9/746: read d19/f9a [2063771,36386] 0 2024-04-26T23:09:24.361 INFO:tasks.workunit.client.0.smithi148.stdout:9/747: creat d19/d1d/d25/d31/dc5/ffb x:0 0 0 2024-04-26T23:09:24.366 INFO:tasks.workunit.client.0.smithi148.stdout:9/748: creat d19/d1d/d25/d31/d48/d8c/dab/ffc x:0 0 0 2024-04-26T23:09:24.366 INFO:tasks.workunit.client.0.smithi148.stdout:6/761: dwrite d6/d9/d1c/d1d/d1f/f59 [4194304,4194304] 0 2024-04-26T23:09:24.370 INFO:tasks.workunit.client.0.smithi148.stdout:9/749: dread d19/d39/f44 [0,4194304] 0 2024-04-26T23:09:24.390 INFO:tasks.workunit.client.0.smithi148.stdout:0/892: dwrite d0/d8/d5f/fde [0,4194304] 0 2024-04-26T23:09:24.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/762: mkdir d6/d9/d1e/dfc 0 2024-04-26T23:09:24.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/763: fsync d6/d9/d23/d4a/f70 0 2024-04-26T23:09:24.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/764: readlink d6/d9/d23/d4a/l89 0 2024-04-26T23:09:24.411 INFO:tasks.workunit.client.0.smithi148.stdout:1/748: rmdir d16/d1c/d82 39 2024-04-26T23:09:24.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/765: rmdir d6/d9 39 2024-04-26T23:09:24.414 INFO:tasks.workunit.client.0.smithi148.stdout:6/766: mkdir d6/d32/dfd 0 2024-04-26T23:09:24.414 INFO:tasks.workunit.client.0.smithi148.stdout:1/749: symlink d16/d17/d77/lfe 0 2024-04-26T23:09:24.414 INFO:tasks.workunit.client.0.smithi148.stdout:1/750: truncate d16/d17/d4b/dd1/fde 1020029 0 2024-04-26T23:09:24.416 INFO:tasks.workunit.client.0.smithi148.stdout:1/751: unlink d16/d17/d4b/d55/d90/fb9 0 2024-04-26T23:09:24.420 INFO:tasks.workunit.client.0.smithi148.stdout:0/893: dwrite d0/d8/d33/d6a/ffc [0,4194304] 0 2024-04-26T23:09:24.423 INFO:tasks.workunit.client.0.smithi148.stdout:2/876: mkdir d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d120 0 2024-04-26T23:09:24.432 INFO:tasks.workunit.client.0.smithi148.stdout:7/740: rename d7/d11/d29/d2e/d41/f48 to d7/d11/d17/d2f/ff8 0 2024-04-26T23:09:24.433 INFO:tasks.workunit.client.0.smithi148.stdout:4/836: rename d12/l50 to d12/d17/d2a/df4/l10b 0 2024-04-26T23:09:24.433 INFO:tasks.workunit.client.0.smithi148.stdout:4/837: link d12/d1c/d56/d87/d9a/d9d/f44 d12/dbd/f10c 0 2024-04-26T23:09:24.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/824: rename da/d68/d7a to da/d68/d69/dc9/d125 0 2024-04-26T23:09:24.433 INFO:tasks.workunit.client.0.smithi148.stdout:4/838: dread - d12/d1c/d56/d87/d9c/ffb zero size 2024-04-26T23:09:24.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/825: creat da/d1f/d67/d71/f126 x:0 0 0 2024-04-26T23:09:24.564 INFO:tasks.workunit.client.0.smithi148.stdout:2/877: dwrite d5/d97/dfd/f102 [0,4194304] 0 2024-04-26T23:09:24.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/752: dwrite d16/d17/d4b/d53/d67/fcc [0,4194304] 0 2024-04-26T23:09:24.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/753: stat d16/d17/daf/dbd/df1 0 2024-04-26T23:09:24.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/754: stat d16/d47/fa0 0 2024-04-26T23:09:24.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/755: chown d16/d17/f93 85062 1 2024-04-26T23:09:24.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/741: dwrite d7/d11/d29/d2e/d41/d67/d94/d95/fbe [0,4194304] 0 2024-04-26T23:09:24.591 INFO:tasks.workunit.client.0.smithi148.stdout:1/756: read d16/d17/d4b/d55/fa9 [1265045,112147] 0 2024-04-26T23:09:24.599 INFO:tasks.workunit.client.0.smithi148.stdout:7/742: write d7/d11/fd8 [2840118,112803] 0 2024-04-26T23:09:24.636 INFO:tasks.workunit.client.0.smithi148.stdout:1/757: dwrite d16/d1c/d84/d94/ffa [0,4194304] 0 2024-04-26T23:09:24.687 INFO:tasks.workunit.client.0.smithi148.stdout:4/839: rename d12/d1c/f8b to d12/d1c/d56/d87/f10d 0 2024-04-26T23:09:24.687 INFO:tasks.workunit.client.0.smithi148.stdout:5/826: rmdir da/d1b/d5b 39 2024-04-26T23:09:24.689 INFO:tasks.workunit.client.0.smithi148.stdout:2/878: creat d5/d8/d15/d43/d8d/f121 x:0 0 0 2024-04-26T23:09:24.689 INFO:tasks.workunit.client.0.smithi148.stdout:2/879: chown d5/f16 1536224 1 2024-04-26T23:09:24.689 INFO:tasks.workunit.client.0.smithi148.stdout:2/880: fsync d5/d8/d9/f79 0 2024-04-26T23:09:24.694 INFO:tasks.workunit.client.0.smithi148.stdout:7/743: creat d7/d11/d17/d43/ff9 x:0 0 0 2024-04-26T23:09:24.696 INFO:tasks.workunit.client.0.smithi148.stdout:8/800: creat d3/d9/d12/d23/f100 x:0 0 0 2024-04-26T23:09:24.699 INFO:tasks.workunit.client.0.smithi148.stdout:1/758: symlink d16/d1c/d84/d94/lff 0 2024-04-26T23:09:24.703 INFO:tasks.workunit.client.0.smithi148.stdout:9/750: rename d19/d39/f44 to d19/d1d/d25/d31/d60/dba/d85/db2/ffd 0 2024-04-26T23:09:24.707 INFO:tasks.workunit.client.0.smithi148.stdout:4/840: rmdir d12/d1c/d56/d87/d9c/da1 39 2024-04-26T23:09:24.707 INFO:tasks.workunit.client.0.smithi148.stdout:4/841: write d12/d1c/f67 [3197425,56095] 0 2024-04-26T23:09:24.707 INFO:tasks.workunit.client.0.smithi148.stdout:5/827: symlink da/d68/d69/l127 0 2024-04-26T23:09:24.707 INFO:tasks.workunit.client.0.smithi148.stdout:5/828: chown da/d1b/d2d/f7b 1706168 1 2024-04-26T23:09:24.710 INFO:tasks.workunit.client.0.smithi148.stdout:7/744: mkdir d7/d11/d17/d2f/d44/de4/dfa 0 2024-04-26T23:09:24.711 INFO:tasks.workunit.client.0.smithi148.stdout:5/829: write da/d1b/d1c/d54/f74 [458720,122948] 0 2024-04-26T23:09:24.711 INFO:tasks.workunit.client.0.smithi148.stdout:5/830: stat da/d1b/d5b/d5e/d6a/fdc 0 2024-04-26T23:09:24.714 INFO:tasks.workunit.client.0.smithi148.stdout:6/767: rename d6/d9/d1c/dbf/db7/fb8 to d6/d9/d1c/d1d/d68/dbc/ffe 0 2024-04-26T23:09:24.714 INFO:tasks.workunit.client.0.smithi148.stdout:6/768: readlink d6/d14/l4f 0 2024-04-26T23:09:24.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/894: rename d0/d8/d95/d97 to d0/d8/d95/d9f/d10e/d12e 0 2024-04-26T23:09:24.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/895: fdatasync d0/d8/d33/d6a/f6e 0 2024-04-26T23:09:24.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/896: readlink d0/d8/d33/d6a/d70/dd6/l7a 0 2024-04-26T23:09:24.720 INFO:tasks.workunit.client.0.smithi148.stdout:6/769: mkdir d6/dbe/ddc/dff 0 2024-04-26T23:09:24.727 INFO:tasks.workunit.client.0.smithi148.stdout:2/881: rename d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/f11d to d5/d8/d11/f122 0 2024-04-26T23:09:24.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/801: rename d3/da/d1c/d7c/fbe to d3/da/d1c/d7a/f101 0 2024-04-26T23:09:24.747 INFO:tasks.workunit.client.0.smithi148.stdout:9/751: write d19/d1d/d69/fca [940132,124571] 0 2024-04-26T23:09:24.747 INFO:tasks.workunit.client.0.smithi148.stdout:9/752: write d19/d1d/d25/d31/f45 [3100140,62278] 0 2024-04-26T23:09:24.748 INFO:tasks.workunit.client.0.smithi148.stdout:1/759: dwrite d16/d17/d4b/d55/d90/f97 [0,4194304] 0 2024-04-26T23:09:24.752 INFO:tasks.workunit.client.0.smithi148.stdout:9/753: symlink d19/d1d/d25/d78/db6/lfe 0 2024-04-26T23:09:24.755 INFO:tasks.workunit.client.0.smithi148.stdout:1/760: truncate d16/d17/d68/f91 1021368 0 2024-04-26T23:09:24.759 INFO:tasks.workunit.client.0.smithi148.stdout:9/754: creat d19/d1d/d25/d31/d60/dba/d85/fff x:0 0 0 2024-04-26T23:09:24.759 INFO:tasks.workunit.client.0.smithi148.stdout:9/755: read - d19/d1d/d25/d2f/d4d/d33/daa/fb0 zero size 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:6/770: dread d6/dc/f75 [0,4194304] 0 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:6/771: write d6/d9/d1c/d1d/fa7 [798896,41787] 0 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:6/772: getdents d6/d32/dee 0 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/761: getdents d16/d45 0 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/762: fdatasync d16/d17/f93 0 2024-04-26T23:09:24.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/763: fdatasync d16/d17/f24 0 2024-04-26T23:09:24.777 INFO:tasks.workunit.client.0.smithi148.stdout:9/756: mknod d19/d1d/d25/d2f/d4d/d33/d50/dd9/dfa/c100 0 2024-04-26T23:09:24.783 INFO:tasks.workunit.client.0.smithi148.stdout:9/757: stat d19/d1d/d25/d31/d32/c37 0 2024-04-26T23:09:24.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/758: mknod d19/d1d/d25/d31/d60/dba/d85/db2/c101 0 2024-04-26T23:09:24.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/759: chown d19/d1d/d25/d31/d60/cc6 3006 1 2024-04-26T23:09:24.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/760: dread - d19/d1d/d69/fc2 zero size 2024-04-26T23:09:24.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/761: read - d19/d1d/d25/d31/d60/dba/d85/fff zero size 2024-04-26T23:09:24.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/762: dread - d19/d1d/d25/fe1 zero size 2024-04-26T23:09:24.785 INFO:tasks.workunit.client.0.smithi148.stdout:9/763: write d19/d1d/d25/d31/d48/d8c/dab/f8d [3150293,126103] 0 2024-04-26T23:09:24.786 INFO:tasks.workunit.client.0.smithi148.stdout:7/745: dwrite d7/d11/f88 [0,4194304] 0 2024-04-26T23:09:24.789 INFO:tasks.workunit.client.0.smithi148.stdout:7/746: link d7/d11/d17/l89 d7/d11/lfb 0 2024-04-26T23:09:24.793 INFO:tasks.workunit.client.0.smithi148.stdout:5/831: dwrite da/d1b/d1c/f66 [0,4194304] 0 2024-04-26T23:09:24.793 INFO:tasks.workunit.client.0.smithi148.stdout:5/832: readlink da/d1f/d67/ld8 0 2024-04-26T23:09:24.796 INFO:tasks.workunit.client.0.smithi148.stdout:5/833: getdents da/d1b/d3b/d73 0 2024-04-26T23:09:24.796 INFO:tasks.workunit.client.0.smithi148.stdout:5/834: write da/f3e [102593,18454] 0 2024-04-26T23:09:24.799 INFO:tasks.workunit.client.0.smithi148.stdout:5/835: creat da/d68/d69/daa/dc0/d11b/f128 x:0 0 0 2024-04-26T23:09:24.804 INFO:tasks.workunit.client.0.smithi148.stdout:5/836: mknod da/d1b/c129 0 2024-04-26T23:09:24.811 INFO:tasks.workunit.client.0.smithi148.stdout:2/882: dwrite d5/d8/db9/fdb [0,4194304] 0 2024-04-26T23:09:24.811 INFO:tasks.workunit.client.0.smithi148.stdout:2/883: write d5/d8/d9/fdf [213210,82771] 0 2024-04-26T23:09:24.811 INFO:tasks.workunit.client.0.smithi148.stdout:2/884: readlink d5/d8/d15/d43/d5d/l8c 0 2024-04-26T23:09:24.820 INFO:tasks.workunit.client.0.smithi148.stdout:1/764: dwrite d16/d1c/f22 [4194304,4194304] 0 2024-04-26T23:09:24.825 INFO:tasks.workunit.client.0.smithi148.stdout:4/842: dwrite d12/f66 [0,4194304] 0 2024-04-26T23:09:24.825 INFO:tasks.workunit.client.0.smithi148.stdout:4/843: fsync d12/d1c/d45/d8c/f83 0 2024-04-26T23:09:24.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/897: dwrite d0/d5/f8a [0,4194304] 0 2024-04-26T23:09:24.829 INFO:tasks.workunit.client.0.smithi148.stdout:4/844: mknod d12/d1c/d56/d87/d9c/da1/da9/c10e 0 2024-04-26T23:09:24.834 INFO:tasks.workunit.client.0.smithi148.stdout:8/802: dwrite d3/d9/d12/d23/d35/f5b [0,4194304] 0 2024-04-26T23:09:24.836 INFO:tasks.workunit.client.0.smithi148.stdout:7/747: dread d7/f9 [0,4194304] 0 2024-04-26T23:09:24.836 INFO:tasks.workunit.client.0.smithi148.stdout:7/748: chown d7/d11/d17/d43/c51 10594131 1 2024-04-26T23:09:24.843 INFO:tasks.workunit.client.0.smithi148.stdout:5/837: dwrite da/d68/d69/f89 [0,4194304] 0 2024-04-26T23:09:24.843 INFO:tasks.workunit.client.0.smithi148.stdout:1/765: write d16/d1c/f33 [1010028,88245] 0 2024-04-26T23:09:24.847 INFO:tasks.workunit.client.0.smithi148.stdout:9/764: dwrite d19/d39/f90 [0,4194304] 0 2024-04-26T23:09:24.849 INFO:tasks.workunit.client.0.smithi148.stdout:3/669: sync 2024-04-26T23:09:24.851 INFO:tasks.workunit.client.0.smithi148.stdout:4/845: creat d12/d1c/d45/d75/f10f x:0 0 0 2024-04-26T23:09:24.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/846: dread d12/d1c/f71 [0,4194304] 0 2024-04-26T23:09:24.856 INFO:tasks.workunit.client.0.smithi148.stdout:8/803: rmdir d3/d9a 39 2024-04-26T23:09:24.859 INFO:tasks.workunit.client.0.smithi148.stdout:1/766: mknod d16/d17/d4b/d55/d90/c100 0 2024-04-26T23:09:24.861 INFO:tasks.workunit.client.0.smithi148.stdout:1/767: dread d16/f20 [0,4194304] 0 2024-04-26T23:09:24.866 INFO:tasks.workunit.client.0.smithi148.stdout:8/804: symlink d3/da/d1c/d7c/d8c/d9f/l102 0 2024-04-26T23:09:24.869 INFO:tasks.workunit.client.0.smithi148.stdout:8/805: creat d3/d9/d12/d23/d35/d69/f103 x:0 0 0 2024-04-26T23:09:24.869 INFO:tasks.workunit.client.0.smithi148.stdout:1/768: mkdir d16/d17/d4b/d53/d101 0 2024-04-26T23:09:24.869 INFO:tasks.workunit.client.0.smithi148.stdout:8/806: fsync d3/d9/d12/d23/d29/d77/f8a 0 2024-04-26T23:09:24.871 INFO:tasks.workunit.client.0.smithi148.stdout:1/769: mknod d16/d47/d73/df5/c102 0 2024-04-26T23:09:24.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/770: rmdir d16/d85 39 2024-04-26T23:09:24.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/771: write d16/d17/d77/fcd [630380,52225] 0 2024-04-26T23:09:24.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/772: read d16/f37 [441134,10447] 0 2024-04-26T23:09:24.873 INFO:tasks.workunit.client.0.smithi148.stdout:1/773: write d16/d45/d2b/d3e/fdb [1134421,63032] 0 2024-04-26T23:09:24.877 INFO:tasks.workunit.client.0.smithi148.stdout:1/774: readlink d16/d17/d68/d6b/lcf 0 2024-04-26T23:09:24.877 INFO:tasks.workunit.client.0.smithi148.stdout:1/775: chown d16/cdf 1579011266 1 2024-04-26T23:09:24.879 INFO:tasks.workunit.client.0.smithi148.stdout:1/776: link d16/f1d d16/d17/d4b/d55/f103 0 2024-04-26T23:09:24.880 INFO:tasks.workunit.client.0.smithi148.stdout:1/777: creat d16/d47/dd2/f104 x:0 0 0 2024-04-26T23:09:24.882 INFO:tasks.workunit.client.0.smithi148.stdout:1/778: creat d16/d17/d4b/d53/d67/f105 x:0 0 0 2024-04-26T23:09:24.883 INFO:tasks.workunit.client.0.smithi148.stdout:1/779: symlink d16/d1c/d84/l106 0 2024-04-26T23:09:24.884 INFO:tasks.workunit.client.0.smithi148.stdout:1/780: getdents d16/d1c/d82 0 2024-04-26T23:09:24.884 INFO:tasks.workunit.client.0.smithi148.stdout:1/781: write d16/d17/f1a [2881831,125052] 0 2024-04-26T23:09:24.891 INFO:tasks.workunit.client.0.smithi148.stdout:9/765: dwrite d19/d39/d5f/fb8 [0,4194304] 0 2024-04-26T23:09:24.891 INFO:tasks.workunit.client.0.smithi148.stdout:9/766: stat d19/d1d/d25/d31/d73/ddc 0 2024-04-26T23:09:24.891 INFO:tasks.workunit.client.0.smithi148.stdout:9/767: write d19/d1d/d25/d78/fdb [371038,123438] 0 2024-04-26T23:09:24.891 INFO:tasks.workunit.client.0.smithi148.stdout:9/768: fsync d19/d9f/dbb/ff4 0 2024-04-26T23:09:24.902 INFO:tasks.workunit.client.0.smithi148.stdout:4/847: dread d12/d17/d2a/d37/f88 [0,4194304] 0 2024-04-26T23:09:24.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/898: dwrite d0/d2e/d8f/d6c/fa9 [0,4194304] 0 2024-04-26T23:09:24.905 INFO:tasks.workunit.client.0.smithi148.stdout:4/848: mknod d12/d1c/d56/d87/d9c/da1/dc3/c110 0 2024-04-26T23:09:24.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/899: mkdir d0/d2e/d8f/d6c/d12f 0 2024-04-26T23:09:24.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/900: fdatasync d0/d2e/d8f/d6c/fa6 0 2024-04-26T23:09:24.906 INFO:tasks.workunit.client.0.smithi148.stdout:3/670: read d9/d15/d29/d4d/d78/f98 [1431374,82351] 0 2024-04-26T23:09:24.910 INFO:tasks.workunit.client.0.smithi148.stdout:3/671: symlink d9/d15/d29/d88/ld1 0 2024-04-26T23:09:24.910 INFO:tasks.workunit.client.0.smithi148.stdout:4/849: creat d12/d1c/d56/d87/d9c/f111 x:0 0 0 2024-04-26T23:09:24.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/850: creat d12/dbd/df8/f112 x:0 0 0 2024-04-26T23:09:24.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/851: write d12/d1c/d56/d87/d9a/d9d/fbc [1760317,94220] 0 2024-04-26T23:09:24.914 INFO:tasks.workunit.client.0.smithi148.stdout:0/901: dread d0/d2e/d8f/d6c/dab/fa7 [0,4194304] 0 2024-04-26T23:09:24.916 INFO:tasks.workunit.client.0.smithi148.stdout:1/782: truncate d16/d17/d68/f91 725335 0 2024-04-26T23:09:24.917 INFO:tasks.workunit.client.0.smithi148.stdout:3/672: write d9/d52/f5c [2011746,15019] 0 2024-04-26T23:09:24.917 INFO:tasks.workunit.client.0.smithi148.stdout:3/673: dread - d9/f93 zero size 2024-04-26T23:09:24.921 INFO:tasks.workunit.client.0.smithi148.stdout:3/674: rename d9/d15/d29/d4d/d68/f9e to d9/d15/d29/d88/fd2 0 2024-04-26T23:09:24.921 INFO:tasks.workunit.client.0.smithi148.stdout:3/675: chown d9/d65/fbe 1778272 1 2024-04-26T23:09:24.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/676: rmdir d9/d65 39 2024-04-26T23:09:24.931 INFO:tasks.workunit.client.0.smithi148.stdout:2/885: dwrite d5/d7/f20 [0,4194304] 0 2024-04-26T23:09:24.931 INFO:tasks.workunit.client.0.smithi148.stdout:2/886: chown d5/c68 49 1 2024-04-26T23:09:24.934 INFO:tasks.workunit.client.0.smithi148.stdout:3/677: write d9/f2d [1898977,16239] 0 2024-04-26T23:09:24.935 INFO:tasks.workunit.client.0.smithi148.stdout:3/678: dread - d9/d31/d8f/fd0 zero size 2024-04-26T23:09:24.942 INFO:tasks.workunit.client.0.smithi148.stdout:2/887: symlink d5/d8/d9/l123 0 2024-04-26T23:09:24.943 INFO:tasks.workunit.client.0.smithi148.stdout:3/679: getdents d9/d4c 0 2024-04-26T23:09:24.948 INFO:tasks.workunit.client.0.smithi148.stdout:2/888: rename d5/d17/d64/c90 to d5/d8/db9/c124 0 2024-04-26T23:09:24.948 INFO:tasks.workunit.client.0.smithi148.stdout:2/889: read - d5/d8/d15/d43/d5d/fcb zero size 2024-04-26T23:09:24.948 INFO:tasks.workunit.client.0.smithi148.stdout:2/890: creat d5/d8/d11/f125 x:0 0 0 2024-04-26T23:09:24.950 INFO:tasks.workunit.client.0.smithi148.stdout:2/891: mknod d5/d8/d11/d114/c126 0 2024-04-26T23:09:24.951 INFO:tasks.workunit.client.0.smithi148.stdout:2/892: mkdir d5/d8/d15/d43/d127 0 2024-04-26T23:09:24.951 INFO:tasks.workunit.client.0.smithi148.stdout:2/893: write d5/d8/d4b/d4e/d6d/dbe/fcf [505574,37426] 0 2024-04-26T23:09:24.952 INFO:tasks.workunit.client.0.smithi148.stdout:2/894: getdents d5/d17/d64/d88 0 2024-04-26T23:09:24.952 INFO:tasks.workunit.client.0.smithi148.stdout:2/895: stat d5/d8/d15 0 2024-04-26T23:09:24.953 INFO:tasks.workunit.client.0.smithi148.stdout:2/896: truncate d5/d8/d9/d3d/fe8 1668274 0 2024-04-26T23:09:24.954 INFO:tasks.workunit.client.0.smithi148.stdout:2/897: getdents d5/d8/d9/d3d 0 2024-04-26T23:09:24.960 INFO:tasks.workunit.client.0.smithi148.stdout:0/902: write d0/d8/d33/d68/def/f77 [1169306,40991] 0 2024-04-26T23:09:24.960 INFO:tasks.workunit.client.0.smithi148.stdout:0/903: dread - d0/d8/d33/d43/d4e/f111 zero size 2024-04-26T23:09:24.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/807: dwrite d3/d9/d12/d23/d35/d69/fdc [0,4194304] 0 2024-04-26T23:09:24.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/808: write d3/da/d1c/f45 [4544439,84872] 0 2024-04-26T23:09:24.968 INFO:tasks.workunit.client.0.smithi148.stdout:9/769: dwrite d19/d1d/d25/d31/d73/dd1/fe3 [0,4194304] 0 2024-04-26T23:09:24.976 INFO:tasks.workunit.client.0.smithi148.stdout:1/783: dwrite d16/d45/d7d/fe6 [0,4194304] 0 2024-04-26T23:09:24.977 INFO:tasks.workunit.client.0.smithi148.stdout:1/784: rmdir d16/d17/d77 39 2024-04-26T23:09:24.988 INFO:tasks.workunit.client.0.smithi148.stdout:1/785: symlink d16/d1c/l107 0 2024-04-26T23:09:24.994 INFO:tasks.workunit.client.0.smithi148.stdout:4/852: dwrite d12/d1c/d45/d75/fa6 [0,4194304] 0 2024-04-26T23:09:24.994 INFO:tasks.workunit.client.0.smithi148.stdout:8/809: write d3/d9/d12/d23/d35/f94 [148612,121868] 0 2024-04-26T23:09:24.997 INFO:tasks.workunit.client.0.smithi148.stdout:4/853: rename d12/dbd/df8 to d12/d1c/d56/d87/d9c/da1/da9/d113 0 2024-04-26T23:09:24.997 INFO:tasks.workunit.client.0.smithi148.stdout:4/854: stat d12/d1c/d56/d87/d9c/da1/da9/d113 0 2024-04-26T23:09:24.998 INFO:tasks.workunit.client.0.smithi148.stdout:8/810: rmdir d3/d9/d12 39 2024-04-26T23:09:25.001 INFO:tasks.workunit.client.0.smithi148.stdout:4/855: creat d12/d1c/d56/d87/d9c/da1/da9/f114 x:0 0 0 2024-04-26T23:09:25.010 INFO:tasks.workunit.client.0.smithi148.stdout:8/811: truncate d3/d9/d12/d23/f73 248442 0 2024-04-26T23:09:25.010 INFO:tasks.workunit.client.0.smithi148.stdout:4/856: mkdir d12/d1c/d45/dc2/dd4/d115 0 2024-04-26T23:09:25.010 INFO:tasks.workunit.client.0.smithi148.stdout:4/857: creat d12/d1c/d45/dc2/dd4/d115/f116 x:0 0 0 2024-04-26T23:09:25.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/898: write d5/d7/fa3 [326458,31383] 0 2024-04-26T23:09:25.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/899: write d5/d8/d15/d43/d8d/f121 [45051,31979] 0 2024-04-26T23:09:25.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/858: rmdir d12/d1c/d45/dc2/dd4/d115 39 2024-04-26T23:09:25.011 INFO:tasks.workunit.client.0.smithi148.stdout:2/900: getdents d5/d8/d4b/d4e/d6d/da0 0 2024-04-26T23:09:25.011 INFO:tasks.workunit.client.0.smithi148.stdout:2/901: chown d5/d8/d4b/d4e/d6d/cb5 2585298 1 2024-04-26T23:09:25.013 INFO:tasks.workunit.client.0.smithi148.stdout:4/859: creat d12/d1c/d56/d87/d9c/da1/df6/f117 x:0 0 0 2024-04-26T23:09:25.014 INFO:tasks.workunit.client.0.smithi148.stdout:2/902: symlink d5/d8/d4b/d4e/d6d/da0/d78/l128 0 2024-04-26T23:09:25.015 INFO:tasks.workunit.client.0.smithi148.stdout:2/903: unlink d5/d97/fd6 0 2024-04-26T23:09:25.018 INFO:tasks.workunit.client.0.smithi148.stdout:1/786: dread f15 [0,4194304] 0 2024-04-26T23:09:25.019 INFO:tasks.workunit.client.0.smithi148.stdout:0/904: dwrite d0/d20/f8d [0,4194304] 0 2024-04-26T23:09:25.020 INFO:tasks.workunit.client.0.smithi148.stdout:0/905: read - d0/d8/d33/f45 zero size 2024-04-26T23:09:25.020 INFO:tasks.workunit.client.0.smithi148.stdout:9/770: dwrite d19/d1d/d25/d31/d60/fec [0,4194304] 0 2024-04-26T23:09:25.020 INFO:tasks.workunit.client.0.smithi148.stdout:9/771: fdatasync d19/d1d/d25/d31/d60/fec 0 2024-04-26T23:09:25.020 INFO:tasks.workunit.client.0.smithi148.stdout:9/772: write d19/d1d/f3b [4433516,91988] 0 2024-04-26T23:09:25.036 INFO:tasks.workunit.client.0.smithi148.stdout:9/773: write d19/d1d/d69/fc2 [651997,55471] 0 2024-04-26T23:09:25.036 INFO:tasks.workunit.client.0.smithi148.stdout:0/906: unlink d0/d20/d54/ce6 0 2024-04-26T23:09:25.036 INFO:tasks.workunit.client.0.smithi148.stdout:0/907: write d0/d20/d54/fb9 [1001986,107501] 0 2024-04-26T23:09:25.036 INFO:tasks.workunit.client.0.smithi148.stdout:0/908: creat d0/d8/d33/d6a/d70/dd6/d9d/db4/f130 x:0 0 0 2024-04-26T23:09:25.036 INFO:tasks.workunit.client.0.smithi148.stdout:0/909: readlink d0/d2e/d8f/d6c/dab/ld9 0 2024-04-26T23:09:25.040 INFO:tasks.workunit.client.0.smithi148.stdout:2/904: dread d5/f16 [0,4194304] 0 2024-04-26T23:09:25.041 INFO:tasks.workunit.client.0.smithi148.stdout:2/905: write d5/d8/d11/f62 [657421,88104] 0 2024-04-26T23:09:25.042 INFO:tasks.workunit.client.0.smithi148.stdout:2/906: creat d5/d8/d4b/d4e/d6d/da0/d100/df1/f129 x:0 0 0 2024-04-26T23:09:25.050 INFO:tasks.workunit.client.0.smithi148.stdout:8/812: write d3/f88 [2609030,122869] 0 2024-04-26T23:09:25.057 INFO:tasks.workunit.client.0.smithi148.stdout:2/907: rename d5/d8/d15/l9e to d5/d8/dc8/l12a 0 2024-04-26T23:09:25.057 INFO:tasks.workunit.client.0.smithi148.stdout:2/908: mknod d5/d7/c12b 0 2024-04-26T23:09:25.058 INFO:tasks.workunit.client.0.smithi148.stdout:2/909: chown d5/d8/d11/dae/cf7 187 1 2024-04-26T23:09:25.058 INFO:tasks.workunit.client.0.smithi148.stdout:2/910: chown d5/d8/d4b/d4e/d6d 268 1 2024-04-26T23:09:25.059 INFO:tasks.workunit.client.0.smithi148.stdout:2/911: rmdir d5/d8/d4b/d4e/d6d/da0/d32 39 2024-04-26T23:09:25.061 INFO:tasks.workunit.client.0.smithi148.stdout:2/912: creat d5/d8/d15/d43/d8d/f12c x:0 0 0 2024-04-26T23:09:25.062 INFO:tasks.workunit.client.0.smithi148.stdout:2/913: readlink l3 0 2024-04-26T23:09:25.069 INFO:tasks.workunit.client.0.smithi148.stdout:9/774: dwrite d19/d1d/d25/d78/db6/dcb/fef [0,4194304] 0 2024-04-26T23:09:25.069 INFO:tasks.workunit.client.0.smithi148.stdout:9/775: getdents d19/d1d/d25/d31/d73/ddc/de4 0 2024-04-26T23:09:25.078 INFO:tasks.workunit.client.0.smithi148.stdout:9/776: mkdir d19/d1d/d25/d31/d60/dba/d85/db2/d102 0 2024-04-26T23:09:25.079 INFO:tasks.workunit.client.0.smithi148.stdout:1/787: dwrite d16/d17/d4b/f9e [0,4194304] 0 2024-04-26T23:09:25.079 INFO:tasks.workunit.client.0.smithi148.stdout:1/788: write d16/f4a [2585872,87907] 0 2024-04-26T23:09:25.079 INFO:tasks.workunit.client.0.smithi148.stdout:4/860: dwrite d12/fcd [0,4194304] 0 2024-04-26T23:09:25.083 INFO:tasks.workunit.client.0.smithi148.stdout:9/777: symlink d19/d1d/d25/d78/l103 0 2024-04-26T23:09:25.096 INFO:tasks.workunit.client.0.smithi148.stdout:4/861: creat d12/d1c/d45/d8c/f118 x:0 0 0 2024-04-26T23:09:25.097 INFO:tasks.workunit.client.0.smithi148.stdout:4/862: truncate d12/d1c/d56/d87/f104 942381 0 2024-04-26T23:09:25.097 INFO:tasks.workunit.client.0.smithi148.stdout:4/863: fsync d12/f8f 0 2024-04-26T23:09:25.098 INFO:tasks.workunit.client.0.smithi148.stdout:9/778: rename d19/d39/fdd to d19/d1d/d25/d31/d60/f104 0 2024-04-26T23:09:25.098 INFO:tasks.workunit.client.0.smithi148.stdout:9/779: readlink d19/d22/l4e 0 2024-04-26T23:09:25.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/910: dwrite d0/d20/d3b/f11a [4194304,4194304] 0 2024-04-26T23:09:25.099 INFO:tasks.workunit.client.0.smithi148.stdout:0/911: fsync d0/d8/d33/fdc 0 2024-04-26T23:09:25.100 INFO:tasks.workunit.client.0.smithi148.stdout:0/912: creat d0/d8/d52/ddd/f131 x:0 0 0 2024-04-26T23:09:25.102 INFO:tasks.workunit.client.0.smithi148.stdout:0/913: mkdir d0/d2e/d8f/d6c/dab/d132 0 2024-04-26T23:09:25.102 INFO:tasks.workunit.client.0.smithi148.stdout:0/914: fdatasync d0/d8/d33/d6a/d70/dd6/d9d/fdf 0 2024-04-26T23:09:25.104 INFO:tasks.workunit.client.0.smithi148.stdout:0/915: mkdir d0/d8/d5f/d133 0 2024-04-26T23:09:25.105 INFO:tasks.workunit.client.0.smithi148.stdout:0/916: symlink d0/d5/df7/d102/l134 0 2024-04-26T23:09:25.107 INFO:tasks.workunit.client.0.smithi148.stdout:0/917: creat d0/d8/d33/d68/def/f135 x:0 0 0 2024-04-26T23:09:25.108 INFO:tasks.workunit.client.0.smithi148.stdout:0/918: creat d0/d8/d33/d43/d4e/f136 x:0 0 0 2024-04-26T23:09:25.127 INFO:tasks.workunit.client.0.smithi148.stdout:1/789: dwrite d16/d17/d4b/d59/fe1 [0,4194304] 0 2024-04-26T23:09:25.203 INFO:tasks.workunit.client.0.smithi148.stdout:0/919: dread d0/d8/d52/f1f [8388608,4194304] 0 2024-04-26T23:09:25.206 INFO:tasks.workunit.client.0.smithi148.stdout:0/920: mkdir d0/d5/df7/d102/d137 0 2024-04-26T23:09:25.206 INFO:tasks.workunit.client.0.smithi148.stdout:0/921: fdatasync d0/d8/d52/ddd/f131 0 2024-04-26T23:09:25.206 INFO:tasks.workunit.client.0.smithi148.stdout:1/790: dread d16/d45/f35 [0,4194304] 0 2024-04-26T23:09:25.207 INFO:tasks.workunit.client.0.smithi148.stdout:0/922: fsync d0/d8/d95/d9f/d10e/d12e/d3a/fa2 0 2024-04-26T23:09:25.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/791: truncate d16/d17/f3d 613874 0 2024-04-26T23:09:25.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/792: readlink d16/d45/l44 0 2024-04-26T23:09:25.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/793: write d16/d85/fb1 [1618263,27860] 0 2024-04-26T23:09:25.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/794: chown d16/d45/lc1 52072416 1 2024-04-26T23:09:25.212 INFO:tasks.workunit.client.0.smithi148.stdout:1/795: mknod d16/d17/d4b/d53/c108 0 2024-04-26T23:09:25.214 INFO:tasks.workunit.client.0.smithi148.stdout:4/864: dwrite d12/d17/f68 [0,4194304] 0 2024-04-26T23:09:25.214 INFO:tasks.workunit.client.0.smithi148.stdout:4/865: fsync d12/d17/f68 0 2024-04-26T23:09:25.214 INFO:tasks.workunit.client.0.smithi148.stdout:4/866: chown d12/d1c/d56/d87/d9a/d9d/f4c 57986989 1 2024-04-26T23:09:25.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/867: creat d12/d17/d2a/d37/d97/dc1/f119 x:0 0 0 2024-04-26T23:09:25.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/868: write d12/dbd/d103/f108 [3144279,101834] 0 2024-04-26T23:09:25.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/869: read d12/f72 [3956132,106664] 0 2024-04-26T23:09:25.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/870: read - d12/d17/d2a/df4/f102 zero size 2024-04-26T23:09:25.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/871: truncate d12/d17/fdf 979703 0 2024-04-26T23:09:25.223 INFO:tasks.workunit.client.0.smithi148.stdout:0/923: dread d0/d8/d33/d6a/ffc [0,4194304] 0 2024-04-26T23:09:25.224 INFO:tasks.workunit.client.0.smithi148.stdout:1/796: write d16/d1c/f3c [167472,49650] 0 2024-04-26T23:09:25.225 INFO:tasks.workunit.client.0.smithi148.stdout:4/872: unlink d12/d1c/d45/d8c/f46 0 2024-04-26T23:09:25.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/924: truncate d0/d8/d33/d6a/d70/dd6/daf/fdb 1199827 0 2024-04-26T23:09:25.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/925: chown d0/d5/df7/f12c 117790276 1 2024-04-26T23:09:25.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/926: dread - d0/d8/d33/d43/f108 zero size 2024-04-26T23:09:25.236 INFO:tasks.workunit.client.0.smithi148.stdout:1/797: rmdir d16/d45/d2b 39 2024-04-26T23:09:25.236 INFO:tasks.workunit.client.0.smithi148.stdout:1/798: stat d16/d17/daf/dbd 0 2024-04-26T23:09:25.244 INFO:tasks.workunit.client.0.smithi148.stdout:0/927: rename d0/d8/d33/d6a/d70/dc0/ce2 to d0/d8/d33/d43/c138 0 2024-04-26T23:09:25.250 INFO:tasks.workunit.client.0.smithi148.stdout:0/928: mknod d0/d2e/d8f/d6c/db8/c139 0 2024-04-26T23:09:25.257 INFO:tasks.workunit.client.0.smithi148.stdout:0/929: mknod d0/d8/d5f/c13a 0 2024-04-26T23:09:25.262 INFO:tasks.workunit.client.0.smithi148.stdout:0/930: link d0/d2e/d8f/d6c/l103 d0/d2e/d10f/l13b 0 2024-04-26T23:09:25.266 INFO:tasks.workunit.client.0.smithi148.stdout:0/931: rename d0/c3e to d0/d5/df7/c13c 0 2024-04-26T23:09:25.266 INFO:tasks.workunit.client.0.smithi148.stdout:0/932: chown d0/d8/d33/d43/d4e/ca3 60040672 1 2024-04-26T23:09:25.267 INFO:tasks.workunit.client.0.smithi148.stdout:0/933: fdatasync d0/d8/d33/d43/d4e/f109 0 2024-04-26T23:09:25.267 INFO:tasks.workunit.client.0.smithi148.stdout:0/934: rmdir d0/d2e 39 2024-04-26T23:09:25.267 INFO:tasks.workunit.client.0.smithi148.stdout:0/935: write d0/d8/d33/d6a/d70/dd6/f60 [3533151,23922] 0 2024-04-26T23:09:25.271 INFO:tasks.workunit.client.0.smithi148.stdout:0/936: creat d0/d8/d33/d43/d4e/f13d x:0 0 0 2024-04-26T23:09:25.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/937: rmdir d0/d5 39 2024-04-26T23:09:25.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/938: dread - d0/d5/ff2 zero size 2024-04-26T23:09:25.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/939: chown d0/ca5 2 1 2024-04-26T23:09:25.276 INFO:tasks.workunit.client.0.smithi148.stdout:0/940: unlink d0/d2e/d8f/dbf/lcb 0 2024-04-26T23:09:25.278 INFO:tasks.workunit.client.0.smithi148.stdout:0/941: mknod d0/d8/d95/c13e 0 2024-04-26T23:09:25.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/942: read d0/d2e/d8f/d6c/dab/fa7 [25439,75623] 0 2024-04-26T23:09:25.301 INFO:tasks.workunit.client.0.smithi148.stdout:1/799: dwrite d16/d17/f4c [0,4194304] 0 2024-04-26T23:09:25.318 INFO:tasks.workunit.client.0.smithi148.stdout:0/943: dwrite d0/d8/d33/d68/f76 [0,4194304] 0 2024-04-26T23:09:25.318 INFO:tasks.workunit.client.0.smithi148.stdout:0/944: chown d0/d8/d33/d68/def/f77 15915591 1 2024-04-26T23:09:25.320 INFO:tasks.workunit.client.0.smithi148.stdout:1/800: dread d16/d45/d2b/f31 [0,4194304] 0 2024-04-26T23:09:25.320 INFO:tasks.workunit.client.0.smithi148.stdout:1/801: stat d16/d17/d4b/d59/cf7 0 2024-04-26T23:09:25.320 INFO:tasks.workunit.client.0.smithi148.stdout:1/802: chown d16/d45/d2b/d3e/l41 53 1 2024-04-26T23:09:25.326 INFO:tasks.workunit.client.0.smithi148.stdout:1/803: creat d16/d1c/f109 x:0 0 0 2024-04-26T23:09:25.328 INFO:tasks.workunit.client.0.smithi148.stdout:1/804: mknod d16/d17/daf/dbd/c10a 0 2024-04-26T23:09:25.331 INFO:tasks.workunit.client.0.smithi148.stdout:0/945: write d0/d8/d33/d6a/ffc [1417685,843] 0 2024-04-26T23:09:25.331 INFO:tasks.workunit.client.0.smithi148.stdout:0/946: chown d0/d2e/d8f/d6c/db8 181459457 1 2024-04-26T23:09:25.331 INFO:tasks.workunit.client.0.smithi148.stdout:0/947: readlink d0/d5/df7/d102/l121 0 2024-04-26T23:09:25.345 INFO:tasks.workunit.client.0.smithi148.stdout:1/805: read d16/d17/d4b/f9e [3839926,11731] 0 2024-04-26T23:09:25.352 INFO:tasks.workunit.client.0.smithi148.stdout:1/806: getdents d16/d1c 0 2024-04-26T23:09:25.352 INFO:tasks.workunit.client.0.smithi148.stdout:1/807: write d16/f20 [1702778,16853] 0 2024-04-26T23:09:25.355 INFO:tasks.workunit.client.0.smithi148.stdout:1/808: creat d16/d1c/d84/da7/f10b x:0 0 0 2024-04-26T23:09:25.357 INFO:tasks.workunit.client.0.smithi148.stdout:1/809: rmdir d16/d45 39 2024-04-26T23:09:25.357 INFO:tasks.workunit.client.0.smithi148.stdout:1/810: chown d16/d17/daf 1 1 2024-04-26T23:09:25.357 INFO:tasks.workunit.client.0.smithi148.stdout:1/811: chown d16/d85/lb6 14 1 2024-04-26T23:09:25.359 INFO:tasks.workunit.client.0.smithi148.stdout:1/812: write d16/d1c/faa [81552,65687] 0 2024-04-26T23:09:25.361 INFO:tasks.workunit.client.0.smithi148.stdout:1/813: mknod d16/d1c/d84/c10c 0 2024-04-26T23:09:25.361 INFO:tasks.workunit.client.0.smithi148.stdout:1/814: getdents d16/d45/d2b 0 2024-04-26T23:09:25.361 INFO:tasks.workunit.client.0.smithi148.stdout:1/815: chown d16/d85/fb0 903760 1 2024-04-26T23:09:25.364 INFO:tasks.workunit.client.0.smithi148.stdout:1/816: creat d16/f10d x:0 0 0 2024-04-26T23:09:25.367 INFO:tasks.workunit.client.0.smithi148.stdout:1/817: rmdir d16/d45/d2b/df6 0 2024-04-26T23:09:25.369 INFO:tasks.workunit.client.0.smithi148.stdout:1/818: creat d16/d17/daf/dbd/f10e x:0 0 0 2024-04-26T23:09:25.372 INFO:tasks.workunit.client.0.smithi148.stdout:1/819: symlink d16/d1c/d84/da7/l10f 0 2024-04-26T23:09:25.372 INFO:tasks.workunit.client.0.smithi148.stdout:1/820: readlink d16/d17/d4b/d53/l64 0 2024-04-26T23:09:25.374 INFO:tasks.workunit.client.0.smithi148.stdout:1/821: creat d16/d1c/d84/d94/f110 x:0 0 0 2024-04-26T23:09:25.385 INFO:tasks.workunit.client.0.smithi148.stdout:1/822: write d16/d45/d2b/f5c [3859992,68627] 0 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:7/749: sync 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/838: sync 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:6/773: sync 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:3/680: sync 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/839: dread - da/d12/f8e zero size 2024-04-26T23:09:25.425 INFO:tasks.workunit.client.0.smithi148.stdout:6/774: chown d6/d9/d1e/dfc 8 1 2024-04-26T23:09:25.427 INFO:tasks.workunit.client.0.smithi148.stdout:7/750: symlink d7/d11/d29/d9a/lfc 0 2024-04-26T23:09:25.429 INFO:tasks.workunit.client.0.smithi148.stdout:5/840: creat da/d1b/d8b/d110/f12a x:0 0 0 2024-04-26T23:09:25.432 INFO:tasks.workunit.client.0.smithi148.stdout:6/775: symlink d6/d9/d23/d4a/d95/l100 0 2024-04-26T23:09:25.434 INFO:tasks.workunit.client.0.smithi148.stdout:5/841: symlink da/d1b/d5b/d5e/dc5/l12b 0 2024-04-26T23:09:25.434 INFO:tasks.workunit.client.0.smithi148.stdout:5/842: fsync f3 0 2024-04-26T23:09:25.437 INFO:tasks.workunit.client.0.smithi148.stdout:6/776: creat d6/d9/d23/dc1/df8/f101 x:0 0 0 2024-04-26T23:09:25.437 INFO:tasks.workunit.client.0.smithi148.stdout:6/777: chown d6/d9/d1e/f5f 296784 1 2024-04-26T23:09:25.441 INFO:tasks.workunit.client.0.smithi148.stdout:6/778: creat d6/d9/d1c/d1d/de3/f102 x:0 0 0 2024-04-26T23:09:25.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/681: dread f5 [0,4194304] 0 2024-04-26T23:09:25.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/682: write d9/d31/f95 [658781,69615] 0 2024-04-26T23:09:25.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/683: write d9/d15/d29/d4d/d9a/fce [4442657,10210] 0 2024-04-26T23:09:25.460 INFO:tasks.workunit.client.0.smithi148.stdout:6/779: mknod d6/c103 0 2024-04-26T23:09:25.470 INFO:tasks.workunit.client.0.smithi148.stdout:3/684: truncate f5 1353961 0 2024-04-26T23:09:25.472 INFO:tasks.workunit.client.0.smithi148.stdout:6/780: unlink d6/d14/d91/d9f/f72 0 2024-04-26T23:09:25.476 INFO:tasks.workunit.client.0.smithi148.stdout:3/685: symlink d9/d15/d29/d4d/d6f/ld3 0 2024-04-26T23:09:25.480 INFO:tasks.workunit.client.0.smithi148.stdout:6/781: link d6/d9/d23/d4a/d95/fae d6/d14/d91/f104 0 2024-04-26T23:09:25.484 INFO:tasks.workunit.client.0.smithi148.stdout:3/686: link d9/f93 d9/d65/fd4 0 2024-04-26T23:09:25.484 INFO:tasks.workunit.client.0.smithi148.stdout:3/687: stat d9/d15/db1/fbd 0 2024-04-26T23:09:25.488 INFO:tasks.workunit.client.0.smithi148.stdout:6/782: creat d6/d32/dd3/f105 x:0 0 0 2024-04-26T23:09:25.492 INFO:tasks.workunit.client.0.smithi148.stdout:6/783: mknod d6/d9/c106 0 2024-04-26T23:09:25.492 INFO:tasks.workunit.client.0.smithi148.stdout:6/784: write d6/d9/d1c/d1d/d1f/f87 [661643,64682] 0 2024-04-26T23:09:25.509 INFO:tasks.workunit.client.0.smithi148.stdout:1/823: dwrite d16/d1c/f32 [0,4194304] 0 2024-04-26T23:09:25.511 INFO:tasks.workunit.client.0.smithi148.stdout:6/785: dread d6/d32/f63 [0,4194304] 0 2024-04-26T23:09:25.511 INFO:tasks.workunit.client.0.smithi148.stdout:6/786: chown d6/d14/d91/d9f/f78 25262773 1 2024-04-26T23:09:25.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/824: dread d16/f37 [0,4194304] 0 2024-04-26T23:09:25.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/825: write d16/d17/d4b/d53/d67/f105 [854321,1482] 0 2024-04-26T23:09:25.520 INFO:tasks.workunit.client.0.smithi148.stdout:6/787: creat d6/d32/d8a/f107 x:0 0 0 2024-04-26T23:09:25.539 INFO:tasks.workunit.client.0.smithi148.stdout:8/813: sync 2024-04-26T23:09:25.541 INFO:tasks.workunit.client.0.smithi148.stdout:6/788: dread d6/d9/d1c/d1d/d1f/f7f [0,4194304] 0 2024-04-26T23:09:25.541 INFO:tasks.workunit.client.0.smithi148.stdout:3/688: dwrite d9/f2d [0,4194304] 0 2024-04-26T23:09:25.544 INFO:tasks.workunit.client.0.smithi148.stdout:3/689: truncate d9/d31/f32 4679550 0 2024-04-26T23:09:25.544 INFO:tasks.workunit.client.0.smithi148.stdout:3/690: write d9/d15/d29/d4d/d7d/f7e [122649,1767] 0 2024-04-26T23:09:25.548 INFO:tasks.workunit.client.0.smithi148.stdout:3/691: rename d9/d52/f81 to d9/fd5 0 2024-04-26T23:09:25.552 INFO:tasks.workunit.client.0.smithi148.stdout:7/751: dwrite d7/d11/d17/d2f/d57/f63 [0,4194304] 0 2024-04-26T23:09:25.572 INFO:tasks.workunit.client.0.smithi148.stdout:1/826: dwrite d16/d17/f3b [0,4194304] 0 2024-04-26T23:09:25.572 INFO:tasks.workunit.client.0.smithi148.stdout:1/827: stat d16/d47/d73/df5/c102 0 2024-04-26T23:09:25.572 INFO:tasks.workunit.client.0.smithi148.stdout:1/828: read d16/d1c/faa [52937,89435] 0 2024-04-26T23:09:25.577 INFO:tasks.workunit.client.0.smithi148.stdout:8/814: dwrite d3/fdd [0,4194304] 0 2024-04-26T23:09:25.578 INFO:tasks.workunit.client.0.smithi148.stdout:1/829: chown d16/d17/d68/d6b/d8b/fe4 882 1 2024-04-26T23:09:25.579 INFO:tasks.workunit.client.0.smithi148.stdout:3/692: write d9/d15/f92 [3850574,60900] 0 2024-04-26T23:09:25.588 INFO:tasks.workunit.client.0.smithi148.stdout:8/815: mkdir d3/da/db6/d79/d104 0 2024-04-26T23:09:25.588 INFO:tasks.workunit.client.0.smithi148.stdout:8/816: readlink d3/d9/d12/d23/d29/d77/le8 0 2024-04-26T23:09:25.588 INFO:tasks.workunit.client.0.smithi148.stdout:8/817: dread - d3/d9/d12/f78 zero size 2024-04-26T23:09:25.591 INFO:tasks.workunit.client.0.smithi148.stdout:1/830: creat d16/d17/d77/f111 x:0 0 0 2024-04-26T23:09:25.591 INFO:tasks.workunit.client.0.smithi148.stdout:3/693: dread d9/d15/d29/f3b [0,4194304] 0 2024-04-26T23:09:25.594 INFO:tasks.workunit.client.0.smithi148.stdout:6/789: dwrite d6/d9/d23/ff7 [0,4194304] 0 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/790: chown d6/d9/d1c/d1d/d68/fac 39611 1 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:7/752: dread d7/d11/d29/d2e/d41/d67/d94/d95/ff3 [0,4194304] 0 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:7/753: chown d7/d11/d17/d2f/d44/de4/d68/c80 41073773 1 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:7/754: dread - d7/d75/ff6 zero size 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:6/791: write d6/d9/d1c/d1d/d68/dbc/ffe [305103,10302] 0 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:7/755: write d7/d75/ff6 [225048,81333] 0 2024-04-26T23:09:25.595 INFO:tasks.workunit.client.0.smithi148.stdout:8/818: unlink d3/d9/d12/d23/d29/cd8 0 2024-04-26T23:09:25.597 INFO:tasks.workunit.client.0.smithi148.stdout:3/694: mkdir d9/d15/d29/d4d/d68/dd6 0 2024-04-26T23:09:25.598 INFO:tasks.workunit.client.0.smithi148.stdout:7/756: dread d7/d11/d29/d2e/d41/d67/d94/d95/ff3 [0,4194304] 0 2024-04-26T23:09:25.600 INFO:tasks.workunit.client.0.smithi148.stdout:6/792: mkdir d6/d9/d1c/d1d/d68/d108 0 2024-04-26T23:09:25.602 INFO:tasks.workunit.client.0.smithi148.stdout:8/819: creat d3/d9/d12/d23/d29/f105 x:0 0 0 2024-04-26T23:09:25.602 INFO:tasks.workunit.client.0.smithi148.stdout:8/820: truncate d3/d9/d12/fc1 305371 0 2024-04-26T23:09:25.606 INFO:tasks.workunit.client.0.smithi148.stdout:8/821: rmdir d3/da/d28 39 2024-04-26T23:09:25.606 INFO:tasks.workunit.client.0.smithi148.stdout:8/822: write d3/d9/d12/d23/d35/d69/f6e [441208,100014] 0 2024-04-26T23:09:25.606 INFO:tasks.workunit.client.0.smithi148.stdout:8/823: fdatasync d3/d9/d12/d23/d54/ff5 0 2024-04-26T23:09:25.606 INFO:tasks.workunit.client.0.smithi148.stdout:8/824: readlink d3/da/d1c/d7c/d8c/d9f/lb4 0 2024-04-26T23:09:25.632 INFO:tasks.workunit.client.0.smithi148.stdout:1/831: dwrite d16/d1c/d84/da7/fc8 [0,4194304] 0 2024-04-26T23:09:25.651 INFO:tasks.workunit.client.0.smithi148.stdout:6/793: dwrite d6/d9/d1c/d1d/d1f/f7f [0,4194304] 0 2024-04-26T23:09:25.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/757: dwrite d7/d11/d29/d2e/d41/f8a [0,4194304] 0 2024-04-26T23:09:25.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/758: chown d7/d11/d29/d2e/d41/d67/d94/d95/ff3 341410265 1 2024-04-26T23:09:25.679 INFO:tasks.workunit.client.0.smithi148.stdout:7/759: mknod d7/d75/de6/cfd 0 2024-04-26T23:09:25.679 INFO:tasks.workunit.client.0.smithi148.stdout:7/760: truncate d7/d11/d29/d2e/f72 676317 0 2024-04-26T23:09:25.691 INFO:tasks.workunit.client.0.smithi148.stdout:7/761: creat d7/d11/d29/d2e/d41/d67/d94/d95/ffe x:0 0 0 2024-04-26T23:09:25.691 INFO:tasks.workunit.client.0.smithi148.stdout:7/762: fdatasync d7/d75/f1f 0 2024-04-26T23:09:25.697 INFO:tasks.workunit.client.0.smithi148.stdout:7/763: getdents d7/d11/d17/d2f/d57 0 2024-04-26T23:09:25.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/825: dwrite d3/da/d1c/d7a/f98 [0,4194304] 0 2024-04-26T23:09:25.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/826: fsync d3/da/f64 0 2024-04-26T23:09:25.698 INFO:tasks.workunit.client.0.smithi148.stdout:8/827: readlink d3/d9/l1a 0 2024-04-26T23:09:25.703 INFO:tasks.workunit.client.0.smithi148.stdout:7/764: symlink d7/d11/d29/d2e/dc6/de7/lff 0 2024-04-26T23:09:25.703 INFO:tasks.workunit.client.0.smithi148.stdout:7/765: fdatasync d7/d11/d17/d43/ff9 0 2024-04-26T23:09:25.705 INFO:tasks.workunit.client.0.smithi148.stdout:1/832: dread d16/d45/d7d/fe6 [0,4194304] 0 2024-04-26T23:09:25.706 INFO:tasks.workunit.client.0.smithi148.stdout:6/794: dwrite d6/d9/d1c/d1d/d1f/fab [4194304,4194304] 0 2024-04-26T23:09:25.707 INFO:tasks.workunit.client.0.smithi148.stdout:1/833: link d16/d1c/d84/d94/lff d16/d1c/d84/da7/l112 0 2024-04-26T23:09:25.712 INFO:tasks.workunit.client.0.smithi148.stdout:3/695: dwrite d9/d15/f92 [0,4194304] 0 2024-04-26T23:09:25.712 INFO:tasks.workunit.client.0.smithi148.stdout:6/795: symlink d6/dc/l109 0 2024-04-26T23:09:25.712 INFO:tasks.workunit.client.0.smithi148.stdout:6/796: fdatasync d6/d9/d1c/f2e 0 2024-04-26T23:09:25.712 INFO:tasks.workunit.client.0.smithi148.stdout:1/834: mkdir d16/d17/d4b/d113 0 2024-04-26T23:09:25.723 INFO:tasks.workunit.client.0.smithi148.stdout:7/766: dread d7/d11/fb0 [0,4194304] 0 2024-04-26T23:09:25.723 INFO:tasks.workunit.client.0.smithi148.stdout:7/767: stat d7/d11/d17/fc4 0 2024-04-26T23:09:25.740 INFO:tasks.workunit.client.0.smithi148.stdout:6/797: mknod d6/d9/d1c/dbf/dec/c10a 0 2024-04-26T23:09:25.742 INFO:tasks.workunit.client.0.smithi148.stdout:2/914: sync 2024-04-26T23:09:25.742 INFO:tasks.workunit.client.0.smithi148.stdout:9/780: sync 2024-04-26T23:09:25.744 INFO:tasks.workunit.client.0.smithi148.stdout:9/781: getdents d19/d1d/d25/d31/d73/dd1 0 2024-04-26T23:09:25.752 INFO:tasks.workunit.client.0.smithi148.stdout:3/696: dread d9/d15/d29/d4d/d78/f98 [4194304,4194304] 0 2024-04-26T23:09:25.752 INFO:tasks.workunit.client.0.smithi148.stdout:3/697: chown d9/d15/d29/d4d/d6f 30 1 2024-04-26T23:09:25.772 INFO:tasks.workunit.client.0.smithi148.stdout:1/835: dwrite d16/d1c/f57 [0,4194304] 0 2024-04-26T23:09:25.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/798: dwrite d6/d9/d23/d4a/f84 [0,4194304] 0 2024-04-26T23:09:25.788 INFO:tasks.workunit.client.0.smithi148.stdout:6/799: rename d6/d9/laf to d6/d9/d23/dc1/l10b 0 2024-04-26T23:09:25.788 INFO:tasks.workunit.client.0.smithi148.stdout:6/800: chown d6/d9/d1c/d1d/de3 75344 1 2024-04-26T23:09:25.795 INFO:tasks.workunit.client.0.smithi148.stdout:2/915: dwrite d5/d10/f58 [0,4194304] 0 2024-04-26T23:09:25.795 INFO:tasks.workunit.client.0.smithi148.stdout:9/782: dread d19/d1d/d25/d2f/d4d/d33/fb3 [0,4194304] 0 2024-04-26T23:09:25.808 INFO:tasks.workunit.client.0.smithi148.stdout:2/916: creat d5/d17/d64/f12d x:0 0 0 2024-04-26T23:09:25.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/828: dwrite d3/d9/d12/d23/d29/d37/f3e [4194304,4194304] 0 2024-04-26T23:09:25.857 INFO:tasks.workunit.client.0.smithi148.stdout:1/836: dread d16/d17/d4b/d53/d67/f105 [0,4194304] 0 2024-04-26T23:09:25.858 INFO:tasks.workunit.client.0.smithi148.stdout:1/837: write d16/d17/d4b/d53/f5e [4507177,114989] 0 2024-04-26T23:09:25.860 INFO:tasks.workunit.client.0.smithi148.stdout:7/768: dwrite d7/f9 [8388608,4194304] 0 2024-04-26T23:09:25.864 INFO:tasks.workunit.client.0.smithi148.stdout:7/769: mknod d7/d11/d17/d2f/d44/de4/dfa/c100 0 2024-04-26T23:09:25.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/843: sync 2024-04-26T23:09:25.880 INFO:tasks.workunit.client.0.smithi148.stdout:4/873: sync 2024-04-26T23:09:25.880 INFO:tasks.workunit.client.0.smithi148.stdout:0/948: sync 2024-04-26T23:09:25.880 INFO:tasks.workunit.client.0.smithi148.stdout:0/949: chown d0/d20/d54 1389 1 2024-04-26T23:09:25.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/844: chown da/d1b/d3b/l84 1866 1 2024-04-26T23:09:25.882 INFO:tasks.workunit.client.0.smithi148.stdout:4/874: mknod d12/d1c/dc8/c11a 0 2024-04-26T23:09:25.883 INFO:tasks.workunit.client.0.smithi148.stdout:5/845: rmdir da/d1b/d3b/db2 39 2024-04-26T23:09:25.883 INFO:tasks.workunit.client.0.smithi148.stdout:5/846: chown da/d1b/d3b/d73/ddd/de5/l118 182 1 2024-04-26T23:09:25.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/875: creat d12/d1c/d56/d87/d9c/da7/f11b x:0 0 0 2024-04-26T23:09:25.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/770: write d7/d11/d29/d2e/d41/d67/d94/d95/fbe [6974454,85814] 0 2024-04-26T23:09:25.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/771: chown d7/d11/d29 2739130 1 2024-04-26T23:09:25.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/838: dread d16/d47/fa0 [0,4194304] 0 2024-04-26T23:09:25.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/839: fsync d16/d17/d4b/dd1/fc9 0 2024-04-26T23:09:25.893 INFO:tasks.workunit.client.0.smithi148.stdout:1/840: mknod d16/d17/d4b/d113/c114 0 2024-04-26T23:09:25.897 INFO:tasks.workunit.client.0.smithi148.stdout:1/841: creat d16/d17/d4b/d55/d90/f115 x:0 0 0 2024-04-26T23:09:25.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/842: getdents d16/d17/d4b/d55 0 2024-04-26T23:09:25.903 INFO:tasks.workunit.client.0.smithi148.stdout:1/843: creat d16/d17/d4b/d113/f116 x:0 0 0 2024-04-26T23:09:25.903 INFO:tasks.workunit.client.0.smithi148.stdout:1/844: write d16/d17/f28 [1252852,28070] 0 2024-04-26T23:09:25.982 INFO:tasks.workunit.client.0.smithi148.stdout:9/783: dwrite d19/d1d/d25/d2f/d4d/d33/daa/d9e/fa8 [0,4194304] 0 2024-04-26T23:09:25.982 INFO:tasks.workunit.client.0.smithi148.stdout:9/784: stat d19/c65 0 2024-04-26T23:09:25.984 INFO:tasks.workunit.client.0.smithi148.stdout:3/698: write d9/d15/d29/f45 [1090435,101491] 0 2024-04-26T23:09:25.992 INFO:tasks.workunit.client.0.smithi148.stdout:3/699: truncate d9/d65/d80/d83/f89 111205 0 2024-04-26T23:09:25.994 INFO:tasks.workunit.client.0.smithi148.stdout:3/700: mknod d9/d15/db1/cd7 0 2024-04-26T23:09:25.995 INFO:tasks.workunit.client.0.smithi148.stdout:3/701: dread - d9/d31/fa9 zero size 2024-04-26T23:09:25.996 INFO:tasks.workunit.client.0.smithi148.stdout:7/772: dwrite d7/d11/fb0 [4194304,4194304] 0 2024-04-26T23:09:25.997 INFO:tasks.workunit.client.0.smithi148.stdout:3/702: getdents d9 0 2024-04-26T23:09:26.001 INFO:tasks.workunit.client.0.smithi148.stdout:3/703: creat d9/d15/fd8 x:0 0 0 2024-04-26T23:09:26.008 INFO:tasks.workunit.client.0.smithi148.stdout:9/785: write d19/d1d/f3b [1740088,886] 0 2024-04-26T23:09:26.022 INFO:tasks.workunit.client.0.smithi148.stdout:8/829: write d3/f76 [3907493,121181] 0 2024-04-26T23:09:26.023 INFO:tasks.workunit.client.0.smithi148.stdout:6/801: dwrite d6/faa [0,4194304] 0 2024-04-26T23:09:26.023 INFO:tasks.workunit.client.0.smithi148.stdout:6/802: fdatasync d6/d9/d1c/d1d/fe4 0 2024-04-26T23:09:26.030 INFO:tasks.workunit.client.0.smithi148.stdout:6/803: creat d6/d9/d23/d4a/f10c x:0 0 0 2024-04-26T23:09:26.034 INFO:tasks.workunit.client.0.smithi148.stdout:2/917: dread d5/d8/d15/ff5 [0,4194304] 0 2024-04-26T23:09:26.038 INFO:tasks.workunit.client.0.smithi148.stdout:2/918: truncate d5/d8/d11/f122 1235842 0 2024-04-26T23:09:26.041 INFO:tasks.workunit.client.0.smithi148.stdout:1/845: dread d16/d17/d4b/d55/f103 [0,4194304] 0 2024-04-26T23:09:26.042 INFO:tasks.workunit.client.0.smithi148.stdout:2/919: rename d5/d8/d4b/d4e/d6d/da0/d100/df1/d8f/cb1 to d5/d17/c12e 0 2024-04-26T23:09:26.046 INFO:tasks.workunit.client.0.smithi148.stdout:2/920: getdents d5/d97 0 2024-04-26T23:09:26.046 INFO:tasks.workunit.client.0.smithi148.stdout:2/921: write d5/d7/f20 [4627501,93700] 0 2024-04-26T23:09:26.060 INFO:tasks.workunit.client.0.smithi148.stdout:1/846: dread d16/d45/d2b/f31 [0,4194304] 0 2024-04-26T23:09:26.063 INFO:tasks.workunit.client.0.smithi148.stdout:1/847: truncate d16/d1c/f57 3028918 0 2024-04-26T23:09:26.063 INFO:tasks.workunit.client.0.smithi148.stdout:1/848: write d16/d45/f35 [2955751,28901] 0 2024-04-26T23:09:26.065 INFO:tasks.workunit.client.0.smithi148.stdout:1/849: rmdir d16/d17 39 2024-04-26T23:09:26.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/950: dwrite d0/d8/d95/d9f/d10e/d12e/d3a/fa2 [4194304,4194304] 0 2024-04-26T23:09:26.076 INFO:tasks.workunit.client.0.smithi148.stdout:0/951: truncate d0/d8/d33/d6a/d70/dd6/d9d/df8/ffe 531689 0 2024-04-26T23:09:26.076 INFO:tasks.workunit.client.0.smithi148.stdout:0/952: dread - d0/d8/d33/d6a/f118 zero size 2024-04-26T23:09:26.092 INFO:tasks.workunit.client.0.smithi148.stdout:8/830: write d3/d9/d12/d23/d29/d77/f8a [982915,91] 0 2024-04-26T23:09:26.092 INFO:tasks.workunit.client.0.smithi148.stdout:8/831: truncate d3/d9/d12/f78 112635 0 2024-04-26T23:09:26.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/922: read d5/d8/f54 [2227812,14124] 0 2024-04-26T23:09:26.095 INFO:tasks.workunit.client.0.smithi148.stdout:6/804: dwrite d6/d9/d1c/d1d/fa0 [0,4194304] 0 2024-04-26T23:09:26.095 INFO:tasks.workunit.client.0.smithi148.stdout:6/805: chown d6/d9/d1c/c22 1513014 1 2024-04-26T23:09:26.098 INFO:tasks.workunit.client.0.smithi148.stdout:8/832: mkdir d3/d9/d12/d23/d29/db2/d106 0 2024-04-26T23:09:26.098 INFO:tasks.workunit.client.0.smithi148.stdout:8/833: truncate d3/f4b 1792047 0 2024-04-26T23:09:26.098 INFO:tasks.workunit.client.0.smithi148.stdout:8/834: dread - d3/d9a/dcd/fff zero size 2024-04-26T23:09:26.100 INFO:tasks.workunit.client.0.smithi148.stdout:2/923: mknod d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/c12f 0 2024-04-26T23:09:26.101 INFO:tasks.workunit.client.0.smithi148.stdout:7/773: dwrite d7/d11/f71 [0,4194304] 0 2024-04-26T23:09:26.101 INFO:tasks.workunit.client.0.smithi148.stdout:3/704: dwrite d9/d15/db1/fbf [0,4194304] 0 2024-04-26T23:09:26.101 INFO:tasks.workunit.client.0.smithi148.stdout:7/774: chown d7/d11/cc9 1467 1 2024-04-26T23:09:26.104 INFO:tasks.workunit.client.0.smithi148.stdout:9/786: dwrite d19/d1d/d25/d2f/f53 [0,4194304] 0 2024-04-26T23:09:26.108 INFO:tasks.workunit.client.0.smithi148.stdout:8/835: creat d3/d9/d12/d23/d65/df8/f107 x:0 0 0 2024-04-26T23:09:26.116 INFO:tasks.workunit.client.0.smithi148.stdout:2/924: creat d5/d8/d4b/d4e/d6d/da0/d100/f130 x:0 0 0 2024-04-26T23:09:26.119 INFO:tasks.workunit.client.0.smithi148.stdout:7/775: unlink d7/d11/d17/d2f/l70 0 2024-04-26T23:09:26.120 INFO:tasks.workunit.client.0.smithi148.stdout:9/787: symlink d19/d1d/d25/d31/d32/l105 0 2024-04-26T23:09:26.122 INFO:tasks.workunit.client.0.smithi148.stdout:7/776: getdents d7/d11/d17/d7c 0 2024-04-26T23:09:26.124 INFO:tasks.workunit.client.0.smithi148.stdout:9/788: creat d19/d1d/d25/d2f/d4d/d33/d50/f106 x:0 0 0 2024-04-26T23:09:26.126 INFO:tasks.workunit.client.0.smithi148.stdout:7/777: getdents d7/d11/d17/d2f/d44/de4/d68 0 2024-04-26T23:09:26.126 INFO:tasks.workunit.client.0.smithi148.stdout:2/925: dread d5/d8/d15/d43/dd4/fc1 [0,4194304] 0 2024-04-26T23:09:26.126 INFO:tasks.workunit.client.0.smithi148.stdout:3/705: dread d9/f43 [0,4194304] 0 2024-04-26T23:09:26.128 INFO:tasks.workunit.client.0.smithi148.stdout:7/778: rename d7/d11/d29/d9a to d7/d11/d17/d2f/d44/de4/d101 0 2024-04-26T23:09:26.134 INFO:tasks.workunit.client.0.smithi148.stdout:2/926: rename d5/d8/d4b/d4e/d6d/da0/d100/df1/ddc/ffa to d5/d8/dc8/f131 0 2024-04-26T23:09:26.134 INFO:tasks.workunit.client.0.smithi148.stdout:2/927: dread - d5/d8/d15/d43/d5d/f11c zero size 2024-04-26T23:09:26.134 INFO:tasks.workunit.client.0.smithi148.stdout:2/928: dread - d5/d7/d73/f10f zero size 2024-04-26T23:09:26.134 INFO:tasks.workunit.client.0.smithi148.stdout:2/929: fdatasync d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/fe4 0 2024-04-26T23:09:26.134 INFO:tasks.workunit.client.0.smithi148.stdout:2/930: fsync d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/f9a 0 2024-04-26T23:09:26.135 INFO:tasks.workunit.client.0.smithi148.stdout:7/779: mknod d7/d19/c102 0 2024-04-26T23:09:26.135 INFO:tasks.workunit.client.0.smithi148.stdout:7/780: stat d7/d11/d17/d9e/fa8 0 2024-04-26T23:09:26.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/931: creat d5/d8/d15/d43/f132 x:0 0 0 2024-04-26T23:09:26.142 INFO:tasks.workunit.client.0.smithi148.stdout:2/932: mkdir d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d87/d133 0 2024-04-26T23:09:26.142 INFO:tasks.workunit.client.0.smithi148.stdout:2/933: stat d5/d10/c57 0 2024-04-26T23:09:26.142 INFO:tasks.workunit.client.0.smithi148.stdout:3/706: write d9/d15/f25 [703919,116968] 0 2024-04-26T23:09:26.143 INFO:tasks.workunit.client.0.smithi148.stdout:2/934: symlink d5/d8/d4b/df4/l134 0 2024-04-26T23:09:26.145 INFO:tasks.workunit.client.0.smithi148.stdout:3/707: creat d9/d15/d29/d4d/d5b/fd9 x:0 0 0 2024-04-26T23:09:26.145 INFO:tasks.workunit.client.0.smithi148.stdout:3/708: fdatasync d9/d52/f62 0 2024-04-26T23:09:26.146 INFO:tasks.workunit.client.0.smithi148.stdout:2/935: unlink d5/d8/d4b/d4e/d6d/da0/d32/f11a 0 2024-04-26T23:09:26.147 INFO:tasks.workunit.client.0.smithi148.stdout:9/789: read d19/d1d/d25/d2f/d4d/d33/d50/fc9 [3199650,116769] 0 2024-04-26T23:09:26.147 INFO:tasks.workunit.client.0.smithi148.stdout:0/953: dwrite d0/d2e/d8f/d6c/fa6 [0,4194304] 0 2024-04-26T23:09:26.147 INFO:tasks.workunit.client.0.smithi148.stdout:0/954: fdatasync d0/d20/d3b/fbb 0 2024-04-26T23:09:26.148 INFO:tasks.workunit.client.0.smithi148.stdout:3/709: rename d9/d31/lb7 to d9/lda 0 2024-04-26T23:09:26.151 INFO:tasks.workunit.client.0.smithi148.stdout:2/936: creat d5/d1c/d38/f135 x:0 0 0 2024-04-26T23:09:26.151 INFO:tasks.workunit.client.0.smithi148.stdout:7/781: write d7/d11/d17/d43/f52 [29156,5827] 0 2024-04-26T23:09:26.153 INFO:tasks.workunit.client.0.smithi148.stdout:3/710: creat d9/d15/d29/d4d/d68/fdb x:0 0 0 2024-04-26T23:09:26.154 INFO:tasks.workunit.client.0.smithi148.stdout:2/937: mkdir d5/d8/d4b/d4e/d6d/da0/d100/d136 0 2024-04-26T23:09:26.155 INFO:tasks.workunit.client.0.smithi148.stdout:7/782: creat d7/d11/d17/d7c/f103 x:0 0 0 2024-04-26T23:09:26.156 INFO:tasks.workunit.client.0.smithi148.stdout:3/711: symlink d9/d31/d8f/ldc 0 2024-04-26T23:09:26.157 INFO:tasks.workunit.client.0.smithi148.stdout:8/836: dwrite d3/da/db6/dfb/fe7 [0,4194304] 0 2024-04-26T23:09:26.158 INFO:tasks.workunit.client.0.smithi148.stdout:2/938: creat d5/d10/f137 x:0 0 0 2024-04-26T23:09:26.160 INFO:tasks.workunit.client.0.smithi148.stdout:8/837: creat d3/d9/d12/d23/d29/db2/f108 x:0 0 0 2024-04-26T23:09:26.161 INFO:tasks.workunit.client.0.smithi148.stdout:7/783: symlink d7/d11/d29/d2e/d41/d67/d94/l104 0 2024-04-26T23:09:26.162 INFO:tasks.workunit.client.0.smithi148.stdout:3/712: dread f5 [0,4194304] 0 2024-04-26T23:09:26.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/838: symlink d3/da/d1c/d7c/l109 0 2024-04-26T23:09:26.162 INFO:tasks.workunit.client.0.smithi148.stdout:3/713: write d9/d4c/f66 [849633,114737] 0 2024-04-26T23:09:26.164 INFO:tasks.workunit.client.0.smithi148.stdout:8/839: mkdir d3/d9/d12/d23/d29/d77/d91/d10a 0 2024-04-26T23:09:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:8/840: rmdir d3/d9/d12/d23/d54 39 2024-04-26T23:09:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:8/841: stat d3/f76 0 2024-04-26T23:09:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/790: dread d19/d39/f54 [0,4194304] 0 2024-04-26T23:09:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/791: write ff [3724343,84743] 0 2024-04-26T23:09:26.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/792: chown d19/l35 24 1 2024-04-26T23:09:26.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/793: write d19/d1d/d25/d31/d60/dba/d85/db2/ffd [1718557,81471] 0 2024-04-26T23:09:26.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/794: fdatasync d19/d1d/d25/d31/d73/dd1/fe0 0 2024-04-26T23:09:26.169 INFO:tasks.workunit.client.0.smithi148.stdout:9/795: truncate d19/d1d/d25/d31/d60/fec 2311689 0 2024-04-26T23:09:26.171 INFO:tasks.workunit.client.0.smithi148.stdout:9/796: creat d19/d1d/d25/d31/d60/dba/f107 x:0 0 0 2024-04-26T23:09:26.176 INFO:tasks.workunit.client.0.smithi148.stdout:0/955: dread d0/d8/d5f/fde [0,4194304] 0 2024-04-26T23:09:26.180 INFO:tasks.workunit.client.0.smithi148.stdout:9/797: creat d19/d1d/d25/d2f/d4d/d33/daa/d9e/f108 x:0 0 0 2024-04-26T23:09:26.182 INFO:tasks.workunit.client.0.smithi148.stdout:7/784: rename d7/d11/d29 to d7/d11/d17/d2f/d44/d105 0 2024-04-26T23:09:26.184 INFO:tasks.workunit.client.0.smithi148.stdout:0/956: creat d0/d8/d33/d6a/d70/dd6/d9d/f13f x:0 0 0 2024-04-26T23:09:26.190 INFO:tasks.workunit.client.0.smithi148.stdout:7/785: write d7/d19/f83 [1187582,89518] 0 2024-04-26T23:09:26.191 INFO:tasks.workunit.client.0.smithi148.stdout:0/957: creat d0/d8/d33/d43/f140 x:0 0 0 2024-04-26T23:09:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/786: creat d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 x:0 0 0 2024-04-26T23:09:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/787: stat d7/d11/d17/d2f/d44/d105/d2e/d41/fed 0 2024-04-26T23:09:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/788: write d7/d11/d17/d2f/d44/d105/d2e/d41/fed [751695,55784] 0 2024-04-26T23:09:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/789: fsync d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/fec 0 2024-04-26T23:09:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:0/958: rmdir d0/d8/d5f/d133 0 2024-04-26T23:09:26.200 INFO:tasks.workunit.client.0.smithi148.stdout:7/790: rename d7/d19/c38 to d7/d11/d17/d2f/d44/d105/d2e/d41/d67/c107 0 2024-04-26T23:09:26.205 INFO:tasks.workunit.client.0.smithi148.stdout:0/959: mknod d0/d8/d33/d68/c141 0 2024-04-26T23:09:26.206 INFO:tasks.workunit.client.0.smithi148.stdout:3/714: dwrite d9/d15/f28 [4194304,4194304] 0 2024-04-26T23:09:26.206 INFO:tasks.workunit.client.0.smithi148.stdout:3/715: chown d9/d65/d80/d83/d99 4 1 2024-04-26T23:09:26.208 INFO:tasks.workunit.client.0.smithi148.stdout:3/716: mknod d9/d31/cdd 0 2024-04-26T23:09:26.208 INFO:tasks.workunit.client.0.smithi148.stdout:0/960: dread d0/f7b [0,4194304] 0 2024-04-26T23:09:26.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/961: write d0/d8/d52/ddd/f131 [543693,31765] 0 2024-04-26T23:09:26.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/962: dread - d0/d8/d33/f45 zero size 2024-04-26T23:09:26.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/963: write d0/d20/d3b/f3c [3161295,98850] 0 2024-04-26T23:09:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/964: creat d0/d2e/d8f/d6c/dab/d132/f142 x:0 0 0 2024-04-26T23:09:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/965: truncate d0/d2e/d8f/d6c/dab/fa7 761580 0 2024-04-26T23:09:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/966: fdatasync d0/d5/ff2 0 2024-04-26T23:09:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/967: write d0/d8/d52/ddd/f10d [927468,54846] 0 2024-04-26T23:09:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/968: write d0/ff6 [95445,127096] 0 2024-04-26T23:09:26.214 INFO:tasks.workunit.client.0.smithi148.stdout:0/969: write d0/d2e/f50 [1316080,109330] 0 2024-04-26T23:09:26.240 INFO:tasks.workunit.client.0.smithi148.stdout:7/791: dwrite d7/d11/d17/d2f/d44/d9b/fbd [0,4194304] 0 2024-04-26T23:09:26.242 INFO:tasks.workunit.client.0.smithi148.stdout:7/792: mknod d7/d11/d17/d2f/d44/d9b/c108 0 2024-04-26T23:09:26.242 INFO:tasks.workunit.client.0.smithi148.stdout:7/793: chown d7/d11/d17/d2f/d44/d105/d2e/d41/l8c 22421033 1 2024-04-26T23:09:26.244 INFO:tasks.workunit.client.0.smithi148.stdout:7/794: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d109 0 2024-04-26T23:09:26.245 INFO:tasks.workunit.client.0.smithi148.stdout:7/795: unlink d7/d19/c3d 0 2024-04-26T23:09:26.259 INFO:tasks.workunit.client.0.smithi148.stdout:9/798: dread f2 [0,4194304] 0 2024-04-26T23:09:26.259 INFO:tasks.workunit.client.0.smithi148.stdout:8/842: dwrite d3/d9/d12/d23/d29/d37/f63 [4194304,4194304] 0 2024-04-26T23:09:26.313 INFO:tasks.workunit.client.0.smithi148.stdout:0/970: dwrite d0/d8/d5f/fde [4194304,4194304] 0 2024-04-26T23:09:26.316 INFO:tasks.workunit.client.0.smithi148.stdout:0/971: unlink d0/d20/d3b/f11a 0 2024-04-26T23:09:26.324 INFO:tasks.workunit.client.0.smithi148.stdout:7/796: dread d7/f15 [0,4194304] 0 2024-04-26T23:09:26.324 INFO:tasks.workunit.client.0.smithi148.stdout:7/797: write d7/d11/d17/d7c/f103 [487043,9275] 0 2024-04-26T23:09:26.324 INFO:tasks.workunit.client.0.smithi148.stdout:7/798: chown d7/d19/l9c 4373113 1 2024-04-26T23:09:26.333 INFO:tasks.workunit.client.0.smithi148.stdout:9/799: read d19/d1d/d25/d2f/f53 [4448293,48855] 0 2024-04-26T23:09:26.333 INFO:tasks.workunit.client.0.smithi148.stdout:9/800: write f13 [2120161,38529] 0 2024-04-26T23:09:26.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/717: dwrite d9/f36 [0,4194304] 0 2024-04-26T23:09:26.334 INFO:tasks.workunit.client.0.smithi148.stdout:3/718: dread - d9/d15/d29/d4d/d6f/f97 zero size 2024-04-26T23:09:26.338 INFO:tasks.workunit.client.0.smithi148.stdout:7/799: rename d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/fb5 to d7/d11/f10a 0 2024-04-26T23:09:26.346 INFO:tasks.workunit.client.0.smithi148.stdout:9/801: creat d19/d1d/d25/d31/d48/f109 x:0 0 0 2024-04-26T23:09:26.346 INFO:tasks.workunit.client.0.smithi148.stdout:9/802: chown d19/d1d/d25/d2f 963 1 2024-04-26T23:09:26.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/803: chown d19/d39/l9b 63589346 1 2024-04-26T23:09:26.350 INFO:tasks.workunit.client.0.smithi148.stdout:1/850: sync 2024-04-26T23:09:26.351 INFO:tasks.workunit.client.0.smithi148.stdout:6/806: sync 2024-04-26T23:09:26.351 INFO:tasks.workunit.client.0.smithi148.stdout:6/807: fdatasync d6/d9/d1c/d1d/d68/dbc/ffe 0 2024-04-26T23:09:26.351 INFO:tasks.workunit.client.0.smithi148.stdout:6/808: stat d6/f47 0 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:5/847: sync 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/809: creat d6/d9/d1c/d1d/d1f/d40/f10d x:0 0 0 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:4/876: sync 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:5/848: truncate da/d1b/d1c/f11d 609093 0 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:3/719: rename d9/d31/dc3/dca/fa5 to d9/d52/fde 0 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:5/849: write da/d1b/fed [5128433,97048] 0 2024-04-26T23:09:26.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/810: symlink d6/d9/d23/dc1/df8/dfb/l10e 0 2024-04-26T23:09:26.371 INFO:tasks.workunit.client.0.smithi148.stdout:3/720: truncate d9/d15/f92 25451 0 2024-04-26T23:09:26.374 INFO:tasks.workunit.client.0.smithi148.stdout:5/850: rename da/d1b/d5b/l4e to da/d1b/d5b/d5e/dc5/l12c 0 2024-04-26T23:09:26.374 INFO:tasks.workunit.client.0.smithi148.stdout:5/851: fsync da/d68/d69/daa/f102 0 2024-04-26T23:09:26.375 INFO:tasks.workunit.client.0.smithi148.stdout:6/811: symlink d6/d14/l10f 0 2024-04-26T23:09:26.381 INFO:tasks.workunit.client.0.smithi148.stdout:3/721: mkdir d9/d15/d29/d4d/d68/dd6/ddf 0 2024-04-26T23:09:26.385 INFO:tasks.workunit.client.0.smithi148.stdout:4/877: dread d12/d1c/d56/d87/d9c/da1/ff2 [0,4194304] 0 2024-04-26T23:09:26.385 INFO:tasks.workunit.client.0.smithi148.stdout:4/878: fsync d12/d1c/d56/d87/d9a/d9d/f90 0 2024-04-26T23:09:26.386 INFO:tasks.workunit.client.0.smithi148.stdout:5/852: getdents da/d1b/d3b/d73/ddd 0 2024-04-26T23:09:26.387 INFO:tasks.workunit.client.0.smithi148.stdout:5/853: write da/d1b/d2d/f60 [88900,128036] 0 2024-04-26T23:09:26.389 INFO:tasks.workunit.client.0.smithi148.stdout:6/812: truncate d6/d9/d1c/d1d/d1f/f59 4918537 0 2024-04-26T23:09:26.389 INFO:tasks.workunit.client.0.smithi148.stdout:1/851: dwrite d16/d47/d73/ffd [0,4194304] 0 2024-04-26T23:09:26.391 INFO:tasks.workunit.client.0.smithi148.stdout:4/879: mkdir d12/d17/d11c 0 2024-04-26T23:09:26.391 INFO:tasks.workunit.client.0.smithi148.stdout:4/880: readlink d12/d1c/d45/dc2/lf9 0 2024-04-26T23:09:26.397 INFO:tasks.workunit.client.0.smithi148.stdout:5/854: rename da/d68/d69/daa/dc0/le3 to da/d1b/d5b/de1/l12d 0 2024-04-26T23:09:26.397 INFO:tasks.workunit.client.0.smithi148.stdout:5/855: chown da/d1b/d3b/d73/l112 253914718 1 2024-04-26T23:09:26.398 INFO:tasks.workunit.client.0.smithi148.stdout:1/852: creat d16/d17/d77/f117 x:0 0 0 2024-04-26T23:09:26.398 INFO:tasks.workunit.client.0.smithi148.stdout:1/853: chown d16/d17/f1a 47423188 1 2024-04-26T23:09:26.398 INFO:tasks.workunit.client.0.smithi148.stdout:4/881: symlink d12/d17/d2a/d37/ded/l11d 0 2024-04-26T23:09:26.410 INFO:tasks.workunit.client.0.smithi148.stdout:1/854: unlink d16/d45/d7d/fe6 0 2024-04-26T23:09:26.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/882: symlink d12/d1c/d56/d87/d9c/da1/dc3/l11e 0 2024-04-26T23:09:26.432 INFO:tasks.workunit.client.0.smithi148.stdout:5/856: write da/d1b/d2d/f7b [3426302,72981] 0 2024-04-26T23:09:26.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/857: chown da/d1b/d3b/d73/l112 499 1 2024-04-26T23:09:26.440 INFO:tasks.workunit.client.0.smithi148.stdout:3/722: dwrite d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:26.444 INFO:tasks.workunit.client.0.smithi148.stdout:3/723: dread d9/d65/f91 [0,4194304] 0 2024-04-26T23:09:26.447 INFO:tasks.workunit.client.0.smithi148.stdout:6/813: dwrite d6/d9/d23/d4a/f70 [4194304,4194304] 0 2024-04-26T23:09:26.452 INFO:tasks.workunit.client.0.smithi148.stdout:1/855: truncate d16/f1d 672324 0 2024-04-26T23:09:26.454 INFO:tasks.workunit.client.0.smithi148.stdout:4/883: dwrite d12/d1c/dc0/fe8 [0,4194304] 0 2024-04-26T23:09:26.454 INFO:tasks.workunit.client.0.smithi148.stdout:8/843: dwrite d3/da/d1c/d7c/d8c/d9f/fee [0,4194304] 0 2024-04-26T23:09:26.457 INFO:tasks.workunit.client.0.smithi148.stdout:6/814: mkdir d6/d9/d23/d4a/d110 0 2024-04-26T23:09:26.457 INFO:tasks.workunit.client.0.smithi148.stdout:4/884: creat d12/d1c/dc8/dda/f11f x:0 0 0 2024-04-26T23:09:26.459 INFO:tasks.workunit.client.0.smithi148.stdout:5/858: rename c8 to da/d68/d69/dc9/d125/c12e 0 2024-04-26T23:09:26.460 INFO:tasks.workunit.client.0.smithi148.stdout:8/844: symlink d3/d9/d12/d23/d29/db2/l10b 0 2024-04-26T23:09:26.460 INFO:tasks.workunit.client.0.smithi148.stdout:8/845: readlink d3/d9/d12/d23/l32 0 2024-04-26T23:09:26.463 INFO:tasks.workunit.client.0.smithi148.stdout:4/885: mknod d12/d1c/d45/d75/c120 0 2024-04-26T23:09:26.464 INFO:tasks.workunit.client.0.smithi148.stdout:4/886: chown d12/d1c/d56/fb6 72646 1 2024-04-26T23:09:26.475 INFO:tasks.workunit.client.0.smithi148.stdout:6/815: dread d6/d9/d1c/f2e [0,4194304] 0 2024-04-26T23:09:26.477 INFO:tasks.workunit.client.0.smithi148.stdout:8/846: creat d3/d9a/f10c x:0 0 0 2024-04-26T23:09:26.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/972: dwrite d0/d8/d33/d6a/d70/dd6/fd3 [0,4194304] 0 2024-04-26T23:09:26.478 INFO:tasks.workunit.client.0.smithi148.stdout:4/887: mknod d12/d1c/d45/dc2/dd4/c121 0 2024-04-26T23:09:26.480 INFO:tasks.workunit.client.0.smithi148.stdout:6/816: dread d6/d9/d1c/f94 [0,4194304] 0 2024-04-26T23:09:26.480 INFO:tasks.workunit.client.0.smithi148.stdout:8/847: creat d3/d9/d12/d23/d29/db2/d106/f10d x:0 0 0 2024-04-26T23:09:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:1/856: write d16/d17/d4b/d59/fe1 [1297202,21028] 0 2024-04-26T23:09:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:1/857: readlink d16/d17/d77/lf9 0 2024-04-26T23:09:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:1/858: readlink d16/d17/d4b/d53/l64 0 2024-04-26T23:09:26.496 INFO:tasks.workunit.client.0.smithi148.stdout:2/939: sync 2024-04-26T23:09:26.496 INFO:tasks.workunit.client.0.smithi148.stdout:5/859: dwrite da/d1a/f9f [0,4194304] 0 2024-04-26T23:09:26.498 INFO:tasks.workunit.client.0.smithi148.stdout:1/859: dread d16/d45/d2b/fd7 [0,4194304] 0 2024-04-26T23:09:26.498 INFO:tasks.workunit.client.0.smithi148.stdout:6/817: mknod d6/dbe/c111 0 2024-04-26T23:09:26.498 INFO:tasks.workunit.client.0.smithi148.stdout:6/818: chown d6/d9/d23/c2d 0 1 2024-04-26T23:09:26.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/860: write da/d68/f80 [291020,38426] 0 2024-04-26T23:09:26.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/861: read da/d1b/d5b/d117/fc3 [3533827,58714] 0 2024-04-26T23:09:26.503 INFO:tasks.workunit.client.0.smithi148.stdout:4/888: read d12/d1c/d45/fd6 [7193849,15086] 0 2024-04-26T23:09:26.503 INFO:tasks.workunit.client.0.smithi148.stdout:4/889: chown d12/d1c/d56/d87/f104 4119685 1 2024-04-26T23:09:26.504 INFO:tasks.workunit.client.0.smithi148.stdout:2/940: symlink d5/d8/d4b/d4e/d6d/da0/d100/df1/l138 0 2024-04-26T23:09:26.504 INFO:tasks.workunit.client.0.smithi148.stdout:2/941: truncate d5/d8/d9/d3d/f11b 84458 0 2024-04-26T23:09:26.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/890: mkdir d12/d1c/d56/d87/d122 0 2024-04-26T23:09:26.510 INFO:tasks.workunit.client.0.smithi148.stdout:2/942: creat d5/d8/d15/d7d/d111/f139 x:0 0 0 2024-04-26T23:09:26.511 INFO:tasks.workunit.client.0.smithi148.stdout:1/860: read d16/d17/d68/f91 [212101,17550] 0 2024-04-26T23:09:26.513 INFO:tasks.workunit.client.0.smithi148.stdout:2/943: dread d5/d7/fb [0,4194304] 0 2024-04-26T23:09:26.514 INFO:tasks.workunit.client.0.smithi148.stdout:4/891: getdents d12/d1c/dc0 0 2024-04-26T23:09:26.514 INFO:tasks.workunit.client.0.smithi148.stdout:1/861: mkdir d16/d1c/d118 0 2024-04-26T23:09:26.515 INFO:tasks.workunit.client.0.smithi148.stdout:6/819: write d6/d9/f64 [3740607,76516] 0 2024-04-26T23:09:26.515 INFO:tasks.workunit.client.0.smithi148.stdout:6/820: write d6/d9/d1c/d1d/d68/fac [338321,17339] 0 2024-04-26T23:09:26.516 INFO:tasks.workunit.client.0.smithi148.stdout:2/944: rename d5/d8/d4b/d4e/d6d/da0/d100/df1 to d5/d17/d64/d13a 0 2024-04-26T23:09:26.517 INFO:tasks.workunit.client.0.smithi148.stdout:4/892: symlink d12/l123 0 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/862: link d16/d45/d2b/d3e/d5a/fd8 d16/d47/d49/d95/f119 0 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/863: chown d16/d17/d4b/d55/f103 483182 1 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/864: truncate d16/d17/d68/d6b/d8b/fe4 205066 0 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/865: chown d16/d1c/f3c 93776956 1 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/866: truncate d16/f37 1285079 0 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:1/867: read - d16/d1c/d84/da7/f10b zero size 2024-04-26T23:09:26.519 INFO:tasks.workunit.client.0.smithi148.stdout:2/945: rmdir d5/d8/d4b/d4e/d6d/da0/d78/df3/d86 39 2024-04-26T23:09:26.520 INFO:tasks.workunit.client.0.smithi148.stdout:4/893: creat d12/d1c/f124 x:0 0 0 2024-04-26T23:09:26.520 INFO:tasks.workunit.client.0.smithi148.stdout:4/894: fsync d12/dbd/d103/f10a 0 2024-04-26T23:09:26.521 INFO:tasks.workunit.client.0.smithi148.stdout:1/868: rename d16/d1c/d84/d94 to d16/d1c/d82/d11a 0 2024-04-26T23:09:26.539 INFO:tasks.workunit.client.0.smithi148.stdout:1/869: dread d16/d17/d4b/d53/d67/fcc [0,4194304] 0 2024-04-26T23:09:26.566 INFO:tasks.workunit.client.0.smithi148.stdout:0/973: write d0/d8/d33/d6a/d70/dd6/d9d/db4/fb5 [2321641,9298] 0 2024-04-26T23:09:26.567 INFO:tasks.workunit.client.0.smithi148.stdout:8/848: dwrite d3/d9/d12/d23/f100 [0,4194304] 0 2024-04-26T23:09:26.567 INFO:tasks.workunit.client.0.smithi148.stdout:2/946: creat d5/d8/d15/d7d/d111/f13b x:0 0 0 2024-04-26T23:09:26.567 INFO:tasks.workunit.client.0.smithi148.stdout:4/895: getdents d12/d1c/dc8/dda 0 2024-04-26T23:09:26.568 INFO:tasks.workunit.client.0.smithi148.stdout:4/896: write d12/fdb [1284483,127383] 0 2024-04-26T23:09:26.568 INFO:tasks.workunit.client.0.smithi148.stdout:4/897: dread - d12/d1c/d56/d87/d9c/f111 zero size 2024-04-26T23:09:26.569 INFO:tasks.workunit.client.0.smithi148.stdout:0/974: creat d0/d2e/d8f/d6c/dab/f143 x:0 0 0 2024-04-26T23:09:26.569 INFO:tasks.workunit.client.0.smithi148.stdout:6/821: dwrite d6/d9/f7e [0,4194304] 0 2024-04-26T23:09:26.570 INFO:tasks.workunit.client.0.smithi148.stdout:8/849: rename d3/da/d1c/ld1 to d3/da/db6/dfb/l10e 0 2024-04-26T23:09:26.572 INFO:tasks.workunit.client.0.smithi148.stdout:2/947: truncate d5/d8/d9/fc 1177766 0 2024-04-26T23:09:26.593 INFO:tasks.workunit.client.0.smithi148.stdout:0/975: dread d0/d20/f40 [0,4194304] 0 2024-04-26T23:09:26.594 INFO:tasks.workunit.client.0.smithi148.stdout:0/976: dread - d0/d2e/d8f/d6c/dab/f11f zero size 2024-04-26T23:09:26.600 INFO:tasks.workunit.client.0.smithi148.stdout:1/870: dwrite d16/d17/d4b/d53/f5e [0,4194304] 0 2024-04-26T23:09:26.600 INFO:tasks.workunit.client.0.smithi148.stdout:1/871: read d16/d17/d4b/d59/fe1 [1479587,115245] 0 2024-04-26T23:09:26.600 INFO:tasks.workunit.client.0.smithi148.stdout:6/822: rename d6/d9/d23/d4a/f67 to d6/d9/d1c/dbf/dec/f112 0 2024-04-26T23:09:26.602 INFO:tasks.workunit.client.0.smithi148.stdout:0/977: rename d0/d8/d33/d43/d4e/f109 to d0/d8/d33/d43/d4e/f144 0 2024-04-26T23:09:26.603 INFO:tasks.workunit.client.0.smithi148.stdout:1/872: creat d16/d47/d49/d95/f11b x:0 0 0 2024-04-26T23:09:26.604 INFO:tasks.workunit.client.0.smithi148.stdout:6/823: mkdir d6/d9/d1c/d1d/d1f/d40/d113 0 2024-04-26T23:09:26.604 INFO:tasks.workunit.client.0.smithi148.stdout:6/824: stat d6/d9/d1c/d5b/cb1 0 2024-04-26T23:09:26.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/825: read d6/d9/d1c/ff4 [541527,48047] 0 2024-04-26T23:09:26.610 INFO:tasks.workunit.client.0.smithi148.stdout:0/978: creat d0/d8/d33/d6a/d70/dd6/f145 x:0 0 0 2024-04-26T23:09:26.610 INFO:tasks.workunit.client.0.smithi148.stdout:0/979: readlink d0/d8/d95/d9f/d10e/d12e/l5a 0 2024-04-26T23:09:26.611 INFO:tasks.workunit.client.0.smithi148.stdout:6/826: creat d6/d9/d1c/d1d/d68/f114 x:0 0 0 2024-04-26T23:09:26.614 INFO:tasks.workunit.client.0.smithi148.stdout:6/827: creat d6/d14/d91/f115 x:0 0 0 2024-04-26T23:09:26.637 INFO:tasks.workunit.client.0.smithi148.stdout:2/948: dwrite d5/d8/d15/d43/d8d/fbd [0,4194304] 0 2024-04-26T23:09:26.641 INFO:tasks.workunit.client.0.smithi148.stdout:0/980: link d0/d5/d84/f100 d0/f146 0 2024-04-26T23:09:26.644 INFO:tasks.workunit.client.0.smithi148.stdout:2/949: mknod d5/d97/dfd/c13c 0 2024-04-26T23:09:26.646 INFO:tasks.workunit.client.0.smithi148.stdout:8/850: dwrite d3/d9/d12/d23/d29/d37/f63 [4194304,4194304] 0 2024-04-26T23:09:26.649 INFO:tasks.workunit.client.0.smithi148.stdout:0/981: creat d0/d2e/d8f/d6c/dab/d132/f147 x:0 0 0 2024-04-26T23:09:26.651 INFO:tasks.workunit.client.0.smithi148.stdout:8/851: mkdir d3/da/d1c/d7c/d10f 0 2024-04-26T23:09:26.653 INFO:tasks.workunit.client.0.smithi148.stdout:0/982: mkdir d0/d2e/d8f/dd8/d124/d148 0 2024-04-26T23:09:26.655 INFO:tasks.workunit.client.0.smithi148.stdout:8/852: getdents d3/da/d1c 0 2024-04-26T23:09:26.656 INFO:tasks.workunit.client.0.smithi148.stdout:0/983: symlink d0/d2e/d10f/l149 0 2024-04-26T23:09:26.656 INFO:tasks.workunit.client.0.smithi148.stdout:0/984: stat d0/d8/d33/d6a/d70/dd6/l7a 0 2024-04-26T23:09:26.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/853: link d3/da/d1c/d7c/d8c/d9f/f51 d3/da/f110 0 2024-04-26T23:09:26.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/854: chown d3/da/ce 3548733 1 2024-04-26T23:09:26.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/855: truncate d3/da/d1c/d7c/d8c/d9f/f51 5075206 0 2024-04-26T23:09:26.661 INFO:tasks.workunit.client.0.smithi148.stdout:0/985: truncate d0/d8/d33/d6a/f6e 2434918 0 2024-04-26T23:09:26.663 INFO:tasks.workunit.client.0.smithi148.stdout:6/828: dwrite d6/d32/f8b [4194304,4194304] 0 2024-04-26T23:09:26.664 INFO:tasks.workunit.client.0.smithi148.stdout:6/829: stat d6/d32/f63 0 2024-04-26T23:09:26.676 INFO:tasks.workunit.client.0.smithi148.stdout:4/898: dwrite d12/d1c/dc0/fe8 [0,4194304] 0 2024-04-26T23:09:26.676 INFO:tasks.workunit.client.0.smithi148.stdout:8/856: creat d3/d9/d12/d23/d35/f111 x:0 0 0 2024-04-26T23:09:26.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/950: dwrite d5/d8/dc8/f131 [0,4194304] 0 2024-04-26T23:09:26.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/951: fsync d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/f9a 0 2024-04-26T23:09:26.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/952: stat d5/d8/dc8/lf6 0 2024-04-26T23:09:26.682 INFO:tasks.workunit.client.0.smithi148.stdout:4/899: creat d12/d1c/d56/d87/d9a/d9d/f125 x:0 0 0 2024-04-26T23:09:26.682 INFO:tasks.workunit.client.0.smithi148.stdout:4/900: readlink d12/d17/d2a/le2 0 2024-04-26T23:09:26.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/953: link d5/d97/caa d5/d8/d15/d7d/d111/c13d 0 2024-04-26T23:09:26.686 INFO:tasks.workunit.client.0.smithi148.stdout:4/901: creat d12/d1c/dc8/f126 x:0 0 0 2024-04-26T23:09:26.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/986: dwrite d0/d20/d3b/f113 [0,4194304] 0 2024-04-26T23:09:26.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/987: stat d0/d5/f129 0 2024-04-26T23:09:26.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/988: readlink d0/d5/df7/d102/l134 0 2024-04-26T23:09:26.709 INFO:tasks.workunit.client.0.smithi148.stdout:2/954: symlink d5/d17/d64/d13a/d8f/d106/l13e 0 2024-04-26T23:09:26.713 INFO:tasks.workunit.client.0.smithi148.stdout:0/989: dread d0/d8/d33/d43/d4e/fbd [0,4194304] 0 2024-04-26T23:09:26.713 INFO:tasks.workunit.client.0.smithi148.stdout:0/990: stat d0/d8/d33/d43/d4e/fbd 0 2024-04-26T23:09:26.720 INFO:tasks.workunit.client.0.smithi148.stdout:6/830: write d6/faa [2003194,64739] 0 2024-04-26T23:09:26.720 INFO:tasks.workunit.client.0.smithi148.stdout:1/873: dwrite d16/d17/f39 [0,4194304] 0 2024-04-26T23:09:26.723 INFO:tasks.workunit.client.0.smithi148.stdout:2/955: dread d5/d8/f3e [0,4194304] 0 2024-04-26T23:09:26.723 INFO:tasks.workunit.client.0.smithi148.stdout:2/956: stat d5/d8/d15/d43/d5d 0 2024-04-26T23:09:26.723 INFO:tasks.workunit.client.0.smithi148.stdout:2/957: fdatasync d5/d8/d4b/d4e/d6d/da0/d32/f37 0 2024-04-26T23:09:26.728 INFO:tasks.workunit.client.0.smithi148.stdout:6/831: creat d6/d32/dfd/f116 x:0 0 0 2024-04-26T23:09:26.740 INFO:tasks.workunit.client.0.smithi148.stdout:2/958: truncate d5/d8/d9/d3d/fe8 1584720 0 2024-04-26T23:09:26.740 INFO:tasks.workunit.client.0.smithi148.stdout:2/959: write d5/d8/d11/f125 [620099,68112] 0 2024-04-26T23:09:26.742 INFO:tasks.workunit.client.0.smithi148.stdout:1/874: truncate d16/d17/d68/f8c 1303803 0 2024-04-26T23:09:26.742 INFO:tasks.workunit.client.0.smithi148.stdout:1/875: fdatasync d16/d47/fa0 0 2024-04-26T23:09:26.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/832: truncate d6/d14/fd9 586856 0 2024-04-26T23:09:26.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/833: chown d6/dbe/ddc/dff 77098 1 2024-04-26T23:09:26.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/902: dwrite d12/d1c/d45/fd6 [4194304,4194304] 0 2024-04-26T23:09:26.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/903: write d12/d17/fca [1078490,52373] 0 2024-04-26T23:09:26.749 INFO:tasks.workunit.client.0.smithi148.stdout:7/800: sync 2024-04-26T23:09:26.757 INFO:tasks.workunit.client.0.smithi148.stdout:2/960: write d5/d17/d64/d88/fc6 [2504325,82680] 0 2024-04-26T23:09:26.772 INFO:tasks.workunit.client.0.smithi148.stdout:9/804: sync 2024-04-26T23:09:26.772 INFO:tasks.workunit.client.0.smithi148.stdout:1/876: unlink d16/d1c/f32 0 2024-04-26T23:09:26.772 INFO:tasks.workunit.client.0.smithi148.stdout:6/834: rename d6/d32/fc0 to d6/d9/d23/dc1/f117 0 2024-04-26T23:09:26.772 INFO:tasks.workunit.client.0.smithi148.stdout:2/961: getdents d5/d8/d4b/d4e/d6d/da0/d32 0 2024-04-26T23:09:26.784 INFO:tasks.workunit.client.0.smithi148.stdout:1/877: mknod d16/d47/dd2/c11c 0 2024-04-26T23:09:26.784 INFO:tasks.workunit.client.0.smithi148.stdout:7/801: rename d7/l3b to d7/d11/d17/d2f/d44/d105/d2e/l10b 0 2024-04-26T23:09:26.785 INFO:tasks.workunit.client.0.smithi148.stdout:1/878: readlink d16/d17/d4b/d59/l5f 0 2024-04-26T23:09:26.785 INFO:tasks.workunit.client.0.smithi148.stdout:6/835: mknod d6/d9/d1c/d1d/d68/dc9/c118 0 2024-04-26T23:09:26.785 INFO:tasks.workunit.client.0.smithi148.stdout:1/879: fsync d16/f4e 0 2024-04-26T23:09:26.785 INFO:tasks.workunit.client.0.smithi148.stdout:2/962: creat d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d120/f13f x:0 0 0 2024-04-26T23:09:26.788 INFO:tasks.workunit.client.0.smithi148.stdout:2/963: truncate d5/d10/f14 70072 0 2024-04-26T23:09:26.790 INFO:tasks.workunit.client.0.smithi148.stdout:7/802: creat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d109/f10c x:0 0 0 2024-04-26T23:09:26.796 INFO:tasks.workunit.client.0.smithi148.stdout:1/880: rename d16/d1c/fc6 to d16/d17/d4b/d59/f11d 0 2024-04-26T23:09:26.801 INFO:tasks.workunit.client.0.smithi148.stdout:1/881: write d16/f4a [984252,101024] 0 2024-04-26T23:09:26.801 INFO:tasks.workunit.client.0.smithi148.stdout:1/882: stat d16/d47/d49/d95/f119 0 2024-04-26T23:09:26.811 INFO:tasks.workunit.client.0.smithi148.stdout:8/857: dwrite d3/d9/d12/d23/d35/f90 [0,4194304] 0 2024-04-26T23:09:26.814 INFO:tasks.workunit.client.0.smithi148.stdout:4/904: dwrite d12/d1c/d56/d87/d9a/d9d/fbc [0,4194304] 0 2024-04-26T23:09:26.817 INFO:tasks.workunit.client.0.smithi148.stdout:4/905: unlink d12/d17/d2a/d37/d97/dec/l101 0 2024-04-26T23:09:26.817 INFO:tasks.workunit.client.0.smithi148.stdout:4/906: chown d12/dbd/fff 184315079 1 2024-04-26T23:09:26.819 INFO:tasks.workunit.client.0.smithi148.stdout:4/907: creat d12/dbd/d103/f127 x:0 0 0 2024-04-26T23:09:26.824 INFO:tasks.workunit.client.0.smithi148.stdout:9/805: dwrite d19/d1d/d25/d31/f56 [0,4194304] 0 2024-04-26T23:09:26.824 INFO:tasks.workunit.client.0.smithi148.stdout:9/806: getdents d19/d1d/d25/d2f/d4d 0 2024-04-26T23:09:26.824 INFO:tasks.workunit.client.0.smithi148.stdout:9/807: chown f13 1489848152 1 2024-04-26T23:09:26.827 INFO:tasks.workunit.client.0.smithi148.stdout:9/808: unlink d19/d1d/f51 0 2024-04-26T23:09:26.829 INFO:tasks.workunit.client.0.smithi148.stdout:9/809: rename d19/d1d/d25/d31/d48/fd8 to d19/d1d/d25/d78/f10a 0 2024-04-26T23:09:26.838 INFO:tasks.workunit.client.0.smithi148.stdout:3/724: sync 2024-04-26T23:09:26.839 INFO:tasks.workunit.client.0.smithi148.stdout:3/725: rmdir d9/d15/d29/d4d/d68/dd6/ddf 0 2024-04-26T23:09:26.840 INFO:tasks.workunit.client.0.smithi148.stdout:9/810: dread d19/d1d/d25/d2f/d4d/d33/d50/fc9 [0,4194304] 0 2024-04-26T23:09:26.840 INFO:tasks.workunit.client.0.smithi148.stdout:9/811: chown d19/d1d/d25/d31/d48/f109 26570593 1 2024-04-26T23:09:26.842 INFO:tasks.workunit.client.0.smithi148.stdout:9/812: link d19/d1d/d25/d31/d48/d8c/dab/c6b d19/d9f/c10b 0 2024-04-26T23:09:26.842 INFO:tasks.workunit.client.0.smithi148.stdout:9/813: write d19/d1d/d25/d31/d32/f91 [567668,93100] 0 2024-04-26T23:09:26.843 INFO:tasks.workunit.client.0.smithi148.stdout:9/814: mknod d19/d1d/d25/d31/d60/dba/c10c 0 2024-04-26T23:09:26.843 INFO:tasks.workunit.client.0.smithi148.stdout:8/858: dread d3/d9a/f9d [0,4194304] 0 2024-04-26T23:09:26.844 INFO:tasks.workunit.client.0.smithi148.stdout:8/859: write d3/d9/d12/d23/d35/f90 [4362016,99413] 0 2024-04-26T23:09:26.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/815: creat d19/d1d/d49/f10d x:0 0 0 2024-04-26T23:09:26.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/816: chown d19/d1d/d25/d31/d60/dba/f107 5 1 2024-04-26T23:09:26.845 INFO:tasks.workunit.client.0.smithi148.stdout:8/860: symlink d3/d9/d12/d23/d54/d60/l112 0 2024-04-26T23:09:26.846 INFO:tasks.workunit.client.0.smithi148.stdout:9/817: rmdir d19/d1d/d25/d31/d73 39 2024-04-26T23:09:26.848 INFO:tasks.workunit.client.0.smithi148.stdout:0/991: dwrite d0/d8/d33/d43/d4e/fbe [0,4194304] 0 2024-04-26T23:09:26.848 INFO:tasks.workunit.client.0.smithi148.stdout:7/803: dwrite d7/f12 [0,4194304] 0 2024-04-26T23:09:26.848 INFO:tasks.workunit.client.0.smithi148.stdout:9/818: read d19/d1d/d25/d31/f45 [2383584,31707] 0 2024-04-26T23:09:26.848 INFO:tasks.workunit.client.0.smithi148.stdout:9/819: chown d19/d1d/d25/d31/f56 15 1 2024-04-26T23:09:26.849 INFO:tasks.workunit.client.0.smithi148.stdout:9/820: fdatasync d19/d1d/d25/d2f/f98 0 2024-04-26T23:09:26.849 INFO:tasks.workunit.client.0.smithi148.stdout:0/992: mkdir d0/d8/d33/d43/d14a 0 2024-04-26T23:09:26.849 INFO:tasks.workunit.client.0.smithi148.stdout:0/993: dread - d0/d8/d33/d6a/f118 zero size 2024-04-26T23:09:26.850 INFO:tasks.workunit.client.0.smithi148.stdout:0/994: chown d0/d8/d52/c6f 26008 1 2024-04-26T23:09:26.850 INFO:tasks.workunit.client.0.smithi148.stdout:0/995: fdatasync d0/d8/d33/d43/f140 0 2024-04-26T23:09:26.857 INFO:tasks.workunit.client.0.smithi148.stdout:9/821: link d19/d1d/l7c d19/d1d/d25/d2f/d4d/d33/daa/d9e/l10e 0 2024-04-26T23:09:26.873 INFO:tasks.workunit.client.0.smithi148.stdout:8/861: write d3/d9/f58 [769309,48361] 0 2024-04-26T23:09:26.875 INFO:tasks.workunit.client.0.smithi148.stdout:8/862: symlink d3/d9/d12/d23/d35/de9/l113 0 2024-04-26T23:09:26.875 INFO:tasks.workunit.client.0.smithi148.stdout:8/863: fdatasync d3/d9/d12/d23/d29/ff9 0 2024-04-26T23:09:26.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/804: dread d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/fc1 [0,4194304] 0 2024-04-26T23:09:26.876 INFO:tasks.workunit.client.0.smithi148.stdout:8/864: getdents d3/da/d1c/d7c/d8c/d9f/dcf 0 2024-04-26T23:09:26.879 INFO:tasks.workunit.client.0.smithi148.stdout:8/865: symlink d3/da/d28/l114 0 2024-04-26T23:09:26.879 INFO:tasks.workunit.client.0.smithi148.stdout:8/866: write d3/d9/d12/d23/d65/fc5 [39552,65955] 0 2024-04-26T23:09:26.879 INFO:tasks.workunit.client.0.smithi148.stdout:8/867: fsync d3/d9/d12/d23/d35/faf 0 2024-04-26T23:09:26.881 INFO:tasks.workunit.client.0.smithi148.stdout:8/868: creat d3/d9/d12/d23/d29/d37/f115 x:0 0 0 2024-04-26T23:09:26.881 INFO:tasks.workunit.client.0.smithi148.stdout:8/869: write d3/d9/d12/f46 [4694079,19633] 0 2024-04-26T23:09:26.882 INFO:tasks.workunit.client.0.smithi148.stdout:8/870: truncate d3/d9/d12/d23/d35/faf 496733 0 2024-04-26T23:09:26.882 INFO:tasks.workunit.client.0.smithi148.stdout:8/871: stat d3/d9/d12/d95 0 2024-04-26T23:09:26.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/726: dwrite d9/d65/f77 [0,4194304] 0 2024-04-26T23:09:26.884 INFO:tasks.workunit.client.0.smithi148.stdout:8/872: creat d3/d9/f116 x:0 0 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:0/996: dread d0/d20/d3b/f113 [0,4194304] 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/883: dwrite d16/f4a [0,4194304] 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/884: chown d16/f1d 3366 1 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/885: chown d16/d17/d4b/d4d 230 1 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/886: truncate d16/d1c/f109 89895 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:7/805: dread d7/d19/f83 [0,4194304] 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:7/806: stat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/lbf 0 2024-04-26T23:09:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/887: write d16/d17/d4b/d53/fba [509989,119245] 0 2024-04-26T23:09:26.888 INFO:tasks.workunit.client.0.smithi148.stdout:3/727: rmdir d9/d15/d29/d4d/d7d 39 2024-04-26T23:09:26.889 INFO:tasks.workunit.client.0.smithi148.stdout:8/873: mknod d3/d9/d12/d23/d29/d77/dd3/c117 0 2024-04-26T23:09:26.889 INFO:tasks.workunit.client.0.smithi148.stdout:9/822: dwrite f3 [0,4194304] 0 2024-04-26T23:09:26.891 INFO:tasks.workunit.client.0.smithi148.stdout:0/997: symlink d0/d2e/d8f/d6c/d12f/l14b 0 2024-04-26T23:09:26.891 INFO:tasks.workunit.client.0.smithi148.stdout:0/998: truncate d0/d8/d33/d43/d4e/f13d 1011990 0 2024-04-26T23:09:26.893 INFO:tasks.workunit.client.0.smithi148.stdout:7/807: truncate d7/d11/d17/d2f/ff8 3372889 0 2024-04-26T23:09:26.893 INFO:tasks.workunit.client.0.smithi148.stdout:7/808: chown d7/d11/d17/d2f/d44/d105/l78 13692634 1 2024-04-26T23:09:26.894 INFO:tasks.workunit.client.0.smithi148.stdout:1/888: unlink d16/d17/d4b/d4d/ff0 0 2024-04-26T23:09:26.895 INFO:tasks.workunit.client.0.smithi148.stdout:0/999: getdents d0/d8/d33/d68 0 2024-04-26T23:09:26.897 INFO:tasks.workunit.client.0.smithi148.stdout:7/809: read d7/d75/fa2 [261157,42509] 0 2024-04-26T23:09:26.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/889: unlink d16/lab 0 2024-04-26T23:09:26.902 INFO:tasks.workunit.client.0.smithi148.stdout:7/810: read d7/d75/f8e [4338034,74605] 0 2024-04-26T23:09:26.902 INFO:tasks.workunit.client.0.smithi148.stdout:3/728: dread d9/d15/f28 [0,4194304] 0 2024-04-26T23:09:26.908 INFO:tasks.workunit.client.0.smithi148.stdout:3/729: creat d9/d15/d29/d88/d9f/dbc/fe0 x:0 0 0 2024-04-26T23:09:26.918 INFO:tasks.workunit.client.0.smithi148.stdout:7/811: read d7/f12 [1490584,12867] 0 2024-04-26T23:09:26.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/812: unlink d7/d11/d17/d2f/d44/d105/d2e/caf 0 2024-04-26T23:09:26.926 INFO:tasks.workunit.client.0.smithi148.stdout:7/813: creat d7/d19/f10d x:0 0 0 2024-04-26T23:09:26.928 INFO:tasks.workunit.client.0.smithi148.stdout:3/730: dread d9/d31/f32 [0,4194304] 0 2024-04-26T23:09:26.928 INFO:tasks.workunit.client.0.smithi148.stdout:7/814: mknod d7/d11/d17/d2f/d44/d105/d2e/d41/c10e 0 2024-04-26T23:09:26.928 INFO:tasks.workunit.client.0.smithi148.stdout:7/815: dread - d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 zero size 2024-04-26T23:09:26.930 INFO:tasks.workunit.client.0.smithi148.stdout:3/731: rename d9/d15/l4a to d9/d15/d29/d4d/d7d/le1 0 2024-04-26T23:09:26.930 INFO:tasks.workunit.client.0.smithi148.stdout:7/816: mknod d7/d11/d17/d2f/d44/de4/d101/c10f 0 2024-04-26T23:09:26.939 INFO:tasks.workunit.client.0.smithi148.stdout:9/823: read d19/d1d/f8b [1710351,116836] 0 2024-04-26T23:09:26.939 INFO:tasks.workunit.client.0.smithi148.stdout:9/824: dread - d19/d1d/d25/d2f/d4d/d33/fbc zero size 2024-04-26T23:09:26.941 INFO:tasks.workunit.client.0.smithi148.stdout:8/874: dwrite d3/d9/d12/d23/d29/db2/d106/f10d [0,4194304] 0 2024-04-26T23:09:26.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/875: mkdir d3/d9/d12/d23/d29/d77/d91/d118 0 2024-04-26T23:09:26.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/876: fsync d3/da/d28/f38 0 2024-04-26T23:09:26.946 INFO:tasks.workunit.client.0.smithi148.stdout:8/877: creat d3/d9a/dcd/f119 x:0 0 0 2024-04-26T23:09:26.954 INFO:tasks.workunit.client.0.smithi148.stdout:3/732: write d9/f94 [3336533,112800] 0 2024-04-26T23:09:26.964 INFO:tasks.workunit.client.0.smithi148.stdout:3/733: getdents d9/d31 0 2024-04-26T23:09:26.966 INFO:tasks.workunit.client.0.smithi148.stdout:3/734: mkdir d9/d15/d29/d4d/d68/dd6/de2 0 2024-04-26T23:09:26.970 INFO:tasks.workunit.client.0.smithi148.stdout:1/890: dwrite d16/d1c/d84/da7/fc8 [0,4194304] 0 2024-04-26T23:09:26.972 INFO:tasks.workunit.client.0.smithi148.stdout:1/891: mkdir d16/d45/d2b/d3e/d5a/d11e 0 2024-04-26T23:09:26.975 INFO:tasks.workunit.client.0.smithi148.stdout:1/892: mkdir d16/d17/d11f 0 2024-04-26T23:09:26.980 INFO:tasks.workunit.client.0.smithi148.stdout:1/893: creat d16/d85/f120 x:0 0 0 2024-04-26T23:09:26.985 INFO:tasks.workunit.client.0.smithi148.stdout:1/894: unlink d16/d1c/f3c 0 2024-04-26T23:09:26.985 INFO:tasks.workunit.client.0.smithi148.stdout:1/895: chown d16/d17/d4b/d53/d67/c74 0 1 2024-04-26T23:09:26.992 INFO:tasks.workunit.client.0.smithi148.stdout:8/878: dwrite d3/d9/f62 [4194304,4194304] 0 2024-04-26T23:09:26.992 INFO:tasks.workunit.client.0.smithi148.stdout:8/879: readlink d3/d9/d12/d23/d29/l31 0 2024-04-26T23:09:27.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/896: dread d16/d17/f4c [0,4194304] 0 2024-04-26T23:09:27.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/897: readlink d16/d45/d2b/d3e/lc7 0 2024-04-26T23:09:27.001 INFO:tasks.workunit.client.0.smithi148.stdout:1/898: fdatasync d16/f4e 0 2024-04-26T23:09:27.002 INFO:tasks.workunit.client.0.smithi148.stdout:1/899: write d16/d17/fef [472836,59631] 0 2024-04-26T23:09:27.003 INFO:tasks.workunit.client.0.smithi148.stdout:1/900: symlink d16/d47/d49/d95/l121 0 2024-04-26T23:09:27.004 INFO:tasks.workunit.client.0.smithi148.stdout:1/901: mkdir d16/d47/d73/df5/d122 0 2024-04-26T23:09:27.005 INFO:tasks.workunit.client.0.smithi148.stdout:1/902: creat d16/d17/d4b/f123 x:0 0 0 2024-04-26T23:09:27.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/903: fsync d16/d1c/f22 0 2024-04-26T23:09:27.006 INFO:tasks.workunit.client.0.smithi148.stdout:1/904: dread - d16/d17/d68/fd0 zero size 2024-04-26T23:09:27.015 INFO:tasks.workunit.client.0.smithi148.stdout:1/905: dread d16/d17/d4b/d53/d67/fae [0,4194304] 0 2024-04-26T23:09:27.017 INFO:tasks.workunit.client.0.smithi148.stdout:1/906: chown d16/d17/daf/dbd/c10a 102371 1 2024-04-26T23:09:27.029 INFO:tasks.workunit.client.0.smithi148.stdout:9/825: dwrite d19/d1d/d25/d2f/d4d/d33/fd7 [0,4194304] 0 2024-04-26T23:09:27.029 INFO:tasks.workunit.client.0.smithi148.stdout:9/826: read d19/d39/f54 [2595137,128684] 0 2024-04-26T23:09:27.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/827: creat d19/d1d/d25/d2f/d4d/d33/daa/f10f x:0 0 0 2024-04-26T23:09:27.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/828: write d19/d1d/d25/d2f/d4d/d33/d80/f8a [287018,28755] 0 2024-04-26T23:09:27.036 INFO:tasks.workunit.client.0.smithi148.stdout:3/735: dwrite d9/d31/d8f/fab [0,4194304] 0 2024-04-26T23:09:27.036 INFO:tasks.workunit.client.0.smithi148.stdout:1/907: dread d16/d17/fef [0,4194304] 0 2024-04-26T23:09:27.037 INFO:tasks.workunit.client.0.smithi148.stdout:1/908: chown d16/d47/l48 86 1 2024-04-26T23:09:27.039 INFO:tasks.workunit.client.0.smithi148.stdout:9/829: truncate d19/d1d/d25/d31/d73/dd1/fe3 3301906 0 2024-04-26T23:09:27.054 INFO:tasks.workunit.client.0.smithi148.stdout:9/830: write d19/d1d/d25/d2f/d4d/d33/daa/d9e/fa8 [839463,77324] 0 2024-04-26T23:09:27.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/909: link d16/d47/d73/lc2 d16/d47/d49/l124 0 2024-04-26T23:09:27.057 INFO:tasks.workunit.client.0.smithi148.stdout:3/736: symlink d9/d15/d29/d4d/d78/dc2/le3 0 2024-04-26T23:09:27.058 INFO:tasks.workunit.client.0.smithi148.stdout:9/831: mkdir d19/d1d/d25/d78/d110 0 2024-04-26T23:09:27.061 INFO:tasks.workunit.client.0.smithi148.stdout:1/910: write d16/d17/f1b [2034671,42920] 0 2024-04-26T23:09:27.061 INFO:tasks.workunit.client.0.smithi148.stdout:1/911: readlink d16/d45/l38 0 2024-04-26T23:09:27.061 INFO:tasks.workunit.client.0.smithi148.stdout:1/912: chown d16/d17/daf/dbd 32 1 2024-04-26T23:09:27.062 INFO:tasks.workunit.client.0.smithi148.stdout:9/832: symlink d19/d1d/d25/d31/d60/l111 0 2024-04-26T23:09:27.062 INFO:tasks.workunit.client.0.smithi148.stdout:7/817: dwrite d7/d11/d17/d2f/d44/d105/d2e/f72 [0,4194304] 0 2024-04-26T23:09:27.062 INFO:tasks.workunit.client.0.smithi148.stdout:7/818: fsync d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d109/f10c 0 2024-04-26T23:09:27.063 INFO:tasks.workunit.client.0.smithi148.stdout:7/819: write d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/ffe [742704,78963] 0 2024-04-26T23:09:27.063 INFO:tasks.workunit.client.0.smithi148.stdout:9/833: truncate d19/d1d/d25/d31/d73/dd1/fe3 1895248 0 2024-04-26T23:09:27.080 INFO:tasks.workunit.client.0.smithi148.stdout:7/820: symlink d7/d11/d17/d43/df0/l110 0 2024-04-26T23:09:27.080 INFO:tasks.workunit.client.0.smithi148.stdout:1/913: rename d16/d45/d2b/cea to d16/d47/d73/c125 0 2024-04-26T23:09:27.081 INFO:tasks.workunit.client.0.smithi148.stdout:9/834: truncate d19/f1e 1935603 0 2024-04-26T23:09:27.082 INFO:tasks.workunit.client.0.smithi148.stdout:1/914: symlink d16/d47/d49/df3/l126 0 2024-04-26T23:09:27.086 INFO:tasks.workunit.client.0.smithi148.stdout:1/915: link d16/d17/d4b/d59/f11d d16/d17/daf/dbd/f127 0 2024-04-26T23:09:27.087 INFO:tasks.workunit.client.0.smithi148.stdout:5/862: sync 2024-04-26T23:09:27.095 INFO:tasks.workunit.client.0.smithi148.stdout:7/821: write d7/d11/d17/d2f/d57/f63 [2527506,112244] 0 2024-04-26T23:09:27.342 INFO:tasks.workunit.client.0.smithi148.stdout:5/863: truncate da/d1b/d1c/d7f/f95 133472 0 2024-04-26T23:09:27.342 INFO:tasks.workunit.client.0.smithi148.stdout:1/916: getdents d16/d47/d73 0 2024-04-26T23:09:27.347 INFO:tasks.workunit.client.0.smithi148.stdout:7/822: rename d7/d11/d17/d2f/d44/d105/d2e/d41/f8a to d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/f111 0 2024-04-26T23:09:27.354 INFO:tasks.workunit.client.0.smithi148.stdout:5/864: truncate da/d1b/d3b/d73/d97/fad 649818 0 2024-04-26T23:09:27.356 INFO:tasks.workunit.client.0.smithi148.stdout:1/917: rmdir d16/d1c/d82/d11a 39 2024-04-26T23:09:27.358 INFO:tasks.workunit.client.0.smithi148.stdout:7/823: mknod d7/d75/c112 0 2024-04-26T23:09:27.358 INFO:tasks.workunit.client.0.smithi148.stdout:7/824: truncate d7/d11/d17/d2f/d44/d9b/fe5 864922 0 2024-04-26T23:09:27.363 INFO:tasks.workunit.client.0.smithi148.stdout:5/865: creat da/d12/f12f x:0 0 0 2024-04-26T23:09:27.367 INFO:tasks.workunit.client.0.smithi148.stdout:7/825: link d7/d11/d17/d2f/d44/d9b/c108 d7/d75/dad/c113 0 2024-04-26T23:09:27.368 INFO:tasks.workunit.client.0.smithi148.stdout:7/826: rmdir d7/d11/d17/d43 39 2024-04-26T23:09:27.368 INFO:tasks.workunit.client.0.smithi148.stdout:7/827: read d7/d11/d17/d2f/f54 [3127348,115792] 0 2024-04-26T23:09:27.372 INFO:tasks.workunit.client.0.smithi148.stdout:7/828: symlink d7/l114 0 2024-04-26T23:09:27.374 INFO:tasks.workunit.client.0.smithi148.stdout:7/829: mknod d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d109/c115 0 2024-04-26T23:09:27.374 INFO:tasks.workunit.client.0.smithi148.stdout:7/830: readlink d7/d11/ld5 0 2024-04-26T23:09:27.376 INFO:tasks.workunit.client.0.smithi148.stdout:7/831: mkdir d7/d11/d17/d2f/d44/de4/d101/d116 0 2024-04-26T23:09:27.379 INFO:tasks.workunit.client.0.smithi148.stdout:7/832: symlink d7/d11/d17/d43/l117 0 2024-04-26T23:09:27.383 INFO:tasks.workunit.client.0.smithi148.stdout:7/833: link d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/feb d7/d11/d17/f118 0 2024-04-26T23:09:27.383 INFO:tasks.workunit.client.0.smithi148.stdout:7/834: chown d7/d11/d17/d2f/d44/d9b/c108 4106 1 2024-04-26T23:09:27.386 INFO:tasks.workunit.client.0.smithi148.stdout:7/835: dread d7/d75/ff6 [0,4194304] 0 2024-04-26T23:09:27.389 INFO:tasks.workunit.client.0.smithi148.stdout:7/836: creat d7/d19/f119 x:0 0 0 2024-04-26T23:09:27.391 INFO:tasks.workunit.client.0.smithi148.stdout:7/837: creat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/f11a x:0 0 0 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:6/836: sync 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:2/964: sync 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:9/835: sync 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:9/836: chown f13 0 1 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:4/908: sync 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:9/837: chown d19/d22/c71 7219 1 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:8/880: sync 2024-04-26T23:09:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:3/737: sync 2024-04-26T23:09:27.405 INFO:tasks.workunit.client.0.smithi148.stdout:7/838: write d7/d11/d17/d2f/d44/d105/d2e/f26 [3900617,65584] 0 2024-04-26T23:09:27.408 INFO:tasks.workunit.client.0.smithi148.stdout:6/837: symlink d6/d9/d1c/d1d/d1f/d40/d113/l119 0 2024-04-26T23:09:27.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/965: rename d5/d10/c1f to d5/d8/d4b/d4e/d6d/da0/d100/c140 0 2024-04-26T23:09:27.420 INFO:tasks.workunit.client.0.smithi148.stdout:5/866: dwrite da/d1b/d2d/f48 [0,4194304] 0 2024-04-26T23:09:27.420 INFO:tasks.workunit.client.0.smithi148.stdout:5/867: getdents da/d1b/d8b/dfc 0 2024-04-26T23:09:27.420 INFO:tasks.workunit.client.0.smithi148.stdout:8/881: creat d3/da/d1c/d7a/f11a x:0 0 0 2024-04-26T23:09:27.428 INFO:tasks.workunit.client.0.smithi148.stdout:3/738: link d9/d31/cdd d9/d52/ce4 0 2024-04-26T23:09:27.428 INFO:tasks.workunit.client.0.smithi148.stdout:3/739: fdatasync d9/d15/d29/d88/fb8 0 2024-04-26T23:09:27.432 INFO:tasks.workunit.client.0.smithi148.stdout:7/839: mknod d7/d75/de6/c11b 0 2024-04-26T23:09:27.434 INFO:tasks.workunit.client.0.smithi148.stdout:6/838: mknod d6/d9/d23/c11a 0 2024-04-26T23:09:27.434 INFO:tasks.workunit.client.0.smithi148.stdout:6/839: fsync d6/d9/d1c/d1d/d1f/d40/f7a 0 2024-04-26T23:09:27.436 INFO:tasks.workunit.client.0.smithi148.stdout:2/966: creat d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d120/f141 x:0 0 0 2024-04-26T23:09:27.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/740: mkdir d9/d65/de5 0 2024-04-26T23:09:27.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/741: chown d9/d15/d29/d4d/d68/f96 2855 1 2024-04-26T23:09:27.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/742: truncate d9/d65/f9b 537625 0 2024-04-26T23:09:27.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/743: dread - d9/d15/d29/d4d/d68/fdb zero size 2024-04-26T23:09:27.440 INFO:tasks.workunit.client.0.smithi148.stdout:5/868: write da/d1b/d1c/ff1 [50682,84279] 0 2024-04-26T23:09:27.443 INFO:tasks.workunit.client.0.smithi148.stdout:4/909: dwrite d12/d1c/faf [0,4194304] 0 2024-04-26T23:09:27.444 INFO:tasks.workunit.client.0.smithi148.stdout:2/967: mknod d5/d8/d4b/d4e/d6d/da0/d78/c142 0 2024-04-26T23:09:27.444 INFO:tasks.workunit.client.0.smithi148.stdout:7/840: creat d7/d75/de6/f11c x:0 0 0 2024-04-26T23:09:27.445 INFO:tasks.workunit.client.0.smithi148.stdout:3/744: rename d9/d15/d29/d4d/d6f/l7f to d9/d15/d29/d88/d9f/le6 0 2024-04-26T23:09:27.445 INFO:tasks.workunit.client.0.smithi148.stdout:2/968: read d5/d17/d64/d88/fe2 [227837,101935] 0 2024-04-26T23:09:27.446 INFO:tasks.workunit.client.0.smithi148.stdout:5/869: mkdir da/d130 0 2024-04-26T23:09:27.447 INFO:tasks.workunit.client.0.smithi148.stdout:3/745: read d9/d65/f9b [211147,3266] 0 2024-04-26T23:09:27.447 INFO:tasks.workunit.client.0.smithi148.stdout:3/746: chown d9/c1f 7336174 1 2024-04-26T23:09:27.449 INFO:tasks.workunit.client.0.smithi148.stdout:4/910: symlink d12/d1c/d56/d87/d9a/l128 0 2024-04-26T23:09:27.451 INFO:tasks.workunit.client.0.smithi148.stdout:7/841: mknod d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/c11d 0 2024-04-26T23:09:27.452 INFO:tasks.workunit.client.0.smithi148.stdout:2/969: getdents d5/d17 0 2024-04-26T23:09:27.452 INFO:tasks.workunit.client.0.smithi148.stdout:9/838: dwrite d19/d1d/d25/d31/d32/f91 [0,4194304] 0 2024-04-26T23:09:27.456 INFO:tasks.workunit.client.0.smithi148.stdout:7/842: mknod d7/d11/d17/d2f/c11e 0 2024-04-26T23:09:27.458 INFO:tasks.workunit.client.0.smithi148.stdout:7/843: creat d7/df5/f11f x:0 0 0 2024-04-26T23:09:27.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/844: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120 0 2024-04-26T23:09:27.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/845: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7 391137678 1 2024-04-26T23:09:27.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/846: dread - d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 zero size 2024-04-26T23:09:27.461 INFO:tasks.workunit.client.0.smithi148.stdout:7/847: rmdir d7/d11/d17/d2f/d44/d105/d2e/dc6/de7 39 2024-04-26T23:09:27.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/870: dread da/d1b/d5b/d117/f9b [0,4194304] 0 2024-04-26T23:09:27.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/871: chown da/d1f/d47/c5d 261211945 1 2024-04-26T23:09:27.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/872: dread - da/d68/d69/dc9/d125/feb zero size 2024-04-26T23:09:27.468 INFO:tasks.workunit.client.0.smithi148.stdout:3/747: dread d9/d31/f55 [0,4194304] 0 2024-04-26T23:09:27.468 INFO:tasks.workunit.client.0.smithi148.stdout:3/748: chown d9/d15/d29/d4d/d68/dd6/de2 49 1 2024-04-26T23:09:27.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/873: mkdir da/d1a/d131 0 2024-04-26T23:09:27.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/874: write da/d12/f12f [99418,92296] 0 2024-04-26T23:09:27.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/875: fdatasync da/d1b/d3b/d73/d97/fac 0 2024-04-26T23:09:27.470 INFO:tasks.workunit.client.0.smithi148.stdout:5/876: chown da/le 24 1 2024-04-26T23:09:27.470 INFO:tasks.workunit.client.0.smithi148.stdout:3/749: creat d9/d65/d80/d83/db9/fe7 x:0 0 0 2024-04-26T23:09:27.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/877: unlink da/d1b/d2d/la6 0 2024-04-26T23:09:27.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/878: chown da/d1b/d3b/d73/d97/db0/f10f 142428939 1 2024-04-26T23:09:27.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/879: chown da/d68/d69/daa/dc0/d11b/f124 5427604 1 2024-04-26T23:09:27.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/880: readlink da/d1b/d5b/d5e/dc5/l12b 0 2024-04-26T23:09:27.473 INFO:tasks.workunit.client.0.smithi148.stdout:5/881: creat da/d1b/d2d/da8/f132 x:0 0 0 2024-04-26T23:09:27.476 INFO:tasks.workunit.client.0.smithi148.stdout:5/882: rename da/d1b/d5b/d5e/dc5/cea to da/d68/d69/dc9/c133 0 2024-04-26T23:09:27.476 INFO:tasks.workunit.client.0.smithi148.stdout:5/883: chown da/d68/d69/l127 1686 1 2024-04-26T23:09:27.478 INFO:tasks.workunit.client.0.smithi148.stdout:5/884: symlink da/d1b/d2d/d82/df5/l134 0 2024-04-26T23:09:27.479 INFO:tasks.workunit.client.0.smithi148.stdout:5/885: read - da/d1a/f123 zero size 2024-04-26T23:09:27.491 INFO:tasks.workunit.client.0.smithi148.stdout:1/918: dwrite d16/d17/d68/d6b/d8b/fe4 [0,4194304] 0 2024-04-26T23:09:27.495 INFO:tasks.workunit.client.0.smithi148.stdout:1/919: mknod d16/d47/d73/df5/c128 0 2024-04-26T23:09:27.496 INFO:tasks.workunit.client.0.smithi148.stdout:1/920: symlink d16/d47/d49/d95/l129 0 2024-04-26T23:09:27.508 INFO:tasks.workunit.client.0.smithi148.stdout:4/911: read d12/d1c/d56/fc7 [2982711,67010] 0 2024-04-26T23:09:27.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/912: truncate d12/d1c/d45/dc2/dd4/d115/f116 1046888 0 2024-04-26T23:09:27.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/913: dread - d12/d1c/d45/d8c/f105 zero size 2024-04-26T23:09:27.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/970: dwrite d5/d8/d15/ff5 [0,4194304] 0 2024-04-26T23:09:27.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/971: fsync d5/d97/dfd/f107 0 2024-04-26T23:09:27.509 INFO:tasks.workunit.client.0.smithi148.stdout:5/886: write da/d1f/d67/ffb [686017,15501] 0 2024-04-26T23:09:27.511 INFO:tasks.workunit.client.0.smithi148.stdout:4/914: creat d12/d17/d2a/df4/f129 x:0 0 0 2024-04-26T23:09:27.511 INFO:tasks.workunit.client.0.smithi148.stdout:2/972: mkdir d5/d8/d15/d43/d5d/d143 0 2024-04-26T23:09:27.512 INFO:tasks.workunit.client.0.smithi148.stdout:4/915: mkdir d12/d17/d2a/d37/ded/d12a 0 2024-04-26T23:09:27.513 INFO:tasks.workunit.client.0.smithi148.stdout:4/916: write d12/d17/f68 [4875339,117295] 0 2024-04-26T23:09:27.516 INFO:tasks.workunit.client.0.smithi148.stdout:4/917: link d12/d17/d2a/d37/d97/fa0 d12/d17/f12b 0 2024-04-26T23:09:27.516 INFO:tasks.workunit.client.0.smithi148.stdout:4/918: truncate d12/d17/d2a/f32 3579689 0 2024-04-26T23:09:27.523 INFO:tasks.workunit.client.0.smithi148.stdout:9/839: dwrite d19/d1d/d25/f63 [0,4194304] 0 2024-04-26T23:09:27.523 INFO:tasks.workunit.client.0.smithi148.stdout:3/750: dread d9/d4c/f5f [0,4194304] 0 2024-04-26T23:09:27.525 INFO:tasks.workunit.client.0.smithi148.stdout:2/973: dread d5/f16 [0,4194304] 0 2024-04-26T23:09:27.527 INFO:tasks.workunit.client.0.smithi148.stdout:9/840: getdents d19/d1d/d25/d2f 0 2024-04-26T23:09:27.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/841: fdatasync ff 0 2024-04-26T23:09:27.529 INFO:tasks.workunit.client.0.smithi148.stdout:3/751: creat d9/d65/fe8 x:0 0 0 2024-04-26T23:09:27.532 INFO:tasks.workunit.client.0.smithi148.stdout:9/842: rename d19/d1d/d25/d31/d73/c8f to d19/d1d/d25/d78/db6/dcb/de5/c112 0 2024-04-26T23:09:27.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/752: mknod d9/d4c/ce9 0 2024-04-26T23:09:27.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/753: truncate d9/d65/d80/d83/db9/fe7 666976 0 2024-04-26T23:09:27.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/754: readlink d9/d15/d29/d4d/d5b/laa 0 2024-04-26T23:09:27.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/974: dread d5/d8/d15/d43/fa9 [0,4194304] 0 2024-04-26T23:09:27.549 INFO:tasks.workunit.client.0.smithi148.stdout:9/843: dread d19/d22/f9c [0,4194304] 0 2024-04-26T23:09:27.549 INFO:tasks.workunit.client.0.smithi148.stdout:4/919: dread d12/f4a [0,4194304] 0 2024-04-26T23:09:27.552 INFO:tasks.workunit.client.0.smithi148.stdout:9/844: creat d19/d1d/d25/d31/d32/df3/f113 x:0 0 0 2024-04-26T23:09:27.552 INFO:tasks.workunit.client.0.smithi148.stdout:9/845: write d19/d1d/d25/d78/db6/dcb/fea [491209,29489] 0 2024-04-26T23:09:27.552 INFO:tasks.workunit.client.0.smithi148.stdout:9/846: readlink d19/d1d/d25/d31/d32/l105 0 2024-04-26T23:09:27.552 INFO:tasks.workunit.client.0.smithi148.stdout:3/755: dread d9/d65/f77 [0,4194304] 0 2024-04-26T23:09:27.556 INFO:tasks.workunit.client.0.smithi148.stdout:5/887: dwrite da/d1a/f123 [0,4194304] 0 2024-04-26T23:09:27.556 INFO:tasks.workunit.client.0.smithi148.stdout:5/888: stat da/d1b/d5b/d117/l88 0 2024-04-26T23:09:27.556 INFO:tasks.workunit.client.0.smithi148.stdout:5/889: readlink da/d68/d69/l127 0 2024-04-26T23:09:27.556 INFO:tasks.workunit.client.0.smithi148.stdout:3/756: creat d9/d15/d29/d4d/d68/dd6/de2/fea x:0 0 0 2024-04-26T23:09:27.566 INFO:tasks.workunit.client.0.smithi148.stdout:5/890: rename da/d68/d69/dc9/d125/cb3 to da/d1b/d5b/d5e/d6a/de4/c135 0 2024-04-26T23:09:27.566 INFO:tasks.workunit.client.0.smithi148.stdout:5/891: stat da/d70 0 2024-04-26T23:09:27.566 INFO:tasks.workunit.client.0.smithi148.stdout:5/892: fsync da/d1f/d67/ffb 0 2024-04-26T23:09:27.571 INFO:tasks.workunit.client.0.smithi148.stdout:3/757: rename d9/d15/d29/d4d/d68/faf to d9/d15/d29/feb 0 2024-04-26T23:09:27.572 INFO:tasks.workunit.client.0.smithi148.stdout:4/920: dread d12/d1c/d45/d75/fa6 [0,4194304] 0 2024-04-26T23:09:27.573 INFO:tasks.workunit.client.0.smithi148.stdout:5/893: creat da/d1a/f136 x:0 0 0 2024-04-26T23:09:27.574 INFO:tasks.workunit.client.0.smithi148.stdout:7/848: dwrite d7/d11/d17/d2f/d44/d9b/fe5 [0,4194304] 0 2024-04-26T23:09:27.576 INFO:tasks.workunit.client.0.smithi148.stdout:3/758: rmdir d9/d31 39 2024-04-26T23:09:27.579 INFO:tasks.workunit.client.0.smithi148.stdout:4/921: creat d12/d17/d2a/d37/d97/f12c x:0 0 0 2024-04-26T23:09:27.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/849: creat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/f121 x:0 0 0 2024-04-26T23:09:27.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/850: truncate d7/d19/fe0 300392 0 2024-04-26T23:09:27.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/851: fdatasync d7/d11/fd8 0 2024-04-26T23:09:27.582 INFO:tasks.workunit.client.0.smithi148.stdout:9/847: dwrite d19/d1d/d25/d31/d60/dba/d85/fff [0,4194304] 0 2024-04-26T23:09:27.584 INFO:tasks.workunit.client.0.smithi148.stdout:4/922: truncate d12/d1c/dc0/fe8 1160675 0 2024-04-26T23:09:27.584 INFO:tasks.workunit.client.0.smithi148.stdout:4/923: chown d12/d1c/d56/f6f 255 1 2024-04-26T23:09:27.587 INFO:tasks.workunit.client.0.smithi148.stdout:7/852: link d7/d11/d17/d2f/d57/ce2 d7/d11/d17/c122 0 2024-04-26T23:09:27.593 INFO:tasks.workunit.client.0.smithi148.stdout:9/848: unlink d19/d39/fbd 0 2024-04-26T23:09:27.593 INFO:tasks.workunit.client.0.smithi148.stdout:9/849: truncate d19/d1d/d25/d2f/d4d/d33/daa/fd3 752305 0 2024-04-26T23:09:27.600 INFO:tasks.workunit.client.0.smithi148.stdout:7/853: symlink d7/d11/d17/d2f/d44/de4/dfa/l123 0 2024-04-26T23:09:27.600 INFO:tasks.workunit.client.0.smithi148.stdout:9/850: unlink d19/d1d/l6c 0 2024-04-26T23:09:27.601 INFO:tasks.workunit.client.0.smithi148.stdout:1/921: dwrite f13 [4194304,4194304] 0 2024-04-26T23:09:27.601 INFO:tasks.workunit.client.0.smithi148.stdout:1/922: write d16/d85/fb1 [2446469,72414] 0 2024-04-26T23:09:27.625 INFO:tasks.workunit.client.0.smithi148.stdout:7/854: mknod d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/c124 0 2024-04-26T23:09:27.625 INFO:tasks.workunit.client.0.smithi148.stdout:7/855: readlink d7/d75/l4a 0 2024-04-26T23:09:27.632 INFO:tasks.workunit.client.0.smithi148.stdout:5/894: dwrite f3 [0,4194304] 0 2024-04-26T23:09:27.634 INFO:tasks.workunit.client.0.smithi148.stdout:1/923: getdents d16/d45/d2b/d3e/d5a/d11e 0 2024-04-26T23:09:27.634 INFO:tasks.workunit.client.0.smithi148.stdout:7/856: mknod d7/d11/d17/d43/df0/c125 0 2024-04-26T23:09:27.634 INFO:tasks.workunit.client.0.smithi148.stdout:5/895: mkdir da/d1b/d8b/d137 0 2024-04-26T23:09:27.635 INFO:tasks.workunit.client.0.smithi148.stdout:1/924: rmdir d16/d1c/d84/da7 39 2024-04-26T23:09:27.635 INFO:tasks.workunit.client.0.smithi148.stdout:7/857: mkdir d7/d11/d126 0 2024-04-26T23:09:27.636 INFO:tasks.workunit.client.0.smithi148.stdout:5/896: unlink da/d1a/f123 0 2024-04-26T23:09:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:5/897: chown da/d1b/d5b/c42 0 1 2024-04-26T23:09:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:5/898: readlink da/le 0 2024-04-26T23:09:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:5/899: write da/d12/f8f [5721744,44807] 0 2024-04-26T23:09:27.652 INFO:tasks.workunit.client.0.smithi148.stdout:7/858: symlink d7/l127 0 2024-04-26T23:09:27.662 INFO:tasks.workunit.client.0.smithi148.stdout:2/975: dwrite d5/f16 [0,4194304] 0 2024-04-26T23:09:27.674 INFO:tasks.workunit.client.0.smithi148.stdout:9/851: dwrite d19/d9f/dbb/fbe [0,4194304] 0 2024-04-26T23:09:27.674 INFO:tasks.workunit.client.0.smithi148.stdout:3/759: dwrite d9/d31/d8f/fab [4194304,4194304] 0 2024-04-26T23:09:27.680 INFO:tasks.workunit.client.0.smithi148.stdout:9/852: symlink d19/d1d/d25/d78/d110/l114 0 2024-04-26T23:09:27.680 INFO:tasks.workunit.client.0.smithi148.stdout:2/976: read d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d87/f8a [348785,39589] 0 2024-04-26T23:09:27.680 INFO:tasks.workunit.client.0.smithi148.stdout:3/760: rename d9/d15/d29/d4d/d6f/f74 to d9/d52/fec 0 2024-04-26T23:09:27.687 INFO:tasks.workunit.client.0.smithi148.stdout:2/977: dread d5/d8/d4b/d4e/d6d/da0/d32/d4c/f60 [0,4194304] 0 2024-04-26T23:09:27.688 INFO:tasks.workunit.client.0.smithi148.stdout:2/978: write d5/d8/f3e [1576049,82170] 0 2024-04-26T23:09:27.688 INFO:tasks.workunit.client.0.smithi148.stdout:2/979: chown d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d87/f8a 14854 1 2024-04-26T23:09:27.692 INFO:tasks.workunit.client.0.smithi148.stdout:2/980: creat d5/d8/d11/dae/f144 x:0 0 0 2024-04-26T23:09:27.692 INFO:tasks.workunit.client.0.smithi148.stdout:2/981: fdatasync d5/d8/d9/f4a 0 2024-04-26T23:09:27.701 INFO:tasks.workunit.client.0.smithi148.stdout:4/924: dwrite d12/d17/d2a/f2f [0,4194304] 0 2024-04-26T23:09:27.703 INFO:tasks.workunit.client.0.smithi148.stdout:9/853: write d19/d1d/d49/f5c [1442625,88112] 0 2024-04-26T23:09:27.710 INFO:tasks.workunit.client.0.smithi148.stdout:7/859: dwrite d7/d19/fef [4194304,4194304] 0 2024-04-26T23:09:27.712 INFO:tasks.workunit.client.0.smithi148.stdout:1/925: dwrite d16/d17/fb5 [0,4194304] 0 2024-04-26T23:09:27.718 INFO:tasks.workunit.client.0.smithi148.stdout:3/761: write d9/d31/f55 [1634192,13458] 0 2024-04-26T23:09:27.718 INFO:tasks.workunit.client.0.smithi148.stdout:5/900: dwrite da/d1b/f93 [0,4194304] 0 2024-04-26T23:09:27.721 INFO:tasks.workunit.client.0.smithi148.stdout:7/860: dread d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/f111 [0,4194304] 0 2024-04-26T23:09:27.722 INFO:tasks.workunit.client.0.smithi148.stdout:7/861: read d7/d11/d17/d2f/d57/f63 [2653527,22499] 0 2024-04-26T23:09:27.724 INFO:tasks.workunit.client.0.smithi148.stdout:4/925: rename d12/d1c/d45/d75 to d12/d1c/d56/d12d 0 2024-04-26T23:09:27.724 INFO:tasks.workunit.client.0.smithi148.stdout:9/854: mkdir d19/d1d/d69/d115 0 2024-04-26T23:09:27.725 INFO:tasks.workunit.client.0.smithi148.stdout:4/926: chown d12/d1c/d56/d87/d9c/da7/lcb 617571 1 2024-04-26T23:09:27.726 INFO:tasks.workunit.client.0.smithi148.stdout:1/926: creat d16/d17/d11f/f12a x:0 0 0 2024-04-26T23:09:27.728 INFO:tasks.workunit.client.0.smithi148.stdout:5/901: creat da/d12/f138 x:0 0 0 2024-04-26T23:09:27.728 INFO:tasks.workunit.client.0.smithi148.stdout:5/902: truncate da/d1b/d5b/d117/f94 755984 0 2024-04-26T23:09:27.728 INFO:tasks.workunit.client.0.smithi148.stdout:7/862: creat d7/d11/d17/d2f/d44/de4/dfa/f128 x:0 0 0 2024-04-26T23:09:27.730 INFO:tasks.workunit.client.0.smithi148.stdout:3/762: rename d9/d4c/fb0 to d9/d65/d80/d83/d99/fed 0 2024-04-26T23:09:27.731 INFO:tasks.workunit.client.0.smithi148.stdout:9/855: mkdir d19/d9f/dbb/d116 0 2024-04-26T23:09:27.731 INFO:tasks.workunit.client.0.smithi148.stdout:4/927: symlink d12/d17/d11c/l12e 0 2024-04-26T23:09:27.732 INFO:tasks.workunit.client.0.smithi148.stdout:7/863: creat d7/df5/f129 x:0 0 0 2024-04-26T23:09:27.733 INFO:tasks.workunit.client.0.smithi148.stdout:4/928: dread d12/d1c/d45/dc2/dd4/d115/f116 [0,4194304] 0 2024-04-26T23:09:27.734 INFO:tasks.workunit.client.0.smithi148.stdout:1/927: rename d16/f20 to d16/d17/d4b/d59/f12b 0 2024-04-26T23:09:27.734 INFO:tasks.workunit.client.0.smithi148.stdout:3/763: mkdir d9/d15/d29/d4d/d78/dee 0 2024-04-26T23:09:27.735 INFO:tasks.workunit.client.0.smithi148.stdout:7/864: creat d7/d75/de6/f12a x:0 0 0 2024-04-26T23:09:27.737 INFO:tasks.workunit.client.0.smithi148.stdout:9/856: rename d19/d1d/d25/d31/dc5/fcc to d19/d1d/d25/d31/d32/db9/f117 0 2024-04-26T23:09:27.737 INFO:tasks.workunit.client.0.smithi148.stdout:9/857: write d19/d1d/d25/d78/fdb [1030070,105299] 0 2024-04-26T23:09:27.737 INFO:tasks.workunit.client.0.smithi148.stdout:1/928: mknod d16/d17/d4b/d113/c12c 0 2024-04-26T23:09:27.752 INFO:tasks.workunit.client.0.smithi148.stdout:3/764: rename d9/d65/fe8 to d9/d31/dc3/dca/fef 0 2024-04-26T23:09:27.752 INFO:tasks.workunit.client.0.smithi148.stdout:9/858: truncate d19/d1d/d25/d31/d60/dba/d85/f95 2167533 0 2024-04-26T23:09:27.776 INFO:tasks.workunit.client.0.smithi148.stdout:7/865: rename d7/d11/d17/d2f/d44/de4/l66 to d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120/l12b 0 2024-04-26T23:09:27.778 INFO:tasks.workunit.client.0.smithi148.stdout:3/765: truncate d9/d15/d29/f45 468522 0 2024-04-26T23:09:27.778 INFO:tasks.workunit.client.0.smithi148.stdout:3/766: truncate d9/d15/db1/fbd 4997944 0 2024-04-26T23:09:27.779 INFO:tasks.workunit.client.0.smithi148.stdout:3/767: mknod d9/d4c/cf0 0 2024-04-26T23:09:27.779 INFO:tasks.workunit.client.0.smithi148.stdout:3/768: chown d9/d15/d29/c8d 9713187 1 2024-04-26T23:09:27.781 INFO:tasks.workunit.client.0.smithi148.stdout:4/929: dwrite d12/d17/d2a/d37/d97/dc1/f119 [0,4194304] 0 2024-04-26T23:09:27.783 INFO:tasks.workunit.client.0.smithi148.stdout:7/866: write d7/d11/d17/d9e/fa8 [247233,46561] 0 2024-04-26T23:09:27.784 INFO:tasks.workunit.client.0.smithi148.stdout:4/930: symlink d12/d1c/d56/d87/d122/l12f 0 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/867: creat d7/d11/f12c x:0 0 0 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/868: write d7/d11/d17/f39 [1571232,3169] 0 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/869: readlink d7/d11/d17/d2f/d44/de4/d68/lca 0 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/870: fdatasync d7/d11/fb0 0 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/871: chown d7/l10 3325 1 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/872: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/f9f 4441 1 2024-04-26T23:09:27.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/873: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/f11a 7 1 2024-04-26T23:09:27.788 INFO:tasks.workunit.client.0.smithi148.stdout:4/931: symlink d12/d1c/d56/d87/d9a/d9d/dc6/l130 0 2024-04-26T23:09:27.793 INFO:tasks.workunit.client.0.smithi148.stdout:3/769: dread d9/d4c/f5f [0,4194304] 0 2024-04-26T23:09:27.797 INFO:tasks.workunit.client.0.smithi148.stdout:4/932: creat d12/d1c/d45/f131 x:0 0 0 2024-04-26T23:09:27.797 INFO:tasks.workunit.client.0.smithi148.stdout:4/933: truncate d12/d1c/d56/d87/d9c/ffd 20177 0 2024-04-26T23:09:27.797 INFO:tasks.workunit.client.0.smithi148.stdout:3/770: creat d9/d15/d29/ff1 x:0 0 0 2024-04-26T23:09:27.797 INFO:tasks.workunit.client.0.smithi148.stdout:3/771: truncate d9/f93 134641 0 2024-04-26T23:09:27.797 INFO:tasks.workunit.client.0.smithi148.stdout:3/772: chown d9/d52/ce4 5 1 2024-04-26T23:09:27.801 INFO:tasks.workunit.client.0.smithi148.stdout:3/773: rename d9/d15/db1 to d9/db3/df2 0 2024-04-26T23:09:27.802 INFO:tasks.workunit.client.0.smithi148.stdout:3/774: fdatasync d9/fd5 0 2024-04-26T23:09:27.802 INFO:tasks.workunit.client.0.smithi148.stdout:3/775: read d9/d31/f95 [100212,12805] 0 2024-04-26T23:09:27.803 INFO:tasks.workunit.client.0.smithi148.stdout:1/929: dwrite d16/d17/d4b/d59/f12b [0,4194304] 0 2024-04-26T23:09:27.811 INFO:tasks.workunit.client.0.smithi148.stdout:1/930: creat d16/d17/d4b/d53/d101/f12d x:0 0 0 2024-04-26T23:09:27.811 INFO:tasks.workunit.client.0.smithi148.stdout:4/934: dread d12/d1c/d56/d87/d9c/da1/dc3/fe9 [0,4194304] 0 2024-04-26T23:09:27.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/931: truncate d16/d17/d4b/dd1/fde 39697 0 2024-04-26T23:09:27.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/935: dread d12/d17/d2a/d37/f88 [0,4194304] 0 2024-04-26T23:09:27.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/936: chown d12/d17/d2a/d37/d97 263332777 1 2024-04-26T23:09:27.854 INFO:tasks.workunit.client.0.smithi148.stdout:2/982: dwrite d5/d1c/d38/f47 [4194304,4194304] 0 2024-04-26T23:09:27.862 INFO:tasks.workunit.client.0.smithi148.stdout:7/874: dwrite d7/d11/d17/d7c/f103 [0,4194304] 0 2024-04-26T23:09:27.863 INFO:tasks.workunit.client.0.smithi148.stdout:7/875: readlink d7/d11/d17/d2f/d44/de4/d101/lfc 0 2024-04-26T23:09:27.863 INFO:tasks.workunit.client.0.smithi148.stdout:7/876: fdatasync d7/f9 0 2024-04-26T23:09:27.895 INFO:tasks.workunit.client.0.smithi148.stdout:1/932: dwrite d16/d17/f4c [0,4194304] 0 2024-04-26T23:09:27.895 INFO:tasks.workunit.client.0.smithi148.stdout:1/933: read - d16/d17/d68/ffb zero size 2024-04-26T23:09:27.914 INFO:tasks.workunit.client.0.smithi148.stdout:4/937: dwrite d12/d1c/d45/fb7 [0,4194304] 0 2024-04-26T23:09:27.930 INFO:tasks.workunit.client.0.smithi148.stdout:3/776: read d9/d15/d29/d4d/d9a/fce [2871745,75715] 0 2024-04-26T23:09:27.930 INFO:tasks.workunit.client.0.smithi148.stdout:5/903: dwrite da/d12/f138 [0,4194304] 0 2024-04-26T23:09:27.935 INFO:tasks.workunit.client.0.smithi148.stdout:3/777: dread f5 [0,4194304] 0 2024-04-26T23:09:27.965 INFO:tasks.workunit.client.0.smithi148.stdout:3/778: dwrite d9/d31/d8f/fa2 [4194304,4194304] 0 2024-04-26T23:09:27.972 INFO:tasks.workunit.client.0.smithi148.stdout:3/779: dread d9/d15/d29/d4d/d78/f98 [0,4194304] 0 2024-04-26T23:09:27.973 INFO:tasks.workunit.client.0.smithi148.stdout:3/780: chown d9/d15/d29/d4d/d68/f96 1 1 2024-04-26T23:09:27.973 INFO:tasks.workunit.client.0.smithi148.stdout:3/781: write d9/d15/d29/d4d/d68/dd6/de2/fea [211600,8311] 0 2024-04-26T23:09:28.075 INFO:tasks.workunit.client.0.smithi148.stdout:3/782: dwrite d9/d65/f9b [0,4194304] 0 2024-04-26T23:09:28.085 INFO:tasks.workunit.client.0.smithi148.stdout:8/882: sync 2024-04-26T23:09:28.085 INFO:tasks.workunit.client.0.smithi148.stdout:6/840: sync 2024-04-26T23:09:28.088 INFO:tasks.workunit.client.0.smithi148.stdout:2/983: rename d5/d17/d64 to d5/d8/db9/d145 0 2024-04-26T23:09:28.088 INFO:tasks.workunit.client.0.smithi148.stdout:2/984: write d5/d8/db9/d145/f72 [9027911,38658] 0 2024-04-26T23:09:28.092 INFO:tasks.workunit.client.0.smithi148.stdout:7/877: rmdir d7/d11/d17 39 2024-04-26T23:09:28.092 INFO:tasks.workunit.client.0.smithi148.stdout:7/878: chown d7/d11/d17/d2f/d57/f63 2219615 1 2024-04-26T23:09:28.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/985: dread d5/d8/d4b/d4e/d6d/da0/d32/f80 [0,4194304] 0 2024-04-26T23:09:28.097 INFO:tasks.workunit.client.0.smithi148.stdout:1/934: mkdir d16/d17/daf/d12e 0 2024-04-26T23:09:28.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/938: mknod d12/d1c/d56/d87/d9c/da1/c132 0 2024-04-26T23:09:28.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/939: write d12/d1c/f67 [4440584,35760] 0 2024-04-26T23:09:28.106 INFO:tasks.workunit.client.0.smithi148.stdout:1/935: dread d16/d47/d73/ffd [0,4194304] 0 2024-04-26T23:09:28.110 INFO:tasks.workunit.client.0.smithi148.stdout:1/936: dread d16/d17/d4b/d55/f103 [0,4194304] 0 2024-04-26T23:09:28.110 INFO:tasks.workunit.client.0.smithi148.stdout:1/937: getdents d16/d17/d4b/d55/d90/da5 0 2024-04-26T23:09:28.116 INFO:tasks.workunit.client.0.smithi148.stdout:5/904: creat da/d70/f139 x:0 0 0 2024-04-26T23:09:28.129 INFO:tasks.workunit.client.0.smithi148.stdout:3/783: symlink d9/d65/d80/lf3 0 2024-04-26T23:09:28.135 INFO:tasks.workunit.client.0.smithi148.stdout:6/841: creat d6/d9/f11b x:0 0 0 2024-04-26T23:09:28.141 INFO:tasks.workunit.client.0.smithi148.stdout:1/938: dwrite d16/d1c/f57 [0,4194304] 0 2024-04-26T23:09:28.142 INFO:tasks.workunit.client.0.smithi148.stdout:8/883: symlink d3/d9/d12/d23/d35/dad/dbb/l11b 0 2024-04-26T23:09:28.142 INFO:tasks.workunit.client.0.smithi148.stdout:8/884: truncate d3/da/d28/f70 4820339 0 2024-04-26T23:09:28.146 INFO:tasks.workunit.client.0.smithi148.stdout:7/879: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d12d 0 2024-04-26T23:09:28.148 INFO:tasks.workunit.client.0.smithi148.stdout:2/986: mkdir d5/d7/d146 0 2024-04-26T23:09:28.149 INFO:tasks.workunit.client.0.smithi148.stdout:2/987: read d5/d8/d9/d3d/f11b [30983,126841] 0 2024-04-26T23:09:28.150 INFO:tasks.workunit.client.0.smithi148.stdout:4/940: creat d12/d1c/d56/d87/d9c/da1/da9/f133 x:0 0 0 2024-04-26T23:09:28.153 INFO:tasks.workunit.client.0.smithi148.stdout:5/905: mkdir da/d1b/d5b/d5e/d6a/de4/d13a 0 2024-04-26T23:09:28.153 INFO:tasks.workunit.client.0.smithi148.stdout:9/859: sync 2024-04-26T23:09:28.155 INFO:tasks.workunit.client.0.smithi148.stdout:3/784: truncate d9/ff 2482181 0 2024-04-26T23:09:28.155 INFO:tasks.workunit.client.0.smithi148.stdout:3/785: truncate d9/d65/fd4 1154098 0 2024-04-26T23:09:28.157 INFO:tasks.workunit.client.0.smithi148.stdout:6/842: creat d6/d9/d1c/d1d/d68/d108/f11c x:0 0 0 2024-04-26T23:09:28.159 INFO:tasks.workunit.client.0.smithi148.stdout:1/939: creat d16/d17/d4b/d4d/f12f x:0 0 0 2024-04-26T23:09:28.159 INFO:tasks.workunit.client.0.smithi148.stdout:1/940: getdents d16/d45 0 2024-04-26T23:09:28.161 INFO:tasks.workunit.client.0.smithi148.stdout:8/885: symlink d3/d9/d12/d23/l11c 0 2024-04-26T23:09:28.181 INFO:tasks.workunit.client.0.smithi148.stdout:5/906: rename da/d1b/d2d/d82 to da/d1b/d1c/d13b 0 2024-04-26T23:09:28.181 INFO:tasks.workunit.client.0.smithi148.stdout:9/860: getdents d19/d1d/d25/d78/db6 0 2024-04-26T23:09:28.181 INFO:tasks.workunit.client.0.smithi148.stdout:1/941: creat d16/d17/d68/d6b/d8b/f130 x:0 0 0 2024-04-26T23:09:28.181 INFO:tasks.workunit.client.0.smithi148.stdout:1/942: read d16/d17/d4b/d59/fe1 [2740318,4083] 0 2024-04-26T23:09:28.183 INFO:tasks.workunit.client.0.smithi148.stdout:5/907: creat da/d1b/d3b/d73/f13c x:0 0 0 2024-04-26T23:09:28.183 INFO:tasks.workunit.client.0.smithi148.stdout:5/908: truncate da/d12/d78/ffd 932247 0 2024-04-26T23:09:28.190 INFO:tasks.workunit.client.0.smithi148.stdout:5/909: mkdir da/d1a/d13d 0 2024-04-26T23:09:28.196 INFO:tasks.workunit.client.0.smithi148.stdout:5/910: creat da/d1b/d1c/df2/f13e x:0 0 0 2024-04-26T23:09:28.200 INFO:tasks.workunit.client.0.smithi148.stdout:7/880: dwrite d7/d75/f93 [0,4194304] 0 2024-04-26T23:09:28.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/911: getdents da/d1b/d5b/d5e/d6a 0 2024-04-26T23:09:28.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/912: write da/d68/d69/daa/dc0/d11b/f128 [320137,115520] 0 2024-04-26T23:09:28.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/913: fsync da/d68/d69/daa/f102 0 2024-04-26T23:09:28.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/914: truncate da/d1b/d3b/d73/f13c 415221 0 2024-04-26T23:09:28.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/915: read - da/d68/d69/daa/f101 zero size 2024-04-26T23:09:28.207 INFO:tasks.workunit.client.0.smithi148.stdout:9/861: dread d19/d9f/faf [0,4194304] 0 2024-04-26T23:09:28.207 INFO:tasks.workunit.client.0.smithi148.stdout:5/916: rename da/d1f/d67/ffb to da/d1b/d2d/da8/f13f 0 2024-04-26T23:09:28.214 INFO:tasks.workunit.client.0.smithi148.stdout:6/843: dread d6/d14/d91/d9f/f7d [4194304,4194304] 0 2024-04-26T23:09:28.216 INFO:tasks.workunit.client.0.smithi148.stdout:6/844: mkdir d6/d9/d1e/d11d 0 2024-04-26T23:09:28.217 INFO:tasks.workunit.client.0.smithi148.stdout:6/845: symlink d6/d14/l11e 0 2024-04-26T23:09:28.217 INFO:tasks.workunit.client.0.smithi148.stdout:4/941: dwrite d12/d1c/dc8/f126 [0,4194304] 0 2024-04-26T23:09:28.218 INFO:tasks.workunit.client.0.smithi148.stdout:2/988: write d5/d8/db9/d145/d88/ff0 [345193,31780] 0 2024-04-26T23:09:28.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/846: rename d6/d9/d1c/d1d/c8c to d6/d9/d23/c11f 0 2024-04-26T23:09:28.222 INFO:tasks.workunit.client.0.smithi148.stdout:1/943: write d16/d47/fa0 [1563007,111282] 0 2024-04-26T23:09:28.223 INFO:tasks.workunit.client.0.smithi148.stdout:1/944: write d16/d17/d68/fd0 [266299,82878] 0 2024-04-26T23:09:28.227 INFO:tasks.workunit.client.0.smithi148.stdout:3/786: dwrite d9/d65/fd4 [0,4194304] 0 2024-04-26T23:09:28.227 INFO:tasks.workunit.client.0.smithi148.stdout:3/787: fdatasync d9/d15/d29/d4d/d68/f96 0 2024-04-26T23:09:28.227 INFO:tasks.workunit.client.0.smithi148.stdout:3/788: chown d9/d31/f32 341 1 2024-04-26T23:09:28.227 INFO:tasks.workunit.client.0.smithi148.stdout:4/942: creat d12/d1c/d45/dc2/f134 x:0 0 0 2024-04-26T23:09:28.227 INFO:tasks.workunit.client.0.smithi148.stdout:2/989: symlink d5/d8/d15/d43/l147 0 2024-04-26T23:09:28.228 INFO:tasks.workunit.client.0.smithi148.stdout:4/943: dread d12/d1c/f71 [0,4194304] 0 2024-04-26T23:09:28.231 INFO:tasks.workunit.client.0.smithi148.stdout:3/789: unlink d9/d65/d80/ca8 0 2024-04-26T23:09:28.233 INFO:tasks.workunit.client.0.smithi148.stdout:9/862: dread f2 [0,4194304] 0 2024-04-26T23:09:28.239 INFO:tasks.workunit.client.0.smithi148.stdout:2/990: dread d5/d8/d11/f122 [0,4194304] 0 2024-04-26T23:09:28.239 INFO:tasks.workunit.client.0.smithi148.stdout:2/991: dread - d5/d8/d15/d43/f132 zero size 2024-04-26T23:09:28.248 INFO:tasks.workunit.client.0.smithi148.stdout:3/790: link d9/d31/dc3/dca/fef d9/d65/ff4 0 2024-04-26T23:09:28.248 INFO:tasks.workunit.client.0.smithi148.stdout:3/791: write d9/d15/d29/d4d/f57 [5216554,40513] 0 2024-04-26T23:09:28.249 INFO:tasks.workunit.client.0.smithi148.stdout:5/917: dwrite da/d1b/d2d/f7b [0,4194304] 0 2024-04-26T23:09:28.270 INFO:tasks.workunit.client.0.smithi148.stdout:9/863: mknod d19/d4b/c118 0 2024-04-26T23:09:28.270 INFO:tasks.workunit.client.0.smithi148.stdout:2/992: mkdir d5/d8/d15/d43/d8d/d148 0 2024-04-26T23:09:28.270 INFO:tasks.workunit.client.0.smithi148.stdout:5/918: creat da/d1b/d2d/f140 x:0 0 0 2024-04-26T23:09:28.270 INFO:tasks.workunit.client.0.smithi148.stdout:2/993: truncate d5/d8/d15/d43/d8d/f121 236269 0 2024-04-26T23:09:28.275 INFO:tasks.workunit.client.0.smithi148.stdout:5/919: rename da/d1b/d1c/f22 to da/d68/d69/dc9/f141 0 2024-04-26T23:09:28.277 INFO:tasks.workunit.client.0.smithi148.stdout:2/994: link d5/d8/d15/d43/d8d/fc3 d5/d8/d4b/d4e/d6d/da0/d100/d136/f149 0 2024-04-26T23:09:28.283 INFO:tasks.workunit.client.0.smithi148.stdout:1/945: dwrite d16/d17/d4b/d55/f58 [0,4194304] 0 2024-04-26T23:09:28.288 INFO:tasks.workunit.client.0.smithi148.stdout:5/920: symlink da/d1b/d5b/d5e/d6a/de4/d13a/l142 0 2024-04-26T23:09:28.288 INFO:tasks.workunit.client.0.smithi148.stdout:2/995: rmdir d5/d8/d9/d3d 39 2024-04-26T23:09:28.288 INFO:tasks.workunit.client.0.smithi148.stdout:2/996: dread - d5/d8/d4b/d4e/d6d/fff zero size 2024-04-26T23:09:28.290 INFO:tasks.workunit.client.0.smithi148.stdout:9/864: write d19/d1d/d25/d2f/d4d/d33/fd7 [1995965,71780] 0 2024-04-26T23:09:28.291 INFO:tasks.workunit.client.0.smithi148.stdout:9/865: write d19/d1d/f3b [5014170,46507] 0 2024-04-26T23:09:28.295 INFO:tasks.workunit.client.0.smithi148.stdout:9/866: rename d19/d1d/d25/d2f/d4d/d33/d50/ld2 to d19/d9f/dbb/l119 0 2024-04-26T23:09:28.304 INFO:tasks.workunit.client.0.smithi148.stdout:4/944: dread d12/d1c/d56/d87/f104 [0,4194304] 0 2024-04-26T23:09:28.308 INFO:tasks.workunit.client.0.smithi148.stdout:1/946: dread f15 [0,4194304] 0 2024-04-26T23:09:28.308 INFO:tasks.workunit.client.0.smithi148.stdout:1/947: fdatasync d16/d1c/f29 0 2024-04-26T23:09:28.311 INFO:tasks.workunit.client.0.smithi148.stdout:5/921: write da/d1b/d2d/f7b [1459923,100744] 0 2024-04-26T23:09:28.312 INFO:tasks.workunit.client.0.smithi148.stdout:1/948: symlink d16/d17/d4b/dd1/l131 0 2024-04-26T23:09:28.314 INFO:tasks.workunit.client.0.smithi148.stdout:8/886: dwrite d3/d9/d12/d23/d54/ff5 [0,4194304] 0 2024-04-26T23:09:28.325 INFO:tasks.workunit.client.0.smithi148.stdout:1/949: dread d16/d17/d4b/d53/fba [0,4194304] 0 2024-04-26T23:09:28.325 INFO:tasks.workunit.client.0.smithi148.stdout:1/950: getdents d16/d17/daf/d12e 0 2024-04-26T23:09:28.328 INFO:tasks.workunit.client.0.smithi148.stdout:1/951: creat d16/d47/dd2/f132 x:0 0 0 2024-04-26T23:09:28.328 INFO:tasks.workunit.client.0.smithi148.stdout:1/952: chown d16/d17/d4b/d53/d67/f105 82997 1 2024-04-26T23:09:28.332 INFO:tasks.workunit.client.0.smithi148.stdout:9/867: dread d19/d1d/f3b [0,4194304] 0 2024-04-26T23:09:28.337 INFO:tasks.workunit.client.0.smithi148.stdout:5/922: dread da/d12/f13 [0,4194304] 0 2024-04-26T23:09:28.340 INFO:tasks.workunit.client.0.smithi148.stdout:5/923: creat da/d1b/d1c/d7f/d90/f143 x:0 0 0 2024-04-26T23:09:28.340 INFO:tasks.workunit.client.0.smithi148.stdout:5/924: chown da/d1b/d1c/d13b 3 1 2024-04-26T23:09:28.358 INFO:tasks.workunit.client.0.smithi148.stdout:9/868: write d19/d39/f90 [3090486,4644] 0 2024-04-26T23:09:28.360 INFO:tasks.workunit.client.0.smithi148.stdout:9/869: creat d19/d9f/f11a x:0 0 0 2024-04-26T23:09:28.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/887: dwrite d3/d9/d12/d23/d35/f5b [4194304,4194304] 0 2024-04-26T23:09:28.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/888: fdatasync d3/d9/d12/d95/f96 0 2024-04-26T23:09:28.360 INFO:tasks.workunit.client.0.smithi148.stdout:6/847: dwrite d6/d9/d1c/d1d/fa7 [0,4194304] 0 2024-04-26T23:09:28.374 INFO:tasks.workunit.client.0.smithi148.stdout:7/881: dwrite d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/feb [0,4194304] 0 2024-04-26T23:09:28.404 INFO:tasks.workunit.client.0.smithi148.stdout:3/792: write d9/d52/f5c [857117,94061] 0 2024-04-26T23:09:28.404 INFO:tasks.workunit.client.0.smithi148.stdout:3/793: write d9/d15/d29/d88/fd2 [288797,75487] 0 2024-04-26T23:09:28.412 INFO:tasks.workunit.client.0.smithi148.stdout:4/945: dread d12/d17/f5d [0,4194304] 0 2024-04-26T23:09:28.412 INFO:tasks.workunit.client.0.smithi148.stdout:2/997: dwrite d5/d7/f20 [4194304,4194304] 0 2024-04-26T23:09:28.468 INFO:tasks.workunit.client.0.smithi148.stdout:1/953: dwrite d16/d17/f1b [0,4194304] 0 2024-04-26T23:09:28.468 INFO:tasks.workunit.client.0.smithi148.stdout:1/954: truncate d16/d1c/faa 409662 0 2024-04-26T23:09:28.483 INFO:tasks.workunit.client.0.smithi148.stdout:5/925: dwrite da/d1b/d3b/d73/d97/fad [0,4194304] 0 2024-04-26T23:09:28.615 INFO:tasks.workunit.client.0.smithi148.stdout:9/870: mkdir d19/d1d/d25/d31/d11b 0 2024-04-26T23:09:28.615 INFO:tasks.workunit.client.0.smithi148.stdout:8/889: mknod d3/da/c11d 0 2024-04-26T23:09:28.615 INFO:tasks.workunit.client.0.smithi148.stdout:9/871: dread - d19/d1d/d25/d2f/d4d/d33/d50/f106 zero size 2024-04-26T23:09:28.615 INFO:tasks.workunit.client.0.smithi148.stdout:6/848: symlink d6/d9/d1c/d1d/d68/dbc/l120 0 2024-04-26T23:09:28.615 INFO:tasks.workunit.client.0.smithi148.stdout:6/849: chown d6/d9/d1c/f2e 3933271 1 2024-04-26T23:09:28.616 INFO:tasks.workunit.client.0.smithi148.stdout:6/850: write d6/d9/d23/dc1/df8/f101 [129929,30963] 0 2024-04-26T23:09:28.616 INFO:tasks.workunit.client.0.smithi148.stdout:6/851: read - d6/d9/d23/fd5 zero size 2024-04-26T23:09:28.623 INFO:tasks.workunit.client.0.smithi148.stdout:7/882: symlink d7/d11/d17/d2f/d57/l12e 0 2024-04-26T23:09:28.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/883: dread d7/d11/fd8 [0,4194304] 0 2024-04-26T23:09:28.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/884: dwrite d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/fbe [0,4194304] 0 2024-04-26T23:09:28.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/885: fsync d7/d11/d17/d2f/d44/d105/d2e/f64 0 2024-04-26T23:09:28.879 INFO:tasks.workunit.client.0.smithi148.stdout:3/794: rename d9/d15/d29/d4d/d5b/f7b to d9/d31/ff5 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:4/946: symlink d12/d1c/d45/dc2/dd4/l135 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:2/998: symlink d5/d8/d15/d7d/dd1/l14a 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:2/999: dread - d5/d8/d4b/d4e/d6d/da0/d78/df3/d86/d120/f13f zero size 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:8/890: symlink d3/da/db6/dfb/l11e 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/872: mkdir d19/d1d/d25/d78/d11c 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/873: getdents d19/d1d/d25/d31/d73/dd1 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:6/852: creat d6/dbe/ddc/dff/f121 x:0 0 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/874: stat d19/d1d/d25/d31/d48/d8c 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/875: stat d19/d1d/d25/d78/fdb 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:6/853: dread - d6/d9/d23/d4a/d95/ffa zero size 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/876: fdatasync d19/d1d/d25/d31/d32/db9/f117 0 2024-04-26T23:09:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/926: write da/d1b/d3b/db2/fb5 [1310055,748] 0 2024-04-26T23:09:28.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/886: creat d7/d11/d17/d9e/f12f x:0 0 0 2024-04-26T23:09:28.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/887: write d7/d75/ff6 [930219,85017] 0 2024-04-26T23:09:28.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/888: fdatasync d7/d11/d17/d2f/d44/de4/dfa/f128 0 2024-04-26T23:09:28.894 INFO:tasks.workunit.client.0.smithi148.stdout:1/955: symlink d16/d45/d2b/l133 0 2024-04-26T23:09:28.896 INFO:tasks.workunit.client.0.smithi148.stdout:3/795: read d9/d4c/f8a [192554,12270] 0 2024-04-26T23:09:28.896 INFO:tasks.workunit.client.0.smithi148.stdout:3/796: chown d9/d15/d29/d4d/l90 1109500 1 2024-04-26T23:09:28.903 INFO:tasks.workunit.client.0.smithi148.stdout:6/854: symlink d6/d32/d8a/l122 0 2024-04-26T23:09:28.908 INFO:tasks.workunit.client.0.smithi148.stdout:9/877: mkdir d19/d22/d7b/d11d 0 2024-04-26T23:09:28.909 INFO:tasks.workunit.client.0.smithi148.stdout:7/889: dread d7/d11/d17/d2f/d44/d105/f53 [0,4194304] 0 2024-04-26T23:09:28.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/927: creat da/d1b/d5b/d5e/f144 x:0 0 0 2024-04-26T23:09:28.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/928: readlink da/d1f/d67/ld8 0 2024-04-26T23:09:28.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/929: chown da/d1b/d5b/de1/l12d 6841918 1 2024-04-26T23:09:28.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/930: fsync f5 0 2024-04-26T23:09:28.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/931: fdatasync da/d12/d78/f10d 0 2024-04-26T23:09:28.922 INFO:tasks.workunit.client.0.smithi148.stdout:1/956: creat d16/d17/d4b/dd1/f134 x:0 0 0 2024-04-26T23:09:28.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/797: creat d9/d15/d29/d4d/d5b/ff6 x:0 0 0 2024-04-26T23:09:28.922 INFO:tasks.workunit.client.0.smithi148.stdout:8/891: write d3/d9/d12/f3f [7845899,92097] 0 2024-04-26T23:09:28.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/878: creat d19/d1d/d25/d2f/d4d/f11e x:0 0 0 2024-04-26T23:09:28.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/879: chown d19/d1d/d25/d2f/d4d/d33/d80/f8a 617 1 2024-04-26T23:09:28.925 INFO:tasks.workunit.client.0.smithi148.stdout:7/890: mkdir d7/d11/d17/d2f/d44/de4/d101/d116/d130 0 2024-04-26T23:09:28.941 INFO:tasks.workunit.client.0.smithi148.stdout:6/855: dwrite d6/d32/d8a/f97 [0,4194304] 0 2024-04-26T23:09:28.947 INFO:tasks.workunit.client.0.smithi148.stdout:5/932: rename da/d1b/d1c to da/d1b/d2d/da8/d145 0 2024-04-26T23:09:28.956 INFO:tasks.workunit.client.0.smithi148.stdout:1/957: unlink d16/d17/d68/d6b/d8b/f130 0 2024-04-26T23:09:28.959 INFO:tasks.workunit.client.0.smithi148.stdout:8/892: mknod d3/d9/d12/d23/d54/d60/df7/c11f 0 2024-04-26T23:09:28.959 INFO:tasks.workunit.client.0.smithi148.stdout:8/893: chown d3/d9/d12/d23/d35/dad/fe1 133932 1 2024-04-26T23:09:28.959 INFO:tasks.workunit.client.0.smithi148.stdout:9/880: getdents d19/d1d/d25/d31/d73/ddc 0 2024-04-26T23:09:28.959 INFO:tasks.workunit.client.0.smithi148.stdout:9/881: write d19/d1d/d25/fe1 [433023,74960] 0 2024-04-26T23:09:28.961 INFO:tasks.workunit.client.0.smithi148.stdout:7/891: link d7/d11/f88 d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/f131 0 2024-04-26T23:09:28.966 INFO:tasks.workunit.client.0.smithi148.stdout:5/933: mknod da/d1b/c146 0 2024-04-26T23:09:28.971 INFO:tasks.workunit.client.0.smithi148.stdout:8/894: symlink d3/da/d1c/d7c/l120 0 2024-04-26T23:09:28.975 INFO:tasks.workunit.client.0.smithi148.stdout:7/892: rename d7/d11/d17/d2f/d57/cf4 to d7/d11/d17/d2f/c132 0 2024-04-26T23:09:28.978 INFO:tasks.workunit.client.0.smithi148.stdout:3/798: truncate d9/d52/f5c 1370831 0 2024-04-26T23:09:28.981 INFO:tasks.workunit.client.0.smithi148.stdout:3/799: symlink d9/db3/lf7 0 2024-04-26T23:09:28.983 INFO:tasks.workunit.client.0.smithi148.stdout:3/800: rmdir d9/d31/dc3 39 2024-04-26T23:09:28.997 INFO:tasks.workunit.client.0.smithi148.stdout:7/893: write d7/f15 [2737300,124700] 0 2024-04-26T23:09:28.998 INFO:tasks.workunit.client.0.smithi148.stdout:6/856: dwrite d6/d9/d1c/d1d/d68/dbc/ffe [0,4194304] 0 2024-04-26T23:09:28.998 INFO:tasks.workunit.client.0.smithi148.stdout:6/857: write d6/d9/d1c/d1d/d1f/fa2 [4530550,68820] 0 2024-04-26T23:09:29.000 INFO:tasks.workunit.client.0.smithi148.stdout:1/958: dwrite d16/d1c/f109 [0,4194304] 0 2024-04-26T23:09:29.000 INFO:tasks.workunit.client.0.smithi148.stdout:1/959: chown d16/d17/d4b/dd1 31362781 1 2024-04-26T23:09:29.000 INFO:tasks.workunit.client.0.smithi148.stdout:3/801: dread d9/d15/d29/d4d/f64 [0,4194304] 0 2024-04-26T23:09:29.000 INFO:tasks.workunit.client.0.smithi148.stdout:3/802: fdatasync d9/d52/f5c 0 2024-04-26T23:09:29.008 INFO:tasks.workunit.client.0.smithi148.stdout:7/894: creat d7/d75/f133 x:0 0 0 2024-04-26T23:09:29.008 INFO:tasks.workunit.client.0.smithi148.stdout:7/895: chown d7/d11/d17/d2f/d44/d105/f53 1194 1 2024-04-26T23:09:29.008 INFO:tasks.workunit.client.0.smithi148.stdout:7/896: dread - d7/d75/de6/f11c zero size 2024-04-26T23:09:29.011 INFO:tasks.workunit.client.0.smithi148.stdout:6/858: rename d6/d32/d66/l6b to d6/d32/dfd/l123 0 2024-04-26T23:09:29.014 INFO:tasks.workunit.client.0.smithi148.stdout:7/897: unlink d7/d11/d17/d2f/ff8 0 2024-04-26T23:09:29.014 INFO:tasks.workunit.client.0.smithi148.stdout:6/859: rmdir d6/dbe 39 2024-04-26T23:09:29.015 INFO:tasks.workunit.client.0.smithi148.stdout:6/860: mknod d6/d14/d91/c124 0 2024-04-26T23:09:29.035 INFO:tasks.workunit.client.0.smithi148.stdout:1/960: dwrite d16/d45/d2b/d3e/d5a/f98 [0,4194304] 0 2024-04-26T23:09:29.038 INFO:tasks.workunit.client.0.smithi148.stdout:1/961: mkdir d16/d17/d4b/d53/d135 0 2024-04-26T23:09:29.039 INFO:tasks.workunit.client.0.smithi148.stdout:1/962: creat d16/d45/d2b/d3e/f136 x:0 0 0 2024-04-26T23:09:29.039 INFO:tasks.workunit.client.0.smithi148.stdout:1/963: stat d16/d17/d4b/d55/cd4 0 2024-04-26T23:09:29.040 INFO:tasks.workunit.client.0.smithi148.stdout:1/964: stat d16/d17/fee 0 2024-04-26T23:09:29.041 INFO:tasks.workunit.client.0.smithi148.stdout:1/965: mknod d16/d47/d73/c137 0 2024-04-26T23:09:29.042 INFO:tasks.workunit.client.0.smithi148.stdout:1/966: truncate d16/d85/fb0 3652184 0 2024-04-26T23:09:29.045 INFO:tasks.workunit.client.0.smithi148.stdout:1/967: unlink d16/d1c/d84/da7/fc8 0 2024-04-26T23:09:29.045 INFO:tasks.workunit.client.0.smithi148.stdout:1/968: dread - d16/fe8 zero size 2024-04-26T23:09:29.047 INFO:tasks.workunit.client.0.smithi148.stdout:1/969: rename d16/d17/d68/d6b/d8b to d16/d47/dd2/d138 0 2024-04-26T23:09:29.047 INFO:tasks.workunit.client.0.smithi148.stdout:1/970: write d16/d47/fa0 [40062,55194] 0 2024-04-26T23:09:29.050 INFO:tasks.workunit.client.0.smithi148.stdout:1/971: creat d16/d45/d2b/d3e/d5a/f139 x:0 0 0 2024-04-26T23:09:29.054 INFO:tasks.workunit.client.0.smithi148.stdout:1/972: creat d16/d17/d4b/d4d/f13a x:0 0 0 2024-04-26T23:09:29.054 INFO:tasks.workunit.client.0.smithi148.stdout:1/973: write d16/d45/d2b/f5c [1618942,99315] 0 2024-04-26T23:09:29.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/974: getdents d16/d17/d4b/dd1 0 2024-04-26T23:09:29.097 INFO:tasks.workunit.client.0.smithi148.stdout:1/975: dread d16/d1c/f33 [0,4194304] 0 2024-04-26T23:09:29.098 INFO:tasks.workunit.client.0.smithi148.stdout:6/861: dwrite d6/d32/d66/f80 [0,4194304] 0 2024-04-26T23:09:29.098 INFO:tasks.workunit.client.0.smithi148.stdout:1/976: getdents d16/d17/d4b/dd1 0 2024-04-26T23:09:29.098 INFO:tasks.workunit.client.0.smithi148.stdout:1/977: stat d16/d17/d4b/f123 0 2024-04-26T23:09:29.103 INFO:tasks.workunit.client.0.smithi148.stdout:1/978: rmdir d16/d17/d4b/d4d 39 2024-04-26T23:09:29.103 INFO:tasks.workunit.client.0.smithi148.stdout:1/979: dread - d16/d17/d4b/d53/d101/f12d zero size 2024-04-26T23:09:29.103 INFO:tasks.workunit.client.0.smithi148.stdout:1/980: chown f5 21049 1 2024-04-26T23:09:29.103 INFO:tasks.workunit.client.0.smithi148.stdout:1/981: chown d16/d17/daf 10 1 2024-04-26T23:09:29.105 INFO:tasks.workunit.client.0.smithi148.stdout:1/982: symlink d16/d47/d49/df3/l13b 0 2024-04-26T23:09:29.105 INFO:tasks.workunit.client.0.smithi148.stdout:1/983: stat d16/d47/dd2/f132 0 2024-04-26T23:09:29.120 INFO:tasks.workunit.client.0.smithi148.stdout:6/862: dread d6/d9/d1c/d1d/fa0 [0,4194304] 0 2024-04-26T23:09:29.122 INFO:tasks.workunit.client.0.smithi148.stdout:3/803: dwrite d9/d15/d29/d4d/d5b/fd9 [0,4194304] 0 2024-04-26T23:09:29.125 INFO:tasks.workunit.client.0.smithi148.stdout:3/804: mknod d9/d15/d29/d4d/d7d/cf8 0 2024-04-26T23:09:29.142 INFO:tasks.workunit.client.0.smithi148.stdout:7/898: dwrite d7/df5/f11f [0,4194304] 0 2024-04-26T23:09:29.142 INFO:tasks.workunit.client.0.smithi148.stdout:7/899: write d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fa0 [260937,98663] 0 2024-04-26T23:09:29.145 INFO:tasks.workunit.client.0.smithi148.stdout:7/900: getdents d7/d19 0 2024-04-26T23:09:29.145 INFO:tasks.workunit.client.0.smithi148.stdout:7/901: getdents d7/d11/d17/d2f/d44/de4/d101/d116/d130 0 2024-04-26T23:09:29.160 INFO:tasks.workunit.client.0.smithi148.stdout:1/984: dwrite d16/d45/d2b/d6e/f75 [0,4194304] 0 2024-04-26T23:09:29.163 INFO:tasks.workunit.client.0.smithi148.stdout:1/985: creat d16/d1c/d82/d11a/f13c x:0 0 0 2024-04-26T23:09:29.164 INFO:tasks.workunit.client.0.smithi148.stdout:1/986: mknod d16/d45/d2b/d6e/c13d 0 2024-04-26T23:09:29.166 INFO:tasks.workunit.client.0.smithi148.stdout:1/987: mkdir d16/d17/d68/d6b/d13e 0 2024-04-26T23:09:29.166 INFO:tasks.workunit.client.0.smithi148.stdout:1/988: stat d16/d17/d4b/d53/d67/fae 0 2024-04-26T23:09:29.168 INFO:tasks.workunit.client.0.smithi148.stdout:1/989: symlink d16/d45/l13f 0 2024-04-26T23:09:29.168 INFO:tasks.workunit.client.0.smithi148.stdout:1/990: stat d16/d1c/f33 0 2024-04-26T23:09:29.174 INFO:tasks.workunit.client.0.smithi148.stdout:6/863: dwrite d6/d9/f64 [0,4194304] 0 2024-04-26T23:09:29.175 INFO:tasks.workunit.client.0.smithi148.stdout:6/864: getdents d6/d9/d1c/d1d/d68/dc9 0 2024-04-26T23:09:29.176 INFO:tasks.workunit.client.0.smithi148.stdout:6/865: mknod d6/d14/d91/c125 0 2024-04-26T23:09:29.181 INFO:tasks.workunit.client.0.smithi148.stdout:6/866: link d6/d9/d1c/d1d/d1f/l6c d6/d32/l126 0 2024-04-26T23:09:29.182 INFO:tasks.workunit.client.0.smithi148.stdout:6/867: creat d6/d14/d91/d9f/f127 x:0 0 0 2024-04-26T23:09:29.182 INFO:tasks.workunit.client.0.smithi148.stdout:6/868: write d6/d14/d91/d9f/f78 [464433,87887] 0 2024-04-26T23:09:29.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/869: readlink d6/d9/d1c/d1d/d1f/l38 0 2024-04-26T23:09:29.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/870: fsync d6/d9/d23/d4a/f84 0 2024-04-26T23:09:29.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/871: chown d6/d9/d1c/d1d 69 1 2024-04-26T23:09:29.185 INFO:tasks.workunit.client.0.smithi148.stdout:6/872: creat d6/d9/d23/dc1/df8/f128 x:0 0 0 2024-04-26T23:09:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:5/934: sync 2024-04-26T23:09:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:4/947: sync 2024-04-26T23:09:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:9/882: sync 2024-04-26T23:09:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:9/883: read - d19/d1d/d25/d31/d48/fd4 zero size 2024-04-26T23:09:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:8/895: sync 2024-04-26T23:09:29.194 INFO:tasks.workunit.client.0.smithi148.stdout:5/935: unlink da/d12/c81 0 2024-04-26T23:09:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/884: symlink d19/d1d/d25/d31/d60/dba/d85/l11f 0 2024-04-26T23:09:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/885: write d19/d1d/d25/d31/d48/d8c/fcd [507426,84410] 0 2024-04-26T23:09:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/886: fsync d19/d1d/d25/d2f/d4d/d33/fb3 0 2024-04-26T23:09:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:9/887: truncate d19/d9f/dbb/ff4 942790 0 2024-04-26T23:09:29.199 INFO:tasks.workunit.client.0.smithi148.stdout:5/936: chown da/d1a/c59 549592 1 2024-04-26T23:09:29.199 INFO:tasks.workunit.client.0.smithi148.stdout:5/937: write da/fc [230194,1049] 0 2024-04-26T23:09:29.199 INFO:tasks.workunit.client.0.smithi148.stdout:5/938: chown da/d70/f77 115 1 2024-04-26T23:09:29.200 INFO:tasks.workunit.client.0.smithi148.stdout:5/939: dread - da/d1b/d2d/da8/d145/d7f/fa9 zero size 2024-04-26T23:09:29.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/940: rename da/d1b/d2d/f7b to da/d1b/d8b/dc7/f147 0 2024-04-26T23:09:29.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/941: chown da/d1b/d2d/da8/d145/f53 66 1 2024-04-26T23:09:29.210 INFO:tasks.workunit.client.0.smithi148.stdout:5/942: unlink da/d1b/d5b/d5e/dc5/l12b 0 2024-04-26T23:09:29.212 INFO:tasks.workunit.client.0.smithi148.stdout:5/943: rename da/d1b/d5b/de1 to da/d1b/d2d/da8/d145/d54/df0/d148 0 2024-04-26T23:09:29.215 INFO:tasks.workunit.client.0.smithi148.stdout:1/991: dwrite d16/d17/d4b/d55/f58 [4194304,4194304] 0 2024-04-26T23:09:29.217 INFO:tasks.workunit.client.0.smithi148.stdout:5/944: creat da/d1b/d2d/da8/d145/d7f/f149 x:0 0 0 2024-04-26T23:09:29.232 INFO:tasks.workunit.client.0.smithi148.stdout:7/902: dread d7/d11/d17/fc4 [0,4194304] 0 2024-04-26T23:09:29.236 INFO:tasks.workunit.client.0.smithi148.stdout:3/805: dwrite d9/d31/dc3/fcb [0,4194304] 0 2024-04-26T23:09:29.236 INFO:tasks.workunit.client.0.smithi148.stdout:3/806: chown d9/d15/d29/d4d/d7d/f7e 120689 1 2024-04-26T23:09:29.243 INFO:tasks.workunit.client.0.smithi148.stdout:4/948: dwrite d12/d1c/d56/d87/d9a/d9d/f44 [0,4194304] 0 2024-04-26T23:09:29.248 INFO:tasks.workunit.client.0.smithi148.stdout:9/888: dread d19/d1d/f8b [0,4194304] 0 2024-04-26T23:09:29.256 INFO:tasks.workunit.client.0.smithi148.stdout:1/992: creat d16/d1c/d82/d11a/f140 x:0 0 0 2024-04-26T23:09:29.256 INFO:tasks.workunit.client.0.smithi148.stdout:7/903: creat d7/d75/f134 x:0 0 0 2024-04-26T23:09:29.256 INFO:tasks.workunit.client.0.smithi148.stdout:4/949: dread d12/d1c/d56/d87/d9c/da1/da9/fd2 [0,4194304] 0 2024-04-26T23:09:29.257 INFO:tasks.workunit.client.0.smithi148.stdout:6/873: dwrite d6/f6f [4194304,4194304] 0 2024-04-26T23:09:29.261 INFO:tasks.workunit.client.0.smithi148.stdout:3/807: truncate d9/f36 352593 0 2024-04-26T23:09:29.269 INFO:tasks.workunit.client.0.smithi148.stdout:5/945: dwrite da/f19 [0,4194304] 0 2024-04-26T23:09:29.272 INFO:tasks.workunit.client.0.smithi148.stdout:9/889: rmdir d19/d1d/d25/d31/d48/d8c 39 2024-04-26T23:09:29.272 INFO:tasks.workunit.client.0.smithi148.stdout:1/993: mknod d16/d17/d4b/d53/c141 0 2024-04-26T23:09:29.272 INFO:tasks.workunit.client.0.smithi148.stdout:7/904: unlink d7/d75/ff6 0 2024-04-26T23:09:29.276 INFO:tasks.workunit.client.0.smithi148.stdout:8/896: dwrite d3/d9/d12/d95/f96 [0,4194304] 0 2024-04-26T23:09:29.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/874: mknod d6/d9/c129 0 2024-04-26T23:09:29.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/875: fsync d6/d9/d1c/dbf/dec/f112 0 2024-04-26T23:09:29.279 INFO:tasks.workunit.client.0.smithi148.stdout:3/808: creat d9/d15/d29/d88/d9f/ff9 x:0 0 0 2024-04-26T23:09:29.280 INFO:tasks.workunit.client.0.smithi148.stdout:5/946: mknod da/d1b/d2d/da8/d145/d54/c14a 0 2024-04-26T23:09:29.280 INFO:tasks.workunit.client.0.smithi148.stdout:5/947: stat da/d12/d78/cda 0 2024-04-26T23:09:29.281 INFO:tasks.workunit.client.0.smithi148.stdout:9/890: mkdir d19/d39/d5f/d120 0 2024-04-26T23:09:29.281 INFO:tasks.workunit.client.0.smithi148.stdout:1/994: mknod d16/d17/d68/d6b/d13e/c142 0 2024-04-26T23:09:29.283 INFO:tasks.workunit.client.0.smithi148.stdout:7/905: unlink d7/fc 0 2024-04-26T23:09:29.283 INFO:tasks.workunit.client.0.smithi148.stdout:7/906: chown d7/d11/d17/d2f/d44/d105/d2e/l10b 71899 1 2024-04-26T23:09:29.288 INFO:tasks.workunit.client.0.smithi148.stdout:6/876: creat d6/d14/d91/f12a x:0 0 0 2024-04-26T23:09:29.296 INFO:tasks.workunit.client.0.smithi148.stdout:3/809: write d9/d15/d29/d88/fc4 [770191,54040] 0 2024-04-26T23:09:29.297 INFO:tasks.workunit.client.0.smithi148.stdout:8/897: write d3/da/f110 [484949,59392] 0 2024-04-26T23:09:29.297 INFO:tasks.workunit.client.0.smithi148.stdout:8/898: fdatasync d3/d9/d12/d23/d35/fd6 0 2024-04-26T23:09:29.304 INFO:tasks.workunit.client.0.smithi148.stdout:9/891: symlink d19/d4b/dc4/l121 0 2024-04-26T23:09:29.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/907: creat d7/d11/d17/d2f/d44/de4/d101/f135 x:0 0 0 2024-04-26T23:09:29.316 INFO:tasks.workunit.client.0.smithi148.stdout:8/899: creat d3/d9/d12/d23/d54/d60/df7/f121 x:0 0 0 2024-04-26T23:09:29.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/908: dread - d7/df5/f129 zero size 2024-04-26T23:09:29.316 INFO:tasks.workunit.client.0.smithi148.stdout:4/950: rmdir d12/d1c/d56/d12d 39 2024-04-26T23:09:29.317 INFO:tasks.workunit.client.0.smithi148.stdout:9/892: truncate d19/d1d/d25/d2f/d4d/d33/d50/fc9 4537395 0 2024-04-26T23:09:29.318 INFO:tasks.workunit.client.0.smithi148.stdout:5/948: dread da/d1b/d2d/da8/d145/d7f/f95 [0,4194304] 0 2024-04-26T23:09:29.320 INFO:tasks.workunit.client.0.smithi148.stdout:7/909: fsync d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/fec 0 2024-04-26T23:09:29.320 INFO:tasks.workunit.client.0.smithi148.stdout:7/910: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fb9 23053671 1 2024-04-26T23:09:29.322 INFO:tasks.workunit.client.0.smithi148.stdout:9/893: creat d19/d1d/d25/d2f/d4d/d33/d50/dd9/dfa/f122 x:0 0 0 2024-04-26T23:09:29.322 INFO:tasks.workunit.client.0.smithi148.stdout:9/894: write d19/d1d/d25/d31/d60/dba/f107 [81649,107476] 0 2024-04-26T23:09:29.324 INFO:tasks.workunit.client.0.smithi148.stdout:5/949: rename da/d1b/d3b/d73/d97/db0/cd9 to da/d1b/d5b/d5e/d6a/de4/d13a/c14b 0 2024-04-26T23:09:29.325 INFO:tasks.workunit.client.0.smithi148.stdout:7/911: link d7/d11/d17/d2f/d44/f7f d7/d11/d17/d2f/d44/de4/dfa/f136 0 2024-04-26T23:09:29.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/912: readlink d7/d11/d17/d2f/d57/l99 0 2024-04-26T23:09:29.326 INFO:tasks.workunit.client.0.smithi148.stdout:9/895: symlink d19/d22/l123 0 2024-04-26T23:09:29.327 INFO:tasks.workunit.client.0.smithi148.stdout:9/896: getdents d19/d1d/d25/d78/d11c 0 2024-04-26T23:09:29.327 INFO:tasks.workunit.client.0.smithi148.stdout:9/897: chown d19/d9f/faf 1009371 1 2024-04-26T23:09:29.335 INFO:tasks.workunit.client.0.smithi148.stdout:5/950: chown da/d1b/d2d/da8/d145/d7f/fcb 106593 1 2024-04-26T23:09:29.362 INFO:tasks.workunit.client.0.smithi148.stdout:6/877: dwrite d6/d9/d23/d4a/f92 [0,4194304] 0 2024-04-26T23:09:29.362 INFO:tasks.workunit.client.0.smithi148.stdout:6/878: write d6/d32/dfd/f116 [983102,124809] 0 2024-04-26T23:09:29.362 INFO:tasks.workunit.client.0.smithi148.stdout:6/879: truncate d6/d9/d1c/d1d/d1f/d40/f10d 738311 0 2024-04-26T23:09:29.362 INFO:tasks.workunit.client.0.smithi148.stdout:5/951: creat da/d1b/d2d/da8/f14c x:0 0 0 2024-04-26T23:09:29.365 INFO:tasks.workunit.client.0.smithi148.stdout:6/880: creat d6/f12b x:0 0 0 2024-04-26T23:09:29.369 INFO:tasks.workunit.client.0.smithi148.stdout:3/810: dwrite d9/d31/d8f/fd0 [0,4194304] 0 2024-04-26T23:09:29.370 INFO:tasks.workunit.client.0.smithi148.stdout:6/881: rmdir d6 39 2024-04-26T23:09:29.371 INFO:tasks.workunit.client.0.smithi148.stdout:6/882: chown d6/d9/d1e/d69/f88 2745522 1 2024-04-26T23:09:29.371 INFO:tasks.workunit.client.0.smithi148.stdout:6/883: chown d6/lb4 3 1 2024-04-26T23:09:29.376 INFO:tasks.workunit.client.0.smithi148.stdout:4/951: dwrite d12/d17/f5d [8388608,4194304] 0 2024-04-26T23:09:29.376 INFO:tasks.workunit.client.0.smithi148.stdout:4/952: dread - d12/d1c/d45/d8c/f105 zero size 2024-04-26T23:09:29.376 INFO:tasks.workunit.client.0.smithi148.stdout:4/953: fdatasync d12/d17/d2a/d37/d97/fa0 0 2024-04-26T23:09:29.397 INFO:tasks.workunit.client.0.smithi148.stdout:8/900: dwrite d3/d9/d12/d23/d29/d77/d91/fba [4194304,4194304] 0 2024-04-26T23:09:29.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/952: rename da/d1b/d2d/da8 to da/d1b/d3b/d14d 0 2024-04-26T23:09:29.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/953: chown da/d1b/fed 8 1 2024-04-26T23:09:29.423 INFO:tasks.workunit.client.0.smithi148.stdout:7/913: dwrite d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/f131 [0,4194304] 0 2024-04-26T23:09:29.430 INFO:tasks.workunit.client.0.smithi148.stdout:4/954: dwrite d12/d1c/d56/f6f [0,4194304] 0 2024-04-26T23:09:29.444 INFO:tasks.workunit.client.0.smithi148.stdout:8/901: dwrite d3/da/d1c/d7a/fa9 [0,4194304] 0 2024-04-26T23:09:29.445 INFO:tasks.workunit.client.0.smithi148.stdout:4/955: unlink d12/d1c/d56/d87/d9a/d9d/l6a 0 2024-04-26T23:09:29.448 INFO:tasks.workunit.client.0.smithi148.stdout:8/902: creat d3/d9a/dcd/f122 x:0 0 0 2024-04-26T23:09:29.449 INFO:tasks.workunit.client.0.smithi148.stdout:4/956: creat d12/d17/f136 x:0 0 0 2024-04-26T23:09:29.449 INFO:tasks.workunit.client.0.smithi148.stdout:4/957: fdatasync d12/d1c/d45/d8c/f26 0 2024-04-26T23:09:29.450 INFO:tasks.workunit.client.0.smithi148.stdout:4/958: fdatasync d12/d1c/d45/d8c/f3c 0 2024-04-26T23:09:29.460 INFO:tasks.workunit.client.0.smithi148.stdout:4/959: dread d12/d1c/d56/d12d/fa6 [0,4194304] 0 2024-04-26T23:09:29.461 INFO:tasks.workunit.client.0.smithi148.stdout:4/960: stat d12/d17/d2a/c9f 0 2024-04-26T23:09:29.461 INFO:tasks.workunit.client.0.smithi148.stdout:4/961: fdatasync d12/d1c/d56/d87/f96 0 2024-04-26T23:09:29.480 INFO:tasks.workunit.client.0.smithi148.stdout:1/995: dwrite d16/d85/fb1 [0,4194304] 0 2024-04-26T23:09:29.482 INFO:tasks.workunit.client.0.smithi148.stdout:8/903: symlink d3/da/d1c/l123 0 2024-04-26T23:09:29.483 INFO:tasks.workunit.client.0.smithi148.stdout:7/914: dwrite d7/d11/f10a [0,4194304] 0 2024-04-26T23:09:29.486 INFO:tasks.workunit.client.0.smithi148.stdout:1/996: mknod d16/d45/d2b/d3e/d5a/c143 0 2024-04-26T23:09:29.493 INFO:tasks.workunit.client.0.smithi148.stdout:4/962: dwrite d12/d1c/d45/d8c/f83 [0,4194304] 0 2024-04-26T23:09:29.495 INFO:tasks.workunit.client.0.smithi148.stdout:8/904: mknod d3/da/d1c/d7c/d8c/c124 0 2024-04-26T23:09:29.495 INFO:tasks.workunit.client.0.smithi148.stdout:7/915: symlink d7/d75/dad/l137 0 2024-04-26T23:09:29.496 INFO:tasks.workunit.client.0.smithi148.stdout:7/916: stat d7/d11/d17/d7c/f103 0 2024-04-26T23:09:29.496 INFO:tasks.workunit.client.0.smithi148.stdout:1/997: creat d16/d1c/d84/da7/f144 x:0 0 0 2024-04-26T23:09:29.497 INFO:tasks.workunit.client.0.smithi148.stdout:7/917: dread d7/d11/d17/f65 [0,4194304] 0 2024-04-26T23:09:29.499 INFO:tasks.workunit.client.0.smithi148.stdout:4/963: symlink d12/d1c/d56/d87/d9a/l137 0 2024-04-26T23:09:29.499 INFO:tasks.workunit.client.0.smithi148.stdout:4/964: write d12/d17/f12b [1662896,78981] 0 2024-04-26T23:09:29.499 INFO:tasks.workunit.client.0.smithi148.stdout:4/965: chown d12/d1c/d56/cb5 251 1 2024-04-26T23:09:29.500 INFO:tasks.workunit.client.0.smithi148.stdout:8/905: truncate d3/d9/d12/d23/f100 2236837 0 2024-04-26T23:09:29.504 INFO:tasks.workunit.client.0.smithi148.stdout:4/966: read d12/d1c/dc0/fe8 [1141242,91170] 0 2024-04-26T23:09:29.504 INFO:tasks.workunit.client.0.smithi148.stdout:4/967: fdatasync d12/d1c/faf 0 2024-04-26T23:09:29.504 INFO:tasks.workunit.client.0.smithi148.stdout:4/968: write d12/d1c/d56/fc7 [3812377,123311] 0 2024-04-26T23:09:29.504 INFO:tasks.workunit.client.0.smithi148.stdout:4/969: write d12/d1c/d56/fc7 [5056401,28052] 0 2024-04-26T23:09:29.520 INFO:tasks.workunit.client.0.smithi148.stdout:4/970: dread d12/d1c/d45/d8c/f26 [0,4194304] 0 2024-04-26T23:09:29.521 INFO:tasks.workunit.client.0.smithi148.stdout:8/906: read d3/d9/d12/d23/d29/d37/f63 [6828647,14076] 0 2024-04-26T23:09:29.524 INFO:tasks.workunit.client.0.smithi148.stdout:7/918: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d138 0 2024-04-26T23:09:29.525 INFO:tasks.workunit.client.0.smithi148.stdout:6/884: write d6/d9/f15 [297915,15666] 0 2024-04-26T23:09:29.526 INFO:tasks.workunit.client.0.smithi148.stdout:4/971: rename d12/d17/d2a/d37/d97/fa0 to d12/d1c/d45/dc2/dd4/f138 0 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/954: dread da/d1b/d5b/d117/f94 [0,4194304] 0 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/955: stat da/d1b/f11a 0 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/811: dwrite d9/d15/d29/d88/d9f/ff9 [0,4194304] 0 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/956: chown da/d1f/d67 27335101 1 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:7/919: getdents d7/d11/d17/d43 0 2024-04-26T23:09:29.527 INFO:tasks.workunit.client.0.smithi148.stdout:6/885: symlink d6/d9/d23/dc1/l12c 0 2024-04-26T23:09:29.530 INFO:tasks.workunit.client.0.smithi148.stdout:4/972: rename d12/d1c/dc8/c106 to d12/d1c/dc8/c139 0 2024-04-26T23:09:29.535 INFO:tasks.workunit.client.0.smithi148.stdout:6/886: dread d6/d9/d23/dc1/df8/f101 [0,4194304] 0 2024-04-26T23:09:29.537 INFO:tasks.workunit.client.0.smithi148.stdout:3/812: creat d9/d15/d29/d4d/d68/dd6/ffa x:0 0 0 2024-04-26T23:09:29.537 INFO:tasks.workunit.client.0.smithi148.stdout:3/813: chown d9/d15/d29/d4d/f64 12 1 2024-04-26T23:09:29.539 INFO:tasks.workunit.client.0.smithi148.stdout:6/887: mkdir d6/d32/d8a/d12d 0 2024-04-26T23:09:29.540 INFO:tasks.workunit.client.0.smithi148.stdout:3/814: mknod d9/d31/cfb 0 2024-04-26T23:09:29.540 INFO:tasks.workunit.client.0.smithi148.stdout:3/815: stat d9/d31/ff5 0 2024-04-26T23:09:29.541 INFO:tasks.workunit.client.0.smithi148.stdout:8/907: write d3/da/d1c/d7a/f98 [343609,51028] 0 2024-04-26T23:09:29.551 INFO:tasks.workunit.client.0.smithi148.stdout:4/973: read d12/d17/f68 [2139402,105505] 0 2024-04-26T23:09:29.584 INFO:tasks.workunit.client.0.smithi148.stdout:5/957: dwrite da/d1b/d3b/d14d/d145/f11d [0,4194304] 0 2024-04-26T23:09:29.587 INFO:tasks.workunit.client.0.smithi148.stdout:6/888: rename d6/d9/d23/l4d to d6/d9/d23/dc1/df8/l12e 0 2024-04-26T23:09:29.595 INFO:tasks.workunit.client.0.smithi148.stdout:5/958: creat da/d1f/d47/f14e x:0 0 0 2024-04-26T23:09:29.595 INFO:tasks.workunit.client.0.smithi148.stdout:4/974: dread d12/d1c/d45/d8c/f3c [0,4194304] 0 2024-04-26T23:09:29.596 INFO:tasks.workunit.client.0.smithi148.stdout:8/908: dwrite d3/f42 [0,4194304] 0 2024-04-26T23:09:29.598 INFO:tasks.workunit.client.0.smithi148.stdout:6/889: link d6/dc/l9e d6/d9/d1c/dbf/dec/l12f 0 2024-04-26T23:09:29.600 INFO:tasks.workunit.client.0.smithi148.stdout:3/816: rename d9/d15/d29/d4d/d6f/fae to d9/d65/d80/d83/d99/ffc 0 2024-04-26T23:09:29.601 INFO:tasks.workunit.client.0.smithi148.stdout:8/909: mkdir d3/d9/d12/d23/d29/d77/d125 0 2024-04-26T23:09:29.612 INFO:tasks.workunit.client.0.smithi148.stdout:3/817: dread d9/d15/d29/d4d/d6f/fb6 [0,4194304] 0 2024-04-26T23:09:29.613 INFO:tasks.workunit.client.0.smithi148.stdout:3/818: write d9/d31/fa9 [814805,81365] 0 2024-04-26T23:09:29.614 INFO:tasks.workunit.client.0.smithi148.stdout:6/890: creat d6/d9/d1c/d1d/f130 x:0 0 0 2024-04-26T23:09:29.616 INFO:tasks.workunit.client.0.smithi148.stdout:4/975: rename d12/d17/d2a/d37/f5c to d12/d17/d2a/d37/d97/f13a 0 2024-04-26T23:09:29.616 INFO:tasks.workunit.client.0.smithi148.stdout:4/976: chown d12/d1c/d56/d87/d9c/da1/da9/f133 4 1 2024-04-26T23:09:29.616 INFO:tasks.workunit.client.0.smithi148.stdout:4/977: truncate d12/d1c/d56/d87/f96 4666557 0 2024-04-26T23:09:29.616 INFO:tasks.workunit.client.0.smithi148.stdout:4/978: write d12/d1c/d45/d8c/f3c [1920977,93742] 0 2024-04-26T23:09:29.616 INFO:tasks.workunit.client.0.smithi148.stdout:3/819: truncate d9/d15/d29/d4d/d6f/fb6 2917377 0 2024-04-26T23:09:29.617 INFO:tasks.workunit.client.0.smithi148.stdout:6/891: rmdir d6/d9/d1c/d1d/d68/dbc 39 2024-04-26T23:09:29.629 INFO:tasks.workunit.client.0.smithi148.stdout:4/979: dread d12/f8f [0,4194304] 0 2024-04-26T23:09:29.632 INFO:tasks.workunit.client.0.smithi148.stdout:3/820: creat d9/d15/d29/d4d/d6f/ffd x:0 0 0 2024-04-26T23:09:29.634 INFO:tasks.workunit.client.0.smithi148.stdout:6/892: mknod d6/d14/d91/c131 0 2024-04-26T23:09:29.641 INFO:tasks.workunit.client.0.smithi148.stdout:4/980: mknod d12/d1c/d56/d87/d9c/da1/dc3/dd0/c13b 0 2024-04-26T23:09:29.641 INFO:tasks.workunit.client.0.smithi148.stdout:4/981: chown d12/d1c/d56/d87/f10d 847 1 2024-04-26T23:09:29.642 INFO:tasks.workunit.client.0.smithi148.stdout:5/959: dwrite da/d1b/d3b/d14d/d145/f66 [0,4194304] 0 2024-04-26T23:09:29.642 INFO:tasks.workunit.client.0.smithi148.stdout:5/960: fsync da/d1b/d8b/dc7/f147 0 2024-04-26T23:09:29.643 INFO:tasks.workunit.client.0.smithi148.stdout:3/821: mknod d9/d15/d29/d4d/d78/dee/cfe 0 2024-04-26T23:09:29.647 INFO:tasks.workunit.client.0.smithi148.stdout:4/982: creat d12/d1c/d45/dc2/dd4/d115/f13c x:0 0 0 2024-04-26T23:09:29.648 INFO:tasks.workunit.client.0.smithi148.stdout:3/822: rename d9/d65/d80/d83/d99/ffc to d9/d15/d29/d4d/d7d/fff 0 2024-04-26T23:09:29.653 INFO:tasks.workunit.client.0.smithi148.stdout:3/823: dread d9/d15/f92 [0,4194304] 0 2024-04-26T23:09:29.670 INFO:tasks.workunit.client.0.smithi148.stdout:8/910: dwrite d3/d9/d12/d23/d35/f47 [4194304,4194304] 0 2024-04-26T23:09:29.671 INFO:tasks.workunit.client.0.smithi148.stdout:3/824: dread d9/d52/fec [4194304,4194304] 0 2024-04-26T23:09:29.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/911: chown d3/d9/d12/f78 1398326408 1 2024-04-26T23:09:29.671 INFO:tasks.workunit.client.0.smithi148.stdout:3/825: stat d9/d15/d29/d88/d9f/dbc/fe0 0 2024-04-26T23:09:29.671 INFO:tasks.workunit.client.0.smithi148.stdout:5/961: dwrite da/d68/d69/dc9/d125/f106 [0,4194304] 0 2024-04-26T23:09:29.671 INFO:tasks.workunit.client.0.smithi148.stdout:5/962: write da/d1b/d8b/dc7/f107 [761692,109136] 0 2024-04-26T23:09:29.672 INFO:tasks.workunit.client.0.smithi148.stdout:5/963: write da/d68/d69/daa/f101 [1013838,86797] 0 2024-04-26T23:09:29.672 INFO:tasks.workunit.client.0.smithi148.stdout:4/983: mknod d12/d1c/d56/d87/d9c/da1/dc3/c13d 0 2024-04-26T23:09:29.672 INFO:tasks.workunit.client.0.smithi148.stdout:4/984: fsync d12/d17/d2a/d37/f88 0 2024-04-26T23:09:29.673 INFO:tasks.workunit.client.0.smithi148.stdout:3/826: rmdir d9/d15/d29/d4d/d78/dee 39 2024-04-26T23:09:29.675 INFO:tasks.workunit.client.0.smithi148.stdout:8/912: creat d3/d9/d12/d23/d29/d77/deb/f126 x:0 0 0 2024-04-26T23:09:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:3/827: read d9/d15/d29/d4d/d6f/fb6 [1471586,72939] 0 2024-04-26T23:09:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:3/828: stat d9/d15/c3a 0 2024-04-26T23:09:29.684 INFO:tasks.workunit.client.0.smithi148.stdout:5/964: creat da/d1b/d3b/d14d/d145/d54/df0/f14f x:0 0 0 2024-04-26T23:09:29.687 INFO:tasks.workunit.client.0.smithi148.stdout:3/829: rename d9/d52/l58 to d9/d65/d80/d83/l100 0 2024-04-26T23:09:29.723 INFO:tasks.workunit.client.0.smithi148.stdout:8/913: dwrite d3/d87/f93 [0,4194304] 0 2024-04-26T23:09:29.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/965: creat da/d130/f150 x:0 0 0 2024-04-26T23:09:29.725 INFO:tasks.workunit.client.0.smithi148.stdout:3/830: symlink d9/d65/d80/d83/db9/l101 0 2024-04-26T23:09:29.725 INFO:tasks.workunit.client.0.smithi148.stdout:3/831: chown d9/d15/d29/d4d/d6f 25 1 2024-04-26T23:09:29.733 INFO:tasks.workunit.client.0.smithi148.stdout:9/898: sync 2024-04-26T23:09:29.739 INFO:tasks.workunit.client.0.smithi148.stdout:3/832: write d9/d15/d29/d88/fa1 [2769390,2106] 0 2024-04-26T23:09:29.742 INFO:tasks.workunit.client.0.smithi148.stdout:8/914: link d3/da/d1c/fe6 d3/d9/d12/d23/d35/f127 0 2024-04-26T23:09:29.744 INFO:tasks.workunit.client.0.smithi148.stdout:9/899: creat d19/d1d/d25/d31/d60/f124 x:0 0 0 2024-04-26T23:09:29.745 INFO:tasks.workunit.client.0.smithi148.stdout:3/833: getdents d9/d15/d29/d88/d9f/dbc 0 2024-04-26T23:09:29.749 INFO:tasks.workunit.client.0.smithi148.stdout:9/900: dread d19/d1d/f3b [4194304,4194304] 0 2024-04-26T23:09:29.751 INFO:tasks.workunit.client.0.smithi148.stdout:8/915: getdents d3/d9/d12/d23/d35/de9 0 2024-04-26T23:09:29.753 INFO:tasks.workunit.client.0.smithi148.stdout:3/834: mkdir d9/d65/d102 0 2024-04-26T23:09:29.753 INFO:tasks.workunit.client.0.smithi148.stdout:3/835: chown d9/d15/d29/c42 27257162 1 2024-04-26T23:09:29.755 INFO:tasks.workunit.client.0.smithi148.stdout:9/901: getdents d19/d22 0 2024-04-26T23:09:29.755 INFO:tasks.workunit.client.0.smithi148.stdout:9/902: truncate d19/d1d/d25/d2f/d4d/d33/daa/f10f 161848 0 2024-04-26T23:09:29.755 INFO:tasks.workunit.client.0.smithi148.stdout:9/903: write d19/d1d/d25/d31/d73/dd1/fe3 [2697914,18399] 0 2024-04-26T23:09:29.755 INFO:tasks.workunit.client.0.smithi148.stdout:9/904: write d19/d1d/d25/d31/d73/ddc/ff0 [68326,13918] 0 2024-04-26T23:09:29.758 INFO:tasks.workunit.client.0.smithi148.stdout:8/916: link d3/da/d1c/d7c/d8c/c124 d3/d9a/c128 0 2024-04-26T23:09:29.759 INFO:tasks.workunit.client.0.smithi148.stdout:3/836: mknod d9/db3/df2/c103 0 2024-04-26T23:09:29.762 INFO:tasks.workunit.client.0.smithi148.stdout:9/905: mkdir d19/d39/d5f/d120/d125 0 2024-04-26T23:09:29.762 INFO:tasks.workunit.client.0.smithi148.stdout:9/906: dread - d19/d1d/d25/d2f/d4d/f11e zero size 2024-04-26T23:09:29.762 INFO:tasks.workunit.client.0.smithi148.stdout:9/907: chown d19/d1d/d25/d2f/d4d/d33/cda 46141 1 2024-04-26T23:09:29.807 INFO:tasks.workunit.client.0.smithi148.stdout:8/917: symlink d3/d9/l129 0 2024-04-26T23:09:29.811 INFO:tasks.workunit.client.0.smithi148.stdout:3/837: creat d9/d65/d80/d83/d99/f104 x:0 0 0 2024-04-26T23:09:29.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/918: creat d3/d9a/f12a x:0 0 0 2024-04-26T23:09:29.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/919: fdatasync d3/d9/d12/fec 0 2024-04-26T23:09:29.814 INFO:tasks.workunit.client.0.smithi148.stdout:8/920: chown d3/da/db6/d79/ffe 126 1 2024-04-26T23:09:29.817 INFO:tasks.workunit.client.0.smithi148.stdout:9/908: dwrite fe [8388608,4194304] 0 2024-04-26T23:09:29.817 INFO:tasks.workunit.client.0.smithi148.stdout:9/909: chown d19/d22/l2b 1 1 2024-04-26T23:09:29.818 INFO:tasks.workunit.client.0.smithi148.stdout:3/838: rename d9/d15/d29/d88/fa1 to d9/d15/d29/d88/d9f/dbc/f105 0 2024-04-26T23:09:29.820 INFO:tasks.workunit.client.0.smithi148.stdout:8/921: creat d3/d9/d12/d23/d29/d37/d5e/f12b x:0 0 0 2024-04-26T23:09:29.823 INFO:tasks.workunit.client.0.smithi148.stdout:9/910: link d19/d1d/d25/d2f/d4d/d33/d50/dd9/dfa/f122 d19/d1d/d25/d31/d60/dba/d85/db2/f126 0 2024-04-26T23:09:29.825 INFO:tasks.workunit.client.0.smithi148.stdout:3/839: creat d9/d65/d102/f106 x:0 0 0 2024-04-26T23:09:29.827 INFO:tasks.workunit.client.0.smithi148.stdout:9/911: getdents d19/d1d/d25/d2f/d4d/d33/d50/dd9 0 2024-04-26T23:09:29.829 INFO:tasks.workunit.client.0.smithi148.stdout:3/840: getdents d9/d15/d29/d4d/d68/dd6/de2 0 2024-04-26T23:09:29.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/912: creat d19/d4b/f127 x:0 0 0 2024-04-26T23:09:29.862 INFO:tasks.workunit.client.0.smithi148.stdout:8/922: dwrite d3/da/f64 [0,4194304] 0 2024-04-26T23:09:29.871 INFO:tasks.workunit.client.0.smithi148.stdout:3/841: dwrite d9/d52/f62 [4194304,4194304] 0 2024-04-26T23:09:29.883 INFO:tasks.workunit.client.0.smithi148.stdout:8/923: dread d3/d9a/fa8 [0,4194304] 0 2024-04-26T23:09:29.883 INFO:tasks.workunit.client.0.smithi148.stdout:8/924: dread - d3/d9a/f12a zero size 2024-04-26T23:09:29.884 INFO:tasks.workunit.client.0.smithi148.stdout:9/913: creat d19/d1d/d25/d2f/d4d/f128 x:0 0 0 2024-04-26T23:09:29.884 INFO:tasks.workunit.client.0.smithi148.stdout:9/914: chown d19/d1d/f3b 555916581 1 2024-04-26T23:09:29.905 INFO:tasks.workunit.client.0.smithi148.stdout:3/842: dwrite d9/d15/d29/d4d/f57 [0,4194304] 0 2024-04-26T23:09:29.908 INFO:tasks.workunit.client.0.smithi148.stdout:8/925: truncate d3/d9/d12/d23/d35/faf 198235 0 2024-04-26T23:09:29.908 INFO:tasks.workunit.client.0.smithi148.stdout:8/926: write d3/f76 [5158858,7558] 0 2024-04-26T23:09:29.924 INFO:tasks.workunit.client.0.smithi148.stdout:1/998: sync 2024-04-26T23:09:29.925 INFO:tasks.workunit.client.0.smithi148.stdout:7/920: sync 2024-04-26T23:09:29.925 INFO:tasks.workunit.client.0.smithi148.stdout:7/921: chown d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 236 1 2024-04-26T23:09:29.925 INFO:tasks.workunit.client.0.smithi148.stdout:7/922: truncate d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fd9 76098 0 2024-04-26T23:09:29.925 INFO:tasks.workunit.client.0.smithi148.stdout:7/923: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/f11a 1016 1 2024-04-26T23:09:29.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/927: rmdir d3/d9/d12/d23/d54 39 2024-04-26T23:09:29.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/928: stat d3/da/d1c/f83 0 2024-04-26T23:09:29.928 INFO:tasks.workunit.client.0.smithi148.stdout:3/843: write d9/d31/d8f/fa2 [3383467,78611] 0 2024-04-26T23:09:29.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/924: mknod d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/c139 0 2024-04-26T23:09:29.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/925: readlink d7/d11/lfb 0 2024-04-26T23:09:29.931 INFO:tasks.workunit.client.0.smithi148.stdout:8/929: symlink d3/d9/d12/d23/d54/d60/l12c 0 2024-04-26T23:09:29.932 INFO:tasks.workunit.client.0.smithi148.stdout:8/930: chown d3/d9/d12/f46 1198514 1 2024-04-26T23:09:29.933 INFO:tasks.workunit.client.0.smithi148.stdout:7/926: dread d7/d11/d17/d9e/fa8 [0,4194304] 0 2024-04-26T23:09:29.936 INFO:tasks.workunit.client.0.smithi148.stdout:3/844: truncate d9/d31/f55 852720 0 2024-04-26T23:09:29.937 INFO:tasks.workunit.client.0.smithi148.stdout:3/845: truncate d9/d65/ff4 541151 0 2024-04-26T23:09:29.940 INFO:tasks.workunit.client.0.smithi148.stdout:1/999: dread d16/d17/f25 [0,4194304] 0 2024-04-26T23:09:29.948 INFO:tasks.workunit.client.0.smithi148.stdout:8/931: symlink d3/da/d28/l12d 0 2024-04-26T23:09:29.950 INFO:tasks.workunit.client.0.smithi148.stdout:3/846: mknod d9/d15/d29/d4d/c107 0 2024-04-26T23:09:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:7/927: dwrite d7/d11/d17/d7c/f103 [0,4194304] 0 2024-04-26T23:09:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:7/928: write d7/d11/d17/d2f/d44/d105/d2e/d41/fd3 [6973,13338] 0 2024-04-26T23:09:30.203 INFO:tasks.workunit.client.0.smithi148.stdout:8/932: symlink d3/da/db6/l12e 0 2024-04-26T23:09:30.203 INFO:tasks.workunit.client.0.smithi148.stdout:3/847: mknod d9/d15/d29/d4d/d78/dee/c108 0 2024-04-26T23:09:30.209 INFO:tasks.workunit.client.0.smithi148.stdout:3/848: symlink d9/d65/d80/d83/db9/l109 0 2024-04-26T23:09:30.209 INFO:tasks.workunit.client.0.smithi148.stdout:7/929: write d7/d19/fe0 [539190,104101] 0 2024-04-26T23:09:30.213 INFO:tasks.workunit.client.0.smithi148.stdout:3/849: creat d9/d15/d29/d4d/f10a x:0 0 0 2024-04-26T23:09:30.213 INFO:tasks.workunit.client.0.smithi148.stdout:3/850: truncate d9/d15/d29/d4d/d5b/ff6 49829 0 2024-04-26T23:09:30.215 INFO:tasks.workunit.client.0.smithi148.stdout:6/893: sync 2024-04-26T23:09:30.215 INFO:tasks.workunit.client.0.smithi148.stdout:9/915: sync 2024-04-26T23:09:30.215 INFO:tasks.workunit.client.0.smithi148.stdout:5/966: sync 2024-04-26T23:09:30.215 INFO:tasks.workunit.client.0.smithi148.stdout:4/985: sync 2024-04-26T23:09:30.215 INFO:tasks.workunit.client.0.smithi148.stdout:9/916: fdatasync f3 0 2024-04-26T23:09:30.216 INFO:tasks.workunit.client.0.smithi148.stdout:4/986: fsync d12/d1c/d56/d87/d9a/d9d/f57 0 2024-04-26T23:09:30.216 INFO:tasks.workunit.client.0.smithi148.stdout:7/930: creat d7/d11/d17/d2f/d44/de4/f13a x:0 0 0 2024-04-26T23:09:30.216 INFO:tasks.workunit.client.0.smithi148.stdout:7/931: write d7/d75/de6/f12a [723934,11886] 0 2024-04-26T23:09:30.216 INFO:tasks.workunit.client.0.smithi148.stdout:3/851: getdents d9/d15/d29/d4d/d7d 0 2024-04-26T23:09:30.218 INFO:tasks.workunit.client.0.smithi148.stdout:6/894: creat d6/d32/d66/f132 x:0 0 0 2024-04-26T23:09:30.220 INFO:tasks.workunit.client.0.smithi148.stdout:5/967: creat da/d1b/d3b/d73/ddd/f151 x:0 0 0 2024-04-26T23:09:30.221 INFO:tasks.workunit.client.0.smithi148.stdout:5/968: write da/d1b/d3b/d73/ddd/de5/ffa [620000,123137] 0 2024-04-26T23:09:30.221 INFO:tasks.workunit.client.0.smithi148.stdout:9/917: getdents d19/d22/d7b 0 2024-04-26T23:09:30.222 INFO:tasks.workunit.client.0.smithi148.stdout:9/918: write d19/d1d/d25/d31/d48/d8c/fcd [891067,87179] 0 2024-04-26T23:09:30.226 INFO:tasks.workunit.client.0.smithi148.stdout:5/969: symlink da/d1b/d2d/l152 0 2024-04-26T23:09:30.226 INFO:tasks.workunit.client.0.smithi148.stdout:5/970: truncate da/d1f/d47/fd7 284828 0 2024-04-26T23:09:30.226 INFO:tasks.workunit.client.0.smithi148.stdout:5/971: chown da/d1b/d2d/c64 411 1 2024-04-26T23:09:30.226 INFO:tasks.workunit.client.0.smithi148.stdout:4/987: mkdir d12/d1c/dc8/dda/d13e 0 2024-04-26T23:09:30.227 INFO:tasks.workunit.client.0.smithi148.stdout:5/972: rmdir da/d1b/d5b/d5e 39 2024-04-26T23:09:30.231 INFO:tasks.workunit.client.0.smithi148.stdout:4/988: creat d12/dbd/f13f x:0 0 0 2024-04-26T23:09:30.233 INFO:tasks.workunit.client.0.smithi148.stdout:3/852: dread d9/f2d [0,4194304] 0 2024-04-26T23:09:30.235 INFO:tasks.workunit.client.0.smithi148.stdout:7/932: dread d7/d11/d17/d2f/d44/d105/d2e/d41/fd3 [0,4194304] 0 2024-04-26T23:09:30.235 INFO:tasks.workunit.client.0.smithi148.stdout:3/853: stat d9/d15/d29/d4d/d7d/le1 0 2024-04-26T23:09:30.235 INFO:tasks.workunit.client.0.smithi148.stdout:4/989: creat d12/d1c/d56/d87/d9a/f140 x:0 0 0 2024-04-26T23:09:30.236 INFO:tasks.workunit.client.0.smithi148.stdout:3/854: stat d9/d15/d29/d4d/d7d/cf8 0 2024-04-26T23:09:30.236 INFO:tasks.workunit.client.0.smithi148.stdout:4/990: stat d12/d1c/d56/d87/d9c/da1/feb 0 2024-04-26T23:09:30.236 INFO:tasks.workunit.client.0.smithi148.stdout:4/991: fsync d12/d1c/d56/d87/d9c/da1/f109 0 2024-04-26T23:09:30.239 INFO:tasks.workunit.client.0.smithi148.stdout:6/895: write d6/d9/d1c/dbf/dec/f112 [3498677,4811] 0 2024-04-26T23:09:30.239 INFO:tasks.workunit.client.0.smithi148.stdout:7/933: creat d7/d11/d17/d2f/d44/d105/d2e/dc6/f13b x:0 0 0 2024-04-26T23:09:30.240 INFO:tasks.workunit.client.0.smithi148.stdout:3/855: creat d9/d15/d29/d4d/d6f/f10b x:0 0 0 2024-04-26T23:09:30.243 INFO:tasks.workunit.client.0.smithi148.stdout:6/896: creat d6/d32/dee/f133 x:0 0 0 2024-04-26T23:09:30.244 INFO:tasks.workunit.client.0.smithi148.stdout:7/934: rmdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120 39 2024-04-26T23:09:30.247 INFO:tasks.workunit.client.0.smithi148.stdout:3/856: symlink d9/d15/d29/d4d/d5b/l10c 0 2024-04-26T23:09:30.254 INFO:tasks.workunit.client.0.smithi148.stdout:6/897: truncate d6/d9/d1e/d69/f88 4229814 0 2024-04-26T23:09:30.255 INFO:tasks.workunit.client.0.smithi148.stdout:6/898: write d6/d9/d23/dc1/df8/f101 [674504,5956] 0 2024-04-26T23:09:30.255 INFO:tasks.workunit.client.0.smithi148.stdout:6/899: fsync d6/d14/d91/f12a 0 2024-04-26T23:09:30.256 INFO:tasks.workunit.client.0.smithi148.stdout:3/857: symlink d9/d52/l10d 0 2024-04-26T23:09:30.256 INFO:tasks.workunit.client.0.smithi148.stdout:3/858: fsync d9/d15/d29/f45 0 2024-04-26T23:09:30.257 INFO:tasks.workunit.client.0.smithi148.stdout:3/859: dread - d9/d15/d29/ff1 zero size 2024-04-26T23:09:30.260 INFO:tasks.workunit.client.0.smithi148.stdout:6/900: mkdir d6/d9/d1c/dbf/d134 0 2024-04-26T23:09:30.263 INFO:tasks.workunit.client.0.smithi148.stdout:4/992: dread d12/d1c/dc8/fd8 [0,4194304] 0 2024-04-26T23:09:30.264 INFO:tasks.workunit.client.0.smithi148.stdout:9/919: dread d19/d1d/d25/d31/d73/dd1/fe3 [0,4194304] 0 2024-04-26T23:09:30.266 INFO:tasks.workunit.client.0.smithi148.stdout:3/860: rename d9/d15/d29/c8d to d9/d31/dc3/dca/c10e 0 2024-04-26T23:09:30.269 INFO:tasks.workunit.client.0.smithi148.stdout:4/993: getdents d12/d17/d2a/d37/d97/dec 0 2024-04-26T23:09:30.272 INFO:tasks.workunit.client.0.smithi148.stdout:8/933: dwrite d3/d9/d12/d23/d35/f90 [0,4194304] 0 2024-04-26T23:09:30.272 INFO:tasks.workunit.client.0.smithi148.stdout:8/934: getdents d3/d9/d12/d23/d29/d77/d91/d10a 0 2024-04-26T23:09:30.288 INFO:tasks.workunit.client.0.smithi148.stdout:9/920: mknod d19/d1d/d25/d31/d73/ddc/c129 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:6/901: rename d6/d9/d23/dc1/l10b to d6/d9/d1c/d1d/d1f/d40/d113/l135 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:9/921: readlink d19/d4b/dc4/lf2 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:3/861: rmdir d9/d15/d29/d4d/d68/dd6 39 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:6/902: fdatasync d6/d9/d1c/d1d/d1f/f59 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/935: getdents d3/d9/d12/d23/d29/d77/dd3 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/936: readlink d3/d9/d12/d23/d29/l31 0 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/937: chown d3/d9/d12/d23/d54/d60/df7/f121 176932059 1 2024-04-26T23:09:30.289 INFO:tasks.workunit.client.0.smithi148.stdout:6/903: write d6/d9/d1c/d5b/f9d [932924,58389] 0 2024-04-26T23:09:30.290 INFO:tasks.workunit.client.0.smithi148.stdout:3/862: creat d9/d15/f10f x:0 0 0 2024-04-26T23:09:30.291 INFO:tasks.workunit.client.0.smithi148.stdout:7/935: dwrite d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 [0,4194304] 0 2024-04-26T23:09:30.291 INFO:tasks.workunit.client.0.smithi148.stdout:6/904: symlink d6/d32/dee/l136 0 2024-04-26T23:09:30.300 INFO:tasks.workunit.client.0.smithi148.stdout:3/863: mknod d9/d4c/c110 0 2024-04-26T23:09:30.300 INFO:tasks.workunit.client.0.smithi148.stdout:7/936: rename d7/d11/d17/d2f/d44/d105/d2e/d41/fed to d7/d11/d17/d2f/d44/d9b/f13c 0 2024-04-26T23:09:30.302 INFO:tasks.workunit.client.0.smithi148.stdout:6/905: creat d6/d9/d1c/dbf/d134/f137 x:0 0 0 2024-04-26T23:09:30.302 INFO:tasks.workunit.client.0.smithi148.stdout:6/906: write d6/d14/fd9 [909436,102177] 0 2024-04-26T23:09:30.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/864: creat d9/db3/f111 x:0 0 0 2024-04-26T23:09:30.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/865: write d9/d15/d29/d4d/d6f/ffd [942927,62429] 0 2024-04-26T23:09:30.304 INFO:tasks.workunit.client.0.smithi148.stdout:3/866: write d9/d31/f55 [1715624,107448] 0 2024-04-26T23:09:30.305 INFO:tasks.workunit.client.0.smithi148.stdout:7/937: link d7/d11/d17/d43/c8b d7/d11/d17/c13d 0 2024-04-26T23:09:30.308 INFO:tasks.workunit.client.0.smithi148.stdout:6/907: rmdir d6/d9/d23/d4a/d110 0 2024-04-26T23:09:30.313 INFO:tasks.workunit.client.0.smithi148.stdout:7/938: dread d7/d19/f83 [0,4194304] 0 2024-04-26T23:09:30.317 INFO:tasks.workunit.client.0.smithi148.stdout:3/867: link d9/d65/f9b d9/d31/d8f/f112 0 2024-04-26T23:09:30.319 INFO:tasks.workunit.client.0.smithi148.stdout:4/994: dwrite d12/f4a [0,4194304] 0 2024-04-26T23:09:30.321 INFO:tasks.workunit.client.0.smithi148.stdout:3/868: dread d9/d31/f95 [0,4194304] 0 2024-04-26T23:09:30.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/939: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d13e 0 2024-04-26T23:09:30.328 INFO:tasks.workunit.client.0.smithi148.stdout:4/995: link d12/d1c/d56/d87/d9a/l137 d12/dbd/d103/l141 0 2024-04-26T23:09:30.330 INFO:tasks.workunit.client.0.smithi148.stdout:8/938: dwrite d3/d9/d12/d23/d35/f4e [0,4194304] 0 2024-04-26T23:09:30.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/869: creat d9/db3/f113 x:0 0 0 2024-04-26T23:09:30.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/870: write d9/d15/d29/d4d/d5b/ff6 [575126,21980] 0 2024-04-26T23:09:30.337 INFO:tasks.workunit.client.0.smithi148.stdout:7/940: symlink d7/d11/d17/d2f/d44/de4/d101/l13f 0 2024-04-26T23:09:30.337 INFO:tasks.workunit.client.0.smithi148.stdout:7/941: readlink d7/d19/lbc 0 2024-04-26T23:09:30.337 INFO:tasks.workunit.client.0.smithi148.stdout:7/942: dread - d7/d75/f133 zero size 2024-04-26T23:09:30.337 INFO:tasks.workunit.client.0.smithi148.stdout:9/922: dwrite d19/d1d/d25/d31/d73/f7e [0,4194304] 0 2024-04-26T23:09:30.338 INFO:tasks.workunit.client.0.smithi148.stdout:4/996: unlink d12/d1c/ce5 0 2024-04-26T23:09:30.342 INFO:tasks.workunit.client.0.smithi148.stdout:8/939: unlink d3/da/db6/lb1 0 2024-04-26T23:09:30.343 INFO:tasks.workunit.client.0.smithi148.stdout:3/871: creat d9/d15/d29/d4d/d68/f114 x:0 0 0 2024-04-26T23:09:30.343 INFO:tasks.workunit.client.0.smithi148.stdout:3/872: dread - d9/d15/d29/d4d/d68/dd6/ffa zero size 2024-04-26T23:09:30.347 INFO:tasks.workunit.client.0.smithi148.stdout:9/923: link d19/d1d/d25/d31/d48/d8c/dab/c6b d19/d1d/d25/d31/d73/ddc/de4/c12a 0 2024-04-26T23:09:30.348 INFO:tasks.workunit.client.0.smithi148.stdout:4/997: symlink d12/d1c/dc8/l142 0 2024-04-26T23:09:30.350 INFO:tasks.workunit.client.0.smithi148.stdout:8/940: truncate d3/d9/d12/fc1 65578 0 2024-04-26T23:09:30.350 INFO:tasks.workunit.client.0.smithi148.stdout:8/941: chown d3/d9/d12/d23/d29/d37/f3e 44 1 2024-04-26T23:09:30.350 INFO:tasks.workunit.client.0.smithi148.stdout:8/942: chown d3/d9/d12/d23/d29/d37/d5e/c84 1 1 2024-04-26T23:09:30.364 INFO:tasks.workunit.client.0.smithi148.stdout:3/873: symlink d9/d15/d29/d4d/d9a/l115 0 2024-04-26T23:09:30.364 INFO:tasks.workunit.client.0.smithi148.stdout:9/924: truncate d19/d1d/d25/d31/d60/dba/d85/db2/ffd 512853 0 2024-04-26T23:09:30.368 INFO:tasks.workunit.client.0.smithi148.stdout:4/998: mkdir d12/d1c/d143 0 2024-04-26T23:09:30.368 INFO:tasks.workunit.client.0.smithi148.stdout:3/874: link d9/d4c/cc8 d9/d15/d29/c116 0 2024-04-26T23:09:30.369 INFO:tasks.workunit.client.0.smithi148.stdout:3/875: write d9/d31/f95 [1342258,69627] 0 2024-04-26T23:09:30.372 INFO:tasks.workunit.client.0.smithi148.stdout:9/925: mknod d19/d4b/c12b 0 2024-04-26T23:09:30.372 INFO:tasks.workunit.client.0.smithi148.stdout:4/999: symlink d12/d1c/dc8/l144 0 2024-04-26T23:09:30.384 INFO:tasks.workunit.client.0.smithi148.stdout:7/943: dwrite d7/d75/f1f [0,4194304] 0 2024-04-26T23:09:30.387 INFO:tasks.workunit.client.0.smithi148.stdout:3/876: dread d9/d31/f95 [0,4194304] 0 2024-04-26T23:09:30.388 INFO:tasks.workunit.client.0.smithi148.stdout:3/877: stat d9/d65/d80/d83/d99 0 2024-04-26T23:09:30.388 INFO:tasks.workunit.client.0.smithi148.stdout:3/878: fsync d9/d15/f24 0 2024-04-26T23:09:30.389 INFO:tasks.workunit.client.0.smithi148.stdout:7/944: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d140 0 2024-04-26T23:09:30.391 INFO:tasks.workunit.client.0.smithi148.stdout:3/879: mknod d9/d65/de5/c117 0 2024-04-26T23:09:30.391 INFO:tasks.workunit.client.0.smithi148.stdout:3/880: chown d9/d15/d29/d4d/d78/dc2/le3 15 1 2024-04-26T23:09:30.391 INFO:tasks.workunit.client.0.smithi148.stdout:3/881: fdatasync d9/d31/d8f/f112 0 2024-04-26T23:09:30.391 INFO:tasks.workunit.client.0.smithi148.stdout:3/882: fdatasync d9/d65/fd4 0 2024-04-26T23:09:30.398 INFO:tasks.workunit.client.0.smithi148.stdout:3/883: dread d9/d15/d29/d4d/d6f/fb6 [0,4194304] 0 2024-04-26T23:09:30.413 INFO:tasks.workunit.client.0.smithi148.stdout:7/945: unlink d7/df5/f129 0 2024-04-26T23:09:30.415 INFO:tasks.workunit.client.0.smithi148.stdout:7/946: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d141 0 2024-04-26T23:09:30.415 INFO:tasks.workunit.client.0.smithi148.stdout:3/884: dread d9/d15/f24 [0,4194304] 0 2024-04-26T23:09:30.416 INFO:tasks.workunit.client.0.smithi148.stdout:7/947: unlink d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/c11d 0 2024-04-26T23:09:30.416 INFO:tasks.workunit.client.0.smithi148.stdout:3/885: creat d9/f118 x:0 0 0 2024-04-26T23:09:30.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/948: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120/d142 0 2024-04-26T23:09:30.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/949: write d7/d11/fd4 [899638,31106] 0 2024-04-26T23:09:30.418 INFO:tasks.workunit.client.0.smithi148.stdout:3/886: creat d9/d65/d102/f119 x:0 0 0 2024-04-26T23:09:30.418 INFO:tasks.workunit.client.0.smithi148.stdout:7/950: creat d7/d11/d17/d43/f143 x:0 0 0 2024-04-26T23:09:30.419 INFO:tasks.workunit.client.0.smithi148.stdout:3/887: mkdir d9/d31/dc3/d11a 0 2024-04-26T23:09:30.419 INFO:tasks.workunit.client.0.smithi148.stdout:3/888: write d9/db3/f111 [658819,111420] 0 2024-04-26T23:09:30.420 INFO:tasks.workunit.client.0.smithi148.stdout:3/889: unlink d9/d15/d29/d4d/d6f/f10b 0 2024-04-26T23:09:30.524 INFO:tasks.workunit.client.0.smithi148.stdout:8/943: dwrite d3/d9a/dcd/f122 [0,4194304] 0 2024-04-26T23:09:30.528 INFO:tasks.workunit.client.0.smithi148.stdout:8/944: mknod d3/d9/d12/d23/d29/db2/de3/c12f 0 2024-04-26T23:09:30.530 INFO:tasks.workunit.client.0.smithi148.stdout:8/945: unlink d3/d9/d12/d23/d29/d77/l8f 0 2024-04-26T23:09:30.530 INFO:tasks.workunit.client.0.smithi148.stdout:8/946: write d3/da/f5c [2459451,81203] 0 2024-04-26T23:09:30.534 INFO:tasks.workunit.client.0.smithi148.stdout:8/947: rename d3/d9/d12/d23/d35/d69/f103 to d3/d9/d12/d23/d29/db2/d106/f130 0 2024-04-26T23:09:30.536 INFO:tasks.workunit.client.0.smithi148.stdout:8/948: mknod d3/d9/d12/d23/d29/d77/d91/c131 0 2024-04-26T23:09:30.540 INFO:tasks.workunit.client.0.smithi148.stdout:8/949: rename d3/d9/d12/d23/d54/ff5 to d3/d9/d12/d23/d65/f132 0 2024-04-26T23:09:30.540 INFO:tasks.workunit.client.0.smithi148.stdout:8/950: chown d3/d9/d12/d23/d29/d77/le8 4485987 1 2024-04-26T23:09:30.540 INFO:tasks.workunit.client.0.smithi148.stdout:8/951: chown d3/d9/d12/d23/d54/d60/df7 5597 1 2024-04-26T23:09:30.540 INFO:tasks.workunit.client.0.smithi148.stdout:8/952: chown d3/da/d28/cb9 328 1 2024-04-26T23:09:30.552 INFO:tasks.workunit.client.0.smithi148.stdout:8/953: rmdir d3/d9/d12/d23/d29/d77/dd3 39 2024-04-26T23:09:30.552 INFO:tasks.workunit.client.0.smithi148.stdout:8/954: fsync d3/f88 0 2024-04-26T23:09:30.554 INFO:tasks.workunit.client.0.smithi148.stdout:8/955: rename d3/d9/d12/d23/d29/d37/d5e/ld4 to d3/d9/d12/d23/d29/d37/d5e/l133 0 2024-04-26T23:09:30.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/926: dwrite d19/d1d/d25/d31/d60/dba/d85/fa6 [0,4194304] 0 2024-04-26T23:09:30.577 INFO:tasks.workunit.client.0.smithi148.stdout:9/927: getdents d19/d1d/d25/d2f/d4d/d33/daa 0 2024-04-26T23:09:30.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/951: dwrite d7/d11/d17/d2f/d44/d105/d2e/dc6/fe8 [0,4194304] 0 2024-04-26T23:09:30.647 INFO:tasks.workunit.client.0.smithi148.stdout:8/956: write d3/f42 [2089573,81293] 0 2024-04-26T23:09:30.648 INFO:tasks.workunit.client.0.smithi148.stdout:8/957: chown d3/da/db6/d79/ffe 17181 1 2024-04-26T23:09:30.648 INFO:tasks.workunit.client.0.smithi148.stdout:3/890: dwrite d9/db3/df2/fbf [4194304,4194304] 0 2024-04-26T23:09:30.649 INFO:tasks.workunit.client.0.smithi148.stdout:8/958: getdents d3/d9/d12/d23/d29/db2/de3 0 2024-04-26T23:09:30.649 INFO:tasks.workunit.client.0.smithi148.stdout:8/959: dread - d3/d9/d12/d23/d29/db2/f108 zero size 2024-04-26T23:09:30.651 INFO:tasks.workunit.client.0.smithi148.stdout:7/952: dwrite d7/d19/fe0 [0,4194304] 0 2024-04-26T23:09:30.654 INFO:tasks.workunit.client.0.smithi148.stdout:9/928: dwrite d19/d1d/d25/d31/d60/f104 [0,4194304] 0 2024-04-26T23:09:30.654 INFO:tasks.workunit.client.0.smithi148.stdout:9/929: fdatasync d19/f2d 0 2024-04-26T23:09:30.654 INFO:tasks.workunit.client.0.smithi148.stdout:3/891: creat d9/d15/f11b x:0 0 0 2024-04-26T23:09:30.656 INFO:tasks.workunit.client.0.smithi148.stdout:8/960: mkdir d3/d9/d12/d23/d29/db2/de3/d134 0 2024-04-26T23:09:30.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/953: rename d7/d19/c102 to d7/d11/d17/d2f/d44/d105/d2e/d41/d67/c144 0 2024-04-26T23:09:30.665 INFO:tasks.workunit.client.0.smithi148.stdout:8/961: rmdir d3/d9/d12/d23/d29/db2/d106 39 2024-04-26T23:09:30.666 INFO:tasks.workunit.client.0.smithi148.stdout:5/973: sync 2024-04-26T23:09:30.666 INFO:tasks.workunit.client.0.smithi148.stdout:6/908: sync 2024-04-26T23:09:30.668 INFO:tasks.workunit.client.0.smithi148.stdout:9/930: rename d19/d1d/d25/d78/db6 to d19/d1d/d25/d31/d32/db9/d12c 0 2024-04-26T23:09:30.673 INFO:tasks.workunit.client.0.smithi148.stdout:6/909: creat d6/dbe/ddc/dff/f138 x:0 0 0 2024-04-26T23:09:30.673 INFO:tasks.workunit.client.0.smithi148.stdout:6/910: fdatasync d6/d32/dee/f133 0 2024-04-26T23:09:30.678 INFO:tasks.workunit.client.0.smithi148.stdout:7/954: rename d7/d11/d17/d2f/d44/de4/d68/lca to d7/d11/d17/d2f/d44/l145 0 2024-04-26T23:09:30.681 INFO:tasks.workunit.client.0.smithi148.stdout:8/962: dread d3/da/d1c/f45 [0,4194304] 0 2024-04-26T23:09:30.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/963: fdatasync d3/da/d1c/d7a/fa9 0 2024-04-26T23:09:30.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/964: fsync d3/f76 0 2024-04-26T23:09:30.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/965: write d3/d9/d12/d23/d29/ff9 [566136,85392] 0 2024-04-26T23:09:30.682 INFO:tasks.workunit.client.0.smithi148.stdout:8/966: dread - d3/d9/d12/d23/d54/d60/df7/f121 zero size 2024-04-26T23:09:30.684 INFO:tasks.workunit.client.0.smithi148.stdout:9/931: rename d19/d1d/d25/d31/d32/dc8/cce to d19/d1d/d25/d31/d32/db9/d12c/c12d 0 2024-04-26T23:09:30.685 INFO:tasks.workunit.client.0.smithi148.stdout:8/967: symlink d3/d9/d12/d23/d29/d77/l135 0 2024-04-26T23:09:30.688 INFO:tasks.workunit.client.0.smithi148.stdout:9/932: creat d19/d1d/d69/d115/f12e x:0 0 0 2024-04-26T23:09:30.688 INFO:tasks.workunit.client.0.smithi148.stdout:8/968: link d3/d9/d12/d23/d29/d37/d5e/cf4 d3/d9/d12/c136 0 2024-04-26T23:09:30.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/974: write da/d1b/d5b/f3a [219692,73778] 0 2024-04-26T23:09:30.694 INFO:tasks.workunit.client.0.smithi148.stdout:8/969: getdents d3/d9/d12/d23/d65/df8 0 2024-04-26T23:09:30.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/970: unlink d3/d9a/dcd/ff6 0 2024-04-26T23:09:30.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/971: dread - d3/da/d1c/d7a/f11a zero size 2024-04-26T23:09:30.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/972: fdatasync d3/d9/d12/d95/fcc 0 2024-04-26T23:09:30.701 INFO:tasks.workunit.client.0.smithi148.stdout:8/973: read d3/d9/f58 [1409259,99399] 0 2024-04-26T23:09:30.702 INFO:tasks.workunit.client.0.smithi148.stdout:8/974: fdatasync d3/d9/d12/d23/d29/d37/f3e 0 2024-04-26T23:09:30.712 INFO:tasks.workunit.client.0.smithi148.stdout:3/892: dwrite d9/d15/d29/f73 [4194304,4194304] 0 2024-04-26T23:09:30.718 INFO:tasks.workunit.client.0.smithi148.stdout:8/975: fsync d3/f42 0 2024-04-26T23:09:30.718 INFO:tasks.workunit.client.0.smithi148.stdout:5/975: write da/d1b/fed [3924987,67944] 0 2024-04-26T23:09:30.723 INFO:tasks.workunit.client.0.smithi148.stdout:7/955: dread d7/d19/f20 [4194304,4194304] 0 2024-04-26T23:09:30.725 INFO:tasks.workunit.client.0.smithi148.stdout:8/976: rename d3/da/d1c/d7c/d8c/d9f/f17 to d3/da/db6/f137 0 2024-04-26T23:09:30.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/977: unlink d3/da/d1c/d7c/lbf 0 2024-04-26T23:09:30.732 INFO:tasks.workunit.client.0.smithi148.stdout:8/978: symlink d3/d9/d12/d23/d54/d60/df7/l138 0 2024-04-26T23:09:30.738 INFO:tasks.workunit.client.0.smithi148.stdout:5/976: write da/d68/d69/daa/fce [850143,68812] 0 2024-04-26T23:09:30.739 INFO:tasks.workunit.client.0.smithi148.stdout:5/977: fdatasync da/d1b/d3b/d14d/d145/d13b/f103 0 2024-04-26T23:09:30.739 INFO:tasks.workunit.client.0.smithi148.stdout:5/978: fdatasync da/d70/f139 0 2024-04-26T23:09:30.757 INFO:tasks.workunit.client.0.smithi148.stdout:3/893: dwrite d9/d15/d29/d4d/f10a [0,4194304] 0 2024-04-26T23:09:30.757 INFO:tasks.workunit.client.0.smithi148.stdout:3/894: write d9/d31/fa9 [1686656,114090] 0 2024-04-26T23:09:30.816 INFO:tasks.workunit.client.0.smithi148.stdout:6/911: dwrite d6/d9/d1c/f5d [0,4194304] 0 2024-04-26T23:09:30.816 INFO:tasks.workunit.client.0.smithi148.stdout:6/912: chown d6/d9/d1c/d1d/d68/dbc 2047113 1 2024-04-26T23:09:30.831 INFO:tasks.workunit.client.0.smithi148.stdout:6/913: dread d6/d9/d23/d4a/f92 [0,4194304] 0 2024-04-26T23:09:30.831 INFO:tasks.workunit.client.0.smithi148.stdout:6/914: write d6/d9/d1c/d1d/d68/dbc/ff9 [815561,126830] 0 2024-04-26T23:09:30.831 INFO:tasks.workunit.client.0.smithi148.stdout:6/915: truncate d6/d9/d1c/dbf/ff6 82709 0 2024-04-26T23:09:30.834 INFO:tasks.workunit.client.0.smithi148.stdout:7/956: dwrite d7/df5/f11f [0,4194304] 0 2024-04-26T23:09:30.990 INFO:tasks.workunit.client.0.smithi148.stdout:8/979: mkdir d3/da/d1c/d7c/d8c/d9f/d139 0 2024-04-26T23:09:30.993 INFO:tasks.workunit.client.0.smithi148.stdout:5/979: getdents da/d1b/d3b/d14d 0 2024-04-26T23:09:30.993 INFO:tasks.workunit.client.0.smithi148.stdout:5/980: chown da 339 1 2024-04-26T23:09:30.993 INFO:tasks.workunit.client.0.smithi148.stdout:5/981: read da/d1b/d5b/f3a [231194,10972] 0 2024-04-26T23:09:31.000 INFO:tasks.workunit.client.0.smithi148.stdout:3/895: unlink d9/d15/d29/f47 0 2024-04-26T23:09:31.005 INFO:tasks.workunit.client.0.smithi148.stdout:6/916: creat d6/f139 x:0 0 0 2024-04-26T23:09:31.007 INFO:tasks.workunit.client.0.smithi148.stdout:7/957: mkdir d7/df5/d146 0 2024-04-26T23:09:31.007 INFO:tasks.workunit.client.0.smithi148.stdout:7/958: readlink d7/d19/l9c 0 2024-04-26T23:09:31.026 INFO:tasks.workunit.client.0.smithi148.stdout:8/980: rename d3/da/d28/f70 to d3/d9/d12/d23/d29/d37/db5/f13a 0 2024-04-26T23:09:31.026 INFO:tasks.workunit.client.0.smithi148.stdout:5/982: dwrite da/d68/f80 [0,4194304] 0 2024-04-26T23:09:31.030 INFO:tasks.workunit.client.0.smithi148.stdout:6/917: symlink d6/d32/d8a/l13a 0 2024-04-26T23:09:31.030 INFO:tasks.workunit.client.0.smithi148.stdout:6/918: chown d6/d9/d23/fd5 2018755 1 2024-04-26T23:09:31.032 INFO:tasks.workunit.client.0.smithi148.stdout:7/959: mkdir d7/d11/d17/d2f/d44/de4/d101/d147 0 2024-04-26T23:09:31.035 INFO:tasks.workunit.client.0.smithi148.stdout:8/981: creat d3/d9/d12/d23/d29/d37/f13b x:0 0 0 2024-04-26T23:09:31.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/919: dread d6/d14/d91/d9f/f78 [0,4194304] 0 2024-04-26T23:09:31.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/920: fsync d6/d14/d91/d9f/f127 0 2024-04-26T23:09:31.046 INFO:tasks.workunit.client.0.smithi148.stdout:5/983: rename da/d1b/d8b/dc7/f107 to da/d1f/d67/f153 0 2024-04-26T23:09:31.048 INFO:tasks.workunit.client.0.smithi148.stdout:7/960: mknod d7/d11/d17/d43/c148 0 2024-04-26T23:09:31.048 INFO:tasks.workunit.client.0.smithi148.stdout:7/961: chown d7/d11/f71 0 1 2024-04-26T23:09:31.050 INFO:tasks.workunit.client.0.smithi148.stdout:6/921: creat d6/d9/d1e/f13b x:0 0 0 2024-04-26T23:09:31.050 INFO:tasks.workunit.client.0.smithi148.stdout:6/922: chown d6/d9/d1c/d1d/de3/fea 0 1 2024-04-26T23:09:31.054 INFO:tasks.workunit.client.0.smithi148.stdout:5/984: rename da/d1b/d2d/c64 to da/d1b/d8b/d110/c154 0 2024-04-26T23:09:31.055 INFO:tasks.workunit.client.0.smithi148.stdout:8/982: write d3/d9/d12/d23/d35/f90 [3820233,48566] 0 2024-04-26T23:09:31.058 INFO:tasks.workunit.client.0.smithi148.stdout:7/962: link d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/lbf d7/d11/d17/d2f/d44/d105/d2e/d41/d13e/l149 0 2024-04-26T23:09:31.058 INFO:tasks.workunit.client.0.smithi148.stdout:7/963: truncate d7/d11/d17/d2f/d44/d9b/faa 679129 0 2024-04-26T23:09:31.060 INFO:tasks.workunit.client.0.smithi148.stdout:9/933: sync 2024-04-26T23:09:31.060 INFO:tasks.workunit.client.0.smithi148.stdout:9/934: chown d19/d1d/d25/d31/c3c 0 1 2024-04-26T23:09:31.060 INFO:tasks.workunit.client.0.smithi148.stdout:9/935: write d19/d22/f9c [49608,8568] 0 2024-04-26T23:09:31.062 INFO:tasks.workunit.client.0.smithi148.stdout:6/923: rename d6/d9/d1c/d1d/d68/fac to d6/d32/d8a/f13c 0 2024-04-26T23:09:31.065 INFO:tasks.workunit.client.0.smithi148.stdout:3/896: dwrite d9/d15/d29/d4d/d6f/f97 [0,4194304] 0 2024-04-26T23:09:31.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/983: unlink d3/da/d1c/d7c/d8c/ca7 0 2024-04-26T23:09:31.070 INFO:tasks.workunit.client.0.smithi148.stdout:7/964: mknod d7/d11/d17/d2f/d44/d9b/c14a 0 2024-04-26T23:09:31.073 INFO:tasks.workunit.client.0.smithi148.stdout:6/924: dread d6/d9/d1e/f5f [4194304,4194304] 0 2024-04-26T23:09:31.074 INFO:tasks.workunit.client.0.smithi148.stdout:9/936: symlink d19/d1d/d25/d31/d32/db9/d12c/l12f 0 2024-04-26T23:09:31.075 INFO:tasks.workunit.client.0.smithi148.stdout:9/937: dread - d19/d1d/d25/d2f/d4d/d33/fbc zero size 2024-04-26T23:09:31.077 INFO:tasks.workunit.client.0.smithi148.stdout:5/985: rename da/d1f/f49 to da/d1b/d3b/d14d/d11c/f155 0 2024-04-26T23:09:31.084 INFO:tasks.workunit.client.0.smithi148.stdout:7/965: link d7/d11/d17/d2f/d44/d105/d2e/d41/le9 d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120/d142/l14b 0 2024-04-26T23:09:31.084 INFO:tasks.workunit.client.0.smithi148.stdout:7/966: chown d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/f121 0 1 2024-04-26T23:09:31.085 INFO:tasks.workunit.client.0.smithi148.stdout:6/925: creat d6/d9/d23/d4a/d95/f13d x:0 0 0 2024-04-26T23:09:31.086 INFO:tasks.workunit.client.0.smithi148.stdout:6/926: fsync d6/d9/d23/d4a/d95/ffa 0 2024-04-26T23:09:31.087 INFO:tasks.workunit.client.0.smithi148.stdout:5/986: mkdir da/d1a/dc2/d156 0 2024-04-26T23:09:31.087 INFO:tasks.workunit.client.0.smithi148.stdout:5/987: chown da/d68/d69/daa/fb9 2 1 2024-04-26T23:09:31.088 INFO:tasks.workunit.client.0.smithi148.stdout:3/897: write d9/d65/f9b [21598,11261] 0 2024-04-26T23:09:31.088 INFO:tasks.workunit.client.0.smithi148.stdout:3/898: chown d9/d31/d8f/ldc 320933799 1 2024-04-26T23:09:31.088 INFO:tasks.workunit.client.0.smithi148.stdout:3/899: read - d9/d65/d80/d83/d99/f104 zero size 2024-04-26T23:09:31.128 INFO:tasks.workunit.client.0.smithi148.stdout:6/927: write d6/d9/d1c/dbf/db7/fd1 [859969,85847] 0 2024-04-26T23:09:31.129 INFO:tasks.workunit.client.0.smithi148.stdout:5/988: dread da/d12/f8f [0,4194304] 0 2024-04-26T23:09:31.132 INFO:tasks.workunit.client.0.smithi148.stdout:7/967: mknod d7/d11/d17/d2f/d44/de4/d101/d116/c14c 0 2024-04-26T23:09:31.142 INFO:tasks.workunit.client.0.smithi148.stdout:8/984: dwrite d3/da/d1c/d7c/d8c/d9f/fee [0,4194304] 0 2024-04-26T23:09:31.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/938: write d19/d1d/d25/d31/d60/dba/d85/fff [3544080,34612] 0 2024-04-26T23:09:31.142 INFO:tasks.workunit.client.0.smithi148.stdout:8/985: fsync d3/d9/d12/d23/d35/f66 0 2024-04-26T23:09:31.143 INFO:tasks.workunit.client.0.smithi148.stdout:3/900: dwrite d9/d15/f28 [4194304,4194304] 0 2024-04-26T23:09:31.148 INFO:tasks.workunit.client.0.smithi148.stdout:6/928: rmdir d6/d9/d1c/d1d/d1f/d40/d113 39 2024-04-26T23:09:31.148 INFO:tasks.workunit.client.0.smithi148.stdout:6/929: dread - d6/d9/d1c/d1d/f130 zero size 2024-04-26T23:09:31.150 INFO:tasks.workunit.client.0.smithi148.stdout:5/989: symlink da/d1b/d3b/d73/d97/d122/l157 0 2024-04-26T23:09:31.151 INFO:tasks.workunit.client.0.smithi148.stdout:9/939: mknod d19/d9f/dbb/d116/c130 0 2024-04-26T23:09:31.151 INFO:tasks.workunit.client.0.smithi148.stdout:9/940: dread - d19/d1d/d25/d31/d32/db9/d12c/dcb/ff6 zero size 2024-04-26T23:09:31.152 INFO:tasks.workunit.client.0.smithi148.stdout:8/986: creat d3/d9/d12/d23/d54/f13c x:0 0 0 2024-04-26T23:09:31.156 INFO:tasks.workunit.client.0.smithi148.stdout:3/901: creat d9/d65/d80/f11c x:0 0 0 2024-04-26T23:09:31.156 INFO:tasks.workunit.client.0.smithi148.stdout:5/990: rmdir da/d68/d69 39 2024-04-26T23:09:31.156 INFO:tasks.workunit.client.0.smithi148.stdout:3/902: write d9/d15/d29/d4d/d68/f96 [3002975,109593] 0 2024-04-26T23:09:31.157 INFO:tasks.workunit.client.0.smithi148.stdout:8/987: mkdir d3/d9/d12/d23/d54/d60/d13d 0 2024-04-26T23:09:31.159 INFO:tasks.workunit.client.0.smithi148.stdout:5/991: mkdir da/d1a/dc2/d156/d158 0 2024-04-26T23:09:31.170 INFO:tasks.workunit.client.0.smithi148.stdout:3/903: truncate d9/d15/d29/f3b 2218780 0 2024-04-26T23:09:31.171 INFO:tasks.workunit.client.0.smithi148.stdout:5/992: read - da/d1b/d3b/d14d/d145/d7f/d90/f143 zero size 2024-04-26T23:09:31.176 INFO:tasks.workunit.client.0.smithi148.stdout:3/904: creat d9/d15/d29/d4d/d9a/f11d x:0 0 0 2024-04-26T23:09:31.200 INFO:tasks.workunit.client.0.smithi148.stdout:8/988: write d3/d9/d12/d23/d29/db2/d106/f10d [2985267,115328] 0 2024-04-26T23:09:31.203 INFO:tasks.workunit.client.0.smithi148.stdout:5/993: creat da/d1b/d3b/d14d/d145/d7f/f159 x:0 0 0 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/994: rmdir da/d12 39 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:8/989: unlink d3/d9/d12/d23/d35/f66 0 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/995: chown da/d1f/d67/d71/c98 1790 1 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/996: stat da/d1b/d3b/d14d/d145/f53 0 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/997: fsync da/fb 0 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/998: dread - da/d1f/d67/d71/f126 zero size 2024-04-26T23:09:31.206 INFO:tasks.workunit.client.0.smithi148.stdout:5/999: chown da/d1b/d3b/d14d/d145/ff1 593 1 2024-04-26T23:09:31.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/990: creat d3/da/f13e x:0 0 0 2024-04-26T23:09:31.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/991: readlink d3/d9/d12/d23/d35/lb3 0 2024-04-26T23:09:31.231 INFO:tasks.workunit.client.0.smithi148.stdout:7/968: dwrite d7/d11/fd8 [4194304,4194304] 0 2024-04-26T23:09:31.231 INFO:tasks.workunit.client.0.smithi148.stdout:7/969: read d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fa0 [290175,9048] 0 2024-04-26T23:09:31.231 INFO:tasks.workunit.client.0.smithi148.stdout:7/970: chown d7/d75/f8e 2545433 1 2024-04-26T23:09:31.237 INFO:tasks.workunit.client.0.smithi148.stdout:3/905: dwrite d9/d15/d29/d4d/d7d/f7e [0,4194304] 0 2024-04-26T23:09:31.237 INFO:tasks.workunit.client.0.smithi148.stdout:7/971: creat d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/f14d x:0 0 0 2024-04-26T23:09:31.238 INFO:tasks.workunit.client.0.smithi148.stdout:3/906: dread d9/d65/ff4 [0,4194304] 0 2024-04-26T23:09:31.241 INFO:tasks.workunit.client.0.smithi148.stdout:9/941: dwrite d19/d9f/f11a [0,4194304] 0 2024-04-26T23:09:31.242 INFO:tasks.workunit.client.0.smithi148.stdout:7/972: symlink d7/df5/l14e 0 2024-04-26T23:09:31.248 INFO:tasks.workunit.client.0.smithi148.stdout:3/907: mkdir d9/d15/d29/d88/d9f/dbc/d11e 0 2024-04-26T23:09:31.259 INFO:tasks.workunit.client.0.smithi148.stdout:6/930: dwrite d6/f6f [0,4194304] 0 2024-04-26T23:09:31.259 INFO:tasks.workunit.client.0.smithi148.stdout:9/942: mkdir d19/d1d/d25/d31/d131 0 2024-04-26T23:09:31.262 INFO:tasks.workunit.client.0.smithi148.stdout:8/992: dwrite d3/d9/d12/f46 [0,4194304] 0 2024-04-26T23:09:31.262 INFO:tasks.workunit.client.0.smithi148.stdout:8/993: readlink d3/da/d1c/l123 0 2024-04-26T23:09:31.263 INFO:tasks.workunit.client.0.smithi148.stdout:6/931: mknod d6/d9/d1c/dbf/db7/c13e 0 2024-04-26T23:09:31.263 INFO:tasks.workunit.client.0.smithi148.stdout:6/932: write d6/d32/fd4 [295525,45406] 0 2024-04-26T23:09:31.266 INFO:tasks.workunit.client.0.smithi148.stdout:8/994: creat d3/da/d1c/f13f x:0 0 0 2024-04-26T23:09:31.266 INFO:tasks.workunit.client.0.smithi148.stdout:8/995: stat d3/da/d1c/f45 0 2024-04-26T23:09:31.268 INFO:tasks.workunit.client.0.smithi148.stdout:6/933: symlink d6/d9/d1c/dbf/d134/l13f 0 2024-04-26T23:09:31.269 INFO:tasks.workunit.client.0.smithi148.stdout:6/934: write d6/d32/f62 [6013710,124097] 0 2024-04-26T23:09:31.269 INFO:tasks.workunit.client.0.smithi148.stdout:7/973: write d7/d75/f93 [2266041,3564] 0 2024-04-26T23:09:31.269 INFO:tasks.workunit.client.0.smithi148.stdout:7/974: readlink d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/lc0 0 2024-04-26T23:09:31.272 INFO:tasks.workunit.client.0.smithi148.stdout:9/943: dread d19/d1d/d25/d31/d73/dd1/fe3 [0,4194304] 0 2024-04-26T23:09:31.274 INFO:tasks.workunit.client.0.smithi148.stdout:9/944: link d19/d1d/d25/l27 d19/d1d/d69/l132 0 2024-04-26T23:09:31.279 INFO:tasks.workunit.client.0.smithi148.stdout:3/908: write d9/d15/f1e [3224223,65155] 0 2024-04-26T23:09:31.295 INFO:tasks.workunit.client.0.smithi148.stdout:3/909: write d9/d31/d8f/fd0 [1920622,116800] 0 2024-04-26T23:09:31.298 INFO:tasks.workunit.client.0.smithi148.stdout:9/945: dread d19/d39/f59 [0,4194304] 0 2024-04-26T23:09:31.298 INFO:tasks.workunit.client.0.smithi148.stdout:9/946: dread - d19/d1d/d25/d31/dc5/ffb zero size 2024-04-26T23:09:31.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/910: symlink d9/d15/d29/d88/d9f/l11f 0 2024-04-26T23:09:31.323 INFO:tasks.workunit.client.0.smithi148.stdout:9/947: write d19/d1d/d25/d31/d60/f104 [3116632,29630] 0 2024-04-26T23:09:31.324 INFO:tasks.workunit.client.0.smithi148.stdout:7/975: dwrite d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fb2 [4194304,4194304] 0 2024-04-26T23:09:31.331 INFO:tasks.workunit.client.0.smithi148.stdout:9/948: rename d19/d22/d7b/la3 to d19/d1d/d25/d31/d32/db9/d12c/l133 0 2024-04-26T23:09:31.332 INFO:tasks.workunit.client.0.smithi148.stdout:9/949: write d19/d1d/d25/d2f/d4d/d33/d80/f8a [1055794,5647] 0 2024-04-26T23:09:31.337 INFO:tasks.workunit.client.0.smithi148.stdout:9/950: mkdir d19/d1d/d25/d31/d60/dba/d85/db2/d102/d134 0 2024-04-26T23:09:31.344 INFO:tasks.workunit.client.0.smithi148.stdout:9/951: link d19/d1d/d25/d31/d73/f7e d19/d1d/d25/d31/d73/ddc/f135 0 2024-04-26T23:09:31.344 INFO:tasks.workunit.client.0.smithi148.stdout:9/952: write d19/d1d/d25/d31/f81 [75368,8124] 0 2024-04-26T23:09:31.360 INFO:tasks.workunit.client.0.smithi148.stdout:9/953: read d19/d1d/d25/d31/d60/fec [2130194,74958] 0 2024-04-26T23:09:31.361 INFO:tasks.workunit.client.0.smithi148.stdout:3/911: dwrite d9/d15/f24 [0,4194304] 0 2024-04-26T23:09:31.361 INFO:tasks.workunit.client.0.smithi148.stdout:8/996: dread d3/d9/d12/d23/d35/f55 [0,4194304] 0 2024-04-26T23:09:31.362 INFO:tasks.workunit.client.0.smithi148.stdout:9/954: mknod d19/d1d/d25/d2f/de7/c136 0 2024-04-26T23:09:31.364 INFO:tasks.workunit.client.0.smithi148.stdout:3/912: unlink d9/d15/d29/d4d/d7d/f7e 0 2024-04-26T23:09:31.364 INFO:tasks.workunit.client.0.smithi148.stdout:3/913: chown d9/d15/d29/d4d/d7d 12189848 1 2024-04-26T23:09:31.364 INFO:tasks.workunit.client.0.smithi148.stdout:3/914: truncate d9/db3/f113 436516 0 2024-04-26T23:09:31.365 INFO:tasks.workunit.client.0.smithi148.stdout:3/915: write d9/d31/f55 [603564,114485] 0 2024-04-26T23:09:31.367 INFO:tasks.workunit.client.0.smithi148.stdout:9/955: unlink d19/d1d/d25/l27 0 2024-04-26T23:09:31.378 INFO:tasks.workunit.client.0.smithi148.stdout:8/997: write d3/da/d1c/f45 [1157154,121952] 0 2024-04-26T23:09:31.378 INFO:tasks.workunit.client.0.smithi148.stdout:8/998: dread - d3/d9/d12/d23/d54/fb8 zero size 2024-04-26T23:09:31.386 INFO:tasks.workunit.client.0.smithi148.stdout:8/999: rename d3/da/db6 to d3/d9/d12/d23/d29/d77/d91/d118/d140 0 2024-04-26T23:09:31.408 INFO:tasks.workunit.client.0.smithi148.stdout:9/956: dread d19/f2e [0,4194304] 0 2024-04-26T23:09:31.408 INFO:tasks.workunit.client.0.smithi148.stdout:9/957: chown d19/d1d/d25/d2f/d4d/c99 2308562 1 2024-04-26T23:09:31.410 INFO:tasks.workunit.client.0.smithi148.stdout:9/958: creat d19/d1d/d25/d78/d11c/f137 x:0 0 0 2024-04-26T23:09:31.411 INFO:tasks.workunit.client.0.smithi148.stdout:9/959: symlink d19/d1d/d25/d31/d60/dba/d85/db2/d102/l138 0 2024-04-26T23:09:31.414 INFO:tasks.workunit.client.0.smithi148.stdout:3/916: dwrite d9/d15/f10f [0,4194304] 0 2024-04-26T23:09:31.416 INFO:tasks.workunit.client.0.smithi148.stdout:3/917: stat d9/d15/d29/lb4 0 2024-04-26T23:09:31.447 INFO:tasks.workunit.client.0.smithi148.stdout:3/918: dwrite d9/d15/d29/f37 [0,4194304] 0 2024-04-26T23:09:31.460 INFO:tasks.workunit.client.0.smithi148.stdout:3/919: write d9/d65/fd4 [1426173,119632] 0 2024-04-26T23:09:31.460 INFO:tasks.workunit.client.0.smithi148.stdout:3/920: chown d9/d15/d29/ccd 2880 1 2024-04-26T23:09:31.478 INFO:tasks.workunit.client.0.smithi148.stdout:3/921: write d9/db3/df2/fbf [8002944,86734] 0 2024-04-26T23:09:31.480 INFO:tasks.workunit.client.0.smithi148.stdout:3/922: getdents d9/d31/dc3/dca 0 2024-04-26T23:09:31.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/923: write d9/d15/d29/d88/d9f/ff9 [4127955,31719] 0 2024-04-26T23:09:31.502 INFO:tasks.workunit.client.0.smithi148.stdout:3/924: creat d9/d15/d29/d88/d9f/dbc/d11e/f120 x:0 0 0 2024-04-26T23:09:31.505 INFO:tasks.workunit.client.0.smithi148.stdout:3/925: creat d9/d65/d80/d83/db9/f121 x:0 0 0 2024-04-26T23:09:31.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/926: link d9/c50 d9/d31/dc3/dca/c122 0 2024-04-26T23:09:31.508 INFO:tasks.workunit.client.0.smithi148.stdout:3/927: fsync d9/d15/d29/d4d/d5b/fd9 0 2024-04-26T23:09:31.543 INFO:tasks.workunit.client.0.smithi148.stdout:3/928: dwrite d9/f36 [0,4194304] 0 2024-04-26T23:09:31.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/929: mkdir d9/d65/de5/d123 0 2024-04-26T23:09:31.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/930: stat d9/d15/d29/c85 0 2024-04-26T23:09:31.549 INFO:tasks.workunit.client.0.smithi148.stdout:3/931: creat d9/d31/f124 x:0 0 0 2024-04-26T23:09:31.550 INFO:tasks.workunit.client.0.smithi148.stdout:3/932: readlink d9/db3/lf7 0 2024-04-26T23:09:31.551 INFO:tasks.workunit.client.0.smithi148.stdout:3/933: truncate d9/d15/d29/f73 3604509 0 2024-04-26T23:09:31.560 INFO:tasks.workunit.client.0.smithi148.stdout:6/935: getdents d6/d9/d1c/dbf/d134 0 2024-04-26T23:09:31.568 INFO:tasks.workunit.client.0.smithi148.stdout:6/936: write d6/d32/f62 [5839158,86851] 0 2024-04-26T23:09:31.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/937: creat d6/d9/d1c/d1d/d68/f140 x:0 0 0 2024-04-26T23:09:31.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/938: fdatasync d6/d9/d23/d4a/d95/f13d 0 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/939: creat d6/d14/f141 x:0 0 0 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/940: chown d6/d9/d1c/d1d/d68/d108 1449763100 1 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/941: fdatasync d6/d9/d1c/dbf/ff6 0 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/942: write d6/d9/d23/f57 [2581790,120811] 0 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/943: stat d6/d9/d1c/d1d/lde 0 2024-04-26T23:09:31.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/944: write d6/d9/d1e/f82 [594643,96127] 0 2024-04-26T23:09:31.590 INFO:tasks.workunit.client.0.smithi148.stdout:6/945: rename d6/d9/d1c/d1d/f130 to d6/d32/dfd/f142 0 2024-04-26T23:09:31.596 INFO:tasks.workunit.client.0.smithi148.stdout:6/946: read d6/d9/d1e/fdb [297873,46657] 0 2024-04-26T23:09:31.603 INFO:tasks.workunit.client.0.smithi148.stdout:3/934: dwrite d9/d15/d29/d4d/d5b/ff6 [0,4194304] 0 2024-04-26T23:09:31.606 INFO:tasks.workunit.client.0.smithi148.stdout:6/947: dread d6/d9/d23/d4a/f70 [4194304,4194304] 0 2024-04-26T23:09:31.610 INFO:tasks.workunit.client.0.smithi148.stdout:3/935: creat d9/d15/d29/d88/d9f/dbc/f125 x:0 0 0 2024-04-26T23:09:31.612 INFO:tasks.workunit.client.0.smithi148.stdout:6/948: rmdir d6/d9/d23/d4a/d95 39 2024-04-26T23:09:31.612 INFO:tasks.workunit.client.0.smithi148.stdout:6/949: dread - d6/d9/d1c/d1d/d68/d108/f11c zero size 2024-04-26T23:09:31.616 INFO:tasks.workunit.client.0.smithi148.stdout:3/936: rename d9/d15/d29/d88/d9f/dbc/fe0 to d9/f126 0 2024-04-26T23:09:31.620 INFO:tasks.workunit.client.0.smithi148.stdout:3/937: symlink d9/d65/d80/d83/d99/l127 0 2024-04-26T23:09:31.623 INFO:tasks.workunit.client.0.smithi148.stdout:3/938: link d9/d52/ce4 d9/d15/d29/d4d/d68/dd6/c128 0 2024-04-26T23:09:31.625 INFO:tasks.workunit.client.0.smithi148.stdout:3/939: mkdir d9/d31/d129 0 2024-04-26T23:09:31.628 INFO:tasks.workunit.client.0.smithi148.stdout:3/940: dread d9/d15/f92 [0,4194304] 0 2024-04-26T23:09:31.628 INFO:tasks.workunit.client.0.smithi148.stdout:3/941: fsync d9/d15/d29/d4d/d68/f96 0 2024-04-26T23:09:31.654 INFO:tasks.workunit.client.0.smithi148.stdout:6/950: dwrite d6/d32/dfd/f116 [0,4194304] 0 2024-04-26T23:09:31.655 INFO:tasks.workunit.client.0.smithi148.stdout:6/951: write d6/d9/d1e/f82 [307842,57129] 0 2024-04-26T23:09:31.661 INFO:tasks.workunit.client.0.smithi148.stdout:6/952: rename d6/d32/l44 to d6/d9/d1c/dbf/db7/dd2/l143 0 2024-04-26T23:09:31.661 INFO:tasks.workunit.client.0.smithi148.stdout:6/953: write d6/f139 [973775,120910] 0 2024-04-26T23:09:31.665 INFO:tasks.workunit.client.0.smithi148.stdout:6/954: link d6/d14/d91/f115 d6/d9/d1e/d11d/f144 0 2024-04-26T23:09:31.666 INFO:tasks.workunit.client.0.smithi148.stdout:6/955: mkdir d6/d9/d1e/d11d/d145 0 2024-04-26T23:09:31.667 INFO:tasks.workunit.client.0.smithi148.stdout:6/956: mknod d6/d9/d1c/dbf/db7/dd2/c146 0 2024-04-26T23:09:31.671 INFO:tasks.workunit.client.0.smithi148.stdout:3/942: dwrite d9/f94 [0,4194304] 0 2024-04-26T23:09:31.671 INFO:tasks.workunit.client.0.smithi148.stdout:3/943: write d9/d15/f25 [1128397,3017] 0 2024-04-26T23:09:31.684 INFO:tasks.workunit.client.0.smithi148.stdout:6/957: write d6/d9/d1c/f94 [1061961,85339] 0 2024-04-26T23:09:31.684 INFO:tasks.workunit.client.0.smithi148.stdout:6/958: readlink d6/d32/dfd/l123 0 2024-04-26T23:09:31.690 INFO:tasks.workunit.client.0.smithi148.stdout:6/959: rename d6/d9/d23/d4a/l89 to d6/d9/d23/dc1/df8/l147 0 2024-04-26T23:09:31.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/960: dwrite d6/d9/d1c/d1d/d1f/d40/f7a [0,4194304] 0 2024-04-26T23:09:31.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/961: write d6/d14/fd9 [176366,118039] 0 2024-04-26T23:09:31.743 INFO:tasks.workunit.client.0.smithi148.stdout:6/962: unlink d6/f33 0 2024-04-26T23:09:31.743 INFO:tasks.workunit.client.0.smithi148.stdout:6/963: chown d6/d9/d23/dc1/df8/f101 28475724 1 2024-04-26T23:09:31.743 INFO:tasks.workunit.client.0.smithi148.stdout:6/964: read - d6/d9/d23/fd5 zero size 2024-04-26T23:09:31.743 INFO:tasks.workunit.client.0.smithi148.stdout:3/944: dwrite d9/d15/d29/d4d/d6f/f97 [0,4194304] 0 2024-04-26T23:09:31.793 INFO:tasks.workunit.client.0.smithi148.stdout:6/965: read d6/f47 [1044779,96849] 0 2024-04-26T23:09:31.793 INFO:tasks.workunit.client.0.smithi148.stdout:6/966: readlink d6/d9/d23/dc1/df8/l12e 0 2024-04-26T23:09:31.801 INFO:tasks.workunit.client.0.smithi148.stdout:9/960: dread d19/d1d/d25/d2f/d4d/d33/d80/f8a [0,4194304] 0 2024-04-26T23:09:31.827 INFO:tasks.workunit.client.0.smithi148.stdout:3/945: dwrite d9/db3/df2/fbf [4194304,4194304] 0 2024-04-26T23:09:31.827 INFO:tasks.workunit.client.0.smithi148.stdout:3/946: stat d9/d65/d80/d83/d99/f104 0 2024-04-26T23:09:31.837 INFO:tasks.workunit.client.0.smithi148.stdout:3/947: creat d9/d15/d29/d4d/d6f/f12a x:0 0 0 2024-04-26T23:09:31.842 INFO:tasks.workunit.client.0.smithi148.stdout:3/948: rename d9/d15/d29/d88/d9f/le6 to d9/d31/dc3/l12b 0 2024-04-26T23:09:31.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/949: chown d9/d15/d29/d4d/d68/dd6/de2 72 1 2024-04-26T23:09:31.844 INFO:tasks.workunit.client.0.smithi148.stdout:3/950: mknod d9/d15/d29/d4d/d7d/c12c 0 2024-04-26T23:09:31.845 INFO:tasks.workunit.client.0.smithi148.stdout:3/951: creat d9/d31/d8f/f12d x:0 0 0 2024-04-26T23:09:31.847 INFO:tasks.workunit.client.0.smithi148.stdout:3/952: creat d9/d15/d29/d88/d9f/dbc/d11e/f12e x:0 0 0 2024-04-26T23:09:31.878 INFO:tasks.workunit.client.0.smithi148.stdout:3/953: dwrite d9/f11 [0,4194304] 0 2024-04-26T23:09:32.420 INFO:tasks.workunit.client.0.smithi148.stdout:3/954: dwrite d9/d65/d102/f106 [0,4194304] 0 2024-04-26T23:09:32.423 INFO:tasks.workunit.client.0.smithi148.stdout:9/961: sync 2024-04-26T23:09:32.424 INFO:tasks.workunit.client.0.smithi148.stdout:6/967: sync 2024-04-26T23:09:32.424 INFO:tasks.workunit.client.0.smithi148.stdout:7/976: sync 2024-04-26T23:09:32.426 INFO:tasks.workunit.client.0.smithi148.stdout:3/955: rename d9/d4c/lb5 to d9/d52/l12f 0 2024-04-26T23:09:32.426 INFO:tasks.workunit.client.0.smithi148.stdout:3/956: chown d9/d15/d29/d4d/d6f/ld3 275638 1 2024-04-26T23:09:32.431 INFO:tasks.workunit.client.0.smithi148.stdout:7/977: creat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/f14f x:0 0 0 2024-04-26T23:09:32.433 INFO:tasks.workunit.client.0.smithi148.stdout:3/957: mkdir d9/d15/d29/d88/d9f/dbc/d130 0 2024-04-26T23:09:32.436 INFO:tasks.workunit.client.0.smithi148.stdout:6/968: unlink d6/d32/dfd/l123 0 2024-04-26T23:09:32.438 INFO:tasks.workunit.client.0.smithi148.stdout:9/962: mknod d19/d1d/d69/c139 0 2024-04-26T23:09:32.441 INFO:tasks.workunit.client.0.smithi148.stdout:7/978: mkdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d150 0 2024-04-26T23:09:32.442 INFO:tasks.workunit.client.0.smithi148.stdout:3/958: mkdir d9/d15/d29/d4d/d68/dd6/de2/d131 0 2024-04-26T23:09:32.443 INFO:tasks.workunit.client.0.smithi148.stdout:6/969: chown d6/d9/d1c/ff4 11 1 2024-04-26T23:09:32.446 INFO:tasks.workunit.client.0.smithi148.stdout:9/963: symlink d19/d1d/d25/d31/d32/db9/d12c/dcb/l13a 0 2024-04-26T23:09:32.448 INFO:tasks.workunit.client.0.smithi148.stdout:7/979: creat d7/df5/f151 x:0 0 0 2024-04-26T23:09:32.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/959: rename d9/c13 to d9/d31/d8f/c132 0 2024-04-26T23:09:32.452 INFO:tasks.workunit.client.0.smithi148.stdout:6/970: truncate d6/d9/d1c/d1d/d1f/d40/f7a 2783822 0 2024-04-26T23:09:32.454 INFO:tasks.workunit.client.0.smithi148.stdout:9/964: symlink d19/d1d/d25/d2f/d4d/d33/daa/l13b 0 2024-04-26T23:09:32.457 INFO:tasks.workunit.client.0.smithi148.stdout:7/980: rmdir d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/d120 39 2024-04-26T23:09:32.457 INFO:tasks.workunit.client.0.smithi148.stdout:7/981: readlink d7/d11/d17/d2f/d57/l99 0 2024-04-26T23:09:32.461 INFO:tasks.workunit.client.0.smithi148.stdout:6/971: creat d6/f148 x:0 0 0 2024-04-26T23:09:32.461 INFO:tasks.workunit.client.0.smithi148.stdout:7/982: dread d7/d11/f18 [0,4194304] 0 2024-04-26T23:09:32.465 INFO:tasks.workunit.client.0.smithi148.stdout:9/965: rename d19/d1d/d25/d2f/d4d/f11e to d19/d1d/d25/d2f/d4d/d33/f13c 0 2024-04-26T23:09:32.465 INFO:tasks.workunit.client.0.smithi148.stdout:9/966: readlink d19/d4b/dc4/lf2 0 2024-04-26T23:09:32.469 INFO:tasks.workunit.client.0.smithi148.stdout:3/960: dread d9/f36 [0,4194304] 0 2024-04-26T23:09:32.469 INFO:tasks.workunit.client.0.smithi148.stdout:6/972: mknod d6/d9/d1c/dbf/c149 0 2024-04-26T23:09:32.472 INFO:tasks.workunit.client.0.smithi148.stdout:7/983: symlink d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d12d/l152 0 2024-04-26T23:09:32.475 INFO:tasks.workunit.client.0.smithi148.stdout:9/967: mknod d19/d1d/d25/d31/d32/db9/d12c/dcb/de5/c13d 0 2024-04-26T23:09:32.479 INFO:tasks.workunit.client.0.smithi148.stdout:3/961: mkdir d9/d31/dc3/d133 0 2024-04-26T23:09:32.481 INFO:tasks.workunit.client.0.smithi148.stdout:6/973: rmdir d6/d9/d1c/d1d 39 2024-04-26T23:09:32.485 INFO:tasks.workunit.client.0.smithi148.stdout:7/984: creat d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/f153 x:0 0 0 2024-04-26T23:09:32.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/968: dread d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:32.495 INFO:tasks.workunit.client.0.smithi148.stdout:6/974: creat d6/d9/d1e/d11d/d145/f14a x:0 0 0 2024-04-26T23:09:32.500 INFO:tasks.workunit.client.0.smithi148.stdout:7/985: link d7/d11/d17/d2f/d44/d105/f53 d7/d11/d17/d2f/d44/d105/f154 0 2024-04-26T23:09:32.501 INFO:tasks.workunit.client.0.smithi148.stdout:6/975: dread d6/d9/d1c/d1d/d68/dbc/ff9 [0,4194304] 0 2024-04-26T23:09:32.506 INFO:tasks.workunit.client.0.smithi148.stdout:7/986: creat d7/d11/d17/d2f/d44/d105/d2e/d41/f155 x:0 0 0 2024-04-26T23:09:32.506 INFO:tasks.workunit.client.0.smithi148.stdout:7/987: write d7/d19/f119 [285803,61084] 0 2024-04-26T23:09:32.509 INFO:tasks.workunit.client.0.smithi148.stdout:6/976: symlink d6/d9/d1c/dbf/d134/l14b 0 2024-04-26T23:09:32.510 INFO:tasks.workunit.client.0.smithi148.stdout:9/969: dread d19/d1d/d25/d2f/d4d/d33/daa/fc0 [0,4194304] 0 2024-04-26T23:09:32.510 INFO:tasks.workunit.client.0.smithi148.stdout:9/970: chown d19/d22/l2b 69836303 1 2024-04-26T23:09:32.510 INFO:tasks.workunit.client.0.smithi148.stdout:9/971: dread - d19/d1d/d25/d31/d32/df3/f113 zero size 2024-04-26T23:09:32.514 INFO:tasks.workunit.client.0.smithi148.stdout:9/972: unlink d19/d1d/d25/d31/d60/f104 0 2024-04-26T23:09:32.518 INFO:tasks.workunit.client.0.smithi148.stdout:9/973: mkdir d19/d1d/d25/d2f/d4d/d33/d50/dd9/d13e 0 2024-04-26T23:09:32.521 INFO:tasks.workunit.client.0.smithi148.stdout:9/974: symlink d19/d1d/d25/d31/dc5/l13f 0 2024-04-26T23:09:32.521 INFO:tasks.workunit.client.0.smithi148.stdout:9/975: dread - d19/d1d/d25/d2f/d4d/d33/f13c zero size 2024-04-26T23:09:32.525 INFO:tasks.workunit.client.0.smithi148.stdout:3/962: write d9/ff [900177,129749] 0 2024-04-26T23:09:32.538 INFO:tasks.workunit.client.0.smithi148.stdout:9/976: read d19/d1d/d25/d2f/d4d/d33/fb3 [1574725,29058] 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:9/977: write d19/d1d/d25/f3e [1878041,72304] 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:3/963: mknod d9/d15/d29/d88/d9f/dbc/d130/c134 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:7/988: dread d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 [0,4194304] 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:9/978: write d19/d1d/d49/f5c [350051,64029] 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:9/979: truncate d19/f2d 4300477 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:7/989: write d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/fbe [7512001,54272] 0 2024-04-26T23:09:32.539 INFO:tasks.workunit.client.0.smithi148.stdout:9/980: rmdir d19/d9f 39 2024-04-26T23:09:32.541 INFO:tasks.workunit.client.0.smithi148.stdout:3/964: truncate d9/d52/fec 100217 0 2024-04-26T23:09:32.545 INFO:tasks.workunit.client.0.smithi148.stdout:7/990: dread d7/d11/d17/d2f/d44/d105/d2e/d41/d67/fd9 [0,4194304] 0 2024-04-26T23:09:32.559 INFO:tasks.workunit.client.0.smithi148.stdout:6/977: dwrite d6/d9/d1e/d11d/d145/f14a [0,4194304] 0 2024-04-26T23:09:32.812 INFO:tasks.workunit.client.0.smithi148.stdout:6/978: creat d6/d9/d23/dc1/f14c x:0 0 0 2024-04-26T23:09:32.825 INFO:tasks.workunit.client.0.smithi148.stdout:9/981: sync 2024-04-26T23:09:32.826 INFO:tasks.workunit.client.0.smithi148.stdout:7/991: sync 2024-04-26T23:09:32.830 INFO:tasks.workunit.client.0.smithi148.stdout:9/982: mknod d19/d1d/d25/d31/d48/c140 0 2024-04-26T23:09:32.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/965: dwrite d9/d65/d80/d83/f89 [0,4194304] 0 2024-04-26T23:09:32.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/966: write d9/d15/f24 [4653703,12171] 0 2024-04-26T23:09:32.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/967: truncate d9/d65/d80/d83/d99/f104 747640 0 2024-04-26T23:09:32.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/968: chown d9/d52/l76 1375 1 2024-04-26T23:09:32.843 INFO:tasks.workunit.client.0.smithi148.stdout:3/969: fdatasync d9/d15/d29/d4d/f64 0 2024-04-26T23:09:32.845 INFO:tasks.workunit.client.0.smithi148.stdout:9/983: dread d19/d39/d5f/fb8 [0,4194304] 0 2024-04-26T23:09:32.849 INFO:tasks.workunit.client.0.smithi148.stdout:9/984: read d19/d1d/f66 [12210,5429] 0 2024-04-26T23:09:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/970: rmdir d9 39 2024-04-26T23:09:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/971: truncate d9/d15/d29/ff1 585921 0 2024-04-26T23:09:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/972: chown d9/d52/f62 182 1 2024-04-26T23:09:32.855 INFO:tasks.workunit.client.0.smithi148.stdout:9/985: mkdir d19/d1d/d25/d31/d73/ddc/d141 0 2024-04-26T23:09:32.857 INFO:tasks.workunit.client.0.smithi148.stdout:6/979: dwrite d6/d9/d1c/d1d/fa0 [0,4194304] 0 2024-04-26T23:09:32.861 INFO:tasks.workunit.client.0.smithi148.stdout:6/980: read d6/d9/d1e/d69/fcf [179964,127183] 0 2024-04-26T23:09:32.862 INFO:tasks.workunit.client.0.smithi148.stdout:3/973: link d9/d15/d29/d4d/d6f/ffd d9/d15/d29/d4d/d78/dee/f135 0 2024-04-26T23:09:32.866 INFO:tasks.workunit.client.0.smithi148.stdout:9/986: link d19/d1d/d25/d78/l103 d19/d1d/d25/d78/d110/l142 0 2024-04-26T23:09:32.869 INFO:tasks.workunit.client.0.smithi148.stdout:6/981: chown d6/dc/f45 166 1 2024-04-26T23:09:32.869 INFO:tasks.workunit.client.0.smithi148.stdout:6/982: write d6/d9/d1e/fdb [608440,91269] 0 2024-04-26T23:09:32.869 INFO:tasks.workunit.client.0.smithi148.stdout:6/983: chown d6/d9/d1e 358 1 2024-04-26T23:09:32.872 INFO:tasks.workunit.client.0.smithi148.stdout:3/974: mkdir d9/d65/d80/d83/db9/d136 0 2024-04-26T23:09:32.876 INFO:tasks.workunit.client.0.smithi148.stdout:6/984: rename d6/d9/d1e/c6e to d6/d9/d1c/d1d/d1f/c14d 0 2024-04-26T23:09:32.876 INFO:tasks.workunit.client.0.smithi148.stdout:7/992: dwrite d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/f9f [0,4194304] 0 2024-04-26T23:09:32.876 INFO:tasks.workunit.client.0.smithi148.stdout:7/993: fsync d7/d11/d17/d2f/d44/d105/d2e/d41/d67/d94/d95/df7/d109/f10c 0 2024-04-26T23:09:32.878 INFO:tasks.workunit.client.0.smithi148.stdout:3/975: creat d9/d65/d80/f137 x:0 0 0 2024-04-26T23:09:32.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/976: mkdir d9/d65/de5/d123/d138 0 2024-04-26T23:09:32.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/977: write d9/d65/f9b [4066385,98726] 0 2024-04-26T23:09:32.886 INFO:tasks.workunit.client.0.smithi148.stdout:6/985: rename d6/d9/d23/dc1/cd8 to d6/d14/d91/c14e 0 2024-04-26T23:09:32.886 INFO:tasks.workunit.client.0.smithi148.stdout:6/986: truncate d6/d14/d91/f12a 400876 0 2024-04-26T23:09:32.887 INFO:tasks.workunit.client.0.smithi148.stdout:9/987: dread d19/d39/f90 [0,4194304] 0 2024-04-26T23:09:32.889 INFO:tasks.workunit.client.0.smithi148.stdout:3/978: unlink d9/d52/l12f 0 2024-04-26T23:09:32.889 INFO:tasks.workunit.client.0.smithi148.stdout:3/979: chown d9/d15/d29/d4d/d7d/cf8 1 1 2024-04-26T23:09:32.893 INFO:tasks.workunit.client.0.smithi148.stdout:3/980: rename d9/d15/d29/d4d/d78/dee/c108 to d9/d15/d29/d88/d9f/dbc/d130/c139 0 2024-04-26T23:09:32.895 INFO:tasks.workunit.client.0.smithi148.stdout:6/987: mknod d6/c14f 0 2024-04-26T23:09:32.899 INFO:tasks.workunit.client.0.smithi148.stdout:6/988: mknod d6/d32/d8a/d12d/c150 0 2024-04-26T23:09:32.899 INFO:tasks.workunit.client.0.smithi148.stdout:6/989: fdatasync d6/dc/f75 0 2024-04-26T23:09:32.899 INFO:tasks.workunit.client.0.smithi148.stdout:6/990: readlink d6/d9/d1c/d1d/d68/dbc/ld0 0 2024-04-26T23:09:32.899 INFO:tasks.workunit.client.0.smithi148.stdout:6/991: stat d6/d9/d1c/d1d/de3/fea 0 2024-04-26T23:09:32.902 INFO:tasks.workunit.client.0.smithi148.stdout:6/992: mkdir d6/d9/d1c/d1d/d68/dbc/d151 0 2024-04-26T23:09:32.902 INFO:tasks.workunit.client.0.smithi148.stdout:6/993: fdatasync d6/d9/d1c/d1d/fe4 0 2024-04-26T23:09:32.904 INFO:tasks.workunit.client.0.smithi148.stdout:6/994: symlink d6/d9/d1c/dbf/dec/l152 0 2024-04-26T23:09:32.907 INFO:tasks.workunit.client.0.smithi148.stdout:6/995: mknod d6/dbe/c153 0 2024-04-26T23:09:32.907 INFO:tasks.workunit.client.0.smithi148.stdout:6/996: chown d6/d9/d1c/d1d/c37 703714888 1 2024-04-26T23:09:32.907 INFO:tasks.workunit.client.0.smithi148.stdout:6/997: fsync d6/d9/d1c/d1d/d68/f114 0 2024-04-26T23:09:32.909 INFO:tasks.workunit.client.0.smithi148.stdout:6/998: creat d6/d32/d98/de2/f154 x:0 0 0 2024-04-26T23:09:32.911 INFO:tasks.workunit.client.0.smithi148.stdout:6/999: rmdir d6/d9/d23/dc1/df8/dfb 39 2024-04-26T23:09:32.924 INFO:tasks.workunit.client.0.smithi148.stdout:7/994: dwrite d7/d11/d17/fc4 [0,4194304] 0 2024-04-26T23:09:32.937 INFO:tasks.workunit.client.0.smithi148.stdout:3/981: dread d9/d31/d8f/f112 [0,4194304] 0 2024-04-26T23:09:32.937 INFO:tasks.workunit.client.0.smithi148.stdout:9/988: dwrite d19/f1e [0,4194304] 0 2024-04-26T23:09:32.937 INFO:tasks.workunit.client.0.smithi148.stdout:9/989: fsync d19/d1d/d25/f63 0 2024-04-26T23:09:32.939 INFO:tasks.workunit.client.0.smithi148.stdout:9/990: mknod d19/d1d/d25/d31/d32/dc8/c143 0 2024-04-26T23:09:32.940 INFO:tasks.workunit.client.0.smithi148.stdout:9/991: chown d19/d1d/d25/d31/d73/dd1/fe3 86147 1 2024-04-26T23:09:32.941 INFO:tasks.workunit.client.0.smithi148.stdout:9/992: mkdir d19/d1d/d25/d31/d60/dba/d144 0 2024-04-26T23:09:32.961 INFO:tasks.workunit.client.0.smithi148.stdout:7/995: dwrite d7/d11/d17/d2f/d44/d105/d2e/d41/d67/f11a [0,4194304] 0 2024-04-26T23:09:32.973 INFO:tasks.workunit.client.0.smithi148.stdout:7/996: dread d7/d11/d17/d2f/d44/d105/d2e/dc6/de7/f131 [0,4194304] 0 2024-04-26T23:09:32.978 INFO:tasks.workunit.client.0.smithi148.stdout:7/997: mknod d7/d11/d17/d2f/d44/de4/d101/c156 0 2024-04-26T23:09:32.978 INFO:tasks.workunit.client.0.smithi148.stdout:7/998: write d7/d11/d17/d9e/fa8 [1113387,29197] 0 2024-04-26T23:09:33.007 INFO:tasks.workunit.client.0.smithi148.stdout:9/993: dwrite fe [8388608,4194304] 0 2024-04-26T23:09:33.028 INFO:tasks.workunit.client.0.smithi148.stdout:7/999: dwrite d7/d11/d17/d2f/d44/d105/d2e/dc6/f106 [0,4194304] 0 2024-04-26T23:09:33.028 INFO:tasks.workunit.client.0.smithi148.stdout:9/994: write fe [11087080,111541] 0 2024-04-26T23:09:33.100 INFO:tasks.workunit.client.0.smithi148.stdout:9/995: dwrite d19/f7d [0,4194304] 0 2024-04-26T23:09:33.105 INFO:tasks.workunit.client.0.smithi148.stdout:9/996: getdents d19/d1d/d25/d31/d60/dba/d85/db2/d102 0 2024-04-26T23:09:33.111 INFO:tasks.workunit.client.0.smithi148.stdout:3/982: sync 2024-04-26T23:09:33.117 INFO:tasks.workunit.client.0.smithi148.stdout:3/983: write d9/db3/f111 [485554,44993] 0 2024-04-26T23:09:33.117 INFO:tasks.workunit.client.0.smithi148.stdout:3/984: getdents d9/d15/d29/d4d/d68/dd6/de2/d131 0 2024-04-26T23:09:33.118 INFO:tasks.workunit.client.0.smithi148.stdout:3/985: write d9/d65/d80/d83/db9/f121 [592962,17470] 0 2024-04-26T23:09:33.118 INFO:tasks.workunit.client.0.smithi148.stdout:3/986: chown d9/d15/f28 116194 1 2024-04-26T23:09:33.118 INFO:tasks.workunit.client.0.smithi148.stdout:3/987: write d9/d31/f95 [279575,92408] 0 2024-04-26T23:09:33.234 INFO:tasks.workunit.client.0.smithi148.stdout:9/997: dwrite d19/f9a [0,4194304] 0 2024-04-26T23:09:33.237 INFO:tasks.workunit.client.0.smithi148.stdout:9/998: creat d19/d1d/d25/d78/d110/f145 x:0 0 0 2024-04-26T23:09:33.256 INFO:tasks.workunit.client.0.smithi148.stdout:3/988: dwrite d9/fd5 [0,4194304] 0 2024-04-26T23:09:33.256 INFO:tasks.workunit.client.0.smithi148.stdout:3/989: dread - d9/d15/d29/d88/fb8 zero size 2024-04-26T23:09:33.276 INFO:tasks.workunit.client.0.smithi148.stdout:9/999: dwrite d19/d1d/d49/f5c [0,4194304] 0 2024-04-26T23:09:33.407 INFO:tasks.workunit.client.0.smithi148.stdout:3/990: sync 2024-04-26T23:09:33.407 INFO:tasks.workunit.client.0.smithi148.stdout:3/991: chown d9/d31 503 1 2024-04-26T23:09:33.410 INFO:tasks.workunit.client.0.smithi148.stdout:3/992: unlink d9/c50 0 2024-04-26T23:09:33.413 INFO:tasks.workunit.client.0.smithi148.stdout:3/993: symlink d9/d15/d29/d88/d9f/dbc/d130/l13a 0 2024-04-26T23:09:33.413 INFO:tasks.workunit.client.0.smithi148.stdout:3/994: fsync d9/d15/f1e 0 2024-04-26T23:09:33.413 INFO:tasks.workunit.client.0.smithi148.stdout:3/995: fdatasync d9/d65/fd4 0 2024-04-26T23:09:33.433 INFO:tasks.workunit.client.0.smithi148.stdout:3/996: dread d9/d15/d29/d88/fc4 [0,4194304] 0 2024-04-26T23:09:33.433 INFO:tasks.workunit.client.0.smithi148.stdout:3/997: write d9/ff [59737,129281] 0 2024-04-26T23:09:33.435 INFO:tasks.workunit.client.0.smithi148.stdout:3/998: mkdir d9/d15/d13b 0 2024-04-26T23:09:33.435 INFO:tasks.workunit.client.0.smithi148.stdout:3/999: write d9/d15/d29/d4d/d6f/f12a [590032,120752] 0 2024-04-26T23:09:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:+ rm -rf -- ./tmp.ITjUCaDr8p 2024-04-26T23:09:41.357 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:09:41.358 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T23:09:41.358 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:09:41.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:09:41.361 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:09:41.361 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T23:09:41.361 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T23:09:41.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:09:43.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:09:43.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:09:56.362 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T23:09:56.363 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T23:09:56.363 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:09:56.363 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:09:56.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.518+0000 7fe335800640 1 Processor -- start 2024-04-26T23:09:56.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.518+0000 7fe335800640 1 -- start start 2024-04-26T23:09:56.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe335800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe33015f490 0x7fe3300cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe335800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 0x7fe3300d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe335800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3300ce550 con 0x7fe3300cb270 2024-04-26T23:09:56.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe335800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe3300ce7c0 con 0x7fe33015f490 2024-04-26T23:09:56.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe335800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe3300cea80 con 0x7fe3300d1640 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe33015f490 0x7fe3300cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe33015f490 0x7fe3300cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42684/0 (socket says 172.21.15.148:42684) 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 -- 172.21.15.148:0/621921487 learned_addr learned my addr 172.21.15.148:0/621921487 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32f400640 1 --2- 172.21.15.148:0/621921487 >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 0x7fe3300d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 -- 172.21.15.148:0/621921487 >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 msgr2=0x7fe3300d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 --2- 172.21.15.148:0/621921487 >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 0x7fe3300d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 -- 172.21.15.148:0/621921487 >> v1:172.21.15.157:6789/0 conn(0x7fe3300cb270 legacy=0x7fe3300cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32e000640 1 -- 172.21.15.148:0/621921487 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3300ced60 con 0x7fe33015f490 2024-04-26T23:09:56.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.522+0000 7fe32f400640 1 --2- 172.21.15.148:0/621921487 >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 0x7fe3300d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:09:56.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe32e000640 1 --2- 172.21.15.148:0/621921487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe33015f490 0x7fe3300cb650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3300c4fa0 tx=0x7fe31c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99e7c43a16a37c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe32d600640 1 -- 172.21.15.148:0/621921487 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0b5070 con 0x7fe33015f490 2024-04-26T23:09:56.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe32d600640 1 -- 172.21.15.148:0/621921487 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c0a8a10 con 0x7fe33015f490 2024-04-26T23:09:56.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe32d600640 1 -- 172.21.15.148:0/621921487 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0a8de0 con 0x7fe33015f490 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- 172.21.15.148:0/621921487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe33015f490 msgr2=0x7fe3300cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 --2- 172.21.15.148:0/621921487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe33015f490 0x7fe3300cb650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3300c4fa0 tx=0x7fe31c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- 172.21.15.148:0/621921487 shutdown_connections 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 --2- 172.21.15.148:0/621921487 >> v2:172.21.15.157:3300/0 conn(0x7fe3300d1640 0x7fe3300d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 --2- 172.21.15.148:0/621921487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe33015f490 0x7fe3300cb650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- 172.21.15.148:0/621921487 >> 172.21.15.148:0/621921487 conn(0x7fe33006eaf0 msgr2=0x7fe33006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- 172.21.15.148:0/621921487 shutdown_connections 2024-04-26T23:09:56.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- 172.21.15.148:0/621921487 wait complete. 2024-04-26T23:09:56.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 Processor -- start 2024-04-26T23:09:56.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.526+0000 7fe335800640 1 -- start start 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3300cb270 0x7fe3301591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe33015f490 0x7fe3301f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300ccc70 con 0x7fe3300d1640 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300cc990 con 0x7fe3300cb270 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe3300cd190 con 0x7fe33015f490 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42692/0 (socket says 172.21.15.148:42692) 2024-04-26T23:09:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 -- 172.21.15.148:0/2165943317 learned_addr learned my addr 172.21.15.148:0/2165943317 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32f400640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe33015f490 0x7fe3301f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32ea00640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3300cb270 0x7fe3301591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 -- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe33015f490 msgr2=0x7fe3301f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe33015f490 0x7fe3301f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 -- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3300cb270 msgr2=0x7fe3301591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3300cb270 0x7fe3301591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 -- 172.21.15.148:0/2165943317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3301f4d40 con 0x7fe3300d1640 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe32e000640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0b3040 tx=0x7fe31c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0c0070 con 0x7fe3300d1640 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c0b08b0 con 0x7fe3300d1640 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0b5040 con 0x7fe3300d1640 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3301f5020 con 0x7fe3300d1640 2024-04-26T23:09:56.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3301f55e0 con 0x7fe3300d1640 2024-04-26T23:09:56.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe330077c20 con 0x7fe3300d1640 2024-04-26T23:09:56.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.530+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe31c0b0ca0 con 0x7fe3300d1640 2024-04-26T23:09:56.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.534+0000 7fe326a00640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 0x7fe31006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.534+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe31c123e60 con 0x7fe3300d1640 2024-04-26T23:09:56.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.534+0000 7fe32ea00640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 0x7fe31006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.534+0000 7fe32ea00640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 0x7fe31006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe320000f70 tx=0x7fe320009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.538+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe31c018870 con 0x7fe3300d1640 2024-04-26T23:09:56.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.758+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe3300b5bf0 con 0x7fe3300d1640 2024-04-26T23:09:56.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.758+0000 7fe326a00640 1 -- 172.21.15.148:0/2165943317 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fe31c0f4010 con 0x7fe3300d1640 2024-04-26T23:09:56.760 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:09:56.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 msgr2=0x7fe31006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 0x7fe31006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe320000f70 tx=0x7fe320009040 comp rx=0 tx=0).stop 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 msgr2=0x7fe33015fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0b3040 tx=0x7fe31c01bab0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 shutdown_connections 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe310068380 0x7fe31006a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe33015f490 0x7fe3301f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3300d1640 0x7fe33015fb20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 --2- 172.21.15.148:0/2165943317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3300cb270 0x7fe3301591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 >> 172.21.15.148:0/2165943317 conn(0x7fe33006eaf0 msgr2=0x7fe33006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:56.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 shutdown_connections 2024-04-26T23:09:56.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.762+0000 7fe335800640 1 -- 172.21.15.148:0/2165943317 wait complete. 2024-04-26T23:09:56.783 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:09:56.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:09:56.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:09:56.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.922+0000 7f9974800640 1 Processor -- start 2024-04-26T23:09:56.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.922+0000 7f9974800640 1 -- start start 2024-04-26T23:09:56.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.922+0000 7f9974800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f996c156040 0x7f996c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9974800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996c0706c0 con 0x7f996c073760 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9974800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996c0709a0 con 0x7f996c0c7b10 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9974800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f996c070c80 con 0x7f996c156040 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f996c156040 0x7f996c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9972800640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f996c073760 0x7f996c06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60652/0 (socket says 172.21.15.148:60652) 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f996c156040 0x7f996c070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42706/0 (socket says 172.21.15.148:42706) 2024-04-26T23:09:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9972800640 1 -- 172.21.15.148:0/189325338 learned_addr learned my addr 172.21.15.148:0/189325338 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:09:56.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 -- 172.21.15.148:0/189325338 >> v1:172.21.15.157:6789/0 conn(0x7f996c0c7b10 legacy=0x7f996c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 -- 172.21.15.148:0/189325338 >> v1:172.21.15.148:6789/0 conn(0x7f996c073760 legacy=0x7f996c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9970a00640 1 -- 172.21.15.148:0/189325338 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672078298 0 0) 0x7f996c0706c0 con 0x7f996c073760 2024-04-26T23:09:56.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 -- 172.21.15.148:0/189325338 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c072c80 con 0x7f996c156040 2024-04-26T23:09:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9971e00640 1 --2- 172.21.15.148:0/189325338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c156040 0x7f996c070010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99600097c0 tx=0x7f996001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc971176719e121a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9970a00640 1 -- 172.21.15.148:0/189325338 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600a7070 con 0x7f996c156040 2024-04-26T23:09:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9970a00640 1 -- 172.21.15.148:0/189325338 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99600b0070 con 0x7f996c156040 2024-04-26T23:09:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.926+0000 7f9970a00640 1 -- 172.21.15.148:0/189325338 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600ab890 con 0x7f996c156040 2024-04-26T23:09:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- 172.21.15.148:0/189325338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c156040 msgr2=0x7f996c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 --2- 172.21.15.148:0/189325338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c156040 0x7f996c070010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99600097c0 tx=0x7f996001c470 comp rx=0 tx=0).stop 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- 172.21.15.148:0/189325338 shutdown_connections 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 --2- 172.21.15.148:0/189325338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c156040 0x7f996c070010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- 172.21.15.148:0/189325338 >> 172.21.15.148:0/189325338 conn(0x7f996c0c9d10 msgr2=0x7f996c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- 172.21.15.148:0/189325338 shutdown_connections 2024-04-26T23:09:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- 172.21.15.148:0/189325338 wait complete. 2024-04-26T23:09:56.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 Processor -- start 2024-04-26T23:09:56.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- start start 2024-04-26T23:09:56.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f996c073760 0x7f996c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 0x7f996c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f996c156040 0x7f996c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f996c0c94b0 con 0x7f996c0c7b10 2024-04-26T23:09:56.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f996c0c9330 con 0x7f996c156040 2024-04-26T23:09:56.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9974800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f996c06fb70 con 0x7f996c073760 2024-04-26T23:09:56.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 0x7f996c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 0x7f996c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42720/0 (socket says 172.21.15.148:42720) 2024-04-26T23:09:56.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 -- 172.21.15.148:0/3093877673 learned_addr learned my addr 172.21.15.148:0/3093877673 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:56.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9972800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f996c156040 0x7f996c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971e00640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f996c073760 0x7f996c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f996c073760 msgr2=0x7f996c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f996c073760 0x7f996c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f996c156040 msgr2=0x7f996c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f996c156040 0x7f996c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c1f5270 con 0x7f996c0c7b10 2024-04-26T23:09:56.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9971400640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 0x7f996c0cc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c500 tx=0x7f995c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.930+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c0052d0 con 0x7f996c0c7b10 2024-04-26T23:09:56.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c005470 con 0x7f996c0c7b10 2024-04-26T23:09:56.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c15d0c0 con 0x7f996c0c7b10 2024-04-26T23:09:56.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c012830 con 0x7f996c0c7b10 2024-04-26T23:09:56.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c15a9b0 con 0x7f996c0c7b10 2024-04-26T23:09:56.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9974800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 0x7f996c1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1f5020 con 0x7f996c15e0e0 2024-04-26T23:09:56.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9971e00640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 0x7f996c1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9971e00640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f996c1f5550 con 0x7f996c15e0e0 2024-04-26T23:09:56.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9971e00640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 0x7f996c1f7b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f996c06ff80 tx=0x7f9960019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600c0680 con 0x7f996c15e0e0 2024-04-26T23:09:56.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f995c0129d0 con 0x7f996c0c7b10 2024-04-26T23:09:56.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99500682b0 0x7f995006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f995c086a90 con 0x7f996c0c7b10 2024-04-26T23:09:56.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f99600b0040 con 0x7f996c15e0e0 2024-04-26T23:09:56.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 msgr2=0x7f996c1f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 0x7f996c1f7b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f996c06ff80 tx=0x7f9960019210 comp rx=0 tx=0).stop 2024-04-26T23:09:56.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 msgr2=0x7f996c1f7b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:56.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9966000640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15e0e0 0x7f996c1f7b10 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f996c06ff80 tx=0x7f9960019210 comp rx=0 tx=0).stop 2024-04-26T23:09:56.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.934+0000 7f9972800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99500682b0 0x7f995006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.938+0000 7f9972800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99500682b0 0x7f995006a770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99680012f0 tx=0x7f9968007eb0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 0x7f996c1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:56.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f996c0744f0 con 0x7f996c15d710 2024-04-26T23:09:56.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9971e00640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 0x7f996c1f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:56.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9971e00640 1 -- 172.21.15.148:0/3093877673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f996c072720 con 0x7f996c15d710 2024-04-26T23:09:56.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9971e00640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 0x7f996c1f8050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f996001c4b0 tx=0x7f9960009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600c0c50 con 0x7f996c15d710 2024-04-26T23:09:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5070 (secure 0 0 0) 0x7f9960003620 con 0x7f996c15d710 2024-04-26T23:09:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 msgr2=0x7f996c1f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 0x7f996c1f8050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f996001c4b0 tx=0x7f9960009190 comp rx=0 tx=0).stop 2024-04-26T23:09:56.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 msgr2=0x7f996c1f8050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:56.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9966000640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c15d710 0x7f996c1f8050 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f996001c4b0 tx=0x7f9960009190 comp rx=0 tx=0).stop 2024-04-26T23:09:56.950 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:09:56.951 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:56.951 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:56.951 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:09:56.951 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:09:56.951 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 73755, 2024-04-26T23:09:56.952 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:09:56.952 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:09:56.952 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:09:56.952 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:09:56.953 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.953 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:09:56.953 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:56.953 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:09:56.953 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:09:56.954 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:56.954 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:56.954 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:56.954 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:56.954 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:56.955 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:56.955 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:56.955 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:56.955 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:56.955 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:56.956 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:56.956 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.956 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:09:56.956 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:09:56.956 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:56.957 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:56.957 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:56.957 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:56.957 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:56.957 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:56.958 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:56.958 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:56.958 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:56.958 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:56.958 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:56.959 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.959 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:09:56.959 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:09:56.959 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:56.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:09:56.961 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:56.962 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:56.963 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:09:56.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:56.966 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:09:56.967 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.968 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:56.969 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:09:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.971 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:09:56.971 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:56.972 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:09:56.973 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:56.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:56.975 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:09:56.976 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.977 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:09:56.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:56.979 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:56.980 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:56.981 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:56.982 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:09:56.983 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99500682b0 msgr2=0x7f995006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99500682b0 0x7f995006a770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99680012f0 tx=0x7f9968007eb0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 msgr2=0x7f996c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 --2- 172.21.15.148:0/3093877673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f996c0c7b10 0x7f996c0cc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c500 tx=0x7f995c00c9c0 comp rx=0 tx=0).stop 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9972800640 1 -- 172.21.15.148:0/3093877673 reap_dead start 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9972800640 1 -- 172.21.15.148:0/3093877673 reap_dead start 2024-04-26T23:09:56.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 shutdown_connections 2024-04-26T23:09:56.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 >> 172.21.15.148:0/3093877673 conn(0x7f996c0c9d10 msgr2=0x7f996c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:56.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 shutdown_connections 2024-04-26T23:09:56.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:56.942+0000 7f9974800640 1 -- 172.21.15.148:0/3093877673 wait complete. 2024-04-26T23:09:56.986 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:09:56.986 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:09:56.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:09:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.122+0000 7fb24e800640 1 Processor -- start 2024-04-26T23:09:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.122+0000 7fb24e800640 1 -- start start 2024-04-26T23:09:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb24e800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 0x7fb24815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb24e800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb248153eb0 0x7fb24806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb24e800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480701f0 con 0x7fb24806fd80 2024-04-26T23:09:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb24e800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb24815ac00 con 0x7fb248153eb0 2024-04-26T23:09:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb24e800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb2480c96a0 con 0x7fb24806f460 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb247400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 0x7fb24815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb248153eb0 0x7fb24806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb247400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 0x7fb24815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:34986/0 (socket says 172.21.15.148:34986) 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb247e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb24806fd80 0x7fb2480c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60668/0 (socket says 172.21.15.148:60668) 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb247400640 1 -- 172.21.15.148:0/1650621740 learned_addr learned my addr 172.21.15.148:0/1650621740 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:57.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246a00640 1 -- 172.21.15.148:0/1650621740 >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 msgr2=0x7fb24815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246a00640 1 --2- 172.21.15.148:0/1650621740 >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 0x7fb24815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246a00640 1 -- 172.21.15.148:0/1650621740 >> v1:172.21.15.148:6789/0 conn(0x7fb24806fd80 legacy=0x7fb2480c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246a00640 1 -- 172.21.15.148:0/1650621740 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480c9980 con 0x7fb248153eb0 2024-04-26T23:09:57.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.126+0000 7fb246000640 1 -- 172.21.15.148:0/1650621740 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270704223 0 0) 0x7fb2400014a0 con 0x7fb24806fd80 2024-04-26T23:09:57.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb246a00640 1 --2- 172.21.15.148:0/1650621740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248153eb0 0x7fb24806f840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb24806d800 tx=0x7fb23401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af79736d5f2f2756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb246000640 1 -- 172.21.15.148:0/1650621740 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340b5070 con 0x7fb248153eb0 2024-04-26T23:09:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb246000640 1 -- 172.21.15.148:0/1650621740 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2340a8970 con 0x7fb248153eb0 2024-04-26T23:09:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb246000640 1 -- 172.21.15.148:0/1650621740 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340a8d40 con 0x7fb248153eb0 2024-04-26T23:09:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 -- 172.21.15.148:0/1650621740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248153eb0 msgr2=0x7fb24806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 --2- 172.21.15.148:0/1650621740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248153eb0 0x7fb24806f840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb24806d800 tx=0x7fb23401ec70 comp rx=0 tx=0).stop 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 -- 172.21.15.148:0/1650621740 shutdown_connections 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 --2- 172.21.15.148:0/1650621740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248153eb0 0x7fb24806f840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 --2- 172.21.15.148:0/1650621740 >> v2:172.21.15.157:3300/0 conn(0x7fb24806f460 0x7fb24815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 -- 172.21.15.148:0/1650621740 >> 172.21.15.148:0/1650621740 conn(0x7fb2480c9d10 msgr2=0x7fb2480ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 -- 172.21.15.148:0/1650621740 shutdown_connections 2024-04-26T23:09:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.130+0000 7fb24e800640 1 -- 172.21.15.148:0/1650621740 wait complete. 2024-04-26T23:09:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 Processor -- start 2024-04-26T23:09:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- start start 2024-04-26T23:09:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb24806f460 0x7fb248149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb24806fd80 0x7fb2481efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480c5120 con 0x7fb248150f30 2024-04-26T23:09:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480708f0 con 0x7fb24806f460 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480c4d70 con 0x7fb24806fd80 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42760/0 (socket says 172.21.15.148:42760) 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 -- 172.21.15.148:0/779896965 learned_addr learned my addr 172.21.15.148:0/779896965 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb246a00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb24806fd80 0x7fb2481efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb24806f460 0x7fb248149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb24806fd80 msgr2=0x7fb2481efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb24806fd80 0x7fb2481efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb24806f460 msgr2=0x7fb248149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb24806f460 0x7fb248149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481f3b10 con 0x7fb248150f30 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247e00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c850 tx=0x7fb24000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240018070 con 0x7fb248150f30 2024-04-26T23:09:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24000a640 con 0x7fb248150f30 2024-04-26T23:09:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24000aa30 con 0x7fb248150f30 2024-04-26T23:09:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24814d8e0 con 0x7fb248150f30 2024-04-26T23:09:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2481f37b0 con 0x7fb248150f30 2024-04-26T23:09:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 0x7fb24814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb248077c20 con 0x7fb248153eb0 2024-04-26T23:09:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.134+0000 7fb247400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 0x7fb24814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb247400640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2480c3fd0 con 0x7fb248153eb0 2024-04-26T23:09:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb24001b070 con 0x7fb248150f30 2024-04-26T23:09:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb247400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 0x7fb24814d2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb238011500 tx=0x7fb2380119c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb2280683b0 0x7fb22806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb240086470 con 0x7fb248150f30 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238015870 con 0x7fb248153eb0 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb238015870 con 0x7fb248153eb0 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 msgr2=0x7fb24814d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 0x7fb24814d2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb238011500 tx=0x7fb2380119c0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb246a00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb2280683b0 0x7fb22806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 msgr2=0x7fb24814d2a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb23f400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb248153eb0 0x7fb24814d2a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.138+0000 7fb246a00640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb2280683b0 0x7fb22806a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b2000 tx=0x7fb234008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.142+0000 7fb24e800640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 0x7fb248146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.142+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb2481ef830 con 0x7fb2481599e0 2024-04-26T23:09:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb247400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 0x7fb248146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb247400640 1 -- 172.21.15.148:0/779896965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb248070c20 con 0x7fb2481599e0 2024-04-26T23:09:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb247400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 0x7fb248146ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb238011500 tx=0x7fb2380046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238004220 con 0x7fb2481599e0 2024-04-26T23:09:57.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4558 (secure 0 0 0) 0x7fb238004220 con 0x7fb2481599e0 2024-04-26T23:09:57.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 msgr2=0x7fb248146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 0x7fb248146ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb238011500 tx=0x7fb2380046d0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 msgr2=0x7fb248146ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:57.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb23f400640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2481599e0 0x7fb248146ba0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 15687, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:09:57.147 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.148 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:09:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.151 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.153 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.154 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.155 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.157 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:09:57.158 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:09:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb2280683b0 msgr2=0x7fb22806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb2280683b0 0x7fb22806a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b2000 tx=0x7fb234008040 comp rx=0 tx=0).stop 2024-04-26T23:09:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 msgr2=0x7fb2481eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c850 tx=0x7fb24000cd10 comp rx=0 tx=0).stop 2024-04-26T23:09:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb247e00640 1 -- 172.21.15.148:0/779896965 reap_dead start 2024-04-26T23:09:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 shutdown_connections 2024-04-26T23:09:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 --2- 172.21.15.148:0/779896965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb248150f30 0x7fb2481eff90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 >> 172.21.15.148:0/779896965 conn(0x7fb2480c9d10 msgr2=0x7fb2480c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 shutdown_connections 2024-04-26T23:09:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.146+0000 7fb24e800640 1 -- 172.21.15.148:0/779896965 wait complete. 2024-04-26T23:09:57.165 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:09:57.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:09:57.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:09:57.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.306+0000 7f5d53000640 1 Processor -- start 2024-04-26T23:09:57.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.306+0000 7f5d53000640 1 -- start start 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d53000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c153eb0 0x7f5d4c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d53000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c0c96a0 con 0x7f5d4c06ff50 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d53000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c0c9980 con 0x7f5d4c06f460 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d53000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c15ac00 con 0x7f5d4c153eb0 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d51000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5d4c06ff50 0x7f5d4c0c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60672/0 (socket says 172.21.15.148:60672) 2024-04-26T23:09:57.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d51000640 1 -- 172.21.15.148:0/85918961 learned_addr learned my addr 172.21.15.148:0/85918961 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c153eb0 0x7f5d4c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338038430 0 0) 0x7f5d4c0c96a0 con 0x7f5d4c06ff50 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d30003530 con 0x7f5d4c06ff50 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 334228539 0 0) 0x7f5d30003530 con 0x7f5d4c06ff50 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c153eb0 msgr2=0x7f5d4c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c153eb0 0x7f5d4c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 >> v1:172.21.15.157:6789/0 conn(0x7f5d4c06f460 legacy=0x7f5d4c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c070610 con 0x7f5d4c06ff50 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f5d44001a00 con 0x7f5d4c06ff50 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 >> v1:172.21.15.148:6789/0 conn(0x7f5d4c06ff50 legacy=0x7f5d4c0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d300039f0 0x7f5d30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d30004350 0x7f5d30004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30005030 0x7f5d3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c15ac00 con 0x7f5d30004350 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30005670 con 0x7f5d300039f0 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3000bf60 con 0x7f5d30005030 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d30004350 0x7f5d30004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d4be00640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d300039f0 0x7f5d30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d51000640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30005030 0x7f5d3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 -- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30005030 msgr2=0x7f5d3000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30005030 0x7f5d3000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 -- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d300039f0 msgr2=0x7f5d30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d300039f0 0x7f5d30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.310+0000 7f5d43400640 1 -- 172.21.15.148:0/85918961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c070610 con 0x7f5d30004350 2024-04-26T23:09:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d43400640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d30004350 0x7f5d30004830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009ae0 tx=0x7f5d3c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc40174ab674eaf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0b2070 con 0x7f5d30004350 2024-04-26T23:09:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0a5660 con 0x7f5d30004350 2024-04-26T23:09:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d4b400640 1 -- 172.21.15.148:0/85918961 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0096b0 con 0x7f5d30004350 2024-04-26T23:09:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- 172.21.15.148:0/85918961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d30004350 msgr2=0x7f5d30004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 --2- 172.21.15.148:0/85918961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d30004350 0x7f5d30004830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009ae0 tx=0x7f5d3c01ca70 comp rx=0 tx=0).stop 2024-04-26T23:09:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d51000640 1 -- 172.21.15.148:0/85918961 reap_dead start 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- 172.21.15.148:0/85918961 shutdown_connections 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- 172.21.15.148:0/85918961 >> 172.21.15.148:0/85918961 conn(0x7f5d4c0c9d10 msgr2=0x7f5d4c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- 172.21.15.148:0/85918961 shutdown_connections 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- 172.21.15.148:0/85918961 wait complete. 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 Processor -- start 2024-04-26T23:09:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.314+0000 7f5d53000640 1 -- start start 2024-04-26T23:09:57.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30004350 0x7f5d4c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d4c150ca0 0x7f5d4c14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c4d70 con 0x7f5d4c14e910 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c5120 con 0x7f5d4c150ca0 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c4ef0 con 0x7f5d30004350 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42774/0 (socket says 172.21.15.148:42774) 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 -- 172.21.15.148:0/973802602 learned_addr learned my addr 172.21.15.148:0/973802602 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d4be00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30004350 0x7f5d4c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d43400640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d4c150ca0 0x7f5d4c14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30004350 msgr2=0x7f5d4c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d30004350 0x7f5d4c0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d4c150ca0 msgr2=0x7f5d4c14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d4c150ca0 0x7f5d4c14f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c1efc20 con 0x7f5d4c14e910 2024-04-26T23:09:57.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d51000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d44011790 tx=0x7f5d44011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44010040 con 0x7f5d4c14e910 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4401a070 con 0x7f5d4c14e910 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400fb30 con 0x7f5d4c14e910 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c14e300 con 0x7f5d4c14e910 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c14ee60 con 0x7f5d4c14e910 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 0x7f5d4c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c077c20 con 0x7f5d4c14f1d0 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.318+0000 7f5d4be00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 0x7f5d4c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d4be00640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d4c070c20 con 0x7f5d4c14f1d0 2024-04-26T23:09:57.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d4400fcd0 con 0x7f5d4c14e910 2024-04-26T23:09:57.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d4be00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 0x7f5d4c14d250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d34000c10 tx=0x7f5d34011c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5d28068380 0x7f5d2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5d44089be0 con 0x7f5d4c14e910 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340050d0 con 0x7f5d4c14f1d0 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d43400640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5d28068380 0x7f5d2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d3401a070 con 0x7f5d4c14f1d0 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 msgr2=0x7f5d4c14d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 0x7f5d4c14d250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d34000c10 tx=0x7f5d34011c80 comp rx=0 tx=0).stop 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 msgr2=0x7f5d4c14d250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d48c00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14f1d0 0x7f5d4c14d250 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d34000c10 tx=0x7f5d34011c80 comp rx=0 tx=0).stop 2024-04-26T23:09:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.322+0000 7f5d43400640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5d28068380 0x7f5d2806a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0046d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.326+0000 7f5d53000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 0x7f5d4c1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.326+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c1e4980 con 0x7f5d4c14d790 2024-04-26T23:09:57.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.326+0000 7f5d4be00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 0x7f5d4c1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d4be00640 1 -- 172.21.15.148:0/973802602 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d4c1e46a0 con 0x7f5d4c14d790 2024-04-26T23:09:57.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d4be00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 0x7f5d4c1f2420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d34019000 tx=0x7f5d34001240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400f9b0 con 0x7f5d4c14d790 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7f5d3400f9b0 con 0x7f5d4c14d790 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 msgr2=0x7f5d4c1f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 0x7f5d4c1f2420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d34019000 tx=0x7f5d34001240 comp rx=0 tx=0).stop 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 msgr2=0x7f5d4c1f2420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d48c00640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d4c14d790 0x7f5d4c1f2420 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d34019000 tx=0x7f5d34001240 comp rx=0 tx=0).stop 2024-04-26T23:09:57.330 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 340177, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:09:57.331 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:09:57.332 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:09:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:09:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.336 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:09:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.338 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.339 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:09:57.340 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:09:57.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:09:57.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:09:57.343 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:09:57.344 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5d28068380 msgr2=0x7f5d2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5d28068380 0x7f5d2806a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 msgr2=0x7f5d4c14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d44011790 tx=0x7f5d44011b90 comp rx=0 tx=0).stop 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d51000640 1 -- 172.21.15.148:0/973802602 reap_dead start 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 shutdown_connections 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 --2- 172.21.15.148:0/973802602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d4c14e910 0x7f5d4c14fba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 >> 172.21.15.148:0/973802602 conn(0x7f5d4c0c9d10 msgr2=0x7f5d4c148c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 shutdown_connections 2024-04-26T23:09:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.330+0000 7f5d53000640 1 -- 172.21.15.148:0/973802602 wait complete. 2024-04-26T23:09:57.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:09:57.348 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:09:57.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:09:57.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 Processor -- start 2024-04-26T23:09:57.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 -- start start 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e80c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd9e80c9340 0x7fd9e8072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9e80732b0 0x7fd9e80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e8152fa0 con 0x7fd9e80732b0 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e8073700 con 0x7fd9e80c9340 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e8159790 con 0x7fd9e8152bc0 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9e80732b0 0x7fd9e80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eca00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9e80732b0 0x7fd9e80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42778/0 (socket says 172.21.15.148:42778) 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9eca00640 1 -- 172.21.15.148:0/3329137854 learned_addr learned my addr 172.21.15.148:0/3329137854 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:57.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9df400640 1 --2- 172.21.15.148:0/3329137854 >> v2:172.21.15.157:3300/0 conn(0x7fd9e80c9340 0x7fd9e8072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.486+0000 7fd9e7e00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e80c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 -- 172.21.15.148:0/3329137854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 msgr2=0x7fd9e80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e80c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 -- 172.21.15.148:0/3329137854 >> v2:172.21.15.157:3300/0 conn(0x7fd9e80c9340 msgr2=0x7fd9e8072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 --2- 172.21.15.148:0/3329137854 >> v2:172.21.15.157:3300/0 conn(0x7fd9e80c9340 0x7fd9e8072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 -- 172.21.15.148:0/3329137854 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e8158930 con 0x7fd9e80732b0 2024-04-26T23:09:57.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eca00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80732b0 0x7fd9e80c9b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8070cf0 tx=0x7fd9e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf38ba274de590c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9e7400640 1 -- 172.21.15.148:0/3329137854 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00b5070 con 0x7fd9e80732b0 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9e7400640 1 -- 172.21.15.148:0/3329137854 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e00a89d0 con 0x7fd9e80732b0 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9e7400640 1 -- 172.21.15.148:0/3329137854 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00a8da0 con 0x7fd9e80732b0 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eea00640 1 -- 172.21.15.148:0/3329137854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80732b0 msgr2=0x7fd9e80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eea00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80732b0 0x7fd9e80c9b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8070cf0 tx=0x7fd9e001ed10 comp rx=0 tx=0).stop 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eea00640 1 -- 172.21.15.148:0/3329137854 shutdown_connections 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eea00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80732b0 0x7fd9e80c9b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.490+0000 7fd9eea00640 1 --2- 172.21.15.148:0/3329137854 >> v2:172.21.15.157:3300/0 conn(0x7fd9e80c9340 0x7fd9e8072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 --2- 172.21.15.148:0/3329137854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e80c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- 172.21.15.148:0/3329137854 >> 172.21.15.148:0/3329137854 conn(0x7fd9e806c380 msgr2=0x7fd9e806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- 172.21.15.148:0/3329137854 shutdown_connections 2024-04-26T23:09:57.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- 172.21.15.148:0/3329137854 wait complete. 2024-04-26T23:09:57.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 Processor -- start 2024-04-26T23:09:57.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- start start 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e80732b0 0x7fd9e81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e81e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81591d0 con 0x7fd9e80c9340 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8158ef0 con 0x7fd9e80732b0 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e81594b0 con 0x7fd9e8152bc0 2024-04-26T23:09:57.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42792/0 (socket says 172.21.15.148:42792) 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 -- 172.21.15.148:0/1152201259 learned_addr learned my addr 172.21.15.148:0/1152201259 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eca00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e81e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9e7e00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e80732b0 0x7fd9e81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 -- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 msgr2=0x7fd9e81e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e81e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 -- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e80732b0 msgr2=0x7fd9e81599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e80732b0 0x7fd9e81599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 -- 172.21.15.148:0/1152201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e815a120 con 0x7fd9e80c9340 2024-04-26T23:09:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9df400640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000eac0 tx=0x7fd9d000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0010440 con 0x7fd9e80c9340 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00105e0 con 0x7fd9e80c9340 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00109b0 con 0x7fd9e80c9340 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e815a400 con 0x7fd9e80c9340 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.494+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81e1cf0 con 0x7fd9e80c9340 2024-04-26T23:09:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e8077c20 con 0x7fd9e80c9340 2024-04-26T23:09:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9d0010b50 con 0x7fd9e80c9340 2024-04-26T23:09:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9e4c00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 0x7fd9c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:09:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd9d0087950 con 0x7fd9e80c9340 2024-04-26T23:09:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9e7e00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 0x7fd9c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:09:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.498+0000 7fd9e7e00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 0x7fd9c406a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003fd0 tx=0x7fd9d80039a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:09:57.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.502+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9d0014030 con 0x7fd9e80c9340 2024-04-26T23:09:57.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.726+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd9e80748e0 con 0x7fd9e80c9340 2024-04-26T23:09:57.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.726+0000 7fd9e4c00640 1 -- 172.21.15.148:0/1152201259 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fd9d00579e0 con 0x7fd9e80c9340 2024-04-26T23:09:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 msgr2=0x7fd9c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 0x7fd9c406a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003fd0 tx=0x7fd9d80039a0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 msgr2=0x7fd9e8157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:09:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000eac0 tx=0x7fd9d000ef80 comp rx=0 tx=0).stop 2024-04-26T23:09:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 shutdown_connections 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd9c4068380 0x7fd9c406a840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9e8152bc0 0x7fd9e81e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9e80c9340 0x7fd9e8157780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 --2- 172.21.15.148:0/1152201259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9e80732b0 0x7fd9e81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 >> 172.21.15.148:0/1152201259 conn(0x7fd9e806c380 msgr2=0x7fd9e8147790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 shutdown_connections 2024-04-26T23:09:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:09:57.730+0000 7fd9eea00640 1 -- 172.21.15.148:0/1152201259 wait complete. 2024-04-26T23:09:57.754 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:10:07.754 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:10:07.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:07.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 Processor -- start 2024-04-26T23:10:07.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 -- start start 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4eac15a570 0x7f4eac163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 0x7f4eac072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac0c8270 con 0x7f4eac0c72c0 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac1603c0 con 0x7f4eac15a570 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eb2c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac1606a0 con 0x7f4eac0c7ca0 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eabe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4eac15a570 0x7f4eac163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eab400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4eac0c72c0 0x7f4eac0c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45084/0 (socket says 172.21.15.148:45084) 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eabe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4eac15a570 0x7f4eac163ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58984/0 (socket says 172.21.15.148:58984) 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.898+0000 7f4eab400640 1 -- 172.21.15.148:0/2095502661 learned_addr learned my addr 172.21.15.148:0/2095502661 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eb0c00640 1 --2- 172.21.15.148:0/2095502661 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 0x7f4eac072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eabe00640 1 -- 172.21.15.148:0/2095502661 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 msgr2=0x7f4eac072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eabe00640 1 --2- 172.21.15.148:0/2095502661 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 0x7f4eac072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eabe00640 1 -- 172.21.15.148:0/2095502661 >> v1:172.21.15.148:6789/0 conn(0x7f4eac0c72c0 legacy=0x7f4eac0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eabe00640 1 -- 172.21.15.148:0/2095502661 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac160980 con 0x7f4eac15a570 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eb0c00640 1 --2- 172.21.15.148:0/2095502661 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 0x7f4eac072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:07.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eaaa00640 1 -- 172.21.15.148:0/2095502661 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578663509 0 0) 0x7f4eac0c8270 con 0x7f4eac0c72c0 2024-04-26T23:10:07.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eabe00640 1 --2- 172.21.15.148:0/2095502661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac163ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0cac80 tx=0x7f4e9c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21ef6985526157b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:07.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eaaa00640 1 -- 172.21.15.148:0/2095502661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0b1070 con 0x7f4eac15a570 2024-04-26T23:10:07.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eaaa00640 1 -- 172.21.15.148:0/2095502661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0ac5f0 con 0x7f4eac15a570 2024-04-26T23:10:07.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.902+0000 7f4eaaa00640 1 -- 172.21.15.148:0/2095502661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0ac9c0 con 0x7f4eac15a570 2024-04-26T23:10:07.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- 172.21.15.148:0/2095502661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 msgr2=0x7f4eac163ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:07.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/2095502661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac163ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0cac80 tx=0x7f4e9c01c480 comp rx=0 tx=0).stop 2024-04-26T23:10:07.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- 172.21.15.148:0/2095502661 shutdown_connections 2024-04-26T23:10:07.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/2095502661 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0c7ca0 0x7f4eac072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:07.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/2095502661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac163ff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:07.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- 172.21.15.148:0/2095502661 >> 172.21.15.148:0/2095502661 conn(0x7f4eac06c380 msgr2=0x7f4eac06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:07.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- 172.21.15.148:0/2095502661 shutdown_connections 2024-04-26T23:10:07.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- 172.21.15.148:0/2095502661 wait complete. 2024-04-26T23:10:07.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 Processor -- start 2024-04-26T23:10:07.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- start start 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0c72c0 0x7f4eac149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0c7ca0 0x7f4eac0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0c92b0 con 0x7f4eac15a570 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0c9130 con 0x7f4eac0c72c0 2024-04-26T23:10:07.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb2c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac16d170 con 0x7f4eac0c7ca0 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58988/0 (socket says 172.21.15.148:58988) 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 -- 172.21.15.148:0/3751610949 learned_addr learned my addr 172.21.15.148:0/3751610949 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eabe00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0c72c0 0x7f4eac149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eab400640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0c7ca0 0x7f4eac0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 -- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0c7ca0 msgr2=0x7f4eac0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0c7ca0 0x7f4eac0cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 -- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0c72c0 msgr2=0x7f4eac149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0c72c0 0x7f4eac149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.906+0000 7f4eb0c00640 1 -- 172.21.15.148:0/3751610949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac0cb030 con 0x7f4eac15a570 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4eb0c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007ea0 tx=0x7f4ea4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401a070 con 0x7f4eac15a570 2024-04-26T23:10:07.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea40039a0 con 0x7f4eac15a570 2024-04-26T23:10:07.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4003db0 con 0x7f4eac15a570 2024-04-26T23:10:07.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac0ccaa0 con 0x7f4eac15a570 2024-04-26T23:10:07.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac0cb5b0 con 0x7f4eac15a570 2024-04-26T23:10:07.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac0cc890 con 0x7f4eac15a570 2024-04-26T23:10:07.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ea401d070 con 0x7f4eac15a570 2024-04-26T23:10:07.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:07.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4ea4086fe0 con 0x7f4eac15a570 2024-04-26T23:10:07.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.910+0000 7f4eabe00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:07.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.914+0000 7f4eabe00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ae000 tx=0x7f4e9c0a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:07.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:07.918+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ea4010070 con 0x7f4eac15a570 2024-04-26T23:10:08.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4eac077c20 con 0x7f4eac15a570 2024-04-26T23:10:08.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4ea3e00640 1 -- 172.21.15.148:0/3751610949 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f4ea4056ad0 con 0x7f4eac15a570 2024-04-26T23:10:08.146 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 msgr2=0x7f4e8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ae000 tx=0x7f4e9c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 msgr2=0x7f4eac162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007ea0 tx=0x7f4ea4007f90 comp rx=0 tx=0).stop 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.146+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 shutdown_connections 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4e8c068380 0x7f4e8c06a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eac15a570 0x7f4eac162430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0c7ca0 0x7f4eac0cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 --2- 172.21.15.148:0/3751610949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0c72c0 0x7f4eac149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 >> 172.21.15.148:0/3751610949 conn(0x7f4eac06c380 msgr2=0x7f4eac14f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 shutdown_connections 2024-04-26T23:10:08.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.150+0000 7f4eb2c00640 1 -- 172.21.15.148:0/3751610949 wait complete. 2024-04-26T23:10:08.168 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:10:08.169 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:10:08.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:10:08.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:10:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 Processor -- start 2024-04-26T23:10:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 -- start start 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efe880c9cd0 0x7efe88163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880c4780 con 0x7efe88152900 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880c4a20 con 0x7efe880c73a0 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe8ca00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7efe8815bc60 con 0x7efe880c9cd0 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe87400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efe88152900 0x7efe881586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45092/0 (socket says 172.21.15.148:45092) 2024-04-26T23:10:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe87400640 1 -- 172.21.15.148:0/2655396504 learned_addr learned my addr 172.21.15.148:0/2655396504 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe87e00640 1 --2- 172.21.15.148:0/2655396504 >> v2:172.21.15.157:3300/0 conn(0x7efe880c9cd0 0x7efe88163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434700490 0 0) 0x7efe880c4780 con 0x7efe88152900 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.310+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe6c003530 con 0x7efe88152900 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1965743361 0 0) 0x7efe6c003530 con 0x7efe88152900 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 >> v2:172.21.15.157:3300/0 conn(0x7efe880c9cd0 msgr2=0x7efe88163fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 --2- 172.21.15.148:0/2655396504 >> v2:172.21.15.157:3300/0 conn(0x7efe880c9cd0 0x7efe88163fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 >> v1:172.21.15.157:6789/0 conn(0x7efe880c73a0 legacy=0x7efe880731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8815beb0 con 0x7efe88152900 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7efe78001680 con 0x7efe88152900 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 >> v1:172.21.15.148:6789/0 conn(0x7efe88152900 legacy=0x7efe881586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe6c0039c0 0x7efe6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 0x7efe6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c0051d0 0x7efe6c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efe8815bc60 con 0x7efe6c004810 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c00c080 con 0x7efe6c0051d0 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c00c280 con 0x7efe6c0039c0 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 0x7efe6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe87400640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe6c0039c0 0x7efe6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe87e00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c0051d0 0x7efe6c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 -- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe6c0039c0 msgr2=0x7efe6c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe6c0039c0 0x7efe6c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 -- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c0051d0 msgr2=0x7efe6c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c0051d0 0x7efe6c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe86a00640 1 -- 172.21.15.148:0/2655396504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c003530 con 0x7efe6c004810 2024-04-26T23:10:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.314+0000 7efe87e00640 1 -- 172.21.15.148:0/2655396504 reap_dead start 2024-04-26T23:10:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe86a00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 0x7efe6c004c90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe74001750 tx=0x7efe7401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea54e5d1ae28658f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe740013a0 con 0x7efe6c004810 2024-04-26T23:10:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe740052f0 con 0x7efe6c004810 2024-04-26T23:10:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe86000640 1 -- 172.21.15.148:0/2655396504 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74003840 con 0x7efe6c004810 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 msgr2=0x7efe6c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 0x7efe6c004c90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe74001750 tx=0x7efe7401c3c0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- 172.21.15.148:0/2655396504 shutdown_connections 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 --2- 172.21.15.148:0/2655396504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe6c004810 0x7efe6c004c90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- 172.21.15.148:0/2655396504 >> 172.21.15.148:0/2655396504 conn(0x7efe8806e0a0 msgr2=0x7efe8806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- 172.21.15.148:0/2655396504 shutdown_connections 2024-04-26T23:10:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- 172.21.15.148:0/2655396504 wait complete. 2024-04-26T23:10:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 Processor -- start 2024-04-26T23:10:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- start start 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c004810 0x7efe881edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe880ccb30 0x7efe881e4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 0x7efe880cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efe8815c990 con 0x7efe880cb3f0 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efe8815c470 con 0x7efe6c004810 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe8ca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efe880cbdb0 con 0x7efe880ccb30 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 0x7efe880cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 0x7efe880cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59008/0 (socket says 172.21.15.148:59008) 2024-04-26T23:10:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 learned_addr learned my addr 172.21.15.148:0/3637126207 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe87400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c004810 0x7efe881edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.318+0000 7efe86a00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe880ccb30 0x7efe881e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe880ccb30 msgr2=0x7efe881e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe880ccb30 0x7efe881e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c004810 msgr2=0x7efe881edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe6c004810 0x7efe881edfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880cc300 con 0x7efe880cb3f0 2024-04-26T23:10:08.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87e00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 0x7efe880cb870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe880ca140 tx=0x7efe80011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8001c640 con 0x7efe880cb3f0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8001c800 con 0x7efe880cb3f0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8001cbf0 con 0x7efe880cb3f0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe880cc5e0 con 0x7efe880cb3f0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe88153160 con 0x7efe880cb3f0 2024-04-26T23:10:08.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe8ca00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 0x7efe88147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efe88152ce0 con 0x7efe880c98c0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 0x7efe88147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87400640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe880506d0 con 0x7efe880c98c0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe87400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 0x7efe88147d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe780077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78012ab0 con 0x7efe880c98c0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe8001b3e0 con 0x7efe880cb3f0 2024-04-26T23:10:08.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efe68068280 0x7efe6806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.322+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efe800892b0 con 0x7efe880cb3f0 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe86a00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efe68068280 0x7efe6806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efe7801a070 con 0x7efe880c98c0 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 msgr2=0x7efe88147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe7f400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 0x7efe88147d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe780077b0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 msgr2=0x7efe88147d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe7f400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c98c0 0x7efe88147d20 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe780077b0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.326+0000 7efe86a00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efe68068280 0x7efe6806a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe880c77a0 tx=0x7efe740011a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe8ca00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 0x7efe881f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efe880cb110 con 0x7efe88148260 2024-04-26T23:10:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe87400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 0x7efe881f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe87400640 1 -- 172.21.15.148:0/3637126207 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe88150c30 con 0x7efe88148260 2024-04-26T23:10:08.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe87400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 0x7efe881f0ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe78007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.330+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78015710 con 0x7efe88148260 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5071 (secure 0 0 0) 0x7efe78015710 con 0x7efe88148260 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 msgr2=0x7efe881f0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe7f400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 0x7efe881f0ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe78007900 comp rx=0 tx=0).stop 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe7f400640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 msgr2=0x7efe881f0ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe7f400640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe88148260 0x7efe881f0ae0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe780072f0 tx=0x7efe78007900 comp rx=0 tx=0).stop 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:08.333 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 85147, 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 11, 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:08.334 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.335 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.336 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.337 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.338 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:08.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.343 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.344 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.345 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.347 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.348 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:08.349 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:08.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efe68068280 msgr2=0x7efe6806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efe68068280 0x7efe6806a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe880c77a0 tx=0x7efe740011a0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 msgr2=0x7efe880cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 --2- 172.21.15.148:0/3637126207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880cb3f0 0x7efe880cb870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe880ca140 tx=0x7efe80011790 comp rx=0 tx=0).stop 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 reap_dead start 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe87e00640 1 -- 172.21.15.148:0/3637126207 reap_dead start 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 shutdown_connections 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 >> 172.21.15.148:0/3637126207 conn(0x7efe8806e0a0 msgr2=0x7efe88150510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 shutdown_connections 2024-04-26T23:10:08.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.334+0000 7efe8ca00640 1 -- 172.21.15.148:0/3637126207 wait complete. 2024-04-26T23:10:08.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:08.353 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:10:08.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:10:08.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 Processor -- start 2024-04-26T23:10:08.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 -- start start 2024-04-26T23:10:08.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54152d00 0x7f4f540c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f54073230 0x7f4f54073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f54073bb0 con 0x7f4f54158a80 2024-04-26T23:10:08.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f4f540c4b30 con 0x7f4f54073230 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f5a000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4f540c6f60 con 0x7f4f54152d00 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f54073230 0x7f4f54073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f54073230 0x7f4f54073670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59026/0 (socket says 172.21.15.148:59026) 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 -- 172.21.15.148:0/118247404 learned_addr learned my addr 172.21.15.148:0/118247404 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f53400640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54152d00 0x7f4f540c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 -- 172.21.15.148:0/118247404 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54152d00 msgr2=0x7f4f540c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54152d00 0x7f4f540c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 -- 172.21.15.148:0/118247404 >> v1:172.21.15.157:6789/0 conn(0x7f4f54158a80 legacy=0x7f4f54158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.494+0000 7f4f52a00640 1 -- 172.21.15.148:0/118247404 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f540c7240 con 0x7f4f54073230 2024-04-26T23:10:08.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f52a00640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f54073670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f4001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47642b956543698b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f52000640 1 -- 172.21.15.148:0/118247404 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400b2070 con 0x7f4f54073230 2024-04-26T23:10:08.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f52000640 1 -- 172.21.15.148:0/118247404 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f400a9070 con 0x7f4f54073230 2024-04-26T23:10:08.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f52000640 1 -- 172.21.15.148:0/118247404 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400ad880 con 0x7f4f54073230 2024-04-26T23:10:08.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 -- 172.21.15.148:0/118247404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 msgr2=0x7f4f54073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f54073670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f4001c560 comp rx=0 tx=0).stop 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 -- 172.21.15.148:0/118247404 shutdown_connections 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f54073670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 --2- 172.21.15.148:0/118247404 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54152d00 0x7f4f540c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 -- 172.21.15.148:0/118247404 >> 172.21.15.148:0/118247404 conn(0x7f4f540c9d10 msgr2=0x7f4f540ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 -- 172.21.15.148:0/118247404 shutdown_connections 2024-04-26T23:10:08.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.498+0000 7f4f5a000640 1 -- 172.21.15.148:0/118247404 wait complete. 2024-04-26T23:10:08.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 Processor -- start 2024-04-26T23:10:08.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- start start 2024-04-26T23:10:08.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f541f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f54152d00 0x7f4f5414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54158a80 0x7f4f541625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540c4890 con 0x7f4f54073230 2024-04-26T23:10:08.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540c4710 con 0x7f4f54152d00 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4f54165c20 con 0x7f4f54158a80 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f541f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f541f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59028/0 (socket says 172.21.15.148:59028) 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 -- 172.21.15.148:0/4241875227 learned_addr learned my addr 172.21.15.148:0/4241875227 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53e00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54158a80 0x7f4f541625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f54152d00 0x7f4f5414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54158a80 msgr2=0x7f4f541625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f54158a80 0x7f4f541625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f54152d00 msgr2=0x7f4f5414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f54152d00 0x7f4f5414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f540ccb40 con 0x7f4f54073230 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f54152d00 0x7f4f5414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f53400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f541f8740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e8a0 tx=0x7f4f4400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44017070 con 0x7f4f54073230 2024-04-26T23:10:08.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4400c940 con 0x7f4f54073230 2024-04-26T23:10:08.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f540cce20 con 0x7f4f54073230 2024-04-26T23:10:08.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400ccf0 con 0x7f4f54073230 2024-04-26T23:10:08.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.502+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5414dcb0 con 0x7f4f54073230 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f5a000640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 0x7f4f54162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54077c20 con 0x7f4f5414de80 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 0x7f4f54162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f52a00640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f54149ed0 con 0x7f4f5414de80 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f4401a070 con 0x7f4f54073230 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 0x7f4f54162b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f540c4540 tx=0x7f4f4001ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4f34068380 0x7f4f3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4f440870d0 con 0x7f4f54073230 2024-04-26T23:10:08.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400bc030 con 0x7f4f5414de80 2024-04-26T23:10:08.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f53e00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4f34068380 0x7f4f3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4f400ada40 con 0x7f4f5414de80 2024-04-26T23:10:08.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 msgr2=0x7f4f54162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 0x7f4f54162b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f540c4540 tx=0x7f4f4001ada0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 msgr2=0x7f4f54162b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f4b400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f5414de80 0x7f4f54162b20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.506+0000 7f4f53e00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4f34068380 0x7f4f3406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0012f0 tx=0x7f4f4c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 0x7f4f540cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540cc080 con 0x7f4f540cb720 2024-04-26T23:10:08.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 0x7f4f540cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f52a00640 1 -- 172.21.15.148:0/4241875227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f540766a0 con 0x7f4f540cb720 2024-04-26T23:10:08.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f52a00640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 0x7f4f540cbb40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f40019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400bc040 con 0x7f4f540cb720 2024-04-26T23:10:08.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7f4f400c2ce0 con 0x7f4f540cb720 2024-04-26T23:10:08.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 msgr2=0x7f4f540cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 0x7f4f540cbb40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f40019300 comp rx=0 tx=0).stop 2024-04-26T23:10:08.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 msgr2=0x7f4f540cbb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f4b400640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f540cb720 0x7f4f540cbb40 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f40019300 comp rx=0 tx=0).stop 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 27055, 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 12, 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:08.528 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4f34068380 msgr2=0x7f4f3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4f34068380 0x7f4f3406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0012f0 tx=0x7f4f4c009040 comp rx=0 tx=0).stop 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 msgr2=0x7f4f541f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 --2- 172.21.15.148:0/4241875227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f54073230 0x7f4f541f8740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e8a0 tx=0x7f4f4400eca0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f53e00640 1 -- 172.21.15.148:0/4241875227 reap_dead start 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f53e00640 1 -- 172.21.15.148:0/4241875227 reap_dead start 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 shutdown_connections 2024-04-26T23:10:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 >> 172.21.15.148:0/4241875227 conn(0x7f4f540c9d10 msgr2=0x7f4f54070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 shutdown_connections 2024-04-26T23:10:08.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.514+0000 7f4f5a000640 1 -- 172.21.15.148:0/4241875227 wait complete. 2024-04-26T23:10:08.533 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:08.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:10:08.534 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:10:08.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.670+0000 7fe9f1600640 1 Processor -- start 2024-04-26T23:10:08.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.670+0000 7fe9f1600640 1 -- start start 2024-04-26T23:10:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9f1600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9ec153eb0 0x7fe9ec15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9f1600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0c96a0 con 0x7fe9ec06f460 2024-04-26T23:10:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9f1600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0c9980 con 0x7fe9ec06ff50 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9f1600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec15ac00 con 0x7fe9ec153eb0 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9eaa00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe9ec06f460 0x7fe9ec06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45100/0 (socket says 172.21.15.148:45100) 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9eaa00640 1 -- 172.21.15.148:0/2061936245 learned_addr learned my addr 172.21.15.148:0/2061936245 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2061936245 >> v2:172.21.15.157:3300/0 conn(0x7fe9ec153eb0 0x7fe9ec15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611421478 0 0) 0x7fe9ec0c96a0 con 0x7fe9ec06f460 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9d0003530 con 0x7fe9ec06f460 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9e2000640 1 -- 172.21.15.148:0/2061936245 >> v1:172.21.15.157:6789/0 conn(0x7fe9ec06ff50 legacy=0x7fe9ec0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2545531466 0 0) 0x7fe9d0003530 con 0x7fe9ec06f460 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9e2000640 1 -- 172.21.15.148:0/2061936245 >> v1:172.21.15.148:6789/0 conn(0x7fe9ec06f460 legacy=0x7fe9ec06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.674+0000 7fe9e2000640 1 -- 172.21.15.148:0/2061936245 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec070610 con 0x7fe9ec153eb0 2024-04-26T23:10:08.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2061936245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec153eb0 0x7fe9ec15a6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90bc7be6c9e565c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40b5070 con 0x7fe9ec153eb0 2024-04-26T23:10:08.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d40a8630 con 0x7fe9ec153eb0 2024-04-26T23:10:08.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9ea000640 1 -- 172.21.15.148:0/2061936245 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc001a00 con 0x7fe9ec153eb0 2024-04-26T23:10:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- 172.21.15.148:0/2061936245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec153eb0 msgr2=0x7fe9ec15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2061936245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec153eb0 0x7fe9ec15a6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401ebb0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- 172.21.15.148:0/2061936245 shutdown_connections 2024-04-26T23:10:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2061936245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec153eb0 0x7fe9ec15a6c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- 172.21.15.148:0/2061936245 >> 172.21.15.148:0/2061936245 conn(0x7fe9ec0c9d10 msgr2=0x7fe9ec0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- 172.21.15.148:0/2061936245 shutdown_connections 2024-04-26T23:10:08.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- 172.21.15.148:0/2061936245 wait complete. 2024-04-26T23:10:08.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 Processor -- start 2024-04-26T23:10:08.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.678+0000 7fe9f1600640 1 -- start start 2024-04-26T23:10:08.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 0x7fe9ec14abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec06ff50 0x7fe9ec1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec0cc2d0 0x7fe9ec151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c4d70 con 0x7fe9ec06f460 2024-04-26T23:10:08.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c5120 con 0x7fe9ec06ff50 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c4ef0 con 0x7fe9ec0cc2d0 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 0x7fe9ec14abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 0x7fe9ec14abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59036/0 (socket says 172.21.15.148:59036) 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 -- 172.21.15.148:0/2657793036 learned_addr learned my addr 172.21.15.148:0/2657793036 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec06ff50 0x7fe9ec1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eb400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec0cc2d0 0x7fe9ec151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec0cc2d0 msgr2=0x7fe9ec151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec0cc2d0 0x7fe9ec151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec06ff50 msgr2=0x7fe9ec1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec06ff50 0x7fe9ec1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec156d30 con 0x7fe9ec06f460 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9ec06ff50 0x7fe9ec1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9eaa00640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 0x7fe9ec14abc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0018c0 tx=0x7fe9dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc017070 con 0x7fe9ec06f460 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc012400 con 0x7fe9ec06f460 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec156fa0 con 0x7fe9ec06f460 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc012830 con 0x7fe9ec06f460 2024-04-26T23:10:08.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec1f1c00 con 0x7fe9ec06f460 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 0x7fe9ec1f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec1f1a60 con 0x7fe9ec153eb0 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 0x7fe9ec1f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.682+0000 7fe9e2000640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9ec157560 con 0x7fe9ec153eb0 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 0x7fe9ec1f5050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06d800 tx=0x7fe9d401d3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9dc01a070 con 0x7fe9ec06f460 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe9c80683b0 0x7fe9c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe9dc086d60 con 0x7fe9ec06f460 2024-04-26T23:10:08.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40c0030 con 0x7fe9ec153eb0 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9eb400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe9c80683b0 0x7fe9c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe9d40a8d40 con 0x7fe9ec153eb0 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 msgr2=0x7fe9ec1f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 0x7fe9ec1f5050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06d800 tx=0x7fe9d401d3f0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 msgr2=0x7fe9ec1f5050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9e3400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec153eb0 0x7fe9ec1f5050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.686+0000 7fe9eb400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe9c80683b0 0x7fe9c806a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000f70 tx=0x7fe9e4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.690+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 0x7fe9ec1f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.690+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec1f21f0 con 0x7fe9ec1f26e0 2024-04-26T23:10:08.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.690+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 0x7fe9ec1f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e2000640 1 -- 172.21.15.148:0/2657793036 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9ec077c20 con 0x7fe9ec1f26e0 2024-04-26T23:10:08.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e2000640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 0x7fe9ec1f5590 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9d401b7c0 tx=0x7fe9d401b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40c0040 con 0x7fe9ec1f26e0 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7fe9d4003c60 con 0x7fe9ec1f26e0 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 msgr2=0x7fe9ec1f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 0x7fe9ec1f5590 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9d401b7c0 tx=0x7fe9d401b950 comp rx=0 tx=0).stop 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 msgr2=0x7fe9ec1f5590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9e3400640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9ec1f26e0 0x7fe9ec1f5590 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9d401b7c0 tx=0x7fe9d401b950 comp rx=0 tx=0).stop 2024-04-26T23:10:08.694 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 38, 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 351541, 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:08.695 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 12, 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.696 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:08.698 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:08.699 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:08.700 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.701 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.702 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.703 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:08.704 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:08.707 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.708 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.709 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.710 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:08.712 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:08.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe9c80683b0 msgr2=0x7fe9c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe9c80683b0 0x7fe9c806a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000f70 tx=0x7fe9e4009040 comp rx=0 tx=0).stop 2024-04-26T23:10:08.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 msgr2=0x7fe9ec14abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 --2- 172.21.15.148:0/2657793036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec06f460 0x7fe9ec14abc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0018c0 tx=0x7fe9dc00a430 comp rx=0 tx=0).stop 2024-04-26T23:10:08.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9eb400640 1 -- 172.21.15.148:0/2657793036 reap_dead start 2024-04-26T23:10:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9eb400640 1 -- 172.21.15.148:0/2657793036 reap_dead start 2024-04-26T23:10:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 shutdown_connections 2024-04-26T23:10:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 >> 172.21.15.148:0/2657793036 conn(0x7fe9ec0c9d10 msgr2=0x7fe9ec1599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 shutdown_connections 2024-04-26T23:10:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.694+0000 7fe9f1600640 1 -- 172.21.15.148:0/2657793036 wait complete. 2024-04-26T23:10:08.714 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:08.715 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-26T23:10:08.715 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:10:08.715 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T23:10:08.715 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:10:08.715 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:10:08.715 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:10:08.728 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:10:08.728 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:10:08.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:08.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 Processor -- start 2024-04-26T23:10:08.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 -- start start 2024-04-26T23:10:08.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c7b80 0x7f48cc0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48cc0c9010 0x7f48cc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0c99e0 con 0x7f48cc153af0 2024-04-26T23:10:08.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc15dec0 con 0x7f48cc0c9010 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d4400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc0ca630 con 0x7f48cc0c7b80 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d2400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48cc0c9010 0x7f48cc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d1a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f48cc153af0 0x7f48cc15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45102/0 (socket says 172.21.15.148:45102) 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d1a00640 1 -- 172.21.15.148:0/68657473 learned_addr learned my addr 172.21.15.148:0/68657473 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.938+0000 7f48d1000640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c7b80 0x7f48cc0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d2400640 1 -- 172.21.15.148:0/68657473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c7b80 msgr2=0x7f48cc0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:08.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d2400640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c7b80 0x7f48cc0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d2400640 1 -- 172.21.15.148:0/68657473 >> v1:172.21.15.148:6789/0 conn(0x7f48cc153af0 legacy=0x7f48cc15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d2400640 1 -- 172.21.15.148:0/68657473 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0c9d90 con 0x7f48cc0c9010 2024-04-26T23:10:08.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d2400640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c9010 0x7f48cc0c94a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f48c40097c0 tx=0x7f48c401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1fc964e341a705 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48cbe00640 1 -- 172.21.15.148:0/68657473 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40b5070 con 0x7f48cc0c9010 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48cbe00640 1 -- 172.21.15.148:0/68657473 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40a8990 con 0x7f48cc0c9010 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48cbe00640 1 -- 172.21.15.148:0/68657473 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40a8d60 con 0x7f48cc0c9010 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 -- 172.21.15.148:0/68657473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c9010 msgr2=0x7f48cc0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c9010 0x7f48cc0c94a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f48c40097c0 tx=0x7f48c401ec90 comp rx=0 tx=0).stop 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 -- 172.21.15.148:0/68657473 shutdown_connections 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c9010 0x7f48cc0c94a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 --2- 172.21.15.148:0/68657473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c7b80 0x7f48cc0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 -- 172.21.15.148:0/68657473 >> 172.21.15.148:0/68657473 conn(0x7f48cc06c380 msgr2=0x7f48cc06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 -- 172.21.15.148:0/68657473 shutdown_connections 2024-04-26T23:10:08.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.942+0000 7f48d4400640 1 -- 172.21.15.148:0/68657473 wait complete. 2024-04-26T23:10:08.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 Processor -- start 2024-04-26T23:10:08.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- start start 2024-04-26T23:10:08.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c9010 0x7f48cc14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 0x7f48cc1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc15cfb0 con 0x7f48cc0c7b80 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0ca350 con 0x7f48cc153af0 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc15d290 con 0x7f48cc0c9010 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d2400640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 msgr2=0x7f48cc1596d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d2400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 0x7f48cc1596d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59066/0 (socket says 172.21.15.148:59066) 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 -- 172.21.15.148:0/3068297333 learned_addr learned my addr 172.21.15.148:0/3068297333 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1000640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c9010 0x7f48cc14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 -- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c9010 msgr2=0x7f48cc14fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c9010 0x7f48cc14fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 -- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 msgr2=0x7f48cc1596d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 0x7f48cc1596d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 -- 172.21.15.148:0/3068297333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc1f5cb0 con 0x7f48cc0c7b80 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d1a00640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48c000caa0 tx=0x7f48c000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0017070 con 0x7f48cc0c7b80 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c000ac00 con 0x7f48cc0c7b80 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc0cdea0 con 0x7f48cc0c7b80 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0012400 con 0x7f48cc0c7b80 2024-04-26T23:10:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.946+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1f4ef0 con 0x7f48cc0c7b80 2024-04-26T23:10:08.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc077c20 con 0x7f48cc0c7b80 2024-04-26T23:10:08.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48c001a070 con 0x7f48cc0c7b80 2024-04-26T23:10:08.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48c9600640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 0x7f48ac06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:08.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f48c0086a40 con 0x7f48cc0c7b80 2024-04-26T23:10:08.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48d1000640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 0x7f48ac06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:08.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.950+0000 7f48d1000640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 0x7f48ac06a7f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48cc151b20 tx=0x7f48b8009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:08.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:08.954+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f48cc0c99e0 con 0x7f48cc0c7b80 2024-04-26T23:10:09.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f48cc072a00 con 0x7f48cc0c7b80 2024-04-26T23:10:09.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48c9600640 1 -- 172.21.15.148:0/3068297333 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f48c00565a0 con 0x7f48cc0c7b80 2024-04-26T23:10:09.170 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 msgr2=0x7f48ac06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 0x7f48ac06a7f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48cc151b20 tx=0x7f48b8009190 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 msgr2=0x7f48cc1e3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48c000caa0 tx=0x7f48c000cf60 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 shutdown_connections 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f48ac068330 0x7f48ac06a7f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48cc153af0 0x7f48cc1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48cc0c9010 0x7f48cc14fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 --2- 172.21.15.148:0/3068297333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc0c7b80 0x7f48cc1e3ba0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 >> 172.21.15.148:0/3068297333 conn(0x7f48cc06c380 msgr2=0x7f48cc06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.170+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 shutdown_connections 2024-04-26T23:10:09.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:09.174+0000 7f48d4400640 1 -- 172.21.15.148:0/3068297333 wait complete. 2024-04-26T23:10:12.191 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:12.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 Processor -- start 2024-04-26T23:10:12.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 -- start start 2024-04-26T23:10:12.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c800c8e20 0x7f5c80159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 0x7f5c80153a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8015a1e0 con 0x7f5c8006c380 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8006c870 con 0x7f5c800c8e20 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c85e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8006cb50 con 0x7f5c800c80e0 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7e000640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f5c8006c380 legacy=0x7f5c800c79d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7f400640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 msgr2=0x7f5c80153a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c800c8e20 0x7f5c80159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7f400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 0x7f5c80153a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c800c8e20 0x7f5c80159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59070/0 (socket says 172.21.15.148:59070) 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 -- 172.21.15.148:0/2513218725 learned_addr learned my addr 172.21.15.148:0/2513218725 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 -- 172.21.15.148:0/2513218725 >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 msgr2=0x7f5c80153a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 --2- 172.21.15.148:0/2513218725 >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 0x7f5c80153a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 -- 172.21.15.148:0/2513218725 >> v1:172.21.15.157:6789/0 conn(0x7f5c8006c380 legacy=0x7f5c800c79d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:12.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.342+0000 7f5c7ea00640 1 -- 172.21.15.148:0/2513218725 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8015d430 con 0x7f5c800c8e20 2024-04-26T23:10:12.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c7ea00640 1 --2- 172.21.15.148:0/2513218725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c80159ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbb76e0060870ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c7d600640 1 -- 172.21.15.148:0/2513218725 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700b5070 con 0x7f5c800c8e20 2024-04-26T23:10:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c7d600640 1 -- 172.21.15.148:0/2513218725 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c700a89f0 con 0x7f5c800c8e20 2024-04-26T23:10:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c7d600640 1 -- 172.21.15.148:0/2513218725 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700a8dc0 con 0x7f5c800c8e20 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 -- 172.21.15.148:0/2513218725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 msgr2=0x7f5c80159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 --2- 172.21.15.148:0/2513218725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c80159ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7001ecf0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 -- 172.21.15.148:0/2513218725 shutdown_connections 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 --2- 172.21.15.148:0/2513218725 >> v2:172.21.15.157:3300/0 conn(0x7f5c800c80e0 0x7f5c80153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 --2- 172.21.15.148:0/2513218725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c80159ca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 -- 172.21.15.148:0/2513218725 >> 172.21.15.148:0/2513218725 conn(0x7f5c800ce2c0 msgr2=0x7f5c800ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 -- 172.21.15.148:0/2513218725 shutdown_connections 2024-04-26T23:10:12.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.346+0000 7f5c85e00640 1 -- 172.21.15.148:0/2513218725 wait complete. 2024-04-26T23:10:12.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 Processor -- start 2024-04-26T23:10:12.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- start start 2024-04-26T23:10:12.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 0x7f5c80150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c800c80e0 0x7f5c8015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8015df10 con 0x7f5c800c8e20 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8015d9f0 con 0x7f5c8006c380 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8015e090 con 0x7f5c800c80e0 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7ea00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 msgr2=0x7f5c80150f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7ea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 0x7f5c80150f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59078/0 (socket says 172.21.15.148:59078) 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 -- 172.21.15.148:0/4019533415 learned_addr learned my addr 172.21.15.148:0/4019533415 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7e000640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c800c80e0 0x7f5c8015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:12.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 -- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c800c80e0 msgr2=0x7f5c8015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c800c80e0 0x7f5c8015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 -- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 msgr2=0x7f5c80150f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 0x7f5c80150f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 -- 172.21.15.148:0/4019533415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8015ae60 con 0x7f5c800c8e20 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c7f400640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800be80 tx=0x7f5c7800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78016430 con 0x7f5c800c8e20 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78010030 con 0x7f5c800c8e20 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c800c5a10 con 0x7f5c800c8e20 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78016810 con 0x7f5c800c8e20 2024-04-26T23:10:12.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.350+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c800c2bd0 con 0x7f5c800c8e20 2024-04-26T23:10:12.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c80077c20 con 0x7f5c800c8e20 2024-04-26T23:10:12.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c780060d0 con 0x7f5c800c8e20 2024-04-26T23:10:12.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c77400640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 0x7f5c6006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:12.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5c78087280 con 0x7f5c800c8e20 2024-04-26T23:10:12.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c7ea00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 0x7f5c6006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:12.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.354+0000 7f5c7ea00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 0x7f5c6006a7f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c700b2000 tx=0x7f5c70008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:12.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.358+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c78056d50 con 0x7f5c800c8e20 2024-04-26T23:10:12.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.578+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5c8015b030 con 0x7f5c800c8e20 2024-04-26T23:10:12.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.578+0000 7f5c77400640 1 -- 172.21.15.148:0/4019533415 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f5c7805b050 con 0x7f5c800c8e20 2024-04-26T23:10:12.578 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 msgr2=0x7f5c6006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 0x7f5c6006a7f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c700b2000 tx=0x7f5c70008040 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 msgr2=0x7f5c8015b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800be80 tx=0x7f5c7800beb0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 shutdown_connections 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5c60068330 0x7f5c6006a7f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c800c8e20 0x7f5c8015b880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c800c80e0 0x7f5c8015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 --2- 172.21.15.148:0/4019533415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c8006c380 0x7f5c80150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 >> 172.21.15.148:0/4019533415 conn(0x7f5c800ce2c0 msgr2=0x7f5c800ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 shutdown_connections 2024-04-26T23:10:12.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:12.582+0000 7f5c85e00640 1 -- 172.21.15.148:0/4019533415 wait complete. 2024-04-26T23:10:13.633 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:10:13.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:10:15.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:15.742 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T23:10:15.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T23:10:15.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.750+0000 7f225b800640 1 Processor -- start 2024-04-26T23:10:15.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.750+0000 7f225b800640 1 -- start start 2024-04-26T23:10:15.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f225b800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 0x7f22540ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f225b800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22540b47e0 0x7f225406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f225b800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22540cb7f0 con 0x7f22540c63f0 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f225b800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f22540c9e80 con 0x7f22540b47e0 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f225b800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f22540ca0d0 con 0x7f22541574b0 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2258e00640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 msgr2=0x7f22540ca730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2253e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22540b47e0 0x7f225406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2258e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 0x7f22540ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2259800640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f22540c63f0 0x7f22540cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45108/0 (socket says 172.21.15.148:45108) 2024-04-26T23:10:15.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2259800640 1 -- 172.21.15.148:0/859358264 learned_addr learned my addr 172.21.15.148:0/859358264 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2253e00640 1 -- 172.21.15.148:0/859358264 >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 msgr2=0x7f22540ca730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2253e00640 1 --2- 172.21.15.148:0/859358264 >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 0x7f22540ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2253e00640 1 -- 172.21.15.148:0/859358264 >> v1:172.21.15.148:6789/0 conn(0x7f22540c63f0 legacy=0x7f22540cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.754+0000 7f2253e00640 1 -- 172.21.15.148:0/859358264 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22540cba90 con 0x7f22540b47e0 2024-04-26T23:10:15.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f2253e00640 1 --2- 172.21.15.148:0/859358264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22540b47e0 0x7f225406feb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22540c6850 tx=0x7f224001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2392c011e0b52158 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:15.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f2253400640 1 -- 172.21.15.148:0/859358264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400b1070 con 0x7f22540b47e0 2024-04-26T23:10:15.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f2253400640 1 -- 172.21.15.148:0/859358264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22400ac5f0 con 0x7f22540b47e0 2024-04-26T23:10:15.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f2253400640 1 -- 172.21.15.148:0/859358264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400ac9c0 con 0x7f22540b47e0 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- 172.21.15.148:0/859358264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22540b47e0 msgr2=0x7f225406feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- 172.21.15.148:0/859358264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22540b47e0 0x7f225406feb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22540c6850 tx=0x7f224001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- 172.21.15.148:0/859358264 shutdown_connections 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- 172.21.15.148:0/859358264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22540b47e0 0x7f225406feb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- 172.21.15.148:0/859358264 >> v2:172.21.15.157:3300/0 conn(0x7f22541574b0 0x7f22540ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- 172.21.15.148:0/859358264 >> 172.21.15.148:0/859358264 conn(0x7f2254071160 msgr2=0x7f2254068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- 172.21.15.148:0/859358264 shutdown_connections 2024-04-26T23:10:15.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- 172.21.15.148:0/859358264 wait complete. 2024-04-26T23:10:15.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 Processor -- start 2024-04-26T23:10:15.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- start start 2024-04-26T23:10:15.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22540b47e0 0x7f2254154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 0x7f225414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22540703f0 con 0x7f22541574b0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f22540ccc90 con 0x7f22540c63f0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.758+0000 7f225b800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2254070570 con 0x7f22540b47e0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2253e00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 msgr2=0x7f225414b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2253e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 0x7f225414b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59100/0 (socket says 172.21.15.148:59100) 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 -- 172.21.15.148:0/2994947714 learned_addr learned my addr 172.21.15.148:0/2994947714 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2258e00640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22540b47e0 0x7f2254154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 -- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22540b47e0 msgr2=0x7f2254154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22540b47e0 0x7f2254154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 -- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 msgr2=0x7f225414b3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 0x7f225414b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:15.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 -- 172.21.15.148:0/2994947714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22541567d0 con 0x7f22541574b0 2024-04-26T23:10:15.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2259800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f224c00caa0 tx=0x7f224c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:15.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c017070 con 0x7f22541574b0 2024-04-26T23:10:15.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c00aba0 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2254155f30 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c012400 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541564f0 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2254077c20 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.762+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f224c01a070 con 0x7f22541574b0 2024-04-26T23:10:15.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.766+0000 7f2250c00640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 0x7f223406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:15.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.766+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f224c086a00 con 0x7f22541574b0 2024-04-26T23:10:15.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.766+0000 7f2258e00640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 0x7f223406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:15.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.766+0000 7f2258e00640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 0x7f223406a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2248006fd0 tx=0x7f2248008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:15.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:15.770+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f224c0564d0 con 0x7f22541574b0 2024-04-26T23:10:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f22540d01a0 con 0x7f22541574b0 2024-04-26T23:10:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f2250c00640 1 -- 172.21.15.148:0/2994947714 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f224c05a7d0 con 0x7f22541574b0 2024-04-26T23:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 msgr2=0x7f223406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 0x7f223406a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2248006fd0 tx=0x7f2248008040 comp rx=0 tx=0).stop 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 msgr2=0x7f22541f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f224c00caa0 tx=0x7f224c00cf60 comp rx=0 tx=0).stop 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 shutdown_connections 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2234068330 0x7f223406a7f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22541574b0 0x7f22541f9120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:16.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22540c63f0 0x7f225414b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:16.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 --2- 172.21.15.148:0/2994947714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22540b47e0 0x7f2254154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:16.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 >> 172.21.15.148:0/2994947714 conn(0x7f2254071160 msgr2=0x7f22540cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:16.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 shutdown_connections 2024-04-26T23:10:16.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:16.058+0000 7f225b800640 1 -- 172.21.15.148:0/2994947714 wait complete. 2024-04-26T23:10:19.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:19.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.226+0000 7fc646400640 1 Processor -- start 2024-04-26T23:10:19.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.226+0000 7fc646400640 1 -- start start 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.226+0000 7fc646400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc646400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc640072e90 con 0x7fc640072a40 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc646400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6400c9190 con 0x7fc6400708f0 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc646400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc6400c8f40 con 0x7fc640152120 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc636a00640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7fc6400708f0 legacy=0x7fc6400c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc63f400640 1 -- >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 msgr2=0x7fc6401589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc63f400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc63fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc640072a40 0x7fc64006fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33970/0 (socket says 172.21.15.148:33970) 2024-04-26T23:10:19.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.230+0000 7fc63fe00640 1 -- 172.21.15.148:0/756432147 learned_addr learned my addr 172.21.15.148:0/756432147 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:19.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.434+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 msgr2=0x7fc6401589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:19.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.434+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v1:172.21.15.157:6789/0 conn(0x7fc6400708f0 legacy=0x7fc6400c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:19.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.434+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:10:19.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.838+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v1:172.21.15.157:6789/0 conn(0x7fc6400708f0 legacy=0x7fc6400c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:19.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.838+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 msgr2=0x7fc6401589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:19.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:19.838+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:10:20.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:20.642+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 msgr2=0x7fc6401589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:20.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:20.642+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v1:172.21.15.157:6789/0 conn(0x7fc6400708f0 legacy=0x7fc6400c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:20.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:20.642+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 msgr2=0x7fc6401589e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.157:3300/0 conn(0x7fc640152120 0x7fc6401589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 -- 172.21.15.148:0/756432147 >> v1:172.21.15.157:6789/0 conn(0x7fc6400708f0 legacy=0x7fc6400c8700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 -- 172.21.15.148:0/756432147 >> v1:172.21.15.148:6789/0 conn(0x7fc640072a40 legacy=0x7fc64006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 -- 172.21.15.148:0/756432147 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc6400c8f40 con 0x7fc61c0061b0 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63d600640 1 -- 172.21.15.148:0/756432147 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c008d20 con 0x7fc61c0036d0 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.230+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:10:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:10:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:10:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.434+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:10:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:10:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:10:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:10:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc63f400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:22.838+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:10:23.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.642+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> v2:172.21.15.148:3300/0 conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:23.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.642+0000 7fc63f400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:23.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.642+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 msgr2=0x7fc61c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:23.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.642+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc61c0036d0 0x7fc61c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.642+0000 7fc636a00640 1 -- 172.21.15.148:0/756432147 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400c7c20 con 0x7fc61c0061b0 2024-04-26T23:10:23.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc636a00640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc61c008670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc628003940 tx=0x7fc62801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5436d61ce76c185d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:23.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc63ea00640 1 -- 172.21.15.148:0/756432147 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6280b1070 con 0x7fc61c0061b0 2024-04-26T23:10:23.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc63ea00640 1 -- 172.21.15.148:0/756432147 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6280ac600 con 0x7fc61c0061b0 2024-04-26T23:10:23.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc63ea00640 1 -- 172.21.15.148:0/756432147 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6280ac9d0 con 0x7fc61c0061b0 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- 172.21.15.148:0/756432147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 msgr2=0x7fc61c008670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc61c008670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc628003940 tx=0x7fc62801d300 comp rx=0 tx=0).stop 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc63fe00640 1 -- 172.21.15.148:0/756432147 reap_dead start 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- 172.21.15.148:0/756432147 shutdown_connections 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 --2- 172.21.15.148:0/756432147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc61c008670 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- 172.21.15.148:0/756432147 >> 172.21.15.148:0/756432147 conn(0x7fc64006c380 msgr2=0x7fc64006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- 172.21.15.148:0/756432147 shutdown_connections 2024-04-26T23:10:23.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- 172.21.15.148:0/756432147 wait complete. 2024-04-26T23:10:23.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 Processor -- start 2024-04-26T23:10:23.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.646+0000 7fc646400640 1 -- start start 2024-04-26T23:10:23.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:23.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 0x7fc6401f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:23.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 0x7fc6401de090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:23.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6400c9470 con 0x7fc61c0061b0 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6400c81e0 con 0x7fc6401f5730 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc640070270 con 0x7fc6400cd330 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc636a00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 msgr2=0x7fc6401f15b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc636a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 0x7fc6401f15b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39266/0 (socket says 172.21.15.148:39266) 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 -- 172.21.15.148:0/3428591902 learned_addr learned my addr 172.21.15.148:0/3428591902 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63fe00640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 0x7fc6401de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 -- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 msgr2=0x7fc6401de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 0x7fc6401de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 -- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 msgr2=0x7fc6401f15b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 0x7fc6401f15b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 -- 172.21.15.148:0/3428591902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401de9b0 con 0x7fc61c0061b0 2024-04-26T23:10:23.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63fe00640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 0x7fc6401de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:23.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc63f400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc630005710 tx=0x7fc630009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:23.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630018680 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630018820 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401dec90 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630018bd0 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401f4f30 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.650+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640077c20 con 0x7fc61c0061b0 2024-04-26T23:10:23.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.654+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc630021400 con 0x7fc61c0061b0 2024-04-26T23:10:23.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.654+0000 7fc637e00640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 0x7fc61c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:23.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.654+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc630087ff0 con 0x7fc61c0061b0 2024-04-26T23:10:23.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.654+0000 7fc636a00640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 0x7fc61c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:23.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.654+0000 7fc636a00640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 0x7fc61c06df40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc61c006180 tx=0x7fc6280ae040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:23.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.658+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc630026060 con 0x7fc61c0061b0 2024-04-26T23:10:23.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.906+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc6401f1af0 con 0x7fc61c0061b0 2024-04-26T23:10:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.906+0000 7fc637e00640 1 -- 172.21.15.148:0/3428591902 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fc630013050 con 0x7fc61c0061b0 2024-04-26T23:10:23.907 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":42,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 msgr2=0x7fc61c06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 0x7fc61c06df40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc61c006180 tx=0x7fc6280ae040 comp rx=0 tx=0).stop 2024-04-26T23:10:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 msgr2=0x7fc64014d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc630005710 tx=0x7fc630009ed0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 shutdown_connections 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc61c06ba80 0x7fc61c06df40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6400cd330 0x7fc6401de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6401f5730 0x7fc6401f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 --2- 172.21.15.148:0/3428591902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc61c0061b0 0x7fc64014d110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 >> 172.21.15.148:0/3428591902 conn(0x7fc64006c380 msgr2=0x7fc6401e34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 shutdown_connections 2024-04-26T23:10:23.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:23.910+0000 7fc646400640 1 -- 172.21.15.148:0/3428591902 wait complete. 2024-04-26T23:10:23.929 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:10:23.929 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:10:23.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:10:24.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 Processor -- start 2024-04-26T23:10:24.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 -- start start 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c15ca70 con 0x7f0f6c0cabf0 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6c0c9df0 con 0x7f0f6c0c8360 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f72200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c15cce0 con 0x7f0f6c0cafd0 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f70e00640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f0f6c0cabf0 legacy=0x7f0f6c15c360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39282/0 (socket says 172.21.15.148:39282) 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 -- 172.21.15.148:0/2225450775 learned_addr learned my addr 172.21.15.148:0/2225450775 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f71800640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 -- 172.21.15.148:0/2225450775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 msgr2=0x7f0f6c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c06d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 -- 172.21.15.148:0/2225450775 >> v1:172.21.15.157:6789/0 conn(0x7f0f6c0cabf0 legacy=0x7f0f6c15c360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:24.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.070+0000 7f0f6be00640 1 -- 172.21.15.148:0/2225450775 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c0ca950 con 0x7f0f6c0c8360 2024-04-26T23:10:24.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f6be00640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009870 tx=0x7f0f5801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c33b1f2db018a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f6b400640 1 -- 172.21.15.148:0/2225450775 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580b0070 con 0x7f0f6c0c8360 2024-04-26T23:10:24.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f6b400640 1 -- 172.21.15.148:0/2225450775 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f580ab600 con 0x7f0f6c0c8360 2024-04-26T23:10:24.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f6b400640 1 -- 172.21.15.148:0/2225450775 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580ab9d0 con 0x7f0f6c0c8360 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 -- 172.21.15.148:0/2225450775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 msgr2=0x7f0f6c15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009870 tx=0x7f0f5801c520 comp rx=0 tx=0).stop 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 -- 172.21.15.148:0/2225450775 shutdown_connections 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 --2- 172.21.15.148:0/2225450775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c15fcb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 -- 172.21.15.148:0/2225450775 >> 172.21.15.148:0/2225450775 conn(0x7f0f6c070ce0 msgr2=0x7f0f6c0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:24.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 -- 172.21.15.148:0/2225450775 shutdown_connections 2024-04-26T23:10:24.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.074+0000 7f0f72200640 1 -- 172.21.15.148:0/2225450775 wait complete. 2024-04-26T23:10:24.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 Processor -- start 2024-04-26T23:10:24.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- start start 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f6c0cabf0 0x7f0f6c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c0c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0c9630 con 0x7f0f6c0c8360 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0ca020 con 0x7f0f6c0cabf0 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c15be40 con 0x7f0f6c0cafd0 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f6be00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f6c0cabf0 msgr2=0x7f0f6c14ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f6be00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f6c0cabf0 0x7f0f6c14ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39288/0 (socket says 172.21.15.148:39288) 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 -- 172.21.15.148:0/632620530 learned_addr learned my addr 172.21.15.148:0/632620530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f71800640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c0c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 msgr2=0x7f0f6c0c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c0c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f6c0cabf0 msgr2=0x7f0f6c14ad90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f6c0cabf0 0x7f0f6c14ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c158e70 con 0x7f0f6c0c8360 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f71800640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f6c0cafd0 0x7f0f6c0c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f70e00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c158850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b7d0 tx=0x7f0f5c00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00c9c0 con 0x7f0f6c0c8360 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c010070 con 0x7f0f6c0c8360 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c1f55b0 con 0x7f0f6c0c8360 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ce00 con 0x7f0f6c0c8360 2024-04-26T23:10:24.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c1f5b70 con 0x7f0f6c0c8360 2024-04-26T23:10:24.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.078+0000 7f0f72200640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 0x7f0f6c0c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0506d0 con 0x7f0f6c14ca40 2024-04-26T23:10:24.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f6be00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 0x7f0f6c0c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f6be00640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f6c1663b0 con 0x7f0f6c14ca40 2024-04-26T23:10:24.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f6be00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 0x7f0f6c0c2e30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cf250 tx=0x7f0f5801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580ba070 con 0x7f0f6c14ca40 2024-04-26T23:10:24.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f5c01e3f0 con 0x7f0f6c0c8360 2024-04-26T23:10:24.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f4c0682b0 0x7f0f4c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0f5c086f80 con 0x7f0f6c0c8360 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0f58004220 con 0x7f0f6c14ca40 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 msgr2=0x7f0f6c0c2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 0x7f0f6c0c2e30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cf250 tx=0x7f0f5801ad60 comp rx=0 tx=0).stop 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 msgr2=0x7f0f6c0c2e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f68c00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c14ca40 0x7f0f6c0c2e30 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cf250 tx=0x7f0f5801ad60 comp rx=0 tx=0).stop 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f71800640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f4c0682b0 0x7f0f4c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.082+0000 7f0f71800640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f4c0682b0 0x7f0f4c06a770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba10 tx=0x7f0f64008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 0x7f0f6c1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0c9bd0 con 0x7f0f6c1580e0 2024-04-26T23:10:24.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f6be00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 0x7f0f6c1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f6be00640 1 -- 172.21.15.148:0/632620530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f6c1f62f0 con 0x7f0f6c1580e0 2024-04-26T23:10:24.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f6be00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 0x7f0f6c1f5db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801cdc0 tx=0x7f0f58009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580c6070 con 0x7f0f6c1580e0 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5060 (secure 0 0 0) 0x7f0f580c4070 con 0x7f0f6c1580e0 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 msgr2=0x7f0f6c1f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 0x7f0f6c1f5db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801cdc0 tx=0x7f0f58009240 comp rx=0 tx=0).stop 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 msgr2=0x7f0f6c1f5db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:24.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f68c00640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c1580e0 0x7f0f6c1f5db0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f5801cdc0 tx=0x7f0f58009240 comp rx=0 tx=0).stop 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 42, 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 100903, 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:24.092 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.093 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.094 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:24.095 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.096 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.098 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.102 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.104 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.105 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:24.105 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:24.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f4c0682b0 msgr2=0x7f0f4c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f4c0682b0 0x7f0f4c06a770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400ba10 tx=0x7f0f64008040 comp rx=0 tx=0).stop 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 msgr2=0x7f0f6c158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f72200640 1 --2- 172.21.15.148:0/632620530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f6c0c8360 0x7f0f6c158850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b7d0 tx=0x7f0f5c00bc90 comp rx=0 tx=0).stop 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.090+0000 7f0f71800640 1 -- 172.21.15.148:0/632620530 reap_dead start 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.094+0000 7f0f71800640 1 -- 172.21.15.148:0/632620530 reap_dead start 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.094+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 shutdown_connections 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.094+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 >> 172.21.15.148:0/632620530 conn(0x7f0f6c070ce0 msgr2=0x7f0f6c15b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.094+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 shutdown_connections 2024-04-26T23:10:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.094+0000 7f0f72200640 1 -- 172.21.15.148:0/632620530 wait complete. 2024-04-26T23:10:24.110 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:10:24.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:10:24.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:10:24.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.250+0000 7f233fc00640 1 Processor -- start 2024-04-26T23:10:24.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.250+0000 7f233fc00640 1 -- start start 2024-04-26T23:10:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233fc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23380c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233fc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23380c4b30 con 0x7f233815c070 2024-04-26T23:10:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233fc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23380c6f60 con 0x7f2338152d00 2024-04-26T23:10:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233fc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f23380c7240 con 0x7f2338073940 2024-04-26T23:10:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 -- >> v1:172.21.15.157:6789/0 conn(0x7f2338152d00 legacy=0x7f2338073230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.157:6789/0 2024-04-26T23:10:24.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233dc00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f233815c070 0x7f233815c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33978/0 (socket says 172.21.15.148:33978) 2024-04-26T23:10:24.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233dc00640 1 -- 172.21.15.148:0/966666722 learned_addr learned my addr 172.21.15.148:0/966666722 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:24.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337e00640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23380c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627656900 0 0) 0x7f23380c4b30 con 0x7f233815c070 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2320003530 con 0x7f233815c070 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3603234049 0 0) 0x7f2320003530 con 0x7f233815c070 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 msgr2=0x7f23380c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23380c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 >> v1:172.21.15.157:6789/0 conn(0x7f2338152d00 legacy=0x7f2338073230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380c7520 con 0x7f233815c070 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f2330001a00 con 0x7f233815c070 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 >> v1:172.21.15.148:6789/0 conn(0x7f233815c070 legacy=0x7f233815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f2320003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23200043c0 0x7f2320004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23200050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23380c7240 con 0x7f23200039f0 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f232000ba00 con 0x7f23200043c0 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f232000bc00 con 0x7f2338073940 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337e00640 1 -- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23200043c0 msgr2=0x7f2320004890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f2320003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f2337e00640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23200043c0 0x7f2320004890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233dc00640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23200050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 -- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 msgr2=0x7f23200050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338073940 0x7f23200050f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 -- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23200043c0 msgr2=0x7f2320004890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23200043c0 0x7f2320004890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.254+0000 7f233d200640 1 -- 172.21.15.148:0/966666722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2320003530 con 0x7f23200039f0 2024-04-26T23:10:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233d200640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f2320003df0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f232c003940 tx=0x7f232c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b38579b1331aff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c009520 con 0x7f23200039f0 2024-04-26T23:10:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c003bc0 con 0x7f23200039f0 2024-04-26T23:10:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f2337400640 1 -- 172.21.15.148:0/966666722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c005070 con 0x7f23200039f0 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- 172.21.15.148:0/966666722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 msgr2=0x7f2320003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 --2- 172.21.15.148:0/966666722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f2320003df0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f232c003940 tx=0x7f232c01c440 comp rx=0 tx=0).stop 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233dc00640 1 -- 172.21.15.148:0/966666722 reap_dead start 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- 172.21.15.148:0/966666722 shutdown_connections 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- 172.21.15.148:0/966666722 >> 172.21.15.148:0/966666722 conn(0x7f23380c9d10 msgr2=0x7f23380ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- 172.21.15.148:0/966666722 shutdown_connections 2024-04-26T23:10:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- 172.21.15.148:0/966666722 wait complete. 2024-04-26T23:10:24.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 Processor -- start 2024-04-26T23:10:24.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.258+0000 7f233fc00640 1 -- start start 2024-04-26T23:10:24.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23380c0200 0x7f233814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23381f8ac0 0x7f2338150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2338164c20 con 0x7f23200039f0 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f233815cfc0 con 0x7f23380c0200 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2338164da0 con 0x7f23381f8ac0 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2337e00640 1 -- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23380c0200 msgr2=0x7f233814a010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3300/0 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2337e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23380c0200 0x7f233814a010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39308/0 (socket says 172.21.15.148:39308) 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 -- 172.21.15.148:0/903695423 learned_addr learned my addr 172.21.15.148:0/903695423 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233dc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23381f8ac0 0x7f2338150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23381f8ac0 msgr2=0x7f2338150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23381f8ac0 0x7f2338150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23380c0200 msgr2=0x7f233814a010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23380c0200 0x7f233814a010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2338162220 con 0x7f23200039f0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233d200640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f232c01c270 tx=0x7f2320005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c009520 con 0x7f23200039f0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c003d70 con 0x7f23200039f0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233815e470 con 0x7f23200039f0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c005720 con 0x7f23200039f0 2024-04-26T23:10:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233815ea30 con 0x7f23200039f0 2024-04-26T23:10:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 0x7f2338162700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f233815def0 con 0x7f2338151520 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2337e00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 0x7f2338162700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.262+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f232c0ac420 con 0x7f23200039f0 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2337e00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2338151900 con 0x7f2338151520 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2337e00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 0x7f2338162700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23380cc030 tx=0x7f232400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2318068330 0x7f231806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f232c120680 con 0x7f23200039f0 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f233dc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2318068330 0x7f231806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324017070 con 0x7f2338151520 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f232400c770 con 0x7f2338151520 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 msgr2=0x7f2338162700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 0x7f2338162700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23380cc030 tx=0x7f232400eb50 comp rx=0 tx=0).stop 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 msgr2=0x7f2338162700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f2334c00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338151520 0x7f2338162700 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23380cc030 tx=0x7f232400eb50 comp rx=0 tx=0).stop 2024-04-26T23:10:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.266+0000 7f233dc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2318068330 0x7f231806a7f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2338068df0 tx=0x7f2330009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 0x7f233814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:24.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f233815f1c0 con 0x7f2338162c40 2024-04-26T23:10:24.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2337e00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 0x7f233814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:24.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2337e00640 1 -- 172.21.15.148:0/903695423 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23381641d0 con 0x7f2338162c40 2024-04-26T23:10:24.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2337e00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 0x7f233814f970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2324019000 tx=0x7f2324004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:24.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324017070 con 0x7f2338162c40 2024-04-26T23:10:24.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5201 (secure 0 0 0) 0x7f23240063f0 con 0x7f2338162c40 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 msgr2=0x7f233814f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 0x7f233814f970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2324019000 tx=0x7f2324004740 comp rx=0 tx=0).stop 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 msgr2=0x7f233814f970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f2334c00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2338162c40 0x7f233814f970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:24.275 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 42, 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 367124, 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:24.276 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:24.277 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:24.278 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:24.279 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.280 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.283 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:24.284 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:24.285 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.286 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:10:24.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:24.289 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2318068330 msgr2=0x7f231806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2318068330 0x7f231806a7f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2338068df0 tx=0x7f2330009040 comp rx=0 tx=0).stop 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 msgr2=0x7f233815d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f232c01c270 tx=0x7f2320005840 comp rx=0 tx=0).stop 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233dc00640 1 -- 172.21.15.148:0/903695423 reap_dead start 2024-04-26T23:10:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 shutdown_connections 2024-04-26T23:10:24.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 --2- 172.21.15.148:0/903695423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23200039f0 0x7f233815d9b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:24.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 >> 172.21.15.148:0/903695423 conn(0x7f23380c9d10 msgr2=0x7f23380cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:24.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 shutdown_connections 2024-04-26T23:10:24.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:24.274+0000 7f233fc00640 1 -- 172.21.15.148:0/903695423 wait complete. 2024-04-26T23:10:24.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:10:24.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:10:43.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:10:43.703 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:10:44.295 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:10:44.295 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T23:10:44.295 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:10:44.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:10:44.298 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:10:44.298 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:10:44.299 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:44.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 Processor -- start 2024-04-26T23:10:44.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 -- start start 2024-04-26T23:10:44.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 0x7fc6c00cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c00701a0 con 0x7fc6c00c4470 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c015aa10 con 0x7fc6c0153d80 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6c5e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c0071090 con 0x7fc6c00c5520 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6be000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc6c00c4470 0x7fc6c00c4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:46868/0 (socket says 172.21.15.148:46868) 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bea00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6be000640 1 -- 172.21.15.148:0/1382899255 learned_addr learned my addr 172.21.15.148:0/1382899255 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1382899255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 0x7fc6c00cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bea00640 1 -- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 msgr2=0x7fc6c015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bea00640 1 -- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 msgr2=0x7fc6c015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bea00640 1 --2- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bea00640 1 --2- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:44.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bf400640 1 -- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 msgr2=0x7fc6c015a4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:44.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bf400640 1 -- 172.21.15.148:0/1382899255 >> v1:172.21.15.157:6789/0 conn(0x7fc6c00c4470 legacy=0x7fc6c00c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:44.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.437+0000 7fc6bf400640 1 -- 172.21.15.148:0/1382899255 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c0070480 con 0x7fc6c00c5520 2024-04-26T23:10:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1382899255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 0x7fc6c00cb140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009d90 tx=0x7fc6b801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d16d30776972c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6bd600640 1 -- 172.21.15.148:0/1382899255 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80b4070 con 0x7fc6c00c5520 2024-04-26T23:10:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6bd600640 1 -- 172.21.15.148:0/1382899255 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b80af600 con 0x7fc6c00c5520 2024-04-26T23:10:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6bd600640 1 -- 172.21.15.148:0/1382899255 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80af9d0 con 0x7fc6c00c5520 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1382899255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 msgr2=0x7fc6c00cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1382899255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 0x7fc6c00cb140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009d90 tx=0x7fc6b801f150 comp rx=0 tx=0).stop 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1382899255 shutdown_connections 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1382899255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c00c5520 0x7fc6c00cb140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1382899255 >> v2:172.21.15.157:3300/0 conn(0x7fc6c0153d80 0x7fc6c015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1382899255 >> 172.21.15.148:0/1382899255 conn(0x7fc6c0071f60 msgr2=0x7fc6c0072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1382899255 shutdown_connections 2024-04-26T23:10:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.441+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1382899255 wait complete. 2024-04-26T23:10:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 Processor -- start 2024-04-26T23:10:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- start start 2024-04-26T23:10:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c0153d80 0x7fc6c0149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0070d20 con 0x7fc6c00c4470 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0070a40 con 0x7fc6c00b1ba0 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c0154160 con 0x7fc6c0153d80 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44678/0 (socket says 172.21.15.148:44678) 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 -- 172.21.15.148:0/1248747123 learned_addr learned my addr 172.21.15.148:0/1248747123 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6be000640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c0153d80 0x7fc6c0149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bf400640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 msgr2=0x7fc6c014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bf400640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 msgr2=0x7fc6c014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bf400640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c0153d80 msgr2=0x7fc6c0149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c0153d80 0x7fc6c0149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 msgr2=0x7fc6c014a250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 -- 172.21.15.148:0/1248747123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c00c6e90 con 0x7fc6c00c4470 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6bea00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e7e0 tx=0x7fc6b000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0017020 con 0x7fc6c00c4470 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b000c6d0 con 0x7fc6c00c4470 2024-04-26T23:10:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000f040 con 0x7fc6c00c4470 2024-04-26T23:10:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c00b0530 con 0x7fc6c00c4470 2024-04-26T23:10:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c01f2af0 con 0x7fc6c00c4470 2024-04-26T23:10:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.445+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c0077c20 con 0x7fc6c00c4470 2024-04-26T23:10:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.449+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6b001a020 con 0x7fc6c00c4470 2024-04-26T23:10:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.449+0000 7fc6b7400640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 0x7fc6a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.449+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc6b0086b50 con 0x7fc6c00c4470 2024-04-26T23:10:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.449+0000 7fc6be000640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 0x7fc6a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.449+0000 7fc6be000640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 0x7fc6a006a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00cc180 tx=0x7fc6ac007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:44.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.453+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6b0021020 con 0x7fc6c00c4470 2024-04-26T23:10:44.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc6c00caba0 con 0x7fc6c00c4470 2024-04-26T23:10:44.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6b7400640 1 -- 172.21.15.148:0/1248747123 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fc6c00c6e90 con 0x7fc6c00c4470 2024-04-26T23:10:44.680 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":42,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 msgr2=0x7fc6a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 0x7fc6a006a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00cc180 tx=0x7fc6ac007e90 comp rx=0 tx=0).stop 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 msgr2=0x7fc6c0148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e7e0 tx=0x7fc6b000eca0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 shutdown_connections 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc6a0068380 0x7fc6a006a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6c00b1ba0 0x7fc6c014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6c0153d80 0x7fc6c0149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 --2- 172.21.15.148:0/1248747123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6c00c4470 0x7fc6c0148130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:44.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 >> 172.21.15.148:0/1248747123 conn(0x7fc6c0071f60 msgr2=0x7fc6c00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:44.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 shutdown_connections 2024-04-26T23:10:44.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:44.681+0000 7fc6c5e00640 1 -- 172.21.15.148:0/1248747123 wait complete. 2024-04-26T23:10:47.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:10:47.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 Processor -- start 2024-04-26T23:10:47.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 -- start start 2024-04-26T23:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8f0815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 0x7f8f080c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f080c9d90 con 0x7f8f080c7b80 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8f080ca630 con 0x7f8f080c9720 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f10200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8f080ca070 con 0x7f8f08153af0 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f0ce00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8f080c7b80 0x7f8f080c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:35370/0 (socket says 172.21.15.148:35370) 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.853+0000 7f8f0ce00640 1 -- 172.21.15.148:0/1627931902 learned_addr learned my addr 172.21.15.148:0/1627931902 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8f0815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 0x7f8f080c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171453453 0 0) 0x7f8f080c9d90 con 0x7f8f080c7b80 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef0003530 con 0x7f8f080c7b80 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 msgr2=0x7f8f080c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 msgr2=0x7f8f080c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 0x7f8f080c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 0x7f8f080c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3054344111 0 0) 0x7f8ef0003530 con 0x7f8f080c7b80 2024-04-26T23:10:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 msgr2=0x7f8f0815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8f0815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 msgr2=0x7f8f080c7f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 --2- 172.21.15.148:0/1627931902 >> v2:172.21.15.157:3300/0 conn(0x7f8f080c9720 0x7f8f080c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f080ca350 con 0x7f8f080c7b80 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f8ef4001680 con 0x7f8f080c7b80 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 >> v1:172.21.15.148:6789/0 conn(0x7f8f080c7b80 legacy=0x7f8f080c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8ef00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ef0003f40 0x7f8ef0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef0004d50 0x7f8ef00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080ca630 con 0x7f8ef0004d50 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080ca070 con 0x7f8ef0003f40 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef000bab0 con 0x7f8f08153af0 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef0004d50 0x7f8ef00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8ef00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0ce00640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ef0003f40 0x7f8ef0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 msgr2=0x7f8ef00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f08153af0 0x7f8ef00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ef0003f40 msgr2=0x7f8ef0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ef0003f40 0x7f8ef0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.857+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef0003530 con 0x7f8ef0004d50 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef0004d50 0x7f8ef00051d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f00000ee0 tx=0x7f8f0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91a4d7e37459140 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000f040 con 0x7f8ef0004d50 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f000a9620 con 0x7f8ef0004d50 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f07e00640 1 -- 172.21.15.148:0/1627931902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a9a10 con 0x7f8ef0004d50 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- 172.21.15.148:0/1627931902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef0004d50 msgr2=0x7f8ef00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 --2- 172.21.15.148:0/1627931902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef0004d50 0x7f8ef00051d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f00000ee0 tx=0x7f8f0001c510 comp rx=0 tx=0).stop 2024-04-26T23:10:47.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f0e200640 1 -- 172.21.15.148:0/1627931902 reap_dead start 2024-04-26T23:10:47.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- 172.21.15.148:0/1627931902 shutdown_connections 2024-04-26T23:10:47.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- 172.21.15.148:0/1627931902 >> 172.21.15.148:0/1627931902 conn(0x7f8f0806c380 msgr2=0x7f8f0806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:47.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- 172.21.15.148:0/1627931902 shutdown_connections 2024-04-26T23:10:47.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- 172.21.15.148:0/1627931902 wait complete. 2024-04-26T23:10:47.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 Processor -- start 2024-04-26T23:10:47.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- start start 2024-04-26T23:10:47.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 0x7f8f0814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f08156ee0 0x7f8f081f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f08153ed0 con 0x7f8f0815caa0 2024-04-26T23:10:47.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0815d290 con 0x7f8f08156ee0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f10200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8f08154050 con 0x7f8ef0004d50 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.861+0000 7f8f0ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39850/0 (socket says 172.21.15.148:39850) 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 -- 172.21.15.148:0/1990877925 learned_addr learned my addr 172.21.15.148:0/1990877925 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 0x7f8f0814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0e200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f08156ee0 0x7f8f081f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 -- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 msgr2=0x7f8f0814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 0x7f8f0814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 -- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f08156ee0 msgr2=0x7f8f081f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f08156ee0 0x7f8f081f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 -- 172.21.15.148:0/1990877925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f081f0bc0 con 0x7f8f0815caa0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 0x7f8f0814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f0ce00640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001210 tx=0x7f8ef400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400ee60 con 0x7f8f0815caa0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4018070 con 0x7f8f0815caa0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f08069750 con 0x7f8f0815caa0 2024-04-26T23:10:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400caf0 con 0x7f8f0815caa0 2024-04-26T23:10:47.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081e4d00 con 0x7f8f0815caa0 2024-04-26T23:10:47.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08077c20 con 0x7f8f0815caa0 2024-04-26T23:10:47.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.865+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ef400cc90 con 0x7f8f0815caa0 2024-04-26T23:10:47.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.869+0000 7f8f05600640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 0x7f8ee806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:47.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.869+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8ef4086d10 con 0x7f8f0815caa0 2024-04-26T23:10:47.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.869+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 0x7f8ee806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:47.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.869+0000 7f8f0d800640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 0x7f8ee806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0074d0 tx=0x7f8efc00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:47.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:47.873+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8ef4056e40 con 0x7f8f0815caa0 2024-04-26T23:10:48.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.137+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8f080c8670 con 0x7f8f0815caa0 2024-04-26T23:10:48.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.137+0000 7f8f05600640 1 -- 172.21.15.148:0/1990877925 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f8ef4056740 con 0x7f8f0815caa0 2024-04-26T23:10:48.138 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:10:48.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 msgr2=0x7f8ee806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 0x7f8ee806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0074d0 tx=0x7f8efc00b040 comp rx=0 tx=0).stop 2024-04-26T23:10:48.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 msgr2=0x7f8f081f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001210 tx=0x7f8ef400ec10 comp rx=0 tx=0).stop 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 shutdown_connections 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8ee8068380 0x7f8ee806a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f08156ee0 0x7f8f081f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f0815caa0 0x7f8f081f0680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 --2- 172.21.15.148:0/1990877925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ef0004d50 0x7f8f0814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.145+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 >> 172.21.15.148:0/1990877925 conn(0x7f8f0806c380 msgr2=0x7f8f0806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:48.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.149+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 shutdown_connections 2024-04-26T23:10:48.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.149+0000 7f8f10200640 1 -- 172.21.15.148:0/1990877925 wait complete. 2024-04-26T23:10:48.183 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:10:48.183 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:10:48.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:10:48.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.369+0000 7f22fda00640 1 Processor -- start 2024-04-26T23:10:48.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.369+0000 7f22fda00640 1 -- start start 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22fda00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22fda00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22fda00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80c49e0 con 0x7f22f80c9e80 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22fda00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f22f80cbb50 con 0x7f22f80c44a0 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22fda00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f22f80caf80 con 0x7f22f8157250 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f7400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f22f80c9e80 0x7f22f815d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:35378/0 (socket says 172.21.15.148:35378) 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f7400640 1 -- 172.21.15.148:0/293407260 learned_addr learned my addr 172.21.15.148:0/293407260 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:48.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6a00640 1 --2- 172.21.15.148:0/293407260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6000640 1 --2- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6000640 1 -- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 msgr2=0x7f22f8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6000640 1 -- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 msgr2=0x7f22f8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6000640 1 --2- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6000640 1 --2- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f5600640 1 -- 172.21.15.148:0/293407260 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548264650 0 0) 0x7f22f80c49e0 con 0x7f22f80c9e80 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f5600640 1 -- 172.21.15.148:0/293407260 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22dc003530 con 0x7f22f80c9e80 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6a00640 1 -- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 msgr2=0x7f22f8070440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6a00640 1 --2- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6a00640 1 -- 172.21.15.148:0/293407260 >> v1:172.21.15.148:6789/0 conn(0x7f22f80c9e80 legacy=0x7f22f815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.373+0000 7f22f6a00640 1 -- 172.21.15.148:0/293407260 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80c6450 con 0x7f22f8157250 2024-04-26T23:10:48.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22f6a00640 1 --2- 172.21.15.148:0/293407260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f806ff00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22e80097c0 tx=0x7f22e801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a55e231efb76d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22f5600640 1 -- 172.21.15.148:0/293407260 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80b0070 con 0x7f22f8157250 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22f5600640 1 -- 172.21.15.148:0/293407260 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e80ab600 con 0x7f22f8157250 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22f5600640 1 -- 172.21.15.148:0/293407260 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80ab9d0 con 0x7f22f8157250 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- 172.21.15.148:0/293407260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 msgr2=0x7f22f806ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- 172.21.15.148:0/293407260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f806ff00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22e80097c0 tx=0x7f22e801c410 comp rx=0 tx=0).stop 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- 172.21.15.148:0/293407260 shutdown_connections 2024-04-26T23:10:48.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- 172.21.15.148:0/293407260 >> v2:172.21.15.157:3300/0 conn(0x7f22f80c44a0 0x7f22f8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- 172.21.15.148:0/293407260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f806ff00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- 172.21.15.148:0/293407260 >> 172.21.15.148:0/293407260 conn(0x7f22f8068140 msgr2=0x7f22f8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:48.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- 172.21.15.148:0/293407260 shutdown_connections 2024-04-26T23:10:48.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- 172.21.15.148:0/293407260 wait complete. 2024-04-26T23:10:48.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 Processor -- start 2024-04-26T23:10:48.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- start start 2024-04-26T23:10:48.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f8149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80b26c0 con 0x7f22f80c9e80 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.377+0000 7f22fda00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8157630 con 0x7f22f80c44a0 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22fda00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f22f80b2840 con 0x7f22f8157250 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:42848/0 (socket says 172.21.15.148:42848) 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39864/0 (socket says 172.21.15.148:39864) 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 -- 172.21.15.148:0/1488270498 learned_addr learned my addr 172.21.15.148:0/1488270498 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f7400640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f8149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 msgr2=0x7f22f814bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 msgr2=0x7f22f814bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 msgr2=0x7f22f8149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22f8157250 0x7f22f8149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 msgr2=0x7f22f814bd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:10:48.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22f80c44a0 0x7f22f814bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80afc20 con 0x7f22f80c9e80 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6000640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22e400e810 tx=0x7f22e400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4017030 con 0x7f22f80c9e80 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e400ee00 con 0x7f22f80c9e80 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f80aff00 con 0x7f22f80c9e80 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e400f040 con 0x7f22f80c9e80 2024-04-26T23:10:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f80b04c0 con 0x7f22f80c9e80 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22fda00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 0x7f22f8149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80b0690 con 0x7f22f80b1200 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 0x7f22f8149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22f8077c20 con 0x7f22f80b1200 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 0x7f22f8149d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f22e801aac0 tx=0x7f22e80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.381+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80b8070 con 0x7f22f80b1200 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f22e80093e0 con 0x7f22f80b1200 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 msgr2=0x7f22f8149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 0x7f22f8149d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f22e801aac0 tx=0x7f22e80191b0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 msgr2=0x7f22f8149d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80b1200 0x7f22f8149d50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22e401a070 con 0x7f22f80c9e80 2024-04-26T23:10:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22d8067e20 0x7f22d806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f22e40866d0 con 0x7f22f80c9e80 2024-04-26T23:10:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22d8067e20 0x7f22d806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.385+0000 7f22f6a00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22d8067e20 0x7f22d806a2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22f814c600 tx=0x7f22e8008000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.389+0000 7f22fda00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 0x7f22f814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.389+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81562e0 con 0x7f22f8153530 2024-04-26T23:10:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.389+0000 7f22f7400640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 0x7f22f814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22f7400640 1 -- 172.21.15.148:0/1488270498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22f80ca540 con 0x7f22f8153530 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22f7400640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 0x7f22f814a290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22f00012f0 tx=0x7f22f000f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0017030 con 0x7f22f8153530 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5071 (secure 0 0 0) 0x7f22f000fe50 con 0x7f22f8153530 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 msgr2=0x7f22f814a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 0x7f22f814a290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22f00012f0 tx=0x7f22f000f660 comp rx=0 tx=0).stop 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 msgr2=0x7f22f814a290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22eea00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f8153530 0x7f22f814a290 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22f00012f0 tx=0x7f22f000f660 comp rx=0 tx=0).stop 2024-04-26T23:10:48.392 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 125206, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:48.393 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:48.394 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:48.395 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:48.396 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:48.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:48.398 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:48.399 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.400 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.401 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.402 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:48.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:48.404 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22d8067e20 msgr2=0x7f22d806a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f22d8067e20 0x7f22d806a2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22f814c600 tx=0x7f22e8008000 comp rx=0 tx=0).stop 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 msgr2=0x7f22f80b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22e400e810 tx=0x7f22e400ecd0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22f7400640 1 -- 172.21.15.148:0/1488270498 reap_dead start 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 shutdown_connections 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 --2- 172.21.15.148:0/1488270498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22f80c9e80 0x7f22f80b0cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 >> 172.21.15.148:0/1488270498 conn(0x7f22f8068140 msgr2=0x7f22f806d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 shutdown_connections 2024-04-26T23:10:48.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.393+0000 7f22fda00640 1 -- 172.21.15.148:0/1488270498 wait complete. 2024-04-26T23:10:48.412 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:48.412 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:10:48.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:10:48.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 Processor -- start 2024-04-26T23:10:48.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 -- start start 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6324159450 0x7f632415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6324071610 0x7f63240cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63240cab70 0x7f63240cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f6324070e80 con 0x7f6324071610 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f632415c140 con 0x7f6324159450 2024-04-26T23:10:48.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6323200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6324070ba0 con 0x7f63240cab70 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6324071610 0x7f63240cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6324071610 0x7f63240cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39888/0 (socket says 172.21.15.148:39888) 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 -- 172.21.15.148:0/3008030617 learned_addr learned my addr 172.21.15.148:0/3008030617 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321e00640 1 --2- 172.21.15.148:0/3008030617 >> v2:172.21.15.157:3300/0 conn(0x7f6324159450 0x7f632415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6322800640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63240cab70 0x7f63240cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 -- 172.21.15.148:0/3008030617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63240cab70 msgr2=0x7f63240cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63240cab70 0x7f63240cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 -- 172.21.15.148:0/3008030617 >> v2:172.21.15.157:3300/0 conn(0x7f6324159450 msgr2=0x7f632415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 --2- 172.21.15.148:0/3008030617 >> v2:172.21.15.157:3300/0 conn(0x7f6324159450 0x7f632415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.557+0000 7f6321400640 1 -- 172.21.15.148:0/3008030617 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240ca630 con 0x7f6324071610 2024-04-26T23:10:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6321400640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6324071610 0x7f63240cf220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6324070840 tx=0x7f631001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff0fb57ec490ea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6320a00640 1 -- 172.21.15.148:0/3008030617 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b1070 con 0x7f6324071610 2024-04-26T23:10:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6320a00640 1 -- 172.21.15.148:0/3008030617 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63100ac600 con 0x7f6324071610 2024-04-26T23:10:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6320a00640 1 -- 172.21.15.148:0/3008030617 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100ac9d0 con 0x7f6324071610 2024-04-26T23:10:48.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 -- 172.21.15.148:0/3008030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6324071610 msgr2=0x7f63240cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6324071610 0x7f63240cf220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6324070840 tx=0x7f631001c4f0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 -- 172.21.15.148:0/3008030617 shutdown_connections 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6324071610 0x7f63240cf220 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 --2- 172.21.15.148:0/3008030617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63240cab70 0x7f63240cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 --2- 172.21.15.148:0/3008030617 >> v2:172.21.15.157:3300/0 conn(0x7f6324159450 0x7f632415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 -- 172.21.15.148:0/3008030617 >> 172.21.15.148:0/3008030617 conn(0x7f632406c980 msgr2=0x7f6324068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 -- 172.21.15.148:0/3008030617 shutdown_connections 2024-04-26T23:10:48.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.561+0000 7f6323200640 1 -- 172.21.15.148:0/3008030617 wait complete. 2024-04-26T23:10:48.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 Processor -- start 2024-04-26T23:10:48.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- start start 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6324071610 0x7f632415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 0x7f632415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324159450 0x7f632415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f632415cb10 con 0x7f63240cab70 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f632406f2e0 con 0x7f6324159450 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f632415d0b0 con 0x7f6324071610 2024-04-26T23:10:48.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 0x7f632415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 0x7f632415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39900/0 (socket says 172.21.15.148:39900) 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 -- 172.21.15.148:0/1307552526 learned_addr learned my addr 172.21.15.148:0/1307552526 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6324071610 0x7f632415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6322800640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324159450 0x7f632415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6324071610 msgr2=0x7f632415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6324071610 0x7f632415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324159450 msgr2=0x7f632415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324159450 0x7f632415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240ce780 con 0x7f63240cab70 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6321400640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 0x7f632415aba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f631001cd90 tx=0x7f631001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b1040 con 0x7f63240cab70 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63100bc070 con 0x7f63240cab70 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63240cea60 con 0x7f63240cab70 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b7850 con 0x7f63240cab70 2024-04-26T23:10:48.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632415a3a0 con 0x7f63240cab70 2024-04-26T23:10:48.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.565+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f632415cc90 con 0x7f632415a710 2024-04-26T23:10:48.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63100ac4c0 con 0x7f63240cab70 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f631a000640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6304068380 0x7f630406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6310121100 con 0x7f63240cab70 2024-04-26T23:10:48.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6322800640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6304068380 0x7f630406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.569+0000 7f6322800640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6304068380 0x7f630406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f631c009f00 tx=0x7f631c00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:48.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.773+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:48.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.773+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-26T23:10:48.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.773+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:10:48.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.773+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:48.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:48.773+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:10:49.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.177+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:49.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.177+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-26T23:10:49.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.177+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:10:49.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.177+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:10:49.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.177+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:10:49.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63240506d0 con 0x7f632415a710 2024-04-26T23:10:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63140156f0 tx=0x7f6314015bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314011910 con 0x7f632415a710 2024-04-26T23:10:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6314011910 con 0x7f632415a710 2024-04-26T23:10:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63140156f0 tx=0x7f6314015bb0 comp rx=0 tx=0).stop 2024-04-26T23:10:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 msgr2=0x7f632414aac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.981+0000 7f631a000640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632415a710 0x7f632414aac0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.989+0000 7f6323200640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 0x7f632414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.989+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f632415e0d0 con 0x7f6324156690 2024-04-26T23:10:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.989+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 0x7f632414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6321e00640 1 -- 172.21.15.148:0/1307552526 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f632415efe0 con 0x7f6324156690 2024-04-26T23:10:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6321e00640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 0x7f632414b000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6314016010 tx=0x7f6314004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631402f020 con 0x7f6324156690 2024-04-26T23:10:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4557 (secure 0 0 0) 0x7f63140163d0 con 0x7f6324156690 2024-04-26T23:10:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 msgr2=0x7f632414b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 0x7f632414b000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6314016010 tx=0x7f6314004740 comp rx=0 tx=0).stop 2024-04-26T23:10:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 msgr2=0x7f632414b000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f631a000640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6324156690 0x7f632414b000 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6314016010 tx=0x7f6314004740 comp rx=0 tx=0).stop 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 5611, 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:49.994 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:49.995 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:49.996 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:49.997 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:49.998 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:49.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.000 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:50.001 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:50.003 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:50.004 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:50.005 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:50.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6304068380 msgr2=0x7f630406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6304068380 0x7f630406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f631c009f00 tx=0x7f631c00b040 comp rx=0 tx=0).stop 2024-04-26T23:10:50.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 msgr2=0x7f632415aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 --2- 172.21.15.148:0/1307552526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240cab70 0x7f632415aba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f631001cd90 tx=0x7f631001ad30 comp rx=0 tx=0).stop 2024-04-26T23:10:50.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6322800640 1 -- 172.21.15.148:0/1307552526 reap_dead start 2024-04-26T23:10:50.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6322800640 1 -- 172.21.15.148:0/1307552526 reap_dead start 2024-04-26T23:10:50.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 shutdown_connections 2024-04-26T23:10:50.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 >> 172.21.15.148:0/1307552526 conn(0x7f632406c980 msgr2=0x7f6324068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:50.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 shutdown_connections 2024-04-26T23:10:50.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:49.993+0000 7f6323200640 1 -- 172.21.15.148:0/1307552526 wait complete. 2024-04-26T23:10:50.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:50.016 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:10:50.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:10:50.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 Processor -- start 2024-04-26T23:10:50.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 -- start start 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2fe80744d0 0x7f2fe81651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe806f280 con 0x7f2fe80c7b80 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe806efe0 con 0x7f2fe8153990 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fecc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe815a3b0 con 0x7f2fe80744d0 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2fe80c7b80 0x7f2fe815ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:35388/0 (socket says 172.21.15.148:35388) 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6a00640 1 -- 172.21.15.148:0/2542853995 learned_addr learned my addr 172.21.15.148:0/2542853995 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/2542853995 >> v2:172.21.15.157:3300/0 conn(0x7f2fe80744d0 0x7f2fe81651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175743586 0 0) 0x7f2fe806f280 con 0x7f2fe80c7b80 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fcc003530 con 0x7f2fe80c7b80 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099255771 0 0) 0x7f2fe806efe0 con 0x7f2fe8153990 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe806f280 con 0x7f2fe8153990 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 593452732 0 0) 0x7f2fcc003530 con 0x7f2fe80c7b80 2024-04-26T23:10:50.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 >> v2:172.21.15.157:3300/0 conn(0x7f2fe80744d0 msgr2=0x7f2fe81651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 --2- 172.21.15.148:0/2542853995 >> v2:172.21.15.157:3300/0 conn(0x7f2fe80744d0 0x7f2fe81651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 >> v1:172.21.15.157:6789/0 conn(0x7f2fe8153990 legacy=0x7f2fe80c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe815a690 con 0x7f2fe80c7b80 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f2fd4001680 con 0x7f2fe80c7b80 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 >> v1:172.21.15.148:6789/0 conn(0x7f2fe80c7b80 legacy=0x7f2fe815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 0x7f2fcc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe815a3b0 con 0x7f2fcc003b50 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc00c050 con 0x7f2fcc004810 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.161+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc00c250 con 0x7f2fcc0051d0 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 0x7f2fcc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe6a00640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 -- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc0051d0 msgr2=0x7f2fcc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:50.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 -- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fcc004810 msgr2=0x7f2fcc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:50.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 -- 172.21.15.148:0/2542853995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc003530 con 0x7f2fcc003b50 2024-04-26T23:10:50.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:10:50.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7e00640 1 -- 172.21.15.148:0/2542853995 reap_dead start 2024-04-26T23:10:50.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe7400640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 0x7f2fcc003f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80018d0 tx=0x7f2fd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01d8833453eddc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8001520 con 0x7f2fcc003b50 2024-04-26T23:10:50.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd80052f0 con 0x7f2fcc003b50 2024-04-26T23:10:50.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fe6000640 1 -- 172.21.15.148:0/2542853995 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8003840 con 0x7f2fcc003b50 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fecc00640 1 -- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 msgr2=0x7f2fcc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.165+0000 7f2fecc00640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 0x7f2fcc003f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80018d0 tx=0x7f2fd801c520 comp rx=0 tx=0).stop 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- 172.21.15.148:0/2542853995 shutdown_connections 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 --2- 172.21.15.148:0/2542853995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc003b50 0x7f2fcc003f50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- 172.21.15.148:0/2542853995 >> 172.21.15.148:0/2542853995 conn(0x7f2fe806e420 msgr2=0x7f2fe806e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- 172.21.15.148:0/2542853995 shutdown_connections 2024-04-26T23:10:50.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- 172.21.15.148:0/2542853995 wait complete. 2024-04-26T23:10:50.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 Processor -- start 2024-04-26T23:10:50.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- start start 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc003b50 0x7f2fe815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fe80c65a0 0x7f2fe81f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 0x7f2fe8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80686b0 con 0x7f2fe80c49e0 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8068530 con 0x7f2fe80c65a0 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe815ce10 con 0x7f2fcc003b50 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 0x7f2fe8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 0x7f2fe8158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39920/0 (socket says 172.21.15.148:39920) 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 learned_addr learned my addr 172.21.15.148:0/1927721256 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc003b50 0x7f2fe815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe6a00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fe80c65a0 0x7f2fe81f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc003b50 msgr2=0x7f2fe815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fcc003b50 0x7f2fe815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fe80c65a0 msgr2=0x7f2fe81f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2fe80c65a0 0x7f2fe81f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe81f58b0 con 0x7f2fe80c49e0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fe7e00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 0x7f2fe8158600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8074bc0 tx=0x7f2fe000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000fe50 con 0x7f2fe80c49e0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe00039a0 con 0x7f2fe80c49e0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0003d90 con 0x7f2fe80c49e0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.169+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe81eaba0 con 0x7f2fe80c49e0 2024-04-26T23:10:50.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80c5ac0 con 0x7f2fe80c49e0 2024-04-26T23:10:50.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fecc00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 0x7f2fe80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe815af20 con 0x7f2fe8158b40 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fe7400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 0x7f2fe80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fe001d020 con 0x7f2fe80c49e0 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fe7400640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe8158f20 con 0x7f2fe8158b40 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fe7400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 0x7f2fe80c5c90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8007fd0 tx=0x7f2fcc005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2fe0087760 con 0x7f2fe80c49e0 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80069e0 con 0x7f2fe8158b40 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fe6a00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fe6a00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001ec0 tx=0x7f2fd4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2fd80015c0 con 0x7f2fe8158b40 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 msgr2=0x7f2fe80c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 0x7f2fe80c5c90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8007fd0 tx=0x7f2fcc005840 comp rx=0 tx=0).stop 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 msgr2=0x7f2fe80c5c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.173+0000 7f2fdf400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8158b40 0x7f2fe80c5c90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.181+0000 7f2fecc00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 0x7f2fe8145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.181+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe80506d0 con 0x7f2fe8144c20 2024-04-26T23:10:50.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.181+0000 7f2fe7400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 0x7f2fe8145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.181+0000 7f2fe7400640 1 -- 172.21.15.148:0/1927721256 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fe80c44a0 con 0x7f2fe8144c20 2024-04-26T23:10:50.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fe7400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 0x7f2fe8145000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801c560 tx=0x7f2fd80a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80bdc70 con 0x7f2fe8144c20 2024-04-26T23:10:50.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7f2fd80b5430 con 0x7f2fe8144c20 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 msgr2=0x7f2fe8145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 0x7f2fe8145000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801c560 tx=0x7f2fd80a8000 comp rx=0 tx=0).stop 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 msgr2=0x7f2fe8145000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fdf400640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2fe8144c20 0x7f2fe8145000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:50.185 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 393032, 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:50.186 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:50.187 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:10:50.188 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:10:50.189 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:10:50.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.191 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.192 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:10:50.194 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:10:50.198 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:10:50.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:10:50.199 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:10:50.199 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:10:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2fc8068380 msgr2=0x7f2fc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001ec0 tx=0x7f2fd4009040 comp rx=0 tx=0).stop 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 msgr2=0x7f2fe8158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 --2- 172.21.15.148:0/1927721256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fe80c49e0 0x7f2fe8158600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8074bc0 tx=0x7f2fe000f520 comp rx=0 tx=0).stop 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 reap_dead start 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fe7e00640 1 -- 172.21.15.148:0/1927721256 reap_dead start 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 shutdown_connections 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 >> 172.21.15.148:0/1927721256 conn(0x7f2fe806e420 msgr2=0x7f2fe80c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 shutdown_connections 2024-04-26T23:10:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.185+0000 7f2fecc00640 1 -- 172.21.15.148:0/1927721256 wait complete. 2024-04-26T23:10:50.204 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:10:50.205 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:10:50.205 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:10:50.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.345+0000 7fba7cc00640 1 Processor -- start 2024-04-26T23:10:50.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.345+0000 7fba7cc00640 1 -- start start 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba7cc00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba78155be0 0x7fba78073a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba7cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba7806e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba7cc00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba780729b0 con 0x7fba78068140 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba7cc00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fba780687f0 con 0x7fba78155be0 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba7cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba78068590 con 0x7fba7815f8d0 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba78155be0 0x7fba78073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba76a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fba78068140 0x7fba7815cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:35396/0 (socket says 172.21.15.148:35396) 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba76a00640 1 -- 172.21.15.148:0/466942347 learned_addr learned my addr 172.21.15.148:0/466942347 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:10:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77e00640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba7806e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77400640 1 -- 172.21.15.148:0/466942347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 msgr2=0x7fba7806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:10:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77400640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba7806e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77400640 1 -- 172.21.15.148:0/466942347 >> v1:172.21.15.148:6789/0 conn(0x7fba78068140 legacy=0x7fba7815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba77400640 1 -- 172.21.15.148:0/466942347 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba78072c90 con 0x7fba78155be0 2024-04-26T23:10:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.349+0000 7fba76000640 1 -- 172.21.15.148:0/466942347 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327017378 0 0) 0x7fba780729b0 con 0x7fba78068140 2024-04-26T23:10:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba77400640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba78073a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba680097c0 tx=0x7fba6801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bad12bc70a03ace server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba76000640 1 -- 172.21.15.148:0/466942347 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba680b2070 con 0x7fba78155be0 2024-04-26T23:10:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba76000640 1 -- 172.21.15.148:0/466942347 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba680ad680 con 0x7fba78155be0 2024-04-26T23:10:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba76000640 1 -- 172.21.15.148:0/466942347 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba680ada50 con 0x7fba78155be0 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- 172.21.15.148:0/466942347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 msgr2=0x7fba78073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba78073a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba680097c0 tx=0x7fba6801c470 comp rx=0 tx=0).stop 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- 172.21.15.148:0/466942347 shutdown_connections 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba7806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 --2- 172.21.15.148:0/466942347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba78073a50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- 172.21.15.148:0/466942347 >> 172.21.15.148:0/466942347 conn(0x7fba780ca3c0 msgr2=0x7fba780ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- 172.21.15.148:0/466942347 shutdown_connections 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- 172.21.15.148:0/466942347 wait complete. 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 Processor -- start 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.353+0000 7fba7cc00640 1 -- start start 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba78068140 0x7fba7814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba78148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba7806f200 con 0x7fba78155be0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fba78155fc0 con 0x7fba78068140 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba7806f380 con 0x7fba7815f8d0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39942/0 (socket says 172.21.15.148:39942) 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 -- 172.21.15.148:0/2137576850 learned_addr learned my addr 172.21.15.148:0/2137576850 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba77e00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba78148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba77400640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba78068140 0x7fba7814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 -- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 msgr2=0x7fba78148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba78148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 -- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba78068140 msgr2=0x7fba7814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba78068140 0x7fba7814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 -- 172.21.15.148:0/2137576850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7814fe30 con 0x7fba78155be0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba76a00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba640011f0 tx=0x7fba6400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64018070 con 0x7fba78155be0 2024-04-26T23:10:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba640074e0 con 0x7fba78155be0 2024-04-26T23:10:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba781f5690 con 0x7fba78155be0 2024-04-26T23:10:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64004a10 con 0x7fba78155be0 2024-04-26T23:10:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba781515c0 con 0x7fba78155be0 2024-04-26T23:10:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.357+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba780506d0 con 0x7fba78155be0 2024-04-26T23:10:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.361+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba6401b070 con 0x7fba78155be0 2024-04-26T23:10:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.361+0000 7fba6f400640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 0x7fba5806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:10:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.361+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fba64086010 con 0x7fba78155be0 2024-04-26T23:10:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.361+0000 7fba77400640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 0x7fba5806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:10:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.361+0000 7fba77400640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 0x7fba5806a870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba680af000 tx=0x7fba680a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:10:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.365+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba64055b80 con 0x7fba78155be0 2024-04-26T23:10:50.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.593+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fba781547e0 con 0x7fba78155be0 2024-04-26T23:10:50.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba6f400640 1 -- 172.21.15.148:0/2137576850 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fba64059e80 con 0x7fba78155be0 2024-04-26T23:10:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 msgr2=0x7fba5806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 0x7fba5806a870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba680af000 tx=0x7fba680a7000 comp rx=0 tx=0).stop 2024-04-26T23:10:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 msgr2=0x7fba781523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:10:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba640011f0 tx=0x7fba6400c9b0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 shutdown_connections 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba580683b0 0x7fba5806a870 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba7815f8d0 0x7fba78148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba78155be0 0x7fba781523d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 --2- 172.21.15.148:0/2137576850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba78068140 0x7fba7814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 >> 172.21.15.148:0/2137576850 conn(0x7fba780ca3c0 msgr2=0x7fba78154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 shutdown_connections 2024-04-26T23:10:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:10:50.597+0000 7fba7cc00640 1 -- 172.21.15.148:0/2137576850 wait complete. 2024-04-26T23:10:50.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:11:00.620 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:11:00.620 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:00.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 Processor -- start 2024-04-26T23:11:00.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 -- start start 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa240152bc0 0x7fa2400c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2400c9340 0x7fa240072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2400732b0 0x7fa2400c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fa240152fa0 con 0x7fa2400c9340 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa240073700 con 0x7fa2400732b0 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa247600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa240159790 con 0x7fa240152bc0 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2400c9340 0x7fa240072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2400c9340 0x7fa240072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37972/0 (socket says 172.21.15.148:37972) 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 -- 172.21.15.148:0/1359405013 learned_addr learned my addr 172.21.15.148:0/1359405013 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa245600640 1 --2- 172.21.15.148:0/1359405013 >> v2:172.21.15.157:3300/0 conn(0x7fa2400732b0 0x7fa2400c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa244c00640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa240152bc0 0x7fa2400c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 -- 172.21.15.148:0/1359405013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa240152bc0 msgr2=0x7fa2400c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa240152bc0 0x7fa2400c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 -- 172.21.15.148:0/1359405013 >> v2:172.21.15.157:3300/0 conn(0x7fa2400732b0 msgr2=0x7fa2400c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 --2- 172.21.15.148:0/1359405013 >> v2:172.21.15.157:3300/0 conn(0x7fa2400732b0 0x7fa2400c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.757+0000 7fa23fe00640 1 -- 172.21.15.148:0/1359405013 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa240158930 con 0x7fa2400c9340 2024-04-26T23:11:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa23fe00640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240072d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa240073b80 tx=0x7fa22c020f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b20e0136a59a8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa23f400640 1 -- 172.21.15.148:0/1359405013 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0b7070 con 0x7fa2400c9340 2024-04-26T23:11:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa23f400640 1 -- 172.21.15.148:0/1359405013 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c0aabe0 con 0x7fa2400c9340 2024-04-26T23:11:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa23f400640 1 -- 172.21.15.148:0/1359405013 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0b2440 con 0x7fa2400c9340 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 -- 172.21.15.148:0/1359405013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 msgr2=0x7fa240072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240072d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa240073b80 tx=0x7fa22c020f20 comp rx=0 tx=0).stop 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 -- 172.21.15.148:0/1359405013 shutdown_connections 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240072d70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 --2- 172.21.15.148:0/1359405013 >> v2:172.21.15.157:3300/0 conn(0x7fa2400732b0 0x7fa2400c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 --2- 172.21.15.148:0/1359405013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa240152bc0 0x7fa2400c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 -- 172.21.15.148:0/1359405013 >> 172.21.15.148:0/1359405013 conn(0x7fa24006c380 msgr2=0x7fa24006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 -- 172.21.15.148:0/1359405013 shutdown_connections 2024-04-26T23:11:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.761+0000 7fa247600640 1 -- 172.21.15.148:0/1359405013 wait complete. 2024-04-26T23:11:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 Processor -- start 2024-04-26T23:11:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- start start 2024-04-26T23:11:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2400732b0 0x7fa2401ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa240152bc0 0x7fa24014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401591d0 con 0x7fa2400c9340 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa240158ef0 con 0x7fa240152bc0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2401594b0 con 0x7fa2400732b0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37976/0 (socket says 172.21.15.148:37976) 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 -- 172.21.15.148:0/564646093 learned_addr learned my addr 172.21.15.148:0/564646093 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa244c00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2400732b0 0x7fa2401ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa245600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa240152bc0 0x7fa24014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 -- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2400732b0 msgr2=0x7fa2401ee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2400732b0 0x7fa2401ee1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 -- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa240152bc0 msgr2=0x7fa24014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa240152bc0 0x7fa24014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 -- 172.21.15.148:0/564646093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa240142790 con 0x7fa2400c9340 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23fe00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa22c01f5d0 tx=0x7fa22c01dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0c2070 con 0x7fa2400c9340 2024-04-26T23:11:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c0b0550 con 0x7fa2400c9340 2024-04-26T23:11:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa240141930 con 0x7fa2400c9340 2024-04-26T23:11:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0b7070 con 0x7fa2400c9340 2024-04-26T23:11:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.765+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa240141ef0 con 0x7fa2400c9340 2024-04-26T23:11:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa240077c20 con 0x7fa2400c9340 2024-04-26T23:11:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa22c0c5070 con 0x7fa2400c9340 2024-04-26T23:11:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa23cc00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 0x7fa22006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa22c126840 con 0x7fa2400c9340 2024-04-26T23:11:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa244c00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 0x7fa22006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.769+0000 7fa244c00640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 0x7fa22006a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa230003fd0 tx=0x7fa2300039a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.773+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa22c01aa80 con 0x7fa2400c9340 2024-04-26T23:11:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa240147e90 con 0x7fa2400c9340 2024-04-26T23:11:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa23cc00640 1 -- 172.21.15.148:0/564646093 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fa22c0f68d0 con 0x7fa2400c9340 2024-04-26T23:11:00.988 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 msgr2=0x7fa22006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 0x7fa22006a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa230003fd0 tx=0x7fa2300039a0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 msgr2=0x7fa240143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa22c01f5d0 tx=0x7fa22c01dcc0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 shutdown_connections 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa220068380 0x7fa22006a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa240152bc0 0x7fa24014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2400c9340 0x7fa240143f40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 --2- 172.21.15.148:0/564646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2400732b0 0x7fa2401ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 >> 172.21.15.148:0/564646093 conn(0x7fa24006c380 msgr2=0x7fa2400c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 shutdown_connections 2024-04-26T23:11:00.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:00.989+0000 7fa247600640 1 -- 172.21.15.148:0/564646093 wait complete. 2024-04-26T23:11:01.009 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:11:01.009 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:11:01.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:11:01.009 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:11:01.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.145+0000 7f5fc7600640 1 Processor -- start 2024-04-26T23:11:01.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.145+0000 7f5fc7600640 1 -- start start 2024-04-26T23:11:01.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc7600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 0x7f5fc00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc7600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5fc0073230 0x7f5fc0073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc7600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc0073bb0 con 0x7f5fc0158a80 2024-04-26T23:11:01.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc7600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc00c4b30 con 0x7f5fc0073230 2024-04-26T23:11:01.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc7600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc00c6f60 con 0x7f5fc0152d00 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 0x7f5fc00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc5600640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5fc0158a80 0x7f5fc0158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:48752/0 (socket says 172.21.15.148:48752) 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fbfe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5fc0073230 0x7f5fc0073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc5600640 1 -- 172.21.15.148:0/3633741212 learned_addr learned my addr 172.21.15.148:0/3633741212 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc4c00640 1 -- 172.21.15.148:0/3633741212 >> v2:172.21.15.157:3300/0 conn(0x7f5fc0073230 msgr2=0x7f5fc0073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fbf400640 1 -- 172.21.15.148:0/3633741212 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278402954 0 0) 0x7f5fc0073bb0 con 0x7f5fc0158a80 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/3633741212 >> v2:172.21.15.157:3300/0 conn(0x7f5fc0073230 0x7f5fc0073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc4c00640 1 -- 172.21.15.148:0/3633741212 >> v1:172.21.15.157:6789/0 conn(0x7f5fc0158a80 legacy=0x7f5fc0158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.149+0000 7f5fc4c00640 1 -- 172.21.15.148:0/3633741212 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc00c7240 con 0x7f5fc0152d00 2024-04-26T23:11:01.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/3633741212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 0x7f5fc00c97d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009d90 tx=0x7f5fb001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b7da94060039eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fbf400640 1 -- 172.21.15.148:0/3633741212 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b2070 con 0x7f5fc0152d00 2024-04-26T23:11:01.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fbf400640 1 -- 172.21.15.148:0/3633741212 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb00a5830 con 0x7f5fc0152d00 2024-04-26T23:11:01.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fbf400640 1 -- 172.21.15.148:0/3633741212 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00a5c00 con 0x7f5fc0152d00 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- 172.21.15.148:0/3633741212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 msgr2=0x7f5fc00c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 --2- 172.21.15.148:0/3633741212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 0x7f5fc00c97d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009d90 tx=0x7f5fb001c970 comp rx=0 tx=0).stop 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- 172.21.15.148:0/3633741212 shutdown_connections 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 --2- 172.21.15.148:0/3633741212 >> v2:172.21.15.157:3300/0 conn(0x7f5fc0073230 0x7f5fc0073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 --2- 172.21.15.148:0/3633741212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0152d00 0x7f5fc00c97d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- 172.21.15.148:0/3633741212 >> 172.21.15.148:0/3633741212 conn(0x7f5fc00c9d10 msgr2=0x7f5fc00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- 172.21.15.148:0/3633741212 shutdown_connections 2024-04-26T23:11:01.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- 172.21.15.148:0/3633741212 wait complete. 2024-04-26T23:11:01.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 Processor -- start 2024-04-26T23:11:01.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.153+0000 7f5fc7600640 1 -- start start 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0073230 0x7f5fc00ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fc0152d00 0x7f5fc01f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 0x7f5fc01f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00c4890 con 0x7f5fc0158a80 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00c4710 con 0x7f5fc0152d00 2024-04-26T23:11:01.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc0165c20 con 0x7f5fc0073230 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 0x7f5fc01f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 0x7f5fc01f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37988/0 (socket says 172.21.15.148:37988) 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0073230 0x7f5fc00ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 learned_addr learned my addr 172.21.15.148:0/4294569099 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fbfe00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fc0152d00 0x7f5fc01f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0073230 msgr2=0x7f5fc00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fc0073230 0x7f5fc00ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fc0152d00 msgr2=0x7f5fc01f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fc0152d00 0x7f5fc01f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc00cc730 con 0x7f5fc0158a80 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fbfe00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fc0152d00 0x7f5fc01f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:11:01.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc5600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 0x7f5fc01f6520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800c4b0 tx=0x7f5fb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8018070 con 0x7f5fc0158a80 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb80074e0 con 0x7f5fc0158a80 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8004a30 con 0x7f5fc0158a80 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc01f3150 con 0x7f5fc0158a80 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc00cccd0 con 0x7f5fc0158a80 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 0x7f5fc0145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0077c20 con 0x7f5fc00cc230 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 0x7f5fc0145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc4c00640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fc00c5e10 con 0x7f5fc00cc230 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.157+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 0x7f5fc0145580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00c4540 tx=0x7f5fb0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00be070 con 0x7f5fc00cc230 2024-04-26T23:11:01.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5fb8004bd0 con 0x7f5fc0158a80 2024-04-26T23:11:01.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5fa00682b0 0x7f5fa006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5fb8085f60 con 0x7f5fc0158a80 2024-04-26T23:11:01.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5fb00b3040 con 0x7f5fc00cc230 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 msgr2=0x7f5fc0145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 0x7f5fc0145580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00c4540 tx=0x7f5fb0019710 comp rx=0 tx=0).stop 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 msgr2=0x7f5fc0145580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbcc00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc00cc230 0x7f5fc0145580 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00c4540 tx=0x7f5fb0019710 comp rx=0 tx=0).stop 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbfe00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5fa00682b0 0x7f5fa006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.161+0000 7f5fbfe00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5fa00682b0 0x7f5fa006a770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00c8920 tx=0x7f5fac008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.165+0000 7f5fc7600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 0x7f5fc0145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.165+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00766a0 con 0x7f5fc01f59e0 2024-04-26T23:11:01.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.165+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 0x7f5fc0145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.165+0000 7f5fc4c00640 1 -- 172.21.15.148:0/4294569099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5fc0068fd0 con 0x7f5fc01f59e0 2024-04-26T23:11:01.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.165+0000 7f5fc4c00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 0x7f5fc0145ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0158a50 tx=0x7f5fb00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b2040 con 0x7f5fc01f59e0 2024-04-26T23:11:01.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5072 (secure 0 0 0) 0x7f5fb0009a50 con 0x7f5fc01f59e0 2024-04-26T23:11:01.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 msgr2=0x7f5fc0145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 0x7f5fc0145ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0158a50 tx=0x7f5fb00a7000 comp rx=0 tx=0).stop 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 msgr2=0x7f5fc0145ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fbcc00640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc01f59e0 0x7f5fc0145ac0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0158a50 tx=0x7f5fb00a7000 comp rx=0 tx=0).stop 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 137982, 2024-04-26T23:11:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 13, 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:11:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:01.181 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5fa00682b0 msgr2=0x7f5fa006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5fa00682b0 0x7f5fa006a770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00c8920 tx=0x7f5fac008040 comp rx=0 tx=0).stop 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 msgr2=0x7f5fc01f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 --2- 172.21.15.148:0/4294569099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc0158a80 0x7f5fc01f6520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800c4b0 tx=0x7f5fb800c970 comp rx=0 tx=0).stop 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 reap_dead start 2024-04-26T23:11:01.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc5600640 1 -- 172.21.15.148:0/4294569099 reap_dead start 2024-04-26T23:11:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 shutdown_connections 2024-04-26T23:11:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 >> 172.21.15.148:0/4294569099 conn(0x7f5fc00c9d10 msgr2=0x7f5fc0073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 shutdown_connections 2024-04-26T23:11:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.169+0000 7f5fc7600640 1 -- 172.21.15.148:0/4294569099 wait complete. 2024-04-26T23:11:01.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:01.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:11:01.186 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:11:01.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.321+0000 7f0493600640 1 Processor -- start 2024-04-26T23:11:01.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.321+0000 7f0493600640 1 -- start start 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0493600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f048c073940 0x7f048c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0493600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c15c070 0x7f048c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0493600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0c4b30 con 0x7f048c152d00 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0493600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f048c0c6f60 con 0x7f048c073940 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0493600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f048c0c7240 con 0x7f048c15c070 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0490c00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f048c152d00 0x7f048c073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51352/0 (socket says 172.21.15.148:51352) 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0490c00640 1 -- 172.21.15.148:0/3990472844 learned_addr learned my addr 172.21.15.148:0/3990472844 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 --2- 172.21.15.148:0/3990472844 >> v2:172.21.15.148:3300/0 conn(0x7f048c073940 0x7f048c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0491600640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c15c070 0x7f048c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f048be00640 1 -- 172.21.15.148:0/3990472844 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550096443 0 0) 0x7f048c0c4b30 con 0x7f048c152d00 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f048be00640 1 -- 172.21.15.148:0/3990472844 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0470003530 con 0x7f048c152d00 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 -- 172.21.15.148:0/3990472844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c15c070 msgr2=0x7f048c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c15c070 0x7f048c15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 -- 172.21.15.148:0/3990472844 >> v1:172.21.15.148:6789/0 conn(0x7f048c152d00 legacy=0x7f048c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 -- 172.21.15.148:0/3990472844 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c0c7520 con 0x7f048c073940 2024-04-26T23:11:01.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.325+0000 7f0483e00640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c073940 0x7f048c0c97d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04740097c0 tx=0x7f047401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3a46998efba45d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f048be00640 1 -- 172.21.15.148:0/3990472844 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740ab640 con 0x7f048c073940 2024-04-26T23:11:01.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f048be00640 1 -- 172.21.15.148:0/3990472844 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04740b0070 con 0x7f048c073940 2024-04-26T23:11:01.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f048be00640 1 -- 172.21.15.148:0/3990472844 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740aba00 con 0x7f048c073940 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- 172.21.15.148:0/3990472844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c073940 msgr2=0x7f048c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c073940 0x7f048c0c97d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04740097c0 tx=0x7f047401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- 172.21.15.148:0/3990472844 shutdown_connections 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c15c070 0x7f048c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- 172.21.15.148:0/3990472844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c073940 0x7f048c0c97d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- 172.21.15.148:0/3990472844 >> 172.21.15.148:0/3990472844 conn(0x7f048c0c9d10 msgr2=0x7f048c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- 172.21.15.148:0/3990472844 shutdown_connections 2024-04-26T23:11:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- 172.21.15.148:0/3990472844 wait complete. 2024-04-26T23:11:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 Processor -- start 2024-04-26T23:11:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- start start 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c073940 0x7f048c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c152d00 0x7f048c1f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 0x7f048c13f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f048c15cfb0 con 0x7f048c15c070 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f048c15ce30 con 0x7f048c073940 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0493600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f048c165c20 con 0x7f048c152d00 2024-04-26T23:11:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0491600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 0x7f048c13f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0491600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 0x7f048c13f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38032/0 (socket says 172.21.15.148:38032) 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 learned_addr learned my addr 172.21.15.148:0/4152990071 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0490c00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c073940 0x7f048c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.329+0000 7f0483e00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c152d00 0x7f048c1f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c152d00 msgr2=0x7f048c1f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f048c152d00 0x7f048c1f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c073940 msgr2=0x7f048c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c073940 0x7f048c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c0cb3e0 con 0x7f048c15c070 2024-04-26T23:11:01.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0491600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 0x7f048c13f9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0484007e70 tx=0x7f048400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484014420 con 0x7f048c15c070 2024-04-26T23:11:01.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0484019070 con 0x7f048c15c070 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c159e70 con 0x7f048c15c070 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484014820 con 0x7f048c15c070 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c14f190 con 0x7f048c15c070 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0493600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 0x7f048c13ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f048c159c40 con 0x7f048c151fe0 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0490c00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 0x7f048c13ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0490c00640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f048c077c20 con 0x7f048c151fe0 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04840149c0 con 0x7f048c15c070 2024-04-26T23:11:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0490c00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 0x7f048c13ff20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f047c005890 tx=0x7f047c00fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0468068380 0x7f046806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0484087560 con 0x7f048c15c070 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0058c0 con 0x7f048c151fe0 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0483e00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0468068380 0x7f046806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.333+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f047c018070 con 0x7f048c151fe0 2024-04-26T23:11:01.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.337+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 msgr2=0x7f048c13ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.337+0000 7f0489600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 0x7f048c13ff20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f047c005890 tx=0x7f047c00fc00 comp rx=0 tx=0).stop 2024-04-26T23:11:01.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.337+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 msgr2=0x7f048c13ff20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.337+0000 7f0489600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c151fe0 0x7f048c13ff20 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f047c005890 tx=0x7f047c00fc00 comp rx=0 tx=0).stop 2024-04-26T23:11:01.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.337+0000 7f0483e00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0468068380 0x7f046806a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04740af000 tx=0x7f04740a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0493600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 0x7f048c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f048c1615a0 con 0x7f048c0cbc30 2024-04-26T23:11:01.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0490c00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 0x7f048c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0490c00640 1 -- 172.21.15.148:0/4152990071 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f048c076010 con 0x7f048c0cbc30 2024-04-26T23:11:01.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0490c00640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 0x7f048c0ccb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f047c005890 tx=0x7f047c0010b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.341+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0070d0 con 0x7f048c0cbc30 2024-04-26T23:11:01.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7f047c0070d0 con 0x7f048c0cbc30 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 msgr2=0x7f048c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0489600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 0x7f048c0ccb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f047c005890 tx=0x7f047c0010b0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0489600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 msgr2=0x7f048c0ccb40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0489600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f048c0cbc30 0x7f048c0ccb40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:01.344 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 16963, 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 13, 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.345 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.346 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:01.347 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.348 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.350 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.353 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.354 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:01.355 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0468068380 msgr2=0x7f046806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0468068380 0x7f046806a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04740af000 tx=0x7f04740a7000 comp rx=0 tx=0).stop 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 msgr2=0x7f048c13f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 --2- 172.21.15.148:0/4152990071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048c15c070 0x7f048c13f9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0484007e70 tx=0x7f048400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 reap_dead start 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0491600640 1 -- 172.21.15.148:0/4152990071 reap_dead start 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 shutdown_connections 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 >> 172.21.15.148:0/4152990071 conn(0x7f048c0c9d10 msgr2=0x7f048c162920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 shutdown_connections 2024-04-26T23:11:01.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.345+0000 7f0493600640 1 -- 172.21.15.148:0/4152990071 wait complete. 2024-04-26T23:11:01.362 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:01.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:11:01.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:11:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.501+0000 7f2c9d400640 1 Processor -- start 2024-04-26T23:11:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.501+0000 7f2c9d400640 1 -- start start 2024-04-26T23:11:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c9d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c98152dd0 0x7f2c980c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c9d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c9815c5c0 0x7f2c9815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c9d400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9815cf70 con 0x7f2c980c8cc0 2024-04-26T23:11:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c9d400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2c98158e00 con 0x7f2c9815c5c0 2024-04-26T23:11:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c9d400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2c981590e0 con 0x7f2c98152dd0 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c95e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2c980c8cc0 0x7f2c98073740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51362/0 (socket says 172.21.15.148:51362) 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c95e00640 1 -- 172.21.15.148:0/3483833672 learned_addr learned my addr 172.21.15.148:0/3483833672 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 --2- 172.21.15.148:0/3483833672 >> v2:172.21.15.148:3300/0 conn(0x7f2c9815c5c0 0x7f2c9815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c96800640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c98152dd0 0x7f2c980c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c95400640 1 -- 172.21.15.148:0/3483833672 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034161420 0 0) 0x7f2c9815cf70 con 0x7f2c980c8cc0 2024-04-26T23:11:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 -- 172.21.15.148:0/3483833672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c98152dd0 msgr2=0x7f2c980c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:01.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c98152dd0 0x7f2c980c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 -- 172.21.15.148:0/3483833672 >> v1:172.21.15.148:6789/0 conn(0x7f2c980c8cc0 legacy=0x7f2c98073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 -- 172.21.15.148:0/3483833672 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c981593c0 con 0x7f2c9815c5c0 2024-04-26T23:11:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.505+0000 7f2c97200640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c9815c5c0 0x7f2c9815ca30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097c0 tx=0x7f2c9001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb73d58875c46705 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c95400640 1 -- 172.21.15.148:0/3483833672 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900b5070 con 0x7f2c9815c5c0 2024-04-26T23:11:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c95400640 1 -- 172.21.15.148:0/3483833672 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c900a8990 con 0x7f2c9815c5c0 2024-04-26T23:11:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c95400640 1 -- 172.21.15.148:0/3483833672 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900a8d60 con 0x7f2c9815c5c0 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- 172.21.15.148:0/3483833672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c9815c5c0 msgr2=0x7f2c9815ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c9815c5c0 0x7f2c9815ca30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097c0 tx=0x7f2c9001ec90 comp rx=0 tx=0).stop 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- 172.21.15.148:0/3483833672 shutdown_connections 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c9815c5c0 0x7f2c9815ca30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- 172.21.15.148:0/3483833672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c98152dd0 0x7f2c980c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- 172.21.15.148:0/3483833672 >> 172.21.15.148:0/3483833672 conn(0x7f2c9806d490 msgr2=0x7f2c9806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- 172.21.15.148:0/3483833672 shutdown_connections 2024-04-26T23:11:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- 172.21.15.148:0/3483833672 wait complete. 2024-04-26T23:11:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 Processor -- start 2024-04-26T23:11:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- start start 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 0x7f2c98151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98152dd0 0x7f2c981f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c9815c5c0 0x7f2c980c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9815c0a0 con 0x7f2c980c8cc0 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98159980 con 0x7f2c98152dd0 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c9d400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2c98158af0 con 0x7f2c9815c5c0 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c96800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 0x7f2c98151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c96800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 0x7f2c98151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38048/0 (socket says 172.21.15.148:38048) 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.509+0000 7f2c96800640 1 -- 172.21.15.148:0/1871286932 learned_addr learned my addr 172.21.15.148:0/1871286932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c97200640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c9815c5c0 0x7f2c980c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c95e00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98152dd0 0x7f2c981f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c9815c5c0 msgr2=0x7f2c980c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c9815c5c0 0x7f2c980c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98152dd0 msgr2=0x7f2c981f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98152dd0 0x7f2c981f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c98158470 con 0x7f2c980c8cc0 2024-04-26T23:11:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c96800640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 0x7f2c98151260 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009ed0 tx=0x7f2c880085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8801b070 con 0x7f2c980c8cc0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c88008ce0 con 0x7f2c980c8cc0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88016640 con 0x7f2c980c8cc0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c98158710 con 0x7f2c980c8cc0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c981f2230 con 0x7f2c980c8cc0 2024-04-26T23:11:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c9d400640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 0x7f2c981577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2c981f5a10 con 0x7f2c981f5ea0 2024-04-26T23:11:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c95e00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 0x7f2c981577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c95e00640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c98077c20 con 0x7f2c981f5ea0 2024-04-26T23:11:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c8801e070 con 0x7f2c980c8cc0 2024-04-26T23:11:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c95e00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 0x7f2c981577e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c8b90 tx=0x7f2c84001980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.513+0000 7f2c8ea00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2c780683b0 0x7f2c7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2c88086990 con 0x7f2c980c8cc0 2024-04-26T23:11:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84012590 con 0x7f2c981f5ea0 2024-04-26T23:11:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2c84018070 con 0x7f2c981f5ea0 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 msgr2=0x7f2c981577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 0x7f2c981577e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c8b90 tx=0x7f2c84001980 comp rx=0 tx=0).stop 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 msgr2=0x7f2c981577e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c8ea00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f5ea0 0x7f2c981577e0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c8b90 tx=0x7f2c84001980 comp rx=0 tx=0).stop 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c97200640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2c780683b0 0x7f2c7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.517+0000 7f2c97200640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2c780683b0 0x7f2c7806a870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c900b2000 tx=0x7f2c90008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c9d400640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 0x7f2c981436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2c980c6820 con 0x7f2c981f55b0 2024-04-26T23:11:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c95e00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 0x7f2c981436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c95e00640 1 -- 172.21.15.148:0/1871286932 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c98074240 con 0x7f2c981f55b0 2024-04-26T23:11:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c95e00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 0x7f2c981436e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c98157360 tx=0x7f2c84001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.521+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84012a60 con 0x7f2c981f55b0 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7f2c84012a60 con 0x7f2c981f55b0 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 msgr2=0x7f2c981436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c8ea00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 0x7f2c981436e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c98157360 tx=0x7f2c84001090 comp rx=0 tx=0).stop 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c8ea00640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 msgr2=0x7f2c981436e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c8ea00640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c981f55b0 0x7f2c981436e0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c98157360 tx=0x7f2c84001090 comp rx=0 tx=0).stop 2024-04-26T23:11:01.524 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 48, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 404372, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 14, 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.525 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.526 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:01.528 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:01.531 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.532 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.535 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.536 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:01.537 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2c780683b0 msgr2=0x7f2c7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2c780683b0 0x7f2c7806a870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c900b2000 tx=0x7f2c90008040 comp rx=0 tx=0).stop 2024-04-26T23:11:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 msgr2=0x7f2c98151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 --2- 172.21.15.148:0/1871286932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c980c8cc0 0x7f2c98151260 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009ed0 tx=0x7f2c880085d0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c97200640 1 -- 172.21.15.148:0/1871286932 reap_dead start 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c97200640 1 -- 172.21.15.148:0/1871286932 reap_dead start 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 shutdown_connections 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 >> 172.21.15.148:0/1871286932 conn(0x7f2c9806d490 msgr2=0x7f2c9806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 shutdown_connections 2024-04-26T23:11:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.525+0000 7f2c9d400640 1 -- 172.21.15.148:0/1871286932 wait complete. 2024-04-26T23:11:01.542 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:01.542 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:11:01.543 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:11:01.543 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:11:01.543 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:11:01.543 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:11:01.543 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:11:01.560 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:11:01.560 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:11:01.560 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:01.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 Processor -- start 2024-04-26T23:11:01.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 -- start start 2024-04-26T23:11:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 0x7fd6d40c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d415f3f0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d415f690 con 0x7fd6d40cb970 2024-04-26T23:11:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6dc800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d415f930 con 0x7fd6d406c9c0 2024-04-26T23:11:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d9e00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7fd6d406c5e0 legacy=0x7fd6d4155d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6da800640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd6d40cb970 0x7fd6d415c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:48758/0 (socket says 172.21.15.148:48758) 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6da800640 1 -- 172.21.15.148:0/1662583018 learned_addr learned my addr 172.21.15.148:0/1662583018 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d9400640 1 --2- 172.21.15.148:0/1662583018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 0x7fd6d40c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d8a00640 1 -- 172.21.15.148:0/1662583018 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837458381 0 0) 0x7fd6d415f690 con 0x7fd6d40cb970 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d8a00640 1 -- 172.21.15.148:0/1662583018 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6bc003530 con 0x7fd6d40cb970 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d9400640 1 -- 172.21.15.148:0/1662583018 >> v1:172.21.15.157:6789/0 conn(0x7fd6d40cb970 legacy=0x7fd6d415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d9400640 1 -- 172.21.15.148:0/1662583018 >> v1:172.21.15.148:6789/0 conn(0x7fd6d406c5e0 legacy=0x7fd6d4155d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.745+0000 7fd6d9400640 1 -- 172.21.15.148:0/1662583018 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d415fc10 con 0x7fd6d406c9c0 2024-04-26T23:11:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6d9400640 1 --2- 172.21.15.148:0/1662583018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 0x7fd6d40c9730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40097f0 tx=0x7fd6c401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=370832599a23161e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6d8a00640 1 -- 172.21.15.148:0/1662583018 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40b0070 con 0x7fd6d406c9c0 2024-04-26T23:11:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6d8a00640 1 -- 172.21.15.148:0/1662583018 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c40ab600 con 0x7fd6d406c9c0 2024-04-26T23:11:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6d8a00640 1 -- 172.21.15.148:0/1662583018 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40ab9b0 con 0x7fd6d406c9c0 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 -- 172.21.15.148:0/1662583018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 msgr2=0x7fd6d40c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 --2- 172.21.15.148:0/1662583018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 0x7fd6d40c9730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40097f0 tx=0x7fd6c401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 -- 172.21.15.148:0/1662583018 shutdown_connections 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 --2- 172.21.15.148:0/1662583018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c9c0 0x7fd6d40c9730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 -- 172.21.15.148:0/1662583018 >> 172.21.15.148:0/1662583018 conn(0x7fd6d4073240 msgr2=0x7fd6d4073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 -- 172.21.15.148:0/1662583018 shutdown_connections 2024-04-26T23:11:01.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.749+0000 7fd6dc800640 1 -- 172.21.15.148:0/1662583018 wait complete. 2024-04-26T23:11:01.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 Processor -- start 2024-04-26T23:11:01.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- start start 2024-04-26T23:11:01.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 0x7fd6d4139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d40cb970 0x7fd6d41466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d41565a0 con 0x7fd6d406c9c0 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4156420 con 0x7fd6d40cb970 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d415cbc0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9400640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 msgr2=0x7fd6d4139f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 0x7fd6d4139f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6da800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d40cb970 0x7fd6d41466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:54968/0 (socket says 172.21.15.148:54968) 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 -- 172.21.15.148:0/935932455 learned_addr learned my addr 172.21.15.148:0/935932455 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 -- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d40cb970 msgr2=0x7fd6d41466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d40cb970 0x7fd6d41466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 -- 172.21.15.148:0/935932455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 msgr2=0x7fd6d4139f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 0x7fd6d4139f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 -- 172.21.15.148:0/935932455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d4145640 con 0x7fd6d406c5e0 2024-04-26T23:11:01.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6d9e00640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b530 tx=0x7fd6c800b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8013020 con 0x7fd6d406c5e0 2024-04-26T23:11:01.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d4145920 con 0x7fd6d406c5e0 2024-04-26T23:11:01.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c8003df0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80052b0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d4145ee0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.753+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d4077c20 con 0x7fd6d406c5e0 2024-04-26T23:11:01.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.757+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6c8016020 con 0x7fd6d406c5e0 2024-04-26T23:11:01.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.757+0000 7fd6ce000640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 0x7fd6b806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:01.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.757+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd6c80870f0 con 0x7fd6d406c5e0 2024-04-26T23:11:01.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.757+0000 7fd6d9400640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 0x7fd6b806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:01.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.757+0000 7fd6d9400640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 0x7fd6b806a820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40ad000 tx=0x7fd6c40a6000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:01.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.769+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6c801d020 con 0x7fd6d406c5e0 2024-04-26T23:11:01.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.981+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd6d4139c20 con 0x7fd6d406c5e0 2024-04-26T23:11:01.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6ce000640 1 -- 172.21.15.148:0/935932455 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd6c8057180 con 0x7fd6d406c5e0 2024-04-26T23:11:01.984 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 msgr2=0x7fd6b806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 0x7fd6b806a820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40ad000 tx=0x7fd6c40a6000 comp rx=0 tx=0).stop 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 msgr2=0x7fd6d41432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b530 tx=0x7fd6c800b9f0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 shutdown_connections 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd6b8068360 0x7fd6b806a820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6d40cb970 0x7fd6d41466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6d406c9c0 0x7fd6d4139f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 --2- 172.21.15.148:0/935932455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd6d406c5e0 0x7fd6d41432d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 >> 172.21.15.148:0/935932455 conn(0x7fd6d4073240 msgr2=0x7fd6d4144140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 shutdown_connections 2024-04-26T23:11:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:01.985+0000 7fd6dc800640 1 -- 172.21.15.148:0/935932455 wait complete. 2024-04-26T23:11:05.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 Processor -- start 2024-04-26T23:11:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 -- start start 2024-04-26T23:11:05.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 0x7fc0980737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc0980c54a0 0x7fc0980c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0980c9f50 0x7fc0980ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc0980cab90 con 0x7fc098152d40 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc098153120 con 0x7fc0980c54a0 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc09d400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc0980c7740 con 0x7fc0980c9f50 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc096800640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 msgr2=0x7fc0980737e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc096800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 0x7fc0980737e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc0980c54a0 0x7fc0980c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc097200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0980c9f50 0x7fc0980ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc0980c54a0 0x7fc0980c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40514/0 (socket says 172.21.15.148:40514) 2024-04-26T23:11:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 -- 172.21.15.148:0/1564505159 learned_addr learned my addr 172.21.15.148:0/1564505159 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 -- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0980c9f50 msgr2=0x7fc0980ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 --2- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0980c9f50 0x7fc0980ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 -- 172.21.15.148:0/1564505159 >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 msgr2=0x7fc0980737e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 --2- 172.21.15.148:0/1564505159 >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 0x7fc0980737e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.153+0000 7fc08fe00640 1 -- 172.21.15.148:0/1564505159 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0980c5a40 con 0x7fc0980c54a0 2024-04-26T23:11:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc08fe00640 1 --2- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c54a0 0x7fc0980c9a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0980c8500 tx=0x7fc08001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29261f87e72862d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc095e00640 1 -- 172.21.15.148:0/1564505159 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800b5070 con 0x7fc0980c54a0 2024-04-26T23:11:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc095e00640 1 -- 172.21.15.148:0/1564505159 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0800a89f0 con 0x7fc0980c54a0 2024-04-26T23:11:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc095e00640 1 -- 172.21.15.148:0/1564505159 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800a8dc0 con 0x7fc0980c54a0 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 -- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c54a0 msgr2=0x7fc0980c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 --2- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c54a0 0x7fc0980c9a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0980c8500 tx=0x7fc08001ed30 comp rx=0 tx=0).stop 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 -- 172.21.15.148:0/1564505159 shutdown_connections 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 --2- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0980c9f50 0x7fc0980ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 --2- 172.21.15.148:0/1564505159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c54a0 0x7fc0980c9a10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 --2- 172.21.15.148:0/1564505159 >> v2:172.21.15.148:3300/0 conn(0x7fc098152d40 0x7fc0980737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.157+0000 7fc09d400640 1 -- 172.21.15.148:0/1564505159 >> 172.21.15.148:0/1564505159 conn(0x7fc09806d490 msgr2=0x7fc09806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- 172.21.15.148:0/1564505159 shutdown_connections 2024-04-26T23:11:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- 172.21.15.148:0/1564505159 wait complete. 2024-04-26T23:11:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 Processor -- start 2024-04-26T23:11:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- start start 2024-04-26T23:11:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 0x7fc098156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc098152d40 0x7fc098157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc0980ca540 con 0x7fc0980c54a0 2024-04-26T23:11:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc0980c6000 con 0x7fc0980c9f50 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc09d400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc0980ca820 con 0x7fc098152d40 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc096800640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 msgr2=0x7fc098156ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc096800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 0x7fc098156ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc097200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc098152d40 0x7fc098157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40528/0 (socket says 172.21.15.148:40528) 2024-04-26T23:11:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 -- 172.21.15.148:0/3071606313 learned_addr learned my addr 172.21.15.148:0/3071606313 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 -- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc098152d40 msgr2=0x7fc098157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc098152d40 0x7fc098157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 -- 172.21.15.148:0/3071606313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 msgr2=0x7fc098156ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 0x7fc098156ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.161+0000 7fc08fe00640 1 -- 172.21.15.148:0/3071606313 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09813b510 con 0x7fc0980c9f50 2024-04-26T23:11:05.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc08fe00640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b3040 tx=0x7fc08001bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800c0070 con 0x7fc0980c9f50 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0800b0760 con 0x7fc0980c9f50 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09814ef20 con 0x7fc0980c9f50 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800b5040 con 0x7fc0980c9f50 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09814dbf0 con 0x7fc0980c9f50 2024-04-26T23:11:05.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.165+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc098077c20 con 0x7fc0980c9f50 2024-04-26T23:11:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.169+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0800b0b50 con 0x7fc0980c9f50 2024-04-26T23:11:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.169+0000 7fc08ea00640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 0x7fc07406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:05.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.169+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc080124200 con 0x7fc0980c9f50 2024-04-26T23:11:05.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.169+0000 7fc096800640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 0x7fc07406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:05.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.169+0000 7fc096800640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 0x7fc07406a7f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc088006fd0 tx=0x7fc088006d40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:05.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.185+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc0800c9020 con 0x7fc0980c9f50 2024-04-26T23:11:05.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.481+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc098074390 con 0x7fc0980c9f50 2024-04-26T23:11:05.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc08ea00640 1 -- 172.21.15.148:0/3071606313 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fc09813b510 con 0x7fc0980c9f50 2024-04-26T23:11:05.483 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 msgr2=0x7fc07406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 0x7fc07406a7f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc088006fd0 tx=0x7fc088006d40 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 msgr2=0x7fc098157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b3040 tx=0x7fc08001bad0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 shutdown_connections 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc074068330 0x7fc07406a7f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc098152d40 0x7fc098157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0980c9f50 0x7fc098157410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 --2- 172.21.15.148:0/3071606313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0980c54a0 0x7fc098156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 >> 172.21.15.148:0/3071606313 conn(0x7fc09806d490 msgr2=0x7fc09806cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 shutdown_connections 2024-04-26T23:11:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:05.485+0000 7fc09d400640 1 -- 172.21.15.148:0/3071606313 wait complete. 2024-04-26T23:11:08.506 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 Processor -- start 2024-04-26T23:11:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 -- start start 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 0x7fe91c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c0cfb50 con 0x7fe91c0c9e80 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c0cce10 con 0x7fe91c0b1d80 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe921000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0cfe10 con 0x7fe91c0c6340 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919e00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 msgr2=0x7fe91c06feb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe91a800640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7fe91c0c9e80 legacy=0x7fe91c15c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 0x7fe91c06feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:08.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:43858/0 (socket says 172.21.15.148:43858) 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 -- 172.21.15.148:0/2408682333 learned_addr learned my addr 172.21.15.148:0/2408682333 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 -- 172.21.15.148:0/2408682333 >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 msgr2=0x7fe91c06feb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 --2- 172.21.15.148:0/2408682333 >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 0x7fe91c06feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 -- 172.21.15.148:0/2408682333 >> v1:172.21.15.148:6789/0 conn(0x7fe91c0c9e80 legacy=0x7fe91c15c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:08.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.653+0000 7fe919400640 1 -- 172.21.15.148:0/2408682333 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c06d650 con 0x7fe91c0c6340 2024-04-26T23:11:08.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe919400640 1 --2- 172.21.15.148:0/2408682333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe908009870 tx=0x7fe90801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b75e0f9a24d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:08.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe918a00640 1 -- 172.21.15.148:0/2408682333 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080b5070 con 0x7fe91c0c6340 2024-04-26T23:11:08.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe918a00640 1 -- 172.21.15.148:0/2408682333 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9080a89f0 con 0x7fe91c0c6340 2024-04-26T23:11:08.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe918a00640 1 -- 172.21.15.148:0/2408682333 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080a8dc0 con 0x7fe91c0c6340 2024-04-26T23:11:08.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 -- 172.21.15.148:0/2408682333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 msgr2=0x7fe91c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 --2- 172.21.15.148:0/2408682333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe908009870 tx=0x7fe90801ed30 comp rx=0 tx=0).stop 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 -- 172.21.15.148:0/2408682333 shutdown_connections 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 --2- 172.21.15.148:0/2408682333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c0703f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 --2- 172.21.15.148:0/2408682333 >> v2:172.21.15.148:3300/0 conn(0x7fe91c0b1d80 0x7fe91c06feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 -- 172.21.15.148:0/2408682333 >> 172.21.15.148:0/2408682333 conn(0x7fe91c071160 msgr2=0x7fe91c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 -- 172.21.15.148:0/2408682333 shutdown_connections 2024-04-26T23:11:08.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.657+0000 7fe921000640 1 -- 172.21.15.148:0/2408682333 wait complete. 2024-04-26T23:11:08.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 Processor -- start 2024-04-26T23:11:08.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 -- start start 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 0x7fe91c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe91c0c9e80 0x7fe91c149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0b2160 con 0x7fe91c0b1d80 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c06dc10 con 0x7fe91c0c9e80 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe921000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c071970 con 0x7fe91c0c6340 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 msgr2=0x7fe91c0c5190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 0x7fe91c0c5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe91a800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe91c0c9e80 0x7fe91c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:43872/0 (socket says 172.21.15.148:43872) 2024-04-26T23:11:08.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 -- 172.21.15.148:0/1628474187 learned_addr learned my addr 172.21.15.148:0/1628474187 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 -- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe91c0c9e80 msgr2=0x7fe91c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe91c0c9e80 0x7fe91c149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 -- 172.21.15.148:0/1628474187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 msgr2=0x7fe91c0c5190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 0x7fe91c0c5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 -- 172.21.15.148:0/1628474187 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0b0e30 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.661+0000 7fe919400640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9080b3040 tx=0x7fe90801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080b5040 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9080be070 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c0b10f0 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080b0b10 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c0b3c70 con 0x7fe91c0c6340 2024-04-26T23:11:08.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c077c20 con 0x7fe91c0c6340 2024-04-26T23:11:08.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.665+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9080b0cb0 con 0x7fe91c0c6340 2024-04-26T23:11:08.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.669+0000 7fe912000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 0x7fe8fc06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:08.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.669+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe908124d40 con 0x7fe91c0c6340 2024-04-26T23:11:08.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.669+0000 7fe919e00640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 0x7fe8fc06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:08.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.669+0000 7fe919e00640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 0x7fe8fc06a7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe90c003d10 tx=0x7fe90c009270 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:08.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.677+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe908018890 con 0x7fe91c0c6340 2024-04-26T23:11:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.893+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe91c0d0210 con 0x7fe91c0c6340 2024-04-26T23:11:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.893+0000 7fe912000640 1 -- 172.21.15.148:0/1628474187 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fe9080f4ee0 con 0x7fe91c0c6340 2024-04-26T23:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 msgr2=0x7fe8fc06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 0x7fe8fc06a7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe90c003d10 tx=0x7fe90c009270 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 msgr2=0x7fe91c1f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9080b3040 tx=0x7fe90801bad0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 shutdown_connections 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fe8fc068330 0x7fe8fc06a7f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe91c0c9e80 0x7fe91c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91c0c6340 0x7fe91c1f50a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 --2- 172.21.15.148:0/1628474187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe91c0b1d80 0x7fe91c0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 >> 172.21.15.148:0/1628474187 conn(0x7fe91c071160 msgr2=0x7fe91c159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 shutdown_connections 2024-04-26T23:11:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:08.897+0000 7fe921000640 1 -- 172.21.15.148:0/1628474187 wait complete. 2024-04-26T23:11:11.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:12.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 Processor -- start 2024-04-26T23:11:12.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 -- start start 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba580cb7f0 con 0x7fba580b47e0 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fba580ccd80 con 0x7fba581574b0 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba5d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba580c9e80 con 0x7fba580c63f0 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba56a00640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 msgr2=0x7fba580ca730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:12.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba56a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba57400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba56000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fba580b47e0 0x7fba5806feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:37658/0 (socket says 172.21.15.148:37658) 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba56000640 1 -- 172.21.15.148:0/2416941010 learned_addr learned my addr 172.21.15.148:0/2416941010 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:12.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.065+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:12.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 msgr2=0x7fba580ca730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:12.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:11:12.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:12.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:11:12.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:12.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:12.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.269+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:11:12.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 msgr2=0x7fba580ca730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:12.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:11:12.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:12.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:11:12.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:12.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:12.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:12.673+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:11:13.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 msgr2=0x7fba580ca730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:13.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:13.477+0000 7fba57400640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:11:13.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:11:13.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 msgr2=0x7fba58164520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba580c63f0 0x7fba58164520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 msgr2=0x7fba580ca730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.148:3300/0 conn(0x7fba581574b0 0x7fba580ca730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.157:6789/0 conn(0x7fba580b47e0 legacy=0x7fba5806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 -- 172.21.15.148:0/2416941010 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba580ca0d0 con 0x7fba380061a0 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba4fe00640 1 -- 172.21.15.148:0/2416941010 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fba580ccd80 con 0x7fba380036d0 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56000640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.148:6789/0 conn(0x7fba380061a0 legacy=0x7fba38008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.065+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:15.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56000640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.148:6789/0 conn(0x7fba380061a0 legacy=0x7fba38008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.269+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:11:15.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56000640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.148:6789/0 conn(0x7fba380061a0 legacy=0x7fba38008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:15.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:15.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:11:15.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 msgr2=0x7fba38005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:15.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:15.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:15.673+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:11:16.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.477+0000 7fba56000640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.148:6789/0 conn(0x7fba380061a0 legacy=0x7fba38008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:16.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.477+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> v2:172.21.15.157:3300/0 conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.477+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 >> v1:172.21.15.148:6789/0 conn(0x7fba380061a0 legacy=0x7fba38008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.477+0000 7fba56a00640 1 -- 172.21.15.148:0/2416941010 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3800af80 con 0x7fba380036d0 2024-04-26T23:11:16.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba56a00640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba380036d0 0x7fba38005b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba48003990 tx=0x7fba4801d1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb71c50d66e5fbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba55600640 1 -- 172.21.15.148:0/2416941010 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480b3070 con 0x7fba380036d0 2024-04-26T23:11:16.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba55600640 1 -- 172.21.15.148:0/2416941010 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480ae410 con 0x7fba380036d0 2024-04-26T23:11:16.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba55600640 1 -- 172.21.15.148:0/2416941010 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480ae800 con 0x7fba380036d0 2024-04-26T23:11:16.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 -- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba380036d0 msgr2=0x7fba38005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba380036d0 0x7fba38005b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba48003990 tx=0x7fba4801d1a0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba57400640 1 -- 172.21.15.148:0/2416941010 reap_dead start 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 -- 172.21.15.148:0/2416941010 shutdown_connections 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 --2- 172.21.15.148:0/2416941010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba380036d0 0x7fba38005b50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 -- 172.21.15.148:0/2416941010 >> 172.21.15.148:0/2416941010 conn(0x7fba58071160 msgr2=0x7fba58068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 -- 172.21.15.148:0/2416941010 shutdown_connections 2024-04-26T23:11:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.485+0000 7fba5d800640 1 -- 172.21.15.148:0/2416941010 wait complete. 2024-04-26T23:11:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 Processor -- start 2024-04-26T23:11:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 -- start start 2024-04-26T23:11:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 0x7fba58151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba58154bb0 0x7fba581537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba56000640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 msgr2=0x7fba58151cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba56000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 0x7fba58151cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba56a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba56a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:42148/0 (socket says 172.21.15.148:42148) 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba580cac70 con 0x7fba58156660 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba56a00640 1 -- 172.21.15.148:0/19251150 learned_addr learned my addr 172.21.15.148:0/19251150 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fba580c4640 con 0x7fba58154bb0 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fba580ca3b0 con 0x7fba380036d0 2024-04-26T23:11:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.489+0000 7fba57400640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba58154bb0 0x7fba581537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 -- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba58154bb0 msgr2=0x7fba581537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba58154bb0 0x7fba581537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 -- 172.21.15.148:0/19251150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 msgr2=0x7fba58151cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 0x7fba58151cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba581f1230 con 0x7fba380036d0 2024-04-26T23:11:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba56a00640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba48019db0 tx=0x7fba4801b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480bd020 con 0x7fba380036d0 2024-04-26T23:11:16.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480b9640 con 0x7fba380036d0 2024-04-26T23:11:16.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba581f14b0 con 0x7fba380036d0 2024-04-26T23:11:16.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba58155b80 con 0x7fba380036d0 2024-04-26T23:11:16.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.493+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480b3040 con 0x7fba380036d0 2024-04-26T23:11:16.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba480c0070 con 0x7fba380036d0 2024-04-26T23:11:16.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba58077c20 con 0x7fba380036d0 2024-04-26T23:11:16.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba4ea00640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 0x7fba3806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fba48121960 con 0x7fba380036d0 2024-04-26T23:11:16.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba56000640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 0x7fba3806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.497+0000 7fba56000640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 0x7fba3806dd30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba44005890 tx=0x7fba44007a20 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.505+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba581f1230 con 0x7fba380036d0 2024-04-26T23:11:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.733+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fba580d01a0 con 0x7fba380036d0 2024-04-26T23:11:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.733+0000 7fba4ea00640 1 -- 172.21.15.148:0/19251150 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fba48017160 con 0x7fba380036d0 2024-04-26T23:11:16.733 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":50,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:16.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 msgr2=0x7fba3806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 0x7fba3806dd30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba44005890 tx=0x7fba44007a20 comp rx=0 tx=0).stop 2024-04-26T23:11:16.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 msgr2=0x7fba581514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba48019db0 tx=0x7fba4801b9e0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 shutdown_connections 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fba3806b870 0x7fba3806dd30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba58154bb0 0x7fba581537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58156660 0x7fba58151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 --2- 172.21.15.148:0/19251150 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba380036d0 0x7fba581514f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 >> 172.21.15.148:0/19251150 conn(0x7fba58071160 msgr2=0x7fba580725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 shutdown_connections 2024-04-26T23:11:16.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.737+0000 7fba5d800640 1 -- 172.21.15.148:0/19251150 wait complete. 2024-04-26T23:11:16.754 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:11:16.754 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:11:16.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:11:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 Processor -- start 2024-04-26T23:11:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 -- start start 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feab8073940 0x7feab80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab80c4b30 con 0x7feab8152d00 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab80c6f60 con 0x7feab815c070 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feabec00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7feab80c7240 con 0x7feab8073940 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feaaf400640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7feab8073940 msgr2=0x7feab80c97d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feab7e00640 1 -- >> v1:172.21.15.148:6789/0 conn(0x7feab8152d00 legacy=0x7feab8073230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.148:6789/0 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.893+0000 7feaaf400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feab8073940 0x7feab80c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feabcc00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feab815c070 0x7feab815c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:35982/0 (socket says 172.21.15.148:35982) 2024-04-26T23:11:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feabcc00640 1 -- 172.21.15.148:0/4211201781 learned_addr learned my addr 172.21.15.148:0/4211201781 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:16.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492204902 0 0) 0x7feab80c6f60 con 0x7feab815c070 2024-04-26T23:11:16.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9c005740 con 0x7feab815c070 2024-04-26T23:11:16.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350537978 0 0) 0x7fea9c005740 con 0x7feab815c070 2024-04-26T23:11:16.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 >> v2:172.21.15.148:3300/0 conn(0x7feab8073940 msgr2=0x7feab80c97d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:16.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 --2- 172.21.15.148:0/4211201781 >> v2:172.21.15.148:3300/0 conn(0x7feab8073940 0x7feab80c97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 >> v1:172.21.15.148:6789/0 conn(0x7feab8152d00 legacy=0x7feab8073230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab80c7520 con 0x7feab815c070 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7feab0001a00 con 0x7feab815c070 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 >> v1:172.21.15.157:6789/0 conn(0x7feab815c070 legacy=0x7feab815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 0x7fea9c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c006a20 0x7fea9c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c007450 0x7fea9c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c7240 con 0x7fea9c006a20 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c00e3b0 con 0x7fea9c007450 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c00e5b0 con 0x7fea9c005bd0 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feaaf400640 1 -- 172.21.15.148:0/4211201781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c006a20 msgr2=0x7fea9c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feaaf400640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c006a20 0x7fea9c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 0x7fea9c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feabcc00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c007450 0x7fea9c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 -- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c007450 msgr2=0x7fea9c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c007450 0x7fea9c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 -- 172.21.15.148:0/4211201781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c006a20 msgr2=0x7fea9c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c006a20 0x7fea9c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feab7e00640 1 -- 172.21.15.148:0/4211201781 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c005740 con 0x7fea9c005bd0 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feabcc00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c007450 0x7fea9c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:11:16.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.897+0000 7feabcc00640 1 -- 172.21.15.148:0/4211201781 reap_dead start 2024-04-26T23:11:16.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feab7e00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 0x7fea9c005fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003990 tx=0x7feaa801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb9162df7db4aa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8009520 con 0x7fea9c005bd0 2024-04-26T23:11:16.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8003bc0 con 0x7fea9c005bd0 2024-04-26T23:11:16.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feab7400640 1 -- 172.21.15.148:0/4211201781 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8005070 con 0x7fea9c005bd0 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 -- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 msgr2=0x7fea9c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 0x7fea9c005fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003990 tx=0x7feaa801c440 comp rx=0 tx=0).stop 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 -- 172.21.15.148:0/4211201781 shutdown_connections 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 --2- 172.21.15.148:0/4211201781 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea9c005bd0 0x7fea9c005fd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 -- 172.21.15.148:0/4211201781 >> 172.21.15.148:0/4211201781 conn(0x7feab80c9d10 msgr2=0x7feab80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 -- 172.21.15.148:0/4211201781 shutdown_connections 2024-04-26T23:11:16.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.901+0000 7feabec00640 1 -- 172.21.15.148:0/4211201781 wait complete. 2024-04-26T23:11:16.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 Processor -- start 2024-04-26T23:11:16.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- start start 2024-04-26T23:11:16.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c005bd0 0x7feab81f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 0x7feab80cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f2950 0x7feab81f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c4f90 con 0x7fea9c005bd0 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c4e10 con 0x7feab81f2950 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feab80c4710 con 0x7feab81e26b0 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feab7e00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c005bd0 msgr2=0x7feab81f1ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feab7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c005bd0 0x7feab81f1ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 0x7feab80cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 0x7feab80cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:42158/0 (socket says 172.21.15.148:42158) 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 -- 172.21.15.148:0/2778815472 learned_addr learned my addr 172.21.15.148:0/2778815472 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabcc00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f2950 0x7feab81f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f2950 msgr2=0x7feab81f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f2950 0x7feab81f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c005bd0 msgr2=0x7feab81f1ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:16.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9c005bd0 0x7feab81f1ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab80704f0 con 0x7feab81e26b0 2024-04-26T23:11:16.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feaaf400640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 0x7feab80cc840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaa000b580 tx=0x7feaa000b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0016070 con 0x7feab81e26b0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa0003df0 con 0x7feab81e26b0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab81f2430 con 0x7feab81e26b0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa00052b0 con 0x7feab81e26b0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.905+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feab81e7340 con 0x7feab81e26b0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feabec00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 0x7feab81f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feab81e7580 con 0x7feab81f42f0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab7e00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 0x7feab81f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab7e00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feab8077c20 con 0x7feab81f42f0 2024-04-26T23:11:16.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab7e00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 0x7feab81f14e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006fd0 tx=0x7fea9c007a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa80050c0 con 0x7feab81f42f0 2024-04-26T23:11:16.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feaa0019070 con 0x7feab81e26b0 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea940682b0 0x7fea9406a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7feaa0085f70 con 0x7feab81e26b0 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feaa8005260 con 0x7feab81f42f0 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 msgr2=0x7feab81f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 0x7feab81f14e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006fd0 tx=0x7fea9c007a50 comp rx=0 tx=0).stop 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 msgr2=0x7feab81f14e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feab4c00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f42f0 0x7feab81f14e0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006fd0 tx=0x7fea9c007a50 comp rx=0 tx=0).stop 2024-04-26T23:11:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.909+0000 7feabcc00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea940682b0 0x7fea9406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.913+0000 7feabcc00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea940682b0 0x7fea9406a770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feab80c4540 tx=0x7feab0001960 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feabec00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 0x7feab81f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:16.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c8890 con 0x7feab81f1a20 2024-04-26T23:11:16.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feab7e00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 0x7feab81f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:16.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feab7e00640 1 -- 172.21.15.148:0/2778815472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feab80c85b0 con 0x7feab81f1a20 2024-04-26T23:11:16.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feab7e00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 0x7feab81f4a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feaa801c270 tx=0x7feaa80090e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:16.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.917+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa80bdda0 con 0x7feab81f1a20 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7feaa80b7460 con 0x7feab81f1a20 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 msgr2=0x7feab81f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feab4c00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 0x7feab81f4a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feaa801c270 tx=0x7feaa80090e0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feab4c00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 msgr2=0x7feab81f4a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feab4c00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab81f1a20 0x7feab81f4a50 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feaa801c270 tx=0x7feaa80090e0 comp rx=0 tx=0).stop 2024-04-26T23:11:16.919 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 50, 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 32539, 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:16.920 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:16.921 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:16.922 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:16.923 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:16.925 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:16.926 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.928 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:16.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:16.931 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:16.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:16.933 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:16.934 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:16.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea940682b0 msgr2=0x7fea9406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fea940682b0 0x7fea9406a770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feab80c4540 tx=0x7feab0001960 comp rx=0 tx=0).stop 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 msgr2=0x7feab80cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 --2- 172.21.15.148:0/2778815472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab81e26b0 0x7feab80cc840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaa000b580 tx=0x7feaa000b980 comp rx=0 tx=0).stop 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabcc00640 1 -- 172.21.15.148:0/2778815472 reap_dead start 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabcc00640 1 -- 172.21.15.148:0/2778815472 reap_dead start 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 shutdown_connections 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 >> 172.21.15.148:0/2778815472 conn(0x7feab80c9d10 msgr2=0x7feab80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 shutdown_connections 2024-04-26T23:11:16.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:16.921+0000 7feabec00640 1 -- 172.21.15.148:0/2778815472 wait complete. 2024-04-26T23:11:16.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:11:16.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:11:16.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:11:17.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.077+0000 7f0ff7800640 1 Processor -- start 2024-04-26T23:11:17.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.077+0000 7f0ff7800640 1 -- start start 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff7800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ff0073940 0x7f0ff00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff7800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 0x7f0ff015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff7800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff00c4b30 con 0x7f0ff0152d00 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff7800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff00c6f60 con 0x7f0ff015c070 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff7800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff00c7240 con 0x7f0ff0073940 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff5800640 1 -- >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 msgr2=0x7f0ff015c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff5800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 0x7f0ff015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff4e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0ff0152d00 0x7f0ff0073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:35990/0 (socket says 172.21.15.148:35990) 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0ff4e00640 1 -- 172.21.15.148:0/3426280948 learned_addr learned my addr 172.21.15.148:0/3426280948 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3426280948 >> v2:172.21.15.157:3300/0 conn(0x7f0ff0073940 0x7f0ff00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fef400640 1 -- 172.21.15.148:0/3426280948 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282083676 0 0) 0x7f0ff00c4b30 con 0x7f0ff0152d00 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fef400640 1 -- 172.21.15.148:0/3426280948 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fd4005740 con 0x7f0ff0152d00 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fefe00640 1 -- 172.21.15.148:0/3426280948 >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 msgr2=0x7f0ff015c4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3426280948 >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 0x7f0ff015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fefe00640 1 -- 172.21.15.148:0/3426280948 >> v1:172.21.15.157:6789/0 conn(0x7f0ff0152d00 legacy=0x7f0ff0073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.081+0000 7f0fefe00640 1 -- 172.21.15.148:0/3426280948 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff00c7520 con 0x7f0ff0073940 2024-04-26T23:11:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3426280948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff0073940 0x7f0ff00c97d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00cad50 tx=0x7f0fdc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a42268058d2f97a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0fef400640 1 -- 172.21.15.148:0/3426280948 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b0070 con 0x7f0ff0073940 2024-04-26T23:11:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0fef400640 1 -- 172.21.15.148:0/3426280948 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0ab600 con 0x7f0ff0073940 2024-04-26T23:11:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0fef400640 1 -- 172.21.15.148:0/3426280948 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0ab9d0 con 0x7f0ff0073940 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 -- 172.21.15.148:0/3426280948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff0073940 msgr2=0x7f0ff00c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3426280948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff0073940 0x7f0ff00c97d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00cad50 tx=0x7f0fdc01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 -- 172.21.15.148:0/3426280948 shutdown_connections 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3426280948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff0073940 0x7f0ff00c97d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3426280948 >> v2:172.21.15.148:3300/0 conn(0x7f0ff015c070 0x7f0ff015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 -- 172.21.15.148:0/3426280948 >> 172.21.15.148:0/3426280948 conn(0x7f0ff00c9d10 msgr2=0x7f0ff00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 -- 172.21.15.148:0/3426280948 shutdown_connections 2024-04-26T23:11:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 -- 172.21.15.148:0/3426280948 wait complete. 2024-04-26T23:11:17.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.085+0000 7f0ff7800640 1 Processor -- start 2024-04-26T23:11:17.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- start start 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 0x7f0ff0140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff0152d00 0x7f0ff0141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff015c070 0x7f0ff01ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff015cf70 con 0x7f0ff0152d00 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff015cdf0 con 0x7f0ff015c070 2024-04-26T23:11:17.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff0070500 con 0x7f0ff0073940 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0fefe00640 1 -- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff0152d00 msgr2=0x7f0ff0141510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:3300/0 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0fefe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff0152d00 0x7f0ff0141510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 0x7f0ff0140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff5800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff015c070 0x7f0ff01ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 0x7f0ff0140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:42166/0 (socket says 172.21.15.148:42166) 2024-04-26T23:11:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 -- 172.21.15.148:0/3386538807 learned_addr learned my addr 172.21.15.148:0/3386538807 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff015c070 msgr2=0x7f0ff01ea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff015c070 0x7f0ff01ea380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff0152d00 msgr2=0x7f0ff0141510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff0152d00 0x7f0ff0141510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff01f0960 con 0x7f0ff0073940 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff4e00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 0x7f0ff0140fd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000cb70 tx=0x7f0fe000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0017070 con 0x7f0ff0073940 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff01f0c40 con 0x7f0ff0073940 2024-04-26T23:11:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe000ad40 con 0x7f0ff0073940 2024-04-26T23:11:17.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0012600 con 0x7f0ff0073940 2024-04-26T23:11:17.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.089+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff01f1200 con 0x7f0ff0073940 2024-04-26T23:11:17.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 0x7f0ff01ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff0077c20 con 0x7f0ff01448e0 2024-04-26T23:11:17.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 0x7f0ff01ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fe001a070 con 0x7f0ff0073940 2024-04-26T23:11:17.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fefe00640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ff00cca60 con 0x7f0ff01448e0 2024-04-26T23:11:17.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 0x7f0ff01ea8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ab000 tx=0x7f0fdc01ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:17.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fecc00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0fd0068330 0x7f0fd006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0fe0086ae0 con 0x7f0ff0073940 2024-04-26T23:11:17.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b0040 con 0x7f0ff01448e0 2024-04-26T23:11:17.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.093+0000 7f0ff5800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0fd0068330 0x7f0fd006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0fdc0093e0 con 0x7f0ff01448e0 2024-04-26T23:11:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 msgr2=0x7f0ff01ea8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0fecc00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 0x7f0ff01ea8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ab000 tx=0x7f0fdc01ace0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 msgr2=0x7f0ff01ea8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0fecc00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01448e0 0x7f0ff01ea8c0 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ab000 tx=0x7f0fdc01ace0 comp rx=0 tx=0).stop 2024-04-26T23:11:17.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.097+0000 7f0ff5800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0fd0068330 0x7f0fd006a7f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8003990 tx=0x7f0fe8009060 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:17.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 0x7f0ff0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:17.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff014abc0 con 0x7f0ff01f1440 2024-04-26T23:11:17.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 0x7f0ff0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:17.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0fefe00640 1 -- 172.21.15.148:0/3386538807 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ff015c520 con 0x7f0ff01f1440 2024-04-26T23:11:17.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0fefe00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 0x7f0ff0147ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc01a0d0 tx=0x7f0fdc019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:17.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.101+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b0050 con 0x7f0ff01f1440 2024-04-26T23:11:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5201 (secure 0 0 0) 0x7f0fdc003620 con 0x7f0ff01f1440 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 msgr2=0x7f0ff0147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0fecc00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 0x7f0ff0147ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc01a0d0 tx=0x7f0fdc019240 comp rx=0 tx=0).stop 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0fecc00640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 msgr2=0x7f0ff0147ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0fecc00640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff01f1440 0x7f0ff0147ae0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc01a0d0 tx=0x7f0fdc019240 comp rx=0 tx=0).stop 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 50, 2024-04-26T23:11:17.104 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 419952, 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 1, 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:17.105 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:17.107 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:17.108 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:17.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:17.111 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:17.112 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.114 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.115 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 8 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.116 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:17.117 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0fd0068330 msgr2=0x7f0fd006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0fd0068330 0x7f0fd006a7f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8003990 tx=0x7f0fe8009060 comp rx=0 tx=0).stop 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 msgr2=0x7f0ff0140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 --2- 172.21.15.148:0/3386538807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff0073940 0x7f0ff0140fd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000cb70 tx=0x7f0fe000a430 comp rx=0 tx=0).stop 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff5800640 1 -- 172.21.15.148:0/3386538807 reap_dead start 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff5800640 1 -- 172.21.15.148:0/3386538807 reap_dead start 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 shutdown_connections 2024-04-26T23:11:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 >> 172.21.15.148:0/3386538807 conn(0x7f0ff00c9d10 msgr2=0x7f0ff00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 shutdown_connections 2024-04-26T23:11:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:17.105+0000 7f0ff7800640 1 -- 172.21.15.148:0/3386538807 wait complete. 2024-04-26T23:11:17.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:11:17.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:11:37.123 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:11:37.123 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:11:37.123 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:11:37.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:11:37.127 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:11:37.127 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:11:37.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:37.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 Processor -- start 2024-04-26T23:11:37.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 -- start start 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf40c9d90 con 0x7fbdf40c7b80 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf40ca070 con 0x7fbdf4153af0 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf9000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf415dec0 con 0x7fbdf40c9720 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43482/0 (socket says 172.21.15.148:43482) 2024-04-26T23:11:37.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbde9400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbdf40c7b80 0x7fbdf40c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54762/0 (socket says 172.21.15.148:54762) 2024-04-26T23:11:37.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 -- 172.21.15.148:0/3911031536 learned_addr learned my addr 172.21.15.148:0/3911031536 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:37.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 -- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 msgr2=0x7fbdf40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:11:37.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 -- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 msgr2=0x7fbdf40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:37.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 --2- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:37.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf2800640 1 --2- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986387260 0 0) 0x7fbdf40ca070 con 0x7fbdf4153af0 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdd8003530 con 0x7fbdf4153af0 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3509690200 0 0) 0x7fbdd8003530 con 0x7fbdf4153af0 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 msgr2=0x7fbdf40c7f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 --2- 172.21.15.148:0/3911031536 >> v2:172.21.15.148:3300/0 conn(0x7fbdf40c9720 0x7fbdf40c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 >> v1:172.21.15.148:6789/0 conn(0x7fbdf40c7b80 legacy=0x7fbdf40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf40ca350 con 0x7fbdf4153af0 2024-04-26T23:11:37.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fbde4001680 con 0x7fbdf4153af0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 >> v1:172.21.15.157:6789/0 conn(0x7fbdf4153af0 legacy=0x7fbdf415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdd80039c0 0x7fbdd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdd80051d0 0x7fbdd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf415dec0 con 0x7fbdd8004810 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd800c100 con 0x7fbdd80051d0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.273+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd800c300 con 0x7fbdd80039c0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf1e00640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdd80039c0 0x7fbdd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf2800640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdd80051d0 0x7fbdd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 -- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdd80039c0 msgr2=0x7fbdd8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:37.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdd80039c0 0x7fbdd8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 -- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdd80051d0 msgr2=0x7fbdd800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:37.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdd80051d0 0x7fbdd800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 -- 172.21.15.148:0/3911031536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8003530 con 0x7fbdd8004810 2024-04-26T23:11:37.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf2800640 1 -- 172.21.15.148:0/3911031536 reap_dead start 2024-04-26T23:11:37.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbde9400640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdd8004c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001790 tx=0x7fbddc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f5a87dd83e9b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:37.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0013b0 con 0x7fbdd8004810 2024-04-26T23:11:37.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc004a10 con 0x7fbdd8004810 2024-04-26T23:11:37.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.277+0000 7fbdf1400640 1 -- 172.21.15.148:0/3911031536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc004e00 con 0x7fbdd8004810 2024-04-26T23:11:37.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 msgr2=0x7fbdd8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdd8004c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001790 tx=0x7fbddc01c400 comp rx=0 tx=0).stop 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- 172.21.15.148:0/3911031536 shutdown_connections 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 --2- 172.21.15.148:0/3911031536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdd8004c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- 172.21.15.148:0/3911031536 >> 172.21.15.148:0/3911031536 conn(0x7fbdf406c380 msgr2=0x7fbdf406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- 172.21.15.148:0/3911031536 shutdown_connections 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- 172.21.15.148:0/3911031536 wait complete. 2024-04-26T23:11:37.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 Processor -- start 2024-04-26T23:11:37.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- start start 2024-04-26T23:11:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf4073350 0x7fbdf41576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 0x7fbdf414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf415d290 con 0x7fbdd8004810 2024-04-26T23:11:37.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf40ca630 con 0x7fbdf4073350 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf9000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf4153ed0 con 0x7fbdf4157be0 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43504/0 (socket says 172.21.15.148:43504) 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 -- 172.21.15.148:0/2782583005 learned_addr learned my addr 172.21.15.148:0/2782583005 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 msgr2=0x7fbdf406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 msgr2=0x7fbdf406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf1e00640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbde9400640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf4073350 0x7fbdf41576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.281+0000 7fbdf2800640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 0x7fbdf414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf4073350 msgr2=0x7fbdf41576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf4073350 0x7fbdf41576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 msgr2=0x7fbdf406fda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 -- 172.21.15.148:0/2782583005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf4159930 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf2800640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 0x7fbdf414cde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4074530 tx=0x7fbdec007e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00b4e0 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec019070 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec009920 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf4159c10 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf4152a80 con 0x7fbdf4157be0 2024-04-26T23:11:37.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.285+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf4077c20 con 0x7fbdf4157be0 2024-04-26T23:11:37.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.289+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbdec012050 con 0x7fbdf4157be0 2024-04-26T23:11:37.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.289+0000 7fbdeaa00640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 0x7fbdd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:37.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.289+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbdec0879a0 con 0x7fbdf4157be0 2024-04-26T23:11:37.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.289+0000 7fbdf1e00640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 0x7fbdd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:37.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.289+0000 7fbdf1e00640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 0x7fbdd006a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbde40011d0 tx=0x7fbde4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:37.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.301+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbdec010040 con 0x7fbdf4157be0 2024-04-26T23:11:37.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.525+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbdf40c8670 con 0x7fbdf4157be0 2024-04-26T23:11:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.529+0000 7fbdeaa00640 1 -- 172.21.15.148:0/2782583005 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fbdec057c40 con 0x7fbdf4157be0 2024-04-26T23:11:37.530 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":50,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:37.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 msgr2=0x7fbdd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 0x7fbdd006a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbde40011d0 tx=0x7fbde4009040 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 msgr2=0x7fbdf414cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 0x7fbdf414cde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4074530 tx=0x7fbdec007e20 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 shutdown_connections 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbdd0068380 0x7fbdd006a840 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbde40011d0 tx=0x7fbde4009040 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbdf4157be0 0x7fbdf414cde0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf4073350 0x7fbdf41576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 --2- 172.21.15.148:0/2782583005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdd8004810 0x7fbdf406fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 >> 172.21.15.148:0/2782583005 conn(0x7fbdf406c380 msgr2=0x7fbdf40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 shutdown_connections 2024-04-26T23:11:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:37.533+0000 7fbdf9000640 1 -- 172.21.15.148:0/2782583005 wait complete. 2024-04-26T23:11:40.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:40.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.801+0000 7f3632a00640 1 Processor -- start 2024-04-26T23:11:40.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.801+0000 7f3632a00640 1 -- start start 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3632a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3632a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0c7e40 con 0x7f362c15c590 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3632a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0c8120 con 0x7f362c06fb60 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3632a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f362c156300 con 0x7f362c155f20 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3623e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f362c15c590 0x7f362c073550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54766/0 (socket says 172.21.15.148:54766) 2024-04-26T23:11:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f3623e00640 1 -- 172.21.15.148:0/157426905 learned_addr learned my addr 172.21.15.148:0/157426905 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:40.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:40.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:40.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:40.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:40.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:40.805+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:11:41.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.009+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:41.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.009+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:41.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.009+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:41.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.009+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:41.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.009+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:11:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.413+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.413+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.413+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.413+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:41.413+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:11:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:42.217+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:42.217+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:11:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:42.217+0000 7f362be00640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:11:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:42.217+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:11:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:42.217+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:11:43.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.509+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977992826 0 0) 0x7f362c0c8120 con 0x7f362c06fb60 2024-04-26T23:11:43.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.509+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3610003530 con 0x7f362c06fb60 2024-04-26T23:11:43.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111829771 0 0) 0x7f362c0c7e40 con 0x7f362c15c590 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c0c8120 con 0x7f362c15c590 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 425768085 0 0) 0x7f362c0c8120 con 0x7f362c15c590 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 msgr2=0x7f362c0722a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 --2- 172.21.15.148:0/157426905 >> v2:172.21.15.148:3300/0 conn(0x7f362c155f20 0x7f362c0722a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 >> v1:172.21.15.157:6789/0 conn(0x7f362c06fb60 legacy=0x7f362c1664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c072d50 con 0x7f362c15c590 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f3614001680 con 0x7f362c15c590 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 >> v1:172.21.15.148:6789/0 conn(0x7f362c15c590 legacy=0x7f362c073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3610003ba0 0x7f3610003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610004810 0x7f3610004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 0x7f361000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f361000c0a0 con 0x7f3610005220 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f361000c220 con 0x7f3610004810 2024-04-26T23:11:43.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f361000c420 con 0x7f3610003ba0 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 0x7f361000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3623e00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610004810 0x7f3610004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f362be00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3610003ba0 0x7f3610003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 -- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3610003ba0 msgr2=0x7f3610003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3610003ba0 0x7f3610003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 -- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610004810 msgr2=0x7f3610004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610004810 0x7f3610004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.517+0000 7f3630a00640 1 -- 172.21.15.148:0/157426905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c0c8120 con 0x7f3610005220 2024-04-26T23:11:43.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3630a00640 1 -- 172.21.15.148:0/157426905 reap_dead start 2024-04-26T23:11:43.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3630a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 0x7f361000b9d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3624001f50 tx=0x7f362401c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c344af06976e442a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624001b70 con 0x7f3610005220 2024-04-26T23:11:43.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624003b80 con 0x7f3610005220 2024-04-26T23:11:43.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f362b400640 1 -- 172.21.15.148:0/157426905 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240050d0 con 0x7f3610005220 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 -- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 msgr2=0x7f361000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 0x7f361000b9d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3624001f50 tx=0x7f362401c840 comp rx=0 tx=0).stop 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 -- 172.21.15.148:0/157426905 shutdown_connections 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 --2- 172.21.15.148:0/157426905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3610005220 0x7f361000b9d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 -- 172.21.15.148:0/157426905 >> 172.21.15.148:0/157426905 conn(0x7f362c06c380 msgr2=0x7f362c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 -- 172.21.15.148:0/157426905 shutdown_connections 2024-04-26T23:11:43.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.521+0000 7f3632a00640 1 -- 172.21.15.148:0/157426905 wait complete. 2024-04-26T23:11:43.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 Processor -- start 2024-04-26T23:11:43.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- start start 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610005220 0x7f362c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f362c14d780 0x7f362c1f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f362c072800 con 0x7f362c14e5c0 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f362c0c7ca0 con 0x7f3610005220 2024-04-26T23:11:43.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f362c15c9e0 con 0x7f362c14d780 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43556/0 (socket says 172.21.15.148:43556) 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 -- 172.21.15.148:0/3214064221 learned_addr learned my addr 172.21.15.148:0/3214064221 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f362be00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610005220 0x7f362c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3623e00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f362c14d780 0x7f362c1f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 -- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f362c14d780 msgr2=0x7f362c1f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f362c14d780 0x7f362c1f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 -- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610005220 msgr2=0x7f362c14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610005220 0x7f362c14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 -- 172.21.15.148:0/3214064221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c14ef80 con 0x7f362c14e5c0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3630a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f362401cd20 tx=0x7f36240195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624001b70 con 0x7f362c14e5c0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624006b60 con 0x7f362c14e5c0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624007dc0 con 0x7f362c14e5c0 2024-04-26T23:11:43.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c15ff20 con 0x7f362c14e5c0 2024-04-26T23:11:43.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c1f5bb0 con 0x7f362c14e5c0 2024-04-26T23:11:43.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.525+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c077c20 con 0x7f362c14e5c0 2024-04-26T23:11:43.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.529+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36240b4020 con 0x7f362c14e5c0 2024-04-26T23:11:43.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.529+0000 7f3628c00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 0x7f360806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.529+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3624120b10 con 0x7f362c14e5c0 2024-04-26T23:11:43.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.529+0000 7f362be00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 0x7f360806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.533+0000 7f362be00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 0x7f360806a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f361c000ee0 tx=0x7f361c0122f0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.533+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f36240bb030 con 0x7f362c14e5c0 2024-04-26T23:11:43.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.749+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f362c0696e0 con 0x7f362c14e5c0 2024-04-26T23:11:43.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.749+0000 7f3628c00640 1 -- 172.21.15.148:0/3214064221 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f362c14ef80 con 0x7f362c14e5c0 2024-04-26T23:11:43.750 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 msgr2=0x7f360806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 0x7f360806a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f361c000ee0 tx=0x7f361c0122f0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 msgr2=0x7f362c14ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f362401cd20 tx=0x7f36240195e0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 shutdown_connections 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f3608068380 0x7f360806a840 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f362c14e5c0 0x7f362c14ea40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f362c14d780 0x7f362c1f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 --2- 172.21.15.148:0/3214064221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3610005220 0x7f362c14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 >> 172.21.15.148:0/3214064221 conn(0x7f362c06c380 msgr2=0x7f362c06ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:43.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 shutdown_connections 2024-04-26T23:11:43.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.753+0000 7f3632a00640 1 -- 172.21.15.148:0/3214064221 wait complete. 2024-04-26T23:11:43.771 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:11:43.771 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:11:43.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:11:43.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.909+0000 7fb64c000640 1 Processor -- start 2024-04-26T23:11:43.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.909+0000 7fb64c000640 1 -- start start 2024-04-26T23:11:43.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64c000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 0x7fb6440c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64c000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb644073230 0x7fb6440736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64c000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb644073be0 con 0x7fb644158a80 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64c000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb6440c4b30 con 0x7fb644073230 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64c000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb6440c6f60 con 0x7fb644152d00 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb644073230 0x7fb6440736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64a000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb644158a80 0x7fb644158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54778/0 (socket says 172.21.15.148:54778) 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb644073230 0x7fb6440736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43558/0 (socket says 172.21.15.148:43558) 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb64a000640 1 -- 172.21.15.148:0/2405486474 learned_addr learned my addr 172.21.15.148:0/2405486474 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:43.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb649600640 1 --2- 172.21.15.148:0/2405486474 >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 0x7fb6440c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 -- 172.21.15.148:0/2405486474 >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 msgr2=0x7fb6440c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 --2- 172.21.15.148:0/2405486474 >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 0x7fb6440c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 -- 172.21.15.148:0/2405486474 >> v1:172.21.15.148:6789/0 conn(0x7fb644158a80 legacy=0x7fb644158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb648c00640 1 -- 172.21.15.148:0/2405486474 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440c7240 con 0x7fb644073230 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb643e00640 1 -- 172.21.15.148:0/2405486474 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637864311 0 0) 0x7fb644073be0 con 0x7fb644158a80 2024-04-26T23:11:43.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.913+0000 7fb649600640 1 --2- 172.21.15.148:0/2405486474 >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 0x7fb6440c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:11:43.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb648c00640 1 --2- 172.21.15.148:0/2405486474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb6440736a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb644068e40 tx=0x7fb63001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d72e36c0da3d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb643e00640 1 -- 172.21.15.148:0/2405486474 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300b0070 con 0x7fb644073230 2024-04-26T23:11:43.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb643e00640 1 -- 172.21.15.148:0/2405486474 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6300ab600 con 0x7fb644073230 2024-04-26T23:11:43.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb643e00640 1 -- 172.21.15.148:0/2405486474 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300ab9d0 con 0x7fb644073230 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- 172.21.15.148:0/2405486474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 msgr2=0x7fb6440736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 --2- 172.21.15.148:0/2405486474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb6440736a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb644068e40 tx=0x7fb63001c480 comp rx=0 tx=0).stop 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- 172.21.15.148:0/2405486474 shutdown_connections 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 --2- 172.21.15.148:0/2405486474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb6440736a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 --2- 172.21.15.148:0/2405486474 >> v2:172.21.15.157:3300/0 conn(0x7fb644152d00 0x7fb6440c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- 172.21.15.148:0/2405486474 >> 172.21.15.148:0/2405486474 conn(0x7fb6440c9d10 msgr2=0x7fb6440ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:43.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- 172.21.15.148:0/2405486474 shutdown_connections 2024-04-26T23:11:43.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- 172.21.15.148:0/2405486474 wait complete. 2024-04-26T23:11:43.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 Processor -- start 2024-04-26T23:11:43.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.917+0000 7fb64c000640 1 -- start start 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb64414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb644152d00 0x7fb64414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb644158a80 0x7fb6440c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440c4890 con 0x7fb644073230 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440c4710 con 0x7fb644152d00 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb64406fcf0 con 0x7fb644158a80 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb64414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb64414f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43566/0 (socket says 172.21.15.148:43566) 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 -- 172.21.15.148:0/1479471248 learned_addr learned my addr 172.21.15.148:0/1479471248 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb648c00640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb644152d00 0x7fb64414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64a000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb644158a80 0x7fb6440c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb644158a80 msgr2=0x7fb6440c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb644158a80 0x7fb6440c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb644152d00 msgr2=0x7fb64414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb644152d00 0x7fb64414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64414cb70 con 0x7fb644073230 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64a000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb644158a80 0x7fb6440c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb649600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb64414f4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e810 tx=0x7fb63800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638017070 con 0x7fb644073230 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63800c8d0 con 0x7fb644073230 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63800f040 con 0x7fb644073230 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6441f5160 con 0x7fb644073230 2024-04-26T23:11:43.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6441f48c0 con 0x7fb644073230 2024-04-26T23:11:43.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 0x7fb6441501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb64414c5c0 con 0x7fb6441f4ba0 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb648c00640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 0x7fb6441501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb648c00640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6441f4f80 con 0x7fb6441f4ba0 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb648c00640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 0x7fb6441501e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb644068ea0 tx=0x7fb630019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.921+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb63801a070 con 0x7fb644073230 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb624068380 0x7fb62406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb638086a10 con 0x7fb644073230 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300bb030 con 0x7fb6441f4ba0 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb6300b1040 con 0x7fb6441f4ba0 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 msgr2=0x7fb6441501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 0x7fb6441501e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb644068ea0 tx=0x7fb630019220 comp rx=0 tx=0).stop 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 msgr2=0x7fb6441501e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb641600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6441f4ba0 0x7fb6441501e0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb644068ea0 tx=0x7fb630019220 comp rx=0 tx=0).stop 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb64a000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb624068380 0x7fb62406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.925+0000 7fb64a000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb624068380 0x7fb62406a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb63c007fd0 tx=0x7fb63c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb64c000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 0x7fb644146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb64406dda0 con 0x7fb644150720 2024-04-26T23:11:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb648c00640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 0x7fb644146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:43.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb648c00640 1 -- 172.21.15.148:0/1479471248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb644074400 con 0x7fb644150720 2024-04-26T23:11:43.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb648c00640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 0x7fb644146f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb630019090 tx=0x7fb630009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.929+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300bb070 con 0x7fb644150720 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4559 (secure 0 0 0) 0x7fb6300b7480 con 0x7fb644150720 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 msgr2=0x7fb644146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb641600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 0x7fb644146f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb630019090 tx=0x7fb630009190 comp rx=0 tx=0).stop 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb641600640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 msgr2=0x7fb644146f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb641600640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644150720 0x7fb644146f30 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb630019090 tx=0x7fb630009190 comp rx=0 tx=0).stop 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:43.931 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 6699, 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:43.932 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:43.933 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:43.934 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:43.935 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:43.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:43.937 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:43.938 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.939 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:43.940 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:43.942 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:43.943 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb624068380 msgr2=0x7fb62406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb624068380 0x7fb62406a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb63c007fd0 tx=0x7fb63c009040 comp rx=0 tx=0).stop 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 msgr2=0x7fb64414f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 --2- 172.21.15.148:0/1479471248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb644073230 0x7fb64414f4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e810 tx=0x7fb63800ecd0 comp rx=0 tx=0).stop 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64a000640 1 -- 172.21.15.148:0/1479471248 reap_dead start 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64a000640 1 -- 172.21.15.148:0/1479471248 reap_dead start 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 shutdown_connections 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 >> 172.21.15.148:0/1479471248 conn(0x7fb6440c9d10 msgr2=0x7fb6440ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 shutdown_connections 2024-04-26T23:11:43.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:43.933+0000 7fb64c000640 1 -- 172.21.15.148:0/1479471248 wait complete. 2024-04-26T23:11:43.949 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:43.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:11:43.950 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:11:44.003 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:11:44.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:11:44.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.089+0000 7ffa6d200640 1 Processor -- start 2024-04-26T23:11:44.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.089+0000 7ffa6d200640 1 -- start start 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa6d200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa68153eb0 0x7ffa6815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa6d200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680c96a0 con 0x7ffa6806f460 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa6d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680c9980 con 0x7ffa6806ff50 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa6d200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6815ac00 con 0x7ffa68153eb0 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ffa6806f460 0x7ffa6806f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54784/0 (socket says 172.21.15.148:54784) 2024-04-26T23:11:44.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65e00640 1 -- 172.21.15.148:0/3522482840 learned_addr learned my addr 172.21.15.148:0/3522482840 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 --2- 172.21.15.148:0/3522482840 >> v2:172.21.15.157:3300/0 conn(0x7ffa68153eb0 0x7ffa6815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081593409 0 0) 0x7ffa680c96a0 con 0x7ffa6806f460 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa4c003530 con 0x7ffa6806f460 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3186332647 0 0) 0x7ffa4c003530 con 0x7ffa6806f460 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 >> v2:172.21.15.157:3300/0 conn(0x7ffa68153eb0 msgr2=0x7ffa6815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 --2- 172.21.15.148:0/3522482840 >> v2:172.21.15.157:3300/0 conn(0x7ffa68153eb0 0x7ffa6815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 >> v1:172.21.15.157:6789/0 conn(0x7ffa6806ff50 legacy=0x7ffa680c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa68070610 con 0x7ffa6806f460 2024-04-26T23:11:44.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7ffa58001680 con 0x7ffa6806f460 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 >> v1:172.21.15.148:6789/0 conn(0x7ffa6806f460 legacy=0x7ffa6806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c0039c0 0x7ffa4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 0x7ffa4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa4c0051d0 0x7ffa4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6815ac00 con 0x7ffa4c004810 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c00c080 con 0x7ffa4c0051d0 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c00c280 con 0x7ffa4c0039c0 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 0x7ffa4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa65e00640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c0039c0 0x7ffa4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa66800640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa4c0051d0 0x7ffa4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 -- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c0039c0 msgr2=0x7ffa4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c0039c0 0x7ffa4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 -- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa4c0051d0 msgr2=0x7ffa4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:44.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa4c0051d0 0x7ffa4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa5d400640 1 -- 172.21.15.148:0/3522482840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c003530 con 0x7ffa4c004810 2024-04-26T23:11:44.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.093+0000 7ffa66800640 1 -- 172.21.15.148:0/3522482840 reap_dead start 2024-04-26T23:11:44.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa5d400640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 0x7ffa4c004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009ae0 tx=0x7ffa5001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9b85da18759ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500b2070 con 0x7ffa4c004810 2024-04-26T23:11:44.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa500a5660 con 0x7ffa4c004810 2024-04-26T23:11:44.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa65400640 1 -- 172.21.15.148:0/3522482840 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500096b0 con 0x7ffa4c004810 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 msgr2=0x7ffa4c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 0x7ffa4c004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009ae0 tx=0x7ffa5001ca70 comp rx=0 tx=0).stop 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- 172.21.15.148:0/3522482840 shutdown_connections 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 --2- 172.21.15.148:0/3522482840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa4c004810 0x7ffa4c004c90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- 172.21.15.148:0/3522482840 >> 172.21.15.148:0/3522482840 conn(0x7ffa680c9d10 msgr2=0x7ffa680ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- 172.21.15.148:0/3522482840 shutdown_connections 2024-04-26T23:11:44.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- 172.21.15.148:0/3522482840 wait complete. 2024-04-26T23:11:44.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 Processor -- start 2024-04-26T23:11:44.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.097+0000 7ffa6d200640 1 -- start start 2024-04-26T23:11:44.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c004810 0x7ffa681ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 0x7ffa6814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814faa0 0x7ffa68149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680c4d70 con 0x7ffa681570e0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680c5120 con 0x7ffa6814faa0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680c4ef0 con 0x7ffa4c004810 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 0x7ffa6814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 0x7ffa6814f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43602/0 (socket says 172.21.15.148:43602) 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 -- 172.21.15.148:0/1955489693 learned_addr learned my addr 172.21.15.148:0/1955489693 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa65e00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c004810 0x7ffa681ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa66800640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814faa0 0x7ffa68149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c004810 msgr2=0x7ffa681ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa4c004810 0x7ffa681ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814faa0 msgr2=0x7ffa68149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814faa0 0x7ffa68149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa681f0840 con 0x7ffa681570e0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5d400640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 0x7ffa6814f230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa5001c8a0 tx=0x7ffa4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500b2040 con 0x7ffa681570e0 2024-04-26T23:11:44.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa500bb070 con 0x7ffa681570e0 2024-04-26T23:11:44.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa681effa0 con 0x7ffa681570e0 2024-04-26T23:11:44.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500ad680 con 0x7ffa681570e0 2024-04-26T23:11:44.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa681f0560 con 0x7ffa681570e0 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 0x7ffa681f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68077c20 con 0x7ffa6814e990 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa65e00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 0x7ffa681f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa65e00640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa680c5ee0 con 0x7ffa6814e990 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa500ad820 con 0x7ffa681570e0 2024-04-26T23:11:44.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.101+0000 7ffa65e00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 0x7ffa681f2e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa580077b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa44068380 0x7ffa4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffa50120720 con 0x7ffa681570e0 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58012b00 con 0x7ffa6814e990 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa66800640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa44068380 0x7ffa4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ffa5801a070 con 0x7ffa6814e990 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 msgr2=0x7ffa681f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 0x7ffa681f2e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa580077b0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 msgr2=0x7ffa681f2e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa5ea00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814e990 0x7ffa681f2e60 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa580077b0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.105+0000 7ffa66800640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa44068380 0x7ffa4406a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa68070330 tx=0x7ffa60009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.109+0000 7ffa6d200640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 0x7ffa681f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.109+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68070c20 con 0x7ffa6814ee10 2024-04-26T23:11:44.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.109+0000 7ffa65e00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 0x7ffa681f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.109+0000 7ffa65e00640 1 -- 172.21.15.148:0/1955489693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffa680c8e30 con 0x7ffa6814ee10 2024-04-26T23:11:44.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa65e00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 0x7ffa681f33a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa58007900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58015910 con 0x7ffa6814ee10 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4728 (secure 0 0 0) 0x7ffa58015910 con 0x7ffa6814ee10 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 msgr2=0x7ffa681f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 0x7ffa681f33a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa58007900 comp rx=0 tx=0).stop 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 msgr2=0x7ffa681f33a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa5ea00640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa6814ee10 0x7ffa681f33a0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa580072f0 tx=0x7ffa58007900 comp rx=0 tx=0).stop 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:44.112 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 59731, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:44.113 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:44.114 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:44.115 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:44.116 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:44.118 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:44.119 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:44.120 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:11:44.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:44.124 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa44068380 msgr2=0x7ffa4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ffa44068380 0x7ffa4406a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa68070330 tx=0x7ffa60009040 comp rx=0 tx=0).stop 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 msgr2=0x7ffa6814f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 --2- 172.21.15.148:0/1955489693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa681570e0 0x7ffa6814f230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa5001c8a0 tx=0x7ffa4c005840 comp rx=0 tx=0).stop 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa66800640 1 -- 172.21.15.148:0/1955489693 reap_dead start 2024-04-26T23:11:44.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa66800640 1 -- 172.21.15.148:0/1955489693 reap_dead start 2024-04-26T23:11:44.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 shutdown_connections 2024-04-26T23:11:44.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 >> 172.21.15.148:0/1955489693 conn(0x7ffa680c9d10 msgr2=0x7ffa680c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 shutdown_connections 2024-04-26T23:11:44.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.113+0000 7ffa6d200640 1 -- 172.21.15.148:0/1955489693 wait complete. 2024-04-26T23:11:44.130 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:44.130 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:11:44.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:11:44.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 Processor -- start 2024-04-26T23:11:44.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 -- start start 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c152d00 0x7fdd4c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd4c073230 0x7fdd4c073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c073bb0 con 0x7fdd4c158a80 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c0c4b30 con 0x7fdd4c073230 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd53a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0c6f60 con 0x7fdd4c152d00 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd43e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd4c073230 0x7fdd4c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd51a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdd4c158a80 0x7fdd4c158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54800/0 (socket says 172.21.15.148:54800) 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd51a00640 1 -- 172.21.15.148:0/4167932613 learned_addr learned my addr 172.21.15.148:0/4167932613 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:44.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd51000640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c152d00 0x7fdd4c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd43e00640 1 -- 172.21.15.148:0/4167932613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c152d00 msgr2=0x7fdd4c0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd43e00640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c152d00 0x7fdd4c0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd43e00640 1 -- 172.21.15.148:0/4167932613 >> v1:172.21.15.148:6789/0 conn(0x7fdd4c158a80 legacy=0x7fdd4c158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd43e00640 1 -- 172.21.15.148:0/4167932613 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0c7240 con 0x7fdd4c073230 2024-04-26T23:11:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.313+0000 7fdd4be00640 1 -- 172.21.15.148:0/4167932613 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678392876 0 0) 0x7fdd4c073bb0 con 0x7fdd4c158a80 2024-04-26T23:11:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd43e00640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c073230 0x7fdd4c073670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097c0 tx=0x7fdd3401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad46fd4b6a259941 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd4be00640 1 -- 172.21.15.148:0/4167932613 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340b0070 con 0x7fdd4c073230 2024-04-26T23:11:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd4be00640 1 -- 172.21.15.148:0/4167932613 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd340ab600 con 0x7fdd4c073230 2024-04-26T23:11:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd4be00640 1 -- 172.21.15.148:0/4167932613 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340ab9d0 con 0x7fdd4c073230 2024-04-26T23:11:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 -- 172.21.15.148:0/4167932613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c073230 msgr2=0x7fdd4c073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c073230 0x7fdd4c073670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097c0 tx=0x7fdd3401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 -- 172.21.15.148:0/4167932613 shutdown_connections 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c073230 0x7fdd4c073670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4167932613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c152d00 0x7fdd4c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 -- 172.21.15.148:0/4167932613 >> 172.21.15.148:0/4167932613 conn(0x7fdd4c0c9d10 msgr2=0x7fdd4c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 -- 172.21.15.148:0/4167932613 shutdown_connections 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.317+0000 7fdd53a00640 1 -- 172.21.15.148:0/4167932613 wait complete. 2024-04-26T23:11:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 Processor -- start 2024-04-26T23:11:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- start start 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd4c073230 0x7fdd4c148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 0x7fdd4c0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c158a80 0x7fdd4c0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0c4890 con 0x7fdd4c152d00 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0c4710 con 0x7fdd4c073230 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c165c20 con 0x7fdd4c158a80 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 0x7fdd4c0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 0x7fdd4c0c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43630/0 (socket says 172.21.15.148:43630) 2024-04-26T23:11:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 -- 172.21.15.148:0/4006748939 learned_addr learned my addr 172.21.15.148:0/4006748939 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd51000640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd4c073230 0x7fdd4c148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd51a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c158a80 0x7fdd4c0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c158a80 msgr2=0x7fdd4c0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c158a80 0x7fdd4c0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd4c073230 msgr2=0x7fdd4c148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd4c073230 0x7fdd4c148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0cbb40 con 0x7fdd4c152d00 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd43e00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 0x7fdd4c0c85c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd340ae040 tx=0x7fdd34019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340b0040 con 0x7fdd4c152d00 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd340ab400 con 0x7fdd4c152d00 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340b4650 con 0x7fdd4c152d00 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c0cbe20 con 0x7fdd4c152d00 2024-04-26T23:11:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.321+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c0cc3e0 con 0x7fdd4c152d00 2024-04-26T23:11:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 0x7fdd4c146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c077c20 con 0x7fdd4c146850 2024-04-26T23:11:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd51000640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 0x7fdd4c146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd51000640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd4c075cb0 con 0x7fdd4c146850 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd340bc020 con 0x7fdd4c152d00 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd51000640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 0x7fdd4c146e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00f410 tx=0x7fdd3c00f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdd28068380 0x7fdd2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdd34120230 con 0x7fdd4c152d00 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c019020 con 0x7fdd4c146850 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd51a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdd28068380 0x7fdd2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd3c014870 con 0x7fdd4c146850 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 msgr2=0x7fdd4c146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 0x7fdd4c146e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00f410 tx=0x7fdd3c00f8d0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 msgr2=0x7fdd4c146e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd49600640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c146850 0x7fdd4c146e10 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00f410 tx=0x7fdd3c00f8d0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.325+0000 7fdd51a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdd28068380 0x7fdd2806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0c1260 tx=0x7fdd44007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 0x7fdd4c1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c147760 con 0x7fdd4c147350 2024-04-26T23:11:44.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd51000640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 0x7fdd4c1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd51000640 1 -- 172.21.15.148:0/4006748939 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd4c157170 con 0x7fdd4c147350 2024-04-26T23:11:44.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd51000640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 0x7fdd4c1f5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00f410 tx=0x7fdd3c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c019070 con 0x7fdd4c147350 2024-04-26T23:11:44.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7fdd3c003820 con 0x7fdd4c147350 2024-04-26T23:11:44.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 msgr2=0x7fdd4c1f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 0x7fdd4c1f5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00f410 tx=0x7fdd3c0046d0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 msgr2=0x7fdd4c1f5870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:44.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd49600640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd4c147350 0x7fdd4c1f5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 447183, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:44.335 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:44.336 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:44.337 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:44.338 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.339 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.340 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.341 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.342 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:44.344 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.345 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 8 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.346 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:44.347 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:44.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:44.348 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:44.348 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdd28068380 msgr2=0x7fdd2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fdd28068380 0x7fdd2806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0c1260 tx=0x7fdd44007e90 comp rx=0 tx=0).stop 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 msgr2=0x7fdd4c0c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd53a00640 1 --2- 172.21.15.148:0/4006748939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd4c152d00 0x7fdd4c0c85c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd340ae040 tx=0x7fdd34019240 comp rx=0 tx=0).stop 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.333+0000 7fdd51a00640 1 -- 172.21.15.148:0/4006748939 reap_dead start 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.337+0000 7fdd51a00640 1 -- 172.21.15.148:0/4006748939 reap_dead start 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.337+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 shutdown_connections 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.337+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 >> 172.21.15.148:0/4006748939 conn(0x7fdd4c0c9d10 msgr2=0x7fdd4c0ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.337+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 shutdown_connections 2024-04-26T23:11:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.337+0000 7fdd53a00640 1 -- 172.21.15.148:0/4006748939 wait complete. 2024-04-26T23:11:44.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:44.353 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:11:44.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:11:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 Processor -- start 2024-04-26T23:11:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 -- start start 2024-04-26T23:11:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 0x7faac80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac80c99c0 con 0x7faac8153af0 2024-04-26T23:11:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7faac815dec0 con 0x7faac80c7b80 2024-04-26T23:11:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.489+0000 7faacdc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faac80ca630 con 0x7faac80c9010 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:41906/0 (socket says 172.21.15.148:41906) 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 -- 172.21.15.148:0/1387026903 learned_addr learned my addr 172.21.15.148:0/1387026903 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac6000640 1 --2- 172.21.15.148:0/1387026903 >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 0x7faac80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 -- 172.21.15.148:0/1387026903 >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 msgr2=0x7faac80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 --2- 172.21.15.148:0/1387026903 >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 0x7faac80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 -- 172.21.15.148:0/1387026903 >> v1:172.21.15.157:6789/0 conn(0x7faac8153af0 legacy=0x7faac815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 -- 172.21.15.148:0/1387026903 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac80c9d90 con 0x7faac80c9010 2024-04-26T23:11:44.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac6000640 1 --2- 172.21.15.148:0/1387026903 >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 0x7faac80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:11:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.493+0000 7faac7400640 1 --2- 172.21.15.148:0/1387026903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46bea3f80138ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac5600640 1 -- 172.21.15.148:0/1387026903 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00b4070 con 0x7faac80c9010 2024-04-26T23:11:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac5600640 1 -- 172.21.15.148:0/1387026903 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00af400 con 0x7faac80c9010 2024-04-26T23:11:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac5600640 1 -- 172.21.15.148:0/1387026903 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00af7d0 con 0x7faac80c9010 2024-04-26T23:11:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- 172.21.15.148:0/1387026903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 msgr2=0x7faac80c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- 172.21.15.148:0/1387026903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac001f210 comp rx=0 tx=0).stop 2024-04-26T23:11:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- 172.21.15.148:0/1387026903 shutdown_connections 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- 172.21.15.148:0/1387026903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c9010 0x7faac80c9480 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- 172.21.15.148:0/1387026903 >> v2:172.21.15.157:3300/0 conn(0x7faac80c7b80 0x7faac80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- 172.21.15.148:0/1387026903 >> 172.21.15.148:0/1387026903 conn(0x7faac806c380 msgr2=0x7faac806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- 172.21.15.148:0/1387026903 shutdown_connections 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- 172.21.15.148:0/1387026903 wait complete. 2024-04-26T23:11:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 Processor -- start 2024-04-26T23:11:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- start start 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c7b80 0x7faac81ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac8153af0 0x7faac81f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faac815cfb0 con 0x7faac80c9010 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faac80ca350 con 0x7faac8153af0 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faacdc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faac815d290 con 0x7faac80c7b80 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43636/0 (socket says 172.21.15.148:43636) 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 -- 172.21.15.148:0/336011378 learned_addr learned my addr 172.21.15.148:0/336011378 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6a00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c7b80 0x7faac81ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac7400640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac8153af0 0x7faac81f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 -- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c7b80 msgr2=0x7faac81ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c7b80 0x7faac81ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 -- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac8153af0 msgr2=0x7faac81f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.497+0000 7faac6000640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac8153af0 0x7faac81f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faac6000640 1 -- 172.21.15.148:0/336011378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac814bcd0 con 0x7faac80c9010 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faac6000640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faab400ebe0 tx=0x7faab400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faac80c9010 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab400cc30 con 0x7faac80c9010 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4013470 con 0x7faac80c9010 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac814ac70 con 0x7faac80c9010 2024-04-26T23:11:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac814bf70 con 0x7faac80c9010 2024-04-26T23:11:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac8077c20 con 0x7faac80c9010 2024-04-26T23:11:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faab401a070 con 0x7faac80c9010 2024-04-26T23:11:44.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 0x7faaa806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:44.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faab4086c00 con 0x7faac80c9010 2024-04-26T23:11:44.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.501+0000 7faac6a00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 0x7faaa806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:44.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.505+0000 7faac6a00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 0x7faaa806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faab8001770 tx=0x7faab8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:44.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.505+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faab408d080 con 0x7faac80c9010 2024-04-26T23:11:44.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.729+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7faac80cb050 con 0x7faac80c9010 2024-04-26T23:11:44.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.729+0000 7faabea00640 1 -- 172.21.15.148:0/336011378 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7faab4056770 con 0x7faac80c9010 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 msgr2=0x7faaa806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 0x7faaa806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faab8001770 tx=0x7faab8009040 comp rx=0 tx=0).stop 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 msgr2=0x7faac814c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faab400ebe0 tx=0x7faab400c520 comp rx=0 tx=0).stop 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 shutdown_connections 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faaa80683b0 0x7faaa806a870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac8153af0 0x7faac81f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac80c9010 0x7faac814c770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 --2- 172.21.15.148:0/336011378 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faac80c7b80 0x7faac81ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:44.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 >> 172.21.15.148:0/336011378 conn(0x7faac806c380 msgr2=0x7faac80cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:44.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 shutdown_connections 2024-04-26T23:11:44.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:44.733+0000 7faacdc00640 1 -- 172.21.15.148:0/336011378 wait complete. 2024-04-26T23:11:44.752 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:11:54.753 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:11:54.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:11:54.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 Processor -- start 2024-04-26T23:11:54.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 -- start start 2024-04-26T23:11:54.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 0x7f479c06e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f479c06cb40 0x7f479c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479c1597a0 con 0x7f479c1593c0 2024-04-26T23:11:54.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f479c1601b0 con 0x7f479c06cb40 2024-04-26T23:11:54.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f47a2800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f479c15f2c0 con 0x7f479c0c8d30 2024-04-26T23:11:54.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f479c06cb40 0x7f479c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f4792a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 0x7f479c06e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f479c06cb40 0x7f479c15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40774/0 (socket says 172.21.15.148:40774) 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 -- 172.21.15.148:0/2013776610 learned_addr learned my addr 172.21.15.148:0/2013776610 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 -- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 msgr2=0x7f479c06e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 0x7f479c06e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 -- 172.21.15.148:0/2013776610 >> v1:172.21.15.157:6789/0 conn(0x7f479c1593c0 legacy=0x7f479c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f479be00640 1 -- 172.21.15.148:0/2013776610 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c15f5a0 con 0x7f479c06cb40 2024-04-26T23:11:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.901+0000 7f4792a00640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 0x7f479c06e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:11:54.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f479be00640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c06cb40 0x7f479c15c0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f479c160330 tx=0x7f479401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22930d0dbe30552a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f479aa00640 1 -- 172.21.15.148:0/2013776610 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940ab430 con 0x7f479c06cb40 2024-04-26T23:11:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f479aa00640 1 -- 172.21.15.148:0/2013776610 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47940b0070 con 0x7f479c06cb40 2024-04-26T23:11:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f479aa00640 1 -- 172.21.15.148:0/2013776610 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940ab7f0 con 0x7f479c06cb40 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 -- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c06cb40 msgr2=0x7f479c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c06cb40 0x7f479c15c0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f479c160330 tx=0x7f479401c540 comp rx=0 tx=0).stop 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 -- 172.21.15.148:0/2013776610 shutdown_connections 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c06cb40 0x7f479c15c0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 --2- 172.21.15.148:0/2013776610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c0c8d30 0x7f479c06e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 -- 172.21.15.148:0/2013776610 >> 172.21.15.148:0/2013776610 conn(0x7f479c06d490 msgr2=0x7f479c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:54.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 -- 172.21.15.148:0/2013776610 shutdown_connections 2024-04-26T23:11:54.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.905+0000 7f47a2800640 1 -- 172.21.15.148:0/2013776610 wait complete. 2024-04-26T23:11:54.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 Processor -- start 2024-04-26T23:11:54.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- start start 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c06cb40 0x7f479c150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c0c8d30 0x7f479c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f479c0ca3b0 con 0x7f479c1593c0 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f479c15c9f0 con 0x7f479c0c8d30 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f479c0ceaa0 con 0x7f479c06cb40 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53890/0 (socket says 172.21.15.148:53890) 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 -- 172.21.15.148:0/1442719358 learned_addr learned my addr 172.21.15.148:0/1442719358 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f4792a00640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c0c8d30 0x7f479c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479b400640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c06cb40 0x7f479c150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 -- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c06cb40 msgr2=0x7f479c150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c06cb40 0x7f479c150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 -- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c0c8d30 msgr2=0x7f479c14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c0c8d30 0x7f479c14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:54.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 -- 172.21.15.148:0/1442719358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c15c040 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f479be00640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f479401abf0 tx=0x7f47940192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940b43f0 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47940bc070 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c150e70 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940b4790 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.909+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c0c7b20 con 0x7f479c1593c0 2024-04-26T23:11:54.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c077c20 con 0x7f479c1593c0 2024-04-26T23:11:54.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47940b4930 con 0x7f479c1593c0 2024-04-26T23:11:54.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f4793e00640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 0x7f477806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:54.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4794120c30 con 0x7f479c1593c0 2024-04-26T23:11:54.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f479b400640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 0x7f477806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:54.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.913+0000 7f479b400640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 0x7f477806a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f478c001e00 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:54.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:54.917+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4794016130 con 0x7f479c1593c0 2024-04-26T23:11:55.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.137+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f479c1f4520 con 0x7f479c1593c0 2024-04-26T23:11:55.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.137+0000 7f4793e00640 1 -- 172.21.15.148:0/1442719358 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f47940f05f0 con 0x7f479c1593c0 2024-04-26T23:11:55.137 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:11:55.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 msgr2=0x7f477806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 0x7f477806a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f478c001e00 tx=0x7f478c009040 comp rx=0 tx=0).stop 2024-04-26T23:11:55.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 msgr2=0x7f479c1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f479401abf0 tx=0x7f47940192e0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 shutdown_connections 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4778068380 0x7f477806a840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f479c1593c0 0x7f479c1518c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f479c0c8d30 0x7f479c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 --2- 172.21.15.148:0/1442719358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f479c06cb40 0x7f479c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 >> 172.21.15.148:0/1442719358 conn(0x7f479c06d490 msgr2=0x7f479c15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 shutdown_connections 2024-04-26T23:11:55.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.141+0000 7f47a2800640 1 -- 172.21.15.148:0/1442719358 wait complete. 2024-04-26T23:11:55.158 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:11:55.158 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:11:55.158 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:11:55.158 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:11:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.297+0000 7fd99d200640 1 Processor -- start 2024-04-26T23:11:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.297+0000 7fd99d200640 1 -- start start 2024-04-26T23:11:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd99d200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd998156100 0x7fd9980c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd99d200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd998070720 con 0x7fd99815bb90 2024-04-26T23:11:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd99d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9980c78f0 con 0x7fd998073700 2024-04-26T23:11:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd99d200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd998069ff0 con 0x7fd998156100 2024-04-26T23:11:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd996800640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd99815bb90 0x7fd99815bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57850/0 (socket says 172.21.15.148:57850) 2024-04-26T23:11:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd996800640 1 -- 172.21.15.148:0/3940449324 learned_addr learned my addr 172.21.15.148:0/3940449324 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 --2- 172.21.15.148:0/3940449324 >> v2:172.21.15.157:3300/0 conn(0x7fd998156100 0x7fd9980c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582456801 0 0) 0x7fd990001120 con 0x7fd99815bb90 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd97c003530 con 0x7fd99815bb90 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1604854496 0 0) 0x7fd97c003530 con 0x7fd99815bb90 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 >> v2:172.21.15.157:3300/0 conn(0x7fd998156100 msgr2=0x7fd9980c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 --2- 172.21.15.148:0/3940449324 >> v2:172.21.15.157:3300/0 conn(0x7fd998156100 0x7fd9980c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 >> v1:172.21.15.157:6789/0 conn(0x7fd998073700 legacy=0x7fd998073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9980709a0 con 0x7fd99815bb90 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fd990001850 con 0x7fd99815bb90 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 >> v1:172.21.15.148:6789/0 conn(0x7fd99815bb90 legacy=0x7fd99815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 0x7fd97c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c004810 0x7fd97c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd97c0051d0 0x7fd97c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd998069ff0 con 0x7fd97c0039c0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c00c070 con 0x7fd97c004810 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c00c270 con 0x7fd97c0051d0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 0x7fd97c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd98d400640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c004810 0x7fd97c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd996800640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd97c0051d0 0x7fd97c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 -- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd97c0051d0 msgr2=0x7fd97c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd97c0051d0 0x7fd97c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 -- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c004810 msgr2=0x7fd97c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c004810 0x7fd97c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd995e00640 1 -- 172.21.15.148:0/3940449324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c003530 con 0x7fd97c0039c0 2024-04-26T23:11:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.301+0000 7fd996800640 1 -- 172.21.15.148:0/3940449324 reap_dead start 2024-04-26T23:11:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd995e00640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 0x7fd97c003de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd988009fc0 tx=0x7fd98801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f7daec24acc5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880b2070 con 0x7fd97c0039c0 2024-04-26T23:11:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9880a5b80 con 0x7fd97c0039c0 2024-04-26T23:11:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd995400640 1 -- 172.21.15.148:0/3940449324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988009c10 con 0x7fd97c0039c0 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 -- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 msgr2=0x7fd97c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 0x7fd97c003de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd988009fc0 tx=0x7fd98801cc80 comp rx=0 tx=0).stop 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 -- 172.21.15.148:0/3940449324 shutdown_connections 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 --2- 172.21.15.148:0/3940449324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd97c0039c0 0x7fd97c003de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 -- 172.21.15.148:0/3940449324 >> 172.21.15.148:0/3940449324 conn(0x7fd9980cd5e0 msgr2=0x7fd9980cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 -- 172.21.15.148:0/3940449324 shutdown_connections 2024-04-26T23:11:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.305+0000 7fd99d200640 1 -- 172.21.15.148:0/3940449324 wait complete. 2024-04-26T23:11:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 Processor -- start 2024-04-26T23:11:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- start start 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c0039c0 0x7fd998157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd99814a130 0x7fd998157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980c74b0 con 0x7fd9980ccf70 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980731e0 con 0x7fd97c0039c0 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9980c7630 con 0x7fd99814a130 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53908/0 (socket says 172.21.15.148:53908) 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 -- 172.21.15.148:0/3693974764 learned_addr learned my addr 172.21.15.148:0/3693974764 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd995e00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c0039c0 0x7fd998157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd98d400640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd99814a130 0x7fd998157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd99814a130 msgr2=0x7fd998157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd99814a130 0x7fd998157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c0039c0 msgr2=0x7fd998157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd97c0039c0 0x7fd998157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99814aa20 con 0x7fd9980ccf70 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd996800640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd990001ec0 tx=0x7fd990007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990007760 con 0x7fd9980ccf70 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99000e660 con 0x7fd9980ccf70 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9980cb960 con 0x7fd9980ccf70 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99000ea50 con 0x7fd9980ccf70 2024-04-26T23:11:55.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99814acc0 con 0x7fd9980ccf70 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 0x7fd99814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd9981439a0 con 0x7fd9980cc850 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.309+0000 7fd995e00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 0x7fd99814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd995e00640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd998077c20 con 0x7fd9980cc850 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd995e00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 0x7fd99814b1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd988009f90 tx=0x7fd988009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880bc070 con 0x7fd9980cc850 2024-04-26T23:11:55.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd99000ebf0 con 0x7fd9980ccf70 2024-04-26T23:11:55.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd974068280 0x7fd97406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd990086510 con 0x7fd9980ccf70 2024-04-26T23:11:55.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd988003ba0 con 0x7fd9980cc850 2024-04-26T23:11:55.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 msgr2=0x7fd99814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 0x7fd99814b1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd988009f90 tx=0x7fd988009750 comp rx=0 tx=0).stop 2024-04-26T23:11:55.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 msgr2=0x7fd99814b1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98ea00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980cc850 0x7fd99814b1e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd988009f90 tx=0x7fd988009750 comp rx=0 tx=0).stop 2024-04-26T23:11:55.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98d400640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd974068280 0x7fd97406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.313+0000 7fd98d400640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd974068280 0x7fd97406a740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9980ce520 tx=0x7fd980009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 0x7fd9981f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd998070fb0 con 0x7fd99814b720 2024-04-26T23:11:55.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd995e00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 0x7fd9981f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd995e00640 1 -- 172.21.15.148:0/3693974764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9980c8df0 con 0x7fd99814b720 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd995e00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 0x7fd9981f8280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd98801cab0 tx=0x7fd988004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880b2040 con 0x7fd99814b720 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4561 (secure 0 0 0) 0x7fd988003e00 con 0x7fd99814b720 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 msgr2=0x7fd9981f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 0x7fd9981f8280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd98801cab0 tx=0x7fd988004a50 comp rx=0 tx=0).stop 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 msgr2=0x7fd9981f8280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd98ea00640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd99814b720 0x7fd9981f8280 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd98801cab0 tx=0x7fd988004a50 comp rx=0 tx=0).stop 2024-04-26T23:11:55.320 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 18087, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 11, 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:55.321 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:55.322 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.323 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:55.324 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.325 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.330 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.331 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:55.332 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd974068280 msgr2=0x7fd97406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd974068280 0x7fd97406a740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9980ce520 tx=0x7fd980009040 comp rx=0 tx=0).stop 2024-04-26T23:11:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 msgr2=0x7fd9980cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd990001ec0 tx=0x7fd990007420 comp rx=0 tx=0).stop 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd996800640 1 -- 172.21.15.148:0/3693974764 reap_dead start 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 shutdown_connections 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 --2- 172.21.15.148:0/3693974764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9980ccf70 0x7fd9980cc310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 >> 172.21.15.148:0/3693974764 conn(0x7fd9980cd5e0 msgr2=0x7fd9980c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 shutdown_connections 2024-04-26T23:11:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.321+0000 7fd99d200640 1 -- 172.21.15.148:0/3693974764 wait complete. 2024-04-26T23:11:55.338 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:55.338 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:11:55.339 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:11:55.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 Processor -- start 2024-04-26T23:11:55.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 -- start start 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd690071630 0x7fd6900cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6900ca5a0 con 0x7fd69015ca20 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6900ca880 con 0x7fd690159320 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd695400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fd6900cab60 con 0x7fd690071630 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd690071630 0x7fd6900cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd690071630 0x7fd6900cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53938/0 (socket says 172.21.15.148:53938) 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 -- 172.21.15.148:0/1286996231 learned_addr learned my addr 172.21.15.148:0/1286996231 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:55.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd68fe00640 1 --1- 172.21.15.148:0/1286996231 >> v1:172.21.15.157:6789/0 conn(0x7fd690159320 0x7fd69015c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52018/0 (socket says 172.21.15.148:52018) 2024-04-26T23:11:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd687400640 1 --1- 172.21.15.148:0/1286996231 >> v1:172.21.15.148:6789/0 conn(0x7fd69015ca20 0x7fd6900cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57854/0 (socket says 172.21.15.148:57854) 2024-04-26T23:11:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 -- 172.21.15.148:0/1286996231 >> v1:172.21.15.157:6789/0 conn(0x7fd690159320 legacy=0x7fd69015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 -- 172.21.15.148:0/1286996231 >> v1:172.21.15.148:6789/0 conn(0x7fd69015ca20 legacy=0x7fd6900cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.477+0000 7fd694a00640 1 -- 172.21.15.148:0/1286996231 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd690159700 con 0x7fd690071630 2024-04-26T23:11:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd694a00640 1 --2- 172.21.15.148:0/1286996231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900cf930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fc0d1d77933ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd68f400640 1 -- 172.21.15.148:0/1286996231 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880a7070 con 0x7fd690071630 2024-04-26T23:11:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd68f400640 1 -- 172.21.15.148:0/1286996231 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6880b0070 con 0x7fd690071630 2024-04-26T23:11:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd68f400640 1 -- 172.21.15.148:0/1286996231 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880ab890 con 0x7fd690071630 2024-04-26T23:11:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 -- 172.21.15.148:0/1286996231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 msgr2=0x7fd6900cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 --2- 172.21.15.148:0/1286996231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900cf930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68801c560 comp rx=0 tx=0).stop 2024-04-26T23:11:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 -- 172.21.15.148:0/1286996231 shutdown_connections 2024-04-26T23:11:55.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 --2- 172.21.15.148:0/1286996231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900cf930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 -- 172.21.15.148:0/1286996231 >> 172.21.15.148:0/1286996231 conn(0x7fd69006c980 msgr2=0x7fd690068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 -- 172.21.15.148:0/1286996231 shutdown_connections 2024-04-26T23:11:55.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.481+0000 7fd695400640 1 -- 172.21.15.148:0/1286996231 wait complete. 2024-04-26T23:11:55.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 Processor -- start 2024-04-26T23:11:55.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- start start 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd690159320 0x7fd690157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd69015ca20 0x7fd6901553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd690169f70 con 0x7fd690071630 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd690169df0 con 0x7fd69015ca20 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd69016a0f0 con 0x7fd690159320 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53940/0 (socket says 172.21.15.148:53940) 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 -- 172.21.15.148:0/499279616 learned_addr learned my addr 172.21.15.148:0/499279616 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd694a00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd69015ca20 0x7fd6901553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd690159320 0x7fd690157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd690159320 msgr2=0x7fd690157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd690159320 0x7fd690157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd69015ca20 msgr2=0x7fd6901553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd69015ca20 0x7fd6901553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd690156f50 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd690159320 0x7fd690157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68fe00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900c4500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c7b0 tx=0x7fd68000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680017070 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68000a640 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd690155920 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68000a9f0 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69014ff90 con 0x7fd690071630 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 0x7fd6901f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.485+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd690069c00 con 0x7fd690157df0 2024-04-26T23:11:55.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 0x7fd6901f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd687400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6900506d0 con 0x7fd690157df0 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd68001a070 con 0x7fd690071630 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 0x7fd6901f7e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd678000f70 tx=0x7fd67800d930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd66c068380 0x7fd66c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd6800863e0 con 0x7fd690071630 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd694a00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd66c068380 0x7fd66c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678018070 con 0x7fd690157df0 2024-04-26T23:11:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd6780074e0 con 0x7fd690157df0 2024-04-26T23:11:55.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 msgr2=0x7fd6901f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 0x7fd6901f7e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd678000f70 tx=0x7fd67800d930 comp rx=0 tx=0).stop 2024-04-26T23:11:55.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 msgr2=0x7fd6901f7e00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd68cc00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd690157df0 0x7fd6901f7e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.489+0000 7fd694a00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd66c068380 0x7fd66c06a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd6880af000 tx=0x7fd6880a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd695400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 0x7fd6901f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900684c0 con 0x7fd6900c5600 2024-04-26T23:11:55.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 0x7fd6901f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd687400640 1 -- 172.21.15.148:0/499279616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6900681e0 con 0x7fd6900c5600 2024-04-26T23:11:55.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd687400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 0x7fd6901f8340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd678000f70 tx=0x7fd678001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.497+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678018050 con 0x7fd6900c5600 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4729 (secure 0 0 0) 0x7fd678019040 con 0x7fd6900c5600 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 msgr2=0x7fd6901f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd68cc00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 0x7fd6901f8340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd678000f70 tx=0x7fd678001130 comp rx=0 tx=0).stop 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd68cc00640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 msgr2=0x7fd6901f8340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd68cc00640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6900c5600 0x7fd6901f8340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:55.499 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 71118, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 12, 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.500 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:55.502 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.503 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.504 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.505 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:55.507 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.508 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 4 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.509 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:55.510 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd66c068380 msgr2=0x7fd66c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd66c068380 0x7fd66c06a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd6880af000 tx=0x7fd6880a7000 comp rx=0 tx=0).stop 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 msgr2=0x7fd6900c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 --2- 172.21.15.148:0/499279616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd690071630 0x7fd6900c4500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c7b0 tx=0x7fd68000cc70 comp rx=0 tx=0).stop 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd694a00640 1 -- 172.21.15.148:0/499279616 reap_dead start 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd694a00640 1 -- 172.21.15.148:0/499279616 reap_dead start 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 shutdown_connections 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 >> 172.21.15.148:0/499279616 conn(0x7fd69006c980 msgr2=0x7fd6900cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 shutdown_connections 2024-04-26T23:11:55.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.501+0000 7fd695400640 1 -- 172.21.15.148:0/499279616 wait complete. 2024-04-26T23:11:55.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:55.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:11:55.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:11:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 Processor -- start 2024-04-26T23:11:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 -- start start 2024-04-26T23:11:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48340d1c10 0x7f4834160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f48340c9510 0x7f4834160e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4832a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f48340d1830 0x7f48340c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.148:52022/0 (socket says 172.21.15.148:52022) 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4832a00640 1 -- 172.21.15.148:0/1425868628 learned_addr learned my addr 172.21.15.148:0/1425868628 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48340ce780 con 0x7f48340d1830 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f483406d6a0 con 0x7f48340d1c10 2024-04-26T23:11:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.713+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f48341613c0 con 0x7f48340c9510 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832000640 1 --2- 172.21.15.148:0/1425868628 >> v2:172.21.15.148:3300/0 conn(0x7f48340d1c10 0x7f4834160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4833400640 1 --2- 172.21.15.148:0/1425868628 >> v2:172.21.15.157:3300/0 conn(0x7f48340c9510 0x7f4834160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476258511 0 0) 0x7f48340ce780 con 0x7f48340d1830 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4818003530 con 0x7f48340d1830 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 164222523 0 0) 0x7f4818003530 con 0x7f48340d1830 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 >> v2:172.21.15.157:3300/0 conn(0x7f48340c9510 msgr2=0x7f4834160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 --2- 172.21.15.148:0/1425868628 >> v2:172.21.15.157:3300/0 conn(0x7f48340c9510 0x7f4834160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 >> v2:172.21.15.148:3300/0 conn(0x7f48340d1c10 msgr2=0x7f4834160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 --2- 172.21.15.148:0/1425868628 >> v2:172.21.15.148:3300/0 conn(0x7f48340d1c10 0x7f4834160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48340cc9e0 con 0x7f48340d1830 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f4824001680 con 0x7f48340d1830 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 >> v1:172.21.15.157:6789/0 conn(0x7f48340d1830 legacy=0x7f48340c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f4818003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4818004810 0x7f4818004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48180051d0 0x7f481800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48341613c0 con 0x7f4818004810 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f481800bf10 con 0x7f48180051d0 2024-04-26T23:11:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f481800c090 con 0x7f48180039c0 2024-04-26T23:11:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f4818003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832000640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4818004810 0x7f4818004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4833400640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48180051d0 0x7f481800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 -- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48180051d0 msgr2=0x7f481800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48180051d0 0x7f481800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 -- 172.21.15.148:0/1425868628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4818004810 msgr2=0x7f4818004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4818004810 0x7f4818004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4832a00640 1 -- 172.21.15.148:0/1425868628 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48340cc9e0 con 0x7f48180039c0 2024-04-26T23:11:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.717+0000 7f4833400640 1 -- 172.21.15.148:0/1425868628 reap_dead start 2024-04-26T23:11:55.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4832a00640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f4818003de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f482400c340 tx=0x7f482401cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4712ba6b2102b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007e60 con 0x7f48180039c0 2024-04-26T23:11:55.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48240a9020 con 0x7f48180039c0 2024-04-26T23:11:55.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4831600640 1 -- 172.21.15.148:0/1425868628 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48240a5c20 con 0x7f48180039c0 2024-04-26T23:11:55.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 msgr2=0x7f4818003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f4818003de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f482400c340 tx=0x7f482401cd20 comp rx=0 tx=0).stop 2024-04-26T23:11:55.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 shutdown_connections 2024-04-26T23:11:55.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 --2- 172.21.15.148:0/1425868628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f4818003de0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 >> 172.21.15.148:0/1425868628 conn(0x7f483406d0d0 msgr2=0x7f483406eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 shutdown_connections 2024-04-26T23:11:55.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.725+0000 7f4839800640 1 -- 172.21.15.148:0/1425868628 wait complete. 2024-04-26T23:11:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 Processor -- start 2024-04-26T23:11:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- start start 2024-04-26T23:11:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f483415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4834072970 0x7f483415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48340c5160 0x7f48340c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48340cccc0 con 0x7f4834072970 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48340cecd0 con 0x7f48340c5160 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48340cd790 con 0x7f48180039c0 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f483415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4834072970 0x7f483415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f483415ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:53820/0 (socket says 172.21.15.148:53820) 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 -- 172.21.15.148:0/1195116174 learned_addr learned my addr 172.21.15.148:0/1195116174 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:11:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4833400640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48340c5160 0x7f48340c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48340c5160 msgr2=0x7f48340c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48340c5160 0x7f48340c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4834072970 msgr2=0x7f483415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4834072970 0x7f483415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48340c5b20 con 0x7f48180039c0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4833400640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48340c5160 0x7f48340c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4832a00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f483415ae80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48240ab040 tx=0x7f4818005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007e60 con 0x7f48180039c0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4824004a10 con 0x7f48180039c0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824004e00 con 0x7f48180039c0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48340c7290 con 0x7f48180039c0 2024-04-26T23:11:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.729+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48341f62b0 con 0x7f48180039c0 2024-04-26T23:11:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4839800640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 0x7f480c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f480c007ed0 con 0x7f480c002a80 2024-04-26T23:11:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4832000640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 0x7f480c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4832000640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f480c0080d0 con 0x7f480c002a80 2024-04-26T23:11:55.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4832000640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 0x7f480c004f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820014aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48240ae430 con 0x7f48180039c0 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4814068380 0x7f481406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f48241205b0 con 0x7f48180039c0 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f4833400640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4814068380 0x7f481406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820004440 con 0x7f480c002a80 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4820003620 con 0x7f480c002a80 2024-04-26T23:11:55.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 msgr2=0x7f480c004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 0x7f480c004f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820014aa0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 msgr2=0x7f480c004f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.733+0000 7f482aa00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c002a80 0x7f480c004f40 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820014aa0 comp rx=0 tx=0).stop 2024-04-26T23:11:55.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.737+0000 7f4833400640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4814068380 0x7f481406a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f48340d20d0 tx=0x7f482c00b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f4839800640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 0x7f480c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:11:55.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f480c00a4b0 con 0x7f480c006f10 2024-04-26T23:11:55.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f4832000640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 0x7f480c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:11:55.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f4832000640 1 -- 172.21.15.148:0/1195116174 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f480c0078e0 con 0x7f480c006f10 2024-04-26T23:11:55.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f4832000640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 0x7f480c0073a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:11:55.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.741+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482002d020 con 0x7f480c006f10 2024-04-26T23:11:55.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5213 (secure 0 0 0) 0x7f4820016cf0 con 0x7f480c006f10 2024-04-26T23:11:55.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 msgr2=0x7f480c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f482aa00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 0x7f480c0073a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820004740 comp rx=0 tx=0).stop 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f482aa00640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 msgr2=0x7f480c0073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f482aa00640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f480c006f10 0x7f480c0073a0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48340d2270 tx=0x7f4820004740 comp rx=0 tx=0).stop 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 54, 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 458591, 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:11:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 12, 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:11:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:11:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:11:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:11:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 8 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:11:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:11:55.759 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:11:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4814068380 msgr2=0x7f481406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4814068380 0x7f481406a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f48340d20d0 tx=0x7f482c00b040 comp rx=0 tx=0).stop 2024-04-26T23:11:55.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 msgr2=0x7f483415ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 --2- 172.21.15.148:0/1195116174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48180039c0 0x7f483415ae80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48240ab040 tx=0x7f4818005840 comp rx=0 tx=0).stop 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4833400640 1 -- 172.21.15.148:0/1195116174 reap_dead start 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4833400640 1 -- 172.21.15.148:0/1195116174 reap_dead start 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 shutdown_connections 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 >> 172.21.15.148:0/1195116174 conn(0x7f483406d0d0 msgr2=0x7f48340cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 shutdown_connections 2024-04-26T23:11:55.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:11:55.745+0000 7f4839800640 1 -- 172.21.15.148:0/1195116174 wait complete. 2024-04-26T23:11:55.761 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:11:55.761 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-26T23:11:55.761 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-04-26T23:11:55.761 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-26T23:11:55.761 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:11:55.762 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:11:55.762 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:11:55.777 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:11:55.778 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-04-26T23:11:55.778 INFO:tasks.ceph.mon.a:Sent signal 19 2024-04-26T23:11:55.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:12:10.778 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-04-26T23:12:10.779 INFO:tasks.ceph.mon.a:Sent signal 18 2024-04-26T23:12:10.779 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:12:10.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:12:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 Processor -- start 2024-04-26T23:12:10.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 -- start start 2024-04-26T23:12:10.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:10.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:10.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f80ca330 con 0x7f16f80c8700 2024-04-26T23:12:10.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80c8f40 con 0x7f16f8072a40 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16ff600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80c9190 con 0x7f16f80708f0 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16fcc00640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16fcc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57876/0 (socket says 172.21.15.148:57876) 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 learned_addr learned my addr 172.21.15.148:0/283705441 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:10.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:10.929+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:11.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16fcc00640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16fcc00640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:12:11.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16fcc00640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16fcc00640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:11.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:11.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16fcc00640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81589e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16fcc00640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:12.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81589e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81589e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 msgr2=0x7f16f8152120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.148:3300/0 conn(0x7f16f8072a40 0x7f16f8152120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 -- 172.21.15.148:0/283705441 >> v1:172.21.15.157:6789/0 conn(0x7f16f80c8700 legacy=0x7f16f80c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 -- 172.21.15.148:0/283705441 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f80c7c20 con 0x7f16d8005900 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f6000640 1 -- 172.21.15.148:0/283705441 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80c8f40 con 0x7f16d8009590 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:13.929+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:14.051 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:12:14.055 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:12:14.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:14.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.133+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:14.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.133+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:14.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:14.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.133+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:12:14.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:14.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.537+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:14.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.537+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:14.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:14.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:14.537+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:12:15.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.341+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:15.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.341+0000 7f16f7e00640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:15.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:15.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.341+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:12:15.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847906419 0 0) 0x7f16f80c7c20 con 0x7f16d8005900 2024-04-26T23:12:15.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16e0003530 con 0x7f16d8005900 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 208653993 0 0) 0x7f16e0003530 con 0x7f16d8005900 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 msgr2=0x7f16d800ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 --2- 172.21.15.148:0/283705441 >> v2:172.21.15.157:3300/0 conn(0x7f16d8009590 0x7f16d800ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d800d1b0 con 0x7f16d8005900 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f16ec004350 con 0x7f16d8005900 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 >> v1:172.21.15.148:6789/0 conn(0x7f16d8005900 legacy=0x7f16d8007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16fd600640 1 -- 172.21.15.148:0/283705441 reap_dead start 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16e00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0003ff0 0x7f16e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 0x7f16e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80c8f40 con 0x7f16e0004d50 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16e000bbe0 con 0x7f16e0003ff0 2024-04-26T23:12:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.801+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f16e000bde0 con 0x7f16f80708f0 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fcc00640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16e00039c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fcc00640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16e00039c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 0x7f16e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16f7e00640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0003ff0 0x7f16e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16e00039c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16e00039c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0003ff0 msgr2=0x7f16e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0003ff0 0x7f16e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 -- 172.21.15.148:0/283705441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e0003530 con 0x7f16e0004d50 2024-04-26T23:12:15.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16fd600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 0x7f16e00051d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16f80c8ae0 tx=0x7f16f001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52061606d3454f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:15.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0001970 con 0x7f16e0004d50 2024-04-26T23:12:15.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0005d50 con 0x7f16e0004d50 2024-04-26T23:12:15.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.805+0000 7f16f7400640 1 -- 172.21.15.148:0/283705441 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003ba0 con 0x7f16e0004d50 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 msgr2=0x7f16e00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 0x7f16e00051d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16f80c8ae0 tx=0x7f16f001c260 comp rx=0 tx=0).stop 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- 172.21.15.148:0/283705441 shutdown_connections 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0004d50 0x7f16e00051d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0003ff0 0x7f16e0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- 172.21.15.148:0/283705441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16e00039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- 172.21.15.148:0/283705441 >> 172.21.15.148:0/283705441 conn(0x7f16f806c380 msgr2=0x7f16f806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- 172.21.15.148:0/283705441 shutdown_connections 2024-04-26T23:12:15.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- 172.21.15.148:0/283705441 wait complete. 2024-04-26T23:12:15.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 Processor -- start 2024-04-26T23:12:15.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- start start 2024-04-26T23:12:15.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0004d50 0x7f16f81f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8072e60 con 0x7f16e0003ff0 2024-04-26T23:12:15.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80c81e0 con 0x7f16e0004d50 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.809+0000 7f16ff600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80c9470 con 0x7f16f80708f0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fd600640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81e4fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fd600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81e4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57918/0 (socket says 172.21.15.148:57918) 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 -- 172.21.15.148:0/1999697931 learned_addr learned my addr 172.21.15.148:0/1999697931 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16f7e00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0004d50 0x7f16f81f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 -- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 msgr2=0x7f16f81e4fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81e4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 -- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0004d50 msgr2=0x7f16f81f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0004d50 0x7f16f81f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 -- 172.21.15.148:0/1999697931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80cce90 con 0x7f16e0003ff0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16fcc00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16ec004400 tx=0x7f16ec00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec01a070 con 0x7f16e0003ff0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec013560 con 0x7f16e0003ff0 2024-04-26T23:12:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec013930 con 0x7f16e0003ff0 2024-04-26T23:12:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f80cc0d0 con 0x7f16e0003ff0 2024-04-26T23:12:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f81f1660 con 0x7f16e0003ff0 2024-04-26T23:12:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.813+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f8077c20 con 0x7f16e0003ff0 2024-04-26T23:12:15.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.817+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16ec013ad0 con 0x7f16e0003ff0 2024-04-26T23:12:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.817+0000 7f16f4c00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 0x7f16d806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.817+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f16ec088dc0 con 0x7f16e0003ff0 2024-04-26T23:12:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.817+0000 7f16f7e00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 0x7f16d806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:15.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.817+0000 7f16f7e00640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 0x7f16d806b020 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16f8158f20 tx=0x7f16e401b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:15.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:15.821+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f16f80cce90 con 0x7f16e0003ff0 2024-04-26T23:12:16.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f16f80c4d30 con 0x7f16e0003ff0 2024-04-26T23:12:16.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16f4c00640 1 -- 172.21.15.148:0/1999697931 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f16ec058890 con 0x7f16e0003ff0 2024-04-26T23:12:16.039 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":58,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 msgr2=0x7f16d806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 0x7f16d806b020 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16f8158f20 tx=0x7f16e401b040 comp rx=0 tx=0).stop 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 msgr2=0x7f16f81479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16ec004400 tx=0x7f16ec00c430 comp rx=0 tx=0).stop 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 shutdown_connections 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f16d8068b60 0x7f16d806b020 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f16f80708f0 0x7f16f81e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16e0004d50 0x7f16f81f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 --2- 172.21.15.148:0/1999697931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e0003ff0 0x7f16f81479a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 >> 172.21.15.148:0/1999697931 conn(0x7f16f806c380 msgr2=0x7f16f8149eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 shutdown_connections 2024-04-26T23:12:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.041+0000 7f16ff600640 1 -- 172.21.15.148:0/1999697931 wait complete. 2024-04-26T23:12:16.060 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:12:16.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:12:16.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:12:16.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 Processor -- start 2024-04-26T23:12:16.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 -- start start 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7e8152d00 0x7fb7e80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e8073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e8073bb0 con 0x7fb7e8158a80 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e80c4b30 con 0x7fb7e8152d00 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7f0800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80c6f60 con 0x7fb7e8073230 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7ed400640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 msgr2=0x7fb7e8073670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7ede00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7e8152d00 0x7fb7e80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7ed400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e8073670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:16.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7ede00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7e8152d00 0x7fb7e80c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57926/0 (socket says 172.21.15.148:57926) 2024-04-26T23:12:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.241+0000 7fb7ede00640 1 -- 172.21.15.148:0/1009069922 learned_addr learned my addr 172.21.15.148:0/1009069922 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7ede00640 1 -- 172.21.15.148:0/1009069922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 msgr2=0x7fb7e8073670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7ede00640 1 --2- 172.21.15.148:0/1009069922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e8073670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7ede00640 1 -- 172.21.15.148:0/1009069922 >> v1:172.21.15.157:6789/0 conn(0x7fb7e8158a80 legacy=0x7fb7e8158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7ede00640 1 -- 172.21.15.148:0/1009069922 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e80c7240 con 0x7fb7e8152d00 2024-04-26T23:12:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7ede00640 1 --2- 172.21.15.148:0/1009069922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8152d00 0x7fb7e80c97d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009870 tx=0x7fb7dc01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4899f112c2dd77ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7eca00640 1 -- 172.21.15.148:0/1009069922 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b2070 con 0x7fb7e8152d00 2024-04-26T23:12:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7eca00640 1 -- 172.21.15.148:0/1009069922 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0ad680 con 0x7fb7e8152d00 2024-04-26T23:12:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7eca00640 1 -- 172.21.15.148:0/1009069922 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0ada50 con 0x7fb7e8152d00 2024-04-26T23:12:16.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.245+0000 7fb7f0800640 1 -- 172.21.15.148:0/1009069922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8152d00 msgr2=0x7fb7e80c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- 172.21.15.148:0/1009069922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8152d00 0x7fb7e80c97d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009870 tx=0x7fb7dc01c580 comp rx=0 tx=0).stop 2024-04-26T23:12:16.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- 172.21.15.148:0/1009069922 shutdown_connections 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- 172.21.15.148:0/1009069922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e8073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- 172.21.15.148:0/1009069922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8152d00 0x7fb7e80c97d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- 172.21.15.148:0/1009069922 >> 172.21.15.148:0/1009069922 conn(0x7fb7e80c9d10 msgr2=0x7fb7e80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- 172.21.15.148:0/1009069922 shutdown_connections 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- 172.21.15.148:0/1009069922 wait complete. 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 Processor -- start 2024-04-26T23:12:16.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- start start 2024-04-26T23:12:16.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e8152d00 0x7fb7e80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 0x7fb7e80cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80c4890 con 0x7fb7e8158a80 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80c4710 con 0x7fb7e8152d00 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7f0800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e8165c20 con 0x7fb7e8073230 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ede00640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 msgr2=0x7fb7e814cbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ede00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e814cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 0x7fb7e80cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 0x7fb7e80cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57928/0 (socket says 172.21.15.148:57928) 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 learned_addr learned my addr 172.21.15.148:0/517354060 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ed400640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e8152d00 0x7fb7e80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 msgr2=0x7fb7e814cbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e8073230 0x7fb7e814cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e8152d00 msgr2=0x7fb7e80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e8152d00 0x7fb7e80cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e815c780 con 0x7fb7e8158a80 2024-04-26T23:12:16.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ed400640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e8152d00 0x7fb7e80cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:12:16.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7ee800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 0x7fb7e80cc720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c770 tx=0x7fb7e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.249+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4003b80 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e4003d20 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e8070b50 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400aa90 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e80cb420 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7f0800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 0x7fb7e80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8077c20 con 0x7fb7e8159c40 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7ede00640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 0x7fb7e80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7ede00640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7e8075e00 con 0x7fb7e8159c40 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7e400ac30 con 0x7fb7e8158a80 2024-04-26T23:12:16.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7ede00640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 0x7fb7e80cb5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c4540 tx=0x7fb7dc01adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb7cc068330 0x7fb7cc06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb7e4086cb0 con 0x7fb7e8158a80 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0bc030 con 0x7fb7e8159c40 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb7dc0ad540 con 0x7fb7e8159c40 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 msgr2=0x7fb7e80cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 0x7fb7e80cb5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c4540 tx=0x7fb7dc01adc0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 msgr2=0x7fb7e80cb5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7e2000640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8159c40 0x7fb7e80cb5f0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c4540 tx=0x7fb7dc01adc0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.253+0000 7fb7ed400640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb7cc068330 0x7fb7cc06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.257+0000 7fb7ed400640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb7cc068330 0x7fb7cc06a7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7e81526e0 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 0x7fb7e80cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80766a0 con 0x7fb7e815b470 2024-04-26T23:12:16.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7ede00640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 0x7fb7e80cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7ede00640 1 -- 172.21.15.148:0/517354060 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7e815ad00 con 0x7fb7e815b470 2024-04-26T23:12:16.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7ede00640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 0x7fb7e80cbb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009870 tx=0x7fb7dc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0bc050 con 0x7fb7e815b470 2024-04-26T23:12:16.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4889 (secure 0 0 0) 0x7fb7dc0c2a10 con 0x7fb7e815b470 2024-04-26T23:12:16.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 msgr2=0x7fb7e80cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 0x7fb7e80cbb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009870 tx=0x7fb7dc009240 comp rx=0 tx=0).stop 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 msgr2=0x7fb7e80cbb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7e2000640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e815b470 0x7fb7e80cbb30 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009870 tx=0x7fb7dc009240 comp rx=0 tx=0).stop 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 58, 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 39027, 2024-04-26T23:12:16.261 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: 1 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.262 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.263 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:12:16.264 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.265 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:12:16.267 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:12:16.269 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.271 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:12:16.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:12:16.273 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb7cc068330 msgr2=0x7fb7cc06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fb7cc068330 0x7fb7cc06a7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7e81526e0 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 msgr2=0x7fb7e80cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 --2- 172.21.15.148:0/517354060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7e8158a80 0x7fb7e80cc720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c770 tx=0x7fb7e400cc30 comp rx=0 tx=0).stop 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 reap_dead start 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7ee800640 1 -- 172.21.15.148:0/517354060 reap_dead start 2024-04-26T23:12:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 shutdown_connections 2024-04-26T23:12:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 >> 172.21.15.148:0/517354060 conn(0x7fb7e80c9d10 msgr2=0x7fb7e8158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 shutdown_connections 2024-04-26T23:12:16.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.261+0000 7fb7f0800640 1 -- 172.21.15.148:0/517354060 wait complete. 2024-04-26T23:12:16.279 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:12:16.279 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:12:16.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:12:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 Processor -- start 2024-04-26T23:12:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 -- start start 2024-04-26T23:12:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72040c97d0 0x7f720415c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72040c4b30 con 0x7f7204073940 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72040c6f60 con 0x7f7204152d00 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7209800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f72040c7240 con 0x7f72040c97d0 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7203400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72040c97d0 0x7f720415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7202000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7204073940 0x7f720415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51142/0 (socket says 172.21.15.148:51142) 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.417+0000 7f7202000640 1 -- 172.21.15.148:0/376370652 learned_addr learned my addr 172.21.15.148:0/376370652 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7203400640 1 -- 172.21.15.148:0/376370652 >> v1:172.21.15.157:6789/0 conn(0x7f7204152d00 legacy=0x7f7204073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7203400640 1 -- 172.21.15.148:0/376370652 >> v1:172.21.15.148:6789/0 conn(0x7f7204073940 legacy=0x7f720415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7203400640 1 -- 172.21.15.148:0/376370652 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72040c7520 con 0x7f72040c97d0 2024-04-26T23:12:16.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7203400640 1 --2- 172.21.15.148:0/376370652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72040c97d0 0x7f720415c780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0097c0 tx=0x7f71fc01e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42565d435edf2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7201600640 1 -- 172.21.15.148:0/376370652 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0ac430 con 0x7f72040c97d0 2024-04-26T23:12:16.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7201600640 1 -- 172.21.15.148:0/376370652 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc0b1070 con 0x7f72040c97d0 2024-04-26T23:12:16.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.421+0000 7f7201600640 1 -- 172.21.15.148:0/376370652 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0ac7f0 con 0x7f72040c97d0 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- 172.21.15.148:0/376370652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72040c97d0 msgr2=0x7f720415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 --2- 172.21.15.148:0/376370652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72040c97d0 0x7f720415c780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0097c0 tx=0x7f71fc01e6b0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- 172.21.15.148:0/376370652 shutdown_connections 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 --2- 172.21.15.148:0/376370652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72040c97d0 0x7f720415c780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- 172.21.15.148:0/376370652 >> 172.21.15.148:0/376370652 conn(0x7f72040c9d10 msgr2=0x7f72040ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- 172.21.15.148:0/376370652 shutdown_connections 2024-04-26T23:12:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- 172.21.15.148:0/376370652 wait complete. 2024-04-26T23:12:16.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 Processor -- start 2024-04-26T23:12:16.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- start start 2024-04-26T23:12:16.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204073940 0x7f720415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72040c97d0 0x7f72041f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7204070680 con 0x7f7204152d00 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7204070500 con 0x7f7204073940 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7209800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7204070800 con 0x7f72040c97d0 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7202000640 1 -- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72040c97d0 msgr2=0x7f72041f5f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.157:3301/0 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7202000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72040c97d0 0x7f72041f5f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57954/0 (socket says 172.21.15.148:57954) 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 -- 172.21.15.148:0/2701543206 learned_addr learned my addr 172.21.15.148:0/2701543206 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7202a00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204073940 0x7f720415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72040c97d0 msgr2=0x7f72041f5f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:12:16.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72040c97d0 0x7f72041f5f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204073940 msgr2=0x7f720415bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204073940 0x7f720415bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72041493f0 con 0x7f7204152d00 2024-04-26T23:12:16.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.425+0000 7f7203400640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71fc01b2c0 tx=0x7f71fc01cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0b5620 con 0x7f7204152d00 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc0be070 con 0x7f7204152d00 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0b59e0 con 0x7f7204152d00 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7204163790 con 0x7f7204152d00 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7204163d50 con 0x7f7204152d00 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7209800640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 0x7f7204140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7204147590 con 0x7f7204161ec0 2024-04-26T23:12:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7202a00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 0x7f7204140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71fc0b5b80 con 0x7f7204152d00 2024-04-26T23:12:16.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7202a00640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72041491a0 con 0x7f7204161ec0 2024-04-26T23:12:16.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7202a00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 0x7f7204140a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71f400f830 tx=0x7f71f400fcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f71e4068330 0x7f71e406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f71fc120f10 con 0x7f7204152d00 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4019070 con 0x7f7204161ec0 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f7202000640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f71e4068330 0x7f71e406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f71f4006d70 con 0x7f7204161ec0 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 msgr2=0x7f7204140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 0x7f7204140a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71f400f830 tx=0x7f71f400fcf0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 msgr2=0x7f7204140a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:12:16.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.429+0000 7f71faa00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7204161ec0 0x7f7204140a70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.433+0000 7f7202000640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f71e4068330 0x7f71e406a7f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f720415a4a0 tx=0x7f71f0007af0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f7209800640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 0x7f72041f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:16.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7204164270 con 0x7f720415c710 2024-04-26T23:12:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f7202a00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 0x7f72041f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f7202a00640 1 -- 172.21.15.148:0/2701543206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f72041496d0 con 0x7f720415c710 2024-04-26T23:12:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f7202a00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 0x7f72041f8060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71f400f830 tx=0x7f71f4001260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.437+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4019070 con 0x7f720415c710 2024-04-26T23:12:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5200 (secure 0 0 0) 0x7f71f400d750 con 0x7f720415c710 2024-04-26T23:12:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 msgr2=0x7f72041f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f71faa00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 0x7f72041f8060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71f400f830 tx=0x7f71f4001260 comp rx=0 tx=0).stop 2024-04-26T23:12:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f71faa00640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 msgr2=0x7f72041f8060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:12:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f71faa00640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f720415c710 0x7f72041f8060 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71f400f830 tx=0x7f71f4001260 comp rx=0 tx=0).stop 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 58, 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 92058, 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: 1 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 0, 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:12:16.439 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:12:16.440 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:12:16.441 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:12:16.442 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:12:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:12:16.444 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.445 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:12:16.446 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:12:16.447 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.448 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:12:16.449 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:12:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f71e4068330 msgr2=0x7f71e406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f71e4068330 0x7f71e406a7f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f720415a4a0 tx=0x7f71f0007af0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 msgr2=0x7f7204140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7203400640 1 -- 172.21.15.148:0/2701543206 reap_dead start 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71fc01b2c0 tx=0x7f71fc01cef0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 shutdown_connections 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 --2- 172.21.15.148:0/2701543206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7204152d00 0x7f7204140530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 >> 172.21.15.148:0/2701543206 conn(0x7f72040c9d10 msgr2=0x7f72040c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 shutdown_connections 2024-04-26T23:12:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:16.441+0000 7f7209800640 1 -- 172.21.15.148:0/2701543206 wait complete. 2024-04-26T23:12:16.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:12:16.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:12:36.458 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:12:36.458 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-26T23:12:36.458 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:12:36.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:12:36.462 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:12:36.462 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-04-26T23:12:36.462 INFO:tasks.ceph.mon.a:Sent signal 19 2024-04-26T23:12:36.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:12:44.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:12:44.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:12:51.463 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-04-26T23:12:51.463 INFO:tasks.ceph.mon.a:Sent signal 18 2024-04-26T23:12:51.464 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:12:51.464 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:12:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 Processor -- start 2024-04-26T23:12:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 -- start start 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13980c9d90 con 0x7f13980c9010 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13980ca070 con 0x7f1398153af0 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f139d200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f139815dec0 con 0x7f13980c7b80 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35234/0 (socket says 172.21.15.148:35234) 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 learned_addr learned my addr 172.21.15.148:0/1497440633 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.604+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:51.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.808+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:51.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.808+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:51.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.808+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:51.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.808+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:51.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:51.808+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:12:52.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:52.212+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:52.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:52.212+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:52.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:52.212+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:52.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:52.212+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:52.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:52.212+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:12:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:53.016+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:53.016+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:53.016+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:53.016+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:53.016+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 msgr2=0x7f13980c7f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.148:3300/0 conn(0x7f13980c7b80 0x7f13980c7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 -- 172.21.15.148:0/1497440633 >> v1:172.21.15.157:6789/0 conn(0x7f1398153af0 legacy=0x7f139815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 -- 172.21.15.148:0/1497440633 >> v1:172.21.15.148:6789/0 conn(0x7f13980c9010 legacy=0x7f13980c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 --2- 172.21.15.148:0/1497440633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1374003720 0x7f1374005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 0x7f1374008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 -- 172.21.15.148:0/1497440633 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f139815dec0 con 0x7f1374006290 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138fe00640 1 -- 172.21.15.148:0/1497440633 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1374008de0 con 0x7f1374003720 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 0x7f1374008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395e00640 1 --2- 172.21.15.148:0/1497440633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1374003720 0x7f1374005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 msgr2=0x7f1374008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138d400640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 msgr2=0x7f1374008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 0x7f1374008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f138d400640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 0x7f1374008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395e00640 1 -- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 msgr2=0x7f1374008730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395e00640 1 --2- 172.21.15.148:0/1497440633 >> v2:172.21.15.157:3300/0 conn(0x7f1374006290 0x7f1374008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395e00640 1 -- 172.21.15.148:0/1497440633 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13980ca350 con 0x7f1374003720 2024-04-26T23:12:54.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395e00640 1 --2- 172.21.15.148:0/1497440633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1374003720 0x7f1374005b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1388001d50 tx=0x7f138801c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebafef9d28865e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:54.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395400640 1 -- 172.21.15.148:0/1497440633 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388003b80 con 0x7f1374003720 2024-04-26T23:12:54.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395400640 1 -- 172.21.15.148:0/1497440633 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388003d40 con 0x7f1374003720 2024-04-26T23:12:54.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1395400640 1 -- 172.21.15.148:0/1497440633 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388005310 con 0x7f1374003720 2024-04-26T23:12:54.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f139d200640 1 -- 172.21.15.148:0/1497440633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1374003720 msgr2=0x7f1374005b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:54.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f139d200640 1 --2- 172.21.15.148:0/1497440633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1374003720 0x7f1374005b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1388001d50 tx=0x7f138801c790 comp rx=0 tx=0).stop 2024-04-26T23:12:54.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f1396800640 1 -- 172.21.15.148:0/1497440633 reap_dead start 2024-04-26T23:12:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f139d200640 1 -- 172.21.15.148:0/1497440633 shutdown_connections 2024-04-26T23:12:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.608+0000 7f139d200640 1 -- 172.21.15.148:0/1497440633 >> 172.21.15.148:0/1497440633 conn(0x7f139806c380 msgr2=0x7f139806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- 172.21.15.148:0/1497440633 shutdown_connections 2024-04-26T23:12:54.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- 172.21.15.148:0/1497440633 wait complete. 2024-04-26T23:12:54.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 Processor -- start 2024-04-26T23:12:54.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- start start 2024-04-26T23:12:54.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 0x7f13981566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f139815d290 con 0x7f1374003720 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f13980ca630 con 0x7f1398073970 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f139d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1398153ed0 con 0x7f13981f4710 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35264/0 (socket says 172.21.15.148:35264) 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 -- 172.21.15.148:0/1501270469 learned_addr learned my addr 172.21.15.148:0/1501270469 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 msgr2=0x7f1398159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 msgr2=0x7f1398159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1396800640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 0x7f13981566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f138d400640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f1395e00640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:54.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f138d400640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 msgr2=0x7f1398157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f138d400640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 msgr2=0x7f1398157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f138d400640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.612+0000 7f138d400640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 msgr2=0x7f1398157740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 msgr2=0x7f1398159700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 -- 172.21.15.148:0/1501270469 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1398157280 con 0x7f13981f4710 2024-04-26T23:12:54.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f1396800640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 0x7f13981566f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13980744b0 tx=0x7f139000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390007480 con 0x7f13981f4710 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390007620 con 0x7f13981f4710 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390005a10 con 0x7f13981f4710 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13981f20a0 con 0x7f13981f4710 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1398158040 con 0x7f13981f4710 2024-04-26T23:12:54.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1398077c20 con 0x7f13981f4710 2024-04-26T23:12:54.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.616+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1390011070 con 0x7f13981f4710 2024-04-26T23:12:54.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.620+0000 7f138ea00640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 0x7f137406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:54.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.620+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1390085970 con 0x7f13981f4710 2024-04-26T23:12:54.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.620+0000 7f1395e00640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 0x7f137406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:54.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.620+0000 7f1395e00640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 0x7f137406dfb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f138801ae40 tx=0x7f13880a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:54.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.632+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1390055bc0 con 0x7f13981f4710 2024-04-26T23:12:54.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.848+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1398069040 con 0x7f13981f4710 2024-04-26T23:12:54.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.848+0000 7f138ea00640 1 -- 172.21.15.148:0/1501270469 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f13900554c0 con 0x7f13981f4710 2024-04-26T23:12:54.848 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 msgr2=0x7f137406dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 0x7f137406dfb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f138801ae40 tx=0x7f13880a7070 comp rx=0 tx=0).stop 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 msgr2=0x7f13981566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 0x7f13981566f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13980744b0 tx=0x7f139000c820 comp rx=0 tx=0).stop 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 shutdown_connections 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f137406baf0 0x7f137406dfb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f13981f4710 0x7f13981566f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1398073970 0x7f1398157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 --2- 172.21.15.148:0/1501270469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1374003720 0x7f1398159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:54.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 >> 172.21.15.148:0/1501270469 conn(0x7f139806c380 msgr2=0x7f13980cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:54.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 shutdown_connections 2024-04-26T23:12:54.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:54.852+0000 7f139d200640 1 -- 172.21.15.148:0/1501270469 wait complete. 2024-04-26T23:12:57.870 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:12:58.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 Processor -- start 2024-04-26T23:12:58.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 -- start start 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 0x7fc68415c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc684156100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc684156640 con 0x7fc6840d1970 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc6840b7250 con 0x7fc6840b4440 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc68ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc68415ceb0 con 0x7fc684155d00 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc683e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 0x7fc68415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc683e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 0x7fc68415c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47916/0 (socket says 172.21.15.148:47916) 2024-04-26T23:12:58.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.032+0000 7fc683e00640 1 -- 172.21.15.148:0/3039426640 learned_addr learned my addr 172.21.15.148:0/3039426640 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:58.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc688e00640 1 --2- 172.21.15.148:0/3039426640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc684156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc682a00640 1 -- 172.21.15.148:0/3039426640 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543407685 0 0) 0x7fc684156640 con 0x7fc6840d1970 2024-04-26T23:12:58.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc682a00640 1 -- 172.21.15.148:0/3039426640 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc668003530 con 0x7fc6840d1970 2024-04-26T23:12:58.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc688e00640 1 -- 172.21.15.148:0/3039426640 >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 msgr2=0x7fc68415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:12:58.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc688e00640 1 --2- 172.21.15.148:0/3039426640 >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 0x7fc68415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc688e00640 1 -- 172.21.15.148:0/3039426640 >> v1:172.21.15.157:6789/0 conn(0x7fc6840d1970 legacy=0x7fc6840b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.036+0000 7fc688e00640 1 -- 172.21.15.148:0/3039426640 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6840b5120 con 0x7fc684155d00 2024-04-26T23:12:58.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.040+0000 7fc688e00640 1 --2- 172.21.15.148:0/3039426640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc684156100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097c0 tx=0x7fc67401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eaceaddda2bdf4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:58.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.040+0000 7fc682a00640 1 -- 172.21.15.148:0/3039426640 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6740b0070 con 0x7fc684155d00 2024-04-26T23:12:58.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.040+0000 7fc682a00640 1 -- 172.21.15.148:0/3039426640 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6740ab600 con 0x7fc684155d00 2024-04-26T23:12:58.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.040+0000 7fc682a00640 1 -- 172.21.15.148:0/3039426640 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6740ab9d0 con 0x7fc684155d00 2024-04-26T23:12:58.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- 172.21.15.148:0/3039426640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 msgr2=0x7fc684156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 --2- 172.21.15.148:0/3039426640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc684156100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097c0 tx=0x7fc67401c410 comp rx=0 tx=0).stop 2024-04-26T23:12:58.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- 172.21.15.148:0/3039426640 shutdown_connections 2024-04-26T23:12:58.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 --2- 172.21.15.148:0/3039426640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc684156100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 --2- 172.21.15.148:0/3039426640 >> v2:172.21.15.148:3300/0 conn(0x7fc6840b4440 0x7fc68415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- 172.21.15.148:0/3039426640 >> 172.21.15.148:0/3039426640 conn(0x7fc68406d1d0 msgr2=0x7fc68406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:58.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- 172.21.15.148:0/3039426640 shutdown_connections 2024-04-26T23:12:58.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- 172.21.15.148:0/3039426640 wait complete. 2024-04-26T23:12:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 Processor -- start 2024-04-26T23:12:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.044+0000 7fc68ae00640 1 -- start start 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 0x7fc68415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc6840cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6840b5f80 con 0x7fc6840b4440 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6840b5ca0 con 0x7fc6840d1970 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6841687a0 con 0x7fc684155d00 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47932/0 (socket says 172.21.15.148:47932) 2024-04-26T23:12:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 -- 172.21.15.148:0/582585329 learned_addr learned my addr 172.21.15.148:0/582585329 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:12:58.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc688e00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc6840cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683400640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 0x7fc68415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 -- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 msgr2=0x7fc6840cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc6840cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 -- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 msgr2=0x7fc68415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 0x7fc68415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 -- 172.21.15.148:0/582585329 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6841586c0 con 0x7fc6840b4440 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc688e00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc6840cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683400640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 0x7fc68415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc683e00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009d90 tx=0x7fc67c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00cda0 con 0x7fc6840b4440 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c019070 con 0x7fc6840b4440 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c014680 con 0x7fc6840b4440 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc684158940 con 0x7fc6840b4440 2024-04-26T23:12:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.048+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc684158f00 con 0x7fc6840b4440 2024-04-26T23:12:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6840696e0 con 0x7fc6840b4440 2024-04-26T23:12:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc67c012050 con 0x7fc6840b4440 2024-04-26T23:12:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc67be00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 0x7fc66406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:12:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc67c0872a0 con 0x7fc6840b4440 2024-04-26T23:12:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc683400640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 0x7fc66406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:12:58.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.052+0000 7fc683400640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 0x7fc66406a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6840cbde0 tx=0x7fc670009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:12:58.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.056+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6841586c0 con 0x7fc6840b4440 2024-04-26T23:12:58.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.268+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc68415cc70 con 0x7fc6840b4440 2024-04-26T23:12:58.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc67be00640 1 -- 172.21.15.148:0/582585329 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fc67c010040 con 0x7fc6840b4440 2024-04-26T23:12:58.270 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:12:58.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 msgr2=0x7fc66406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 0x7fc66406a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6840cbde0 tx=0x7fc670009040 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 msgr2=0x7fc6840c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009d90 tx=0x7fc67c00c490 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 shutdown_connections 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc664068380 0x7fc66406a840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc684155d00 0x7fc6840cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6840d1970 0x7fc68415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 --2- 172.21.15.148:0/582585329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6840b4440 0x7fc6840c5550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 >> 172.21.15.148:0/582585329 conn(0x7fc68406d1d0 msgr2=0x7fc6840d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 shutdown_connections 2024-04-26T23:12:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:12:58.272+0000 7fc68ae00640 1 -- 172.21.15.148:0/582585329 wait complete. 2024-04-26T23:13:01.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:13:01.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 Processor -- start 2024-04-26T23:13:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 -- start start 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f66a80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a80c9d90 con 0x7f66a8153af0 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a80ca070 con 0x7f66a80c9010 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66af000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f66a815dec0 con 0x7f66a80c7b80 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66a7e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f66a8153af0 0x7f66a815d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33960/0 (socket says 172.21.15.148:33960) 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66a7e00640 1 -- 172.21.15.148:0/3853407578 learned_addr learned my addr 172.21.15.148:0/3853407578 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.428+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f66a80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420967530 0 0) 0x7f66a80c9d90 con 0x7f66a8153af0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f668c003530 con 0x7f66a8153af0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435375677 0 0) 0x7f668c003530 con 0x7f66a8153af0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 msgr2=0x7f66a80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f66a80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 >> v1:172.21.15.157:6789/0 conn(0x7f66a80c9010 legacy=0x7f66a80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a80ca350 con 0x7f66a8153af0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f6698001a00 con 0x7f66a8153af0 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f66a80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 >> v1:172.21.15.148:6789/0 conn(0x7f66a8153af0 legacy=0x7f66a815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f668c0039f0 0x7f668c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c0043a0 0x7f668c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f668c005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f66a815dec0 con 0x7f668c0043a0 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f668c00b9d0 con 0x7f668c0039f0 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f668c00bb80 con 0x7f66a80c7b80 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c0043a0 0x7f668c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7e00640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f668c0039f0 0x7f668c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66ad000640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f668c005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 -- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 msgr2=0x7f668c005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66a80c7b80 0x7f668c005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 -- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f668c0039f0 msgr2=0x7f668c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f668c0039f0 0x7f668c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.432+0000 7f66a7400640 1 -- 172.21.15.148:0/3853407578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c003530 con 0x7f668c0043a0 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66a7400640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c0043a0 0x7f668c004870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6694009cb0 tx=0x7f669401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9753c2679d7e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940b2070 con 0x7f668c0043a0 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66940a57c0 con 0x7f668c0043a0 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66a6a00640 1 -- 172.21.15.148:0/3853407578 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694009880 con 0x7f668c0043a0 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- 172.21.15.148:0/3853407578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c0043a0 msgr2=0x7f668c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 --2- 172.21.15.148:0/3853407578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c0043a0 0x7f668c004870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6694009cb0 tx=0x7f669401cc10 comp rx=0 tx=0).stop 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66ad000640 1 -- 172.21.15.148:0/3853407578 reap_dead start 2024-04-26T23:13:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- 172.21.15.148:0/3853407578 shutdown_connections 2024-04-26T23:13:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- 172.21.15.148:0/3853407578 >> 172.21.15.148:0/3853407578 conn(0x7f66a806c380 msgr2=0x7f66a806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- 172.21.15.148:0/3853407578 shutdown_connections 2024-04-26T23:13:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- 172.21.15.148:0/3853407578 wait complete. 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 Processor -- start 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- start start 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f668c0043a0 0x7f66a8072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66a80c30d0 0x7f66a80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f66a815d290 con 0x7f66a80cc610 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f66a80ca630 con 0x7f66a80c30d0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66af000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f66a8153ed0 con 0x7f668c0043a0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66ad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66ad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47946/0 (socket says 172.21.15.148:47946) 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.436+0000 7f66ad000640 1 -- 172.21.15.148:0/406717940 learned_addr learned my addr 172.21.15.148:0/406717940 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66a7e00640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f668c0043a0 0x7f66a8072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66a7400640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66a80c30d0 0x7f66a80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 -- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f668c0043a0 msgr2=0x7f66a8072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f668c0043a0 0x7f66a8072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 -- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66a80c30d0 msgr2=0x7f66a80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66a80c30d0 0x7f66a80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 -- 172.21.15.148:0/406717940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a8154290 con 0x7f66a80cc610 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66ad000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66a8071aa0 tx=0x7f66a000e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0019070 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a00052e0 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003840 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a81f14f0 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81f1ab0 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a8077c20 con 0x7f66a80cc610 2024-04-26T23:13:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66a001c070 con 0x7f66a80cc610 2024-04-26T23:13:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 0x7f668806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.440+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f66a0086250 con 0x7f66a80cc610 2024-04-26T23:13:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.444+0000 7f66a7e00640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 0x7f668806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.444+0000 7f66a7e00640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 0x7f668806a870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6698001b70 tx=0x7f66980018a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.444+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66a0055d20 con 0x7f66a80cc610 2024-04-26T23:13:01.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.676+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66a80c8670 con 0x7f66a80cc610 2024-04-26T23:13:01.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.676+0000 7f669fe00640 1 -- 172.21.15.148:0/406717940 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f66a005c030 con 0x7f66a80cc610 2024-04-26T23:13:01.676 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 msgr2=0x7f668806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 0x7f668806a870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6698001b70 tx=0x7f66980018a0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 msgr2=0x7f66a81f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66a8071aa0 tx=0x7f66a000e760 comp rx=0 tx=0).stop 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 shutdown_connections 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66880683b0 0x7f668806a870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66a80cc610 0x7f66a81f4950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66a80c30d0 0x7f66a80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 --2- 172.21.15.148:0/406717940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f668c0043a0 0x7f66a8072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 >> 172.21.15.148:0/406717940 conn(0x7f66a806c380 msgr2=0x7f66a8073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:01.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 shutdown_connections 2024-04-26T23:13:01.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.680+0000 7f66af000640 1 -- 172.21.15.148:0/406717940 wait complete. 2024-04-26T23:13:01.697 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:13:01.697 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:13:01.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:13:01.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 Processor -- start 2024-04-26T23:13:01.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 -- start start 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45c406ff50 0x7f45c40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45c4070330 0x7f45c4072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c40c96b0 con 0x7f45c40708a0 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f45c40c84e0 con 0x7f45c4070330 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45ca400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f45c40c93d0 con 0x7f45c406ff50 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45c4070330 0x7f45c4072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c3e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f45c40708a0 0x7f45c4158d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33962/0 (socket says 172.21.15.148:33962) 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c3e00640 1 -- 172.21.15.148:0/1287594729 learned_addr learned my addr 172.21.15.148:0/1287594729 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:01.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c3400640 1 --2- 172.21.15.148:0/1287594729 >> v2:172.21.15.157:3300/0 conn(0x7f45c406ff50 0x7f45c40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2000640 1 -- 172.21.15.148:0/1287594729 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918346804 0 0) 0x7f45c40c96b0 con 0x7f45c40708a0 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2000640 1 -- 172.21.15.148:0/1287594729 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a8003530 con 0x7f45c40708a0 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2a00640 1 -- 172.21.15.148:0/1287594729 >> v2:172.21.15.157:3300/0 conn(0x7f45c406ff50 msgr2=0x7f45c40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2a00640 1 --2- 172.21.15.148:0/1287594729 >> v2:172.21.15.157:3300/0 conn(0x7f45c406ff50 0x7f45c40c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2a00640 1 -- 172.21.15.148:0/1287594729 >> v1:172.21.15.148:6789/0 conn(0x7f45c40708a0 legacy=0x7f45c4158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.836+0000 7f45c2a00640 1 -- 172.21.15.148:0/1287594729 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c40c7bb0 con 0x7f45c4070330 2024-04-26T23:13:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45c2a00640 1 --2- 172.21.15.148:0/1287594729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4072d20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45c40cad50 tx=0x7f45b001ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9184fe2d1eab99c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45c2000640 1 -- 172.21.15.148:0/1287594729 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00b5070 con 0x7f45c4070330 2024-04-26T23:13:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45c2000640 1 -- 172.21.15.148:0/1287594729 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b00a8d20 con 0x7f45c4070330 2024-04-26T23:13:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45c2000640 1 -- 172.21.15.148:0/1287594729 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b000b040 con 0x7f45c4070330 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 -- 172.21.15.148:0/1287594729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 msgr2=0x7f45c4072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 --2- 172.21.15.148:0/1287594729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4072d20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45c40cad50 tx=0x7f45b001ef10 comp rx=0 tx=0).stop 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 -- 172.21.15.148:0/1287594729 shutdown_connections 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 --2- 172.21.15.148:0/1287594729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4072d20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 --2- 172.21.15.148:0/1287594729 >> v2:172.21.15.157:3300/0 conn(0x7f45c406ff50 0x7f45c40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 -- 172.21.15.148:0/1287594729 >> 172.21.15.148:0/1287594729 conn(0x7f45c40c9d10 msgr2=0x7f45c40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 -- 172.21.15.148:0/1287594729 shutdown_connections 2024-04-26T23:13:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.840+0000 7f45ca400640 1 -- 172.21.15.148:0/1287594729 wait complete. 2024-04-26T23:13:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 Processor -- start 2024-04-26T23:13:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- start start 2024-04-26T23:13:01.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c406ff50 0x7f45c414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40708a0 0x7f45c40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40c8fd0 con 0x7f45c4070330 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40c8170 con 0x7f45c406ff50 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45c40c9150 con 0x7f45c40708a0 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47966/0 (socket says 172.21.15.148:47966) 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 -- 172.21.15.148:0/1087954455 learned_addr learned my addr 172.21.15.148:0/1087954455 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c3400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c406ff50 0x7f45c414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c3e00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40708a0 0x7f45c40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40708a0 msgr2=0x7f45c40cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40708a0 0x7f45c40cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c406ff50 msgr2=0x7f45c414c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c406ff50 0x7f45c414c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c414c8d0 con 0x7f45c4070330 2024-04-26T23:13:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c2a00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45b001bb20 tx=0x7f45b001bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00b5040 con 0x7f45c4070330 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b000b000 con 0x7f45c4070330 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00b1b50 con 0x7f45c4070330 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c414cbb0 con 0x7f45c4070330 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41f0ba0 con 0x7f45c4070330 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 0x7f45c40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40cc030 con 0x7f45c41f13a0 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.844+0000 7f45c3400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 0x7f45c40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45c3400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45c41f06b0 con 0x7f45c41f13a0 2024-04-26T23:13:01.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45c3400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 0x7f45c40cc830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45b400bf60 tx=0x7f45b400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45b00c3020 con 0x7f45c4070330 2024-04-26T23:13:01.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4004030 con 0x7f45c41f13a0 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f45b0124710 con 0x7f45c4070330 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f45b40041d0 con 0x7f45c41f13a0 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 msgr2=0x7f45c40cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 0x7f45c40cc830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45b400bf60 tx=0x7f45b400bf90 comp rx=0 tx=0).stop 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 msgr2=0x7f45c40cc830 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45bb400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c41f13a0 0x7f45c40cc830 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45b400bf60 tx=0x7f45b400bf90 comp rx=0 tx=0).stop 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45c3e00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.848+0000 7f45c3e00640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f45bc001570 tx=0x7f45bc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.852+0000 7f45ca400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 0x7f45c414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.852+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45c414c000 con 0x7f45c414b470 2024-04-26T23:13:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45c3400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 0x7f45c414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45c3400640 1 -- 172.21.15.148:0/1087954455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f45c40ccfb0 con 0x7f45c414b470 2024-04-26T23:13:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45c3400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 0x7f45c414e360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45b4013ad0 tx=0x7f45b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4003830 con 0x7f45c414b470 2024-04-26T23:13:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4900 (secure 0 0 0) 0x7f45b4003830 con 0x7f45c414b470 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 msgr2=0x7f45c414e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 0x7f45c414e360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45b4013ad0 tx=0x7f45b40046d0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 msgr2=0x7f45c414e360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45bb400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c414b470 0x7f45c414e360 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45b4013ad0 tx=0x7f45b40046d0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "leader", 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 64, 2024-04-26T23:13:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 84623, 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:01.857 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:01.858 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:01.859 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:01.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:01.861 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:01.862 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:01.863 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:01.864 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.865 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 3 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 2 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:01.866 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:13:01.867 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 msgr2=0x7f45a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f45bc001570 tx=0x7f45bc009040 comp rx=0 tx=0).stop 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 msgr2=0x7f45c4144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45b001bb20 tx=0x7f45b001bcb0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45c3e00640 1 -- 172.21.15.148:0/1087954455 reap_dead start 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 shutdown_connections 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 --2- 172.21.15.148:0/1087954455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4070330 0x7f45c4144450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 >> 172.21.15.148:0/1087954455 conn(0x7f45c40c9d10 msgr2=0x7f45c406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 shutdown_connections 2024-04-26T23:13:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:01.856+0000 7f45ca400640 1 -- 172.21.15.148:0/1087954455 wait complete. 2024-04-26T23:13:01.873 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:13:01.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:13:01.873 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:13:02.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 Processor -- start 2024-04-26T23:13:02.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 -- start start 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb900cabe0 0x7feb900ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9015f410 con 0x7feb900cd470 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9015f6f0 con 0x7feb90155f80 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.012+0000 7feb97200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb9015f9d0 con 0x7feb900cabe0 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb95200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feb900cd470 0x7feb9015bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33966/0 (socket says 172.21.15.148:33966) 2024-04-26T23:13:02.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb95200640 1 -- 172.21.15.148:0/1921953063 learned_addr learned my addr 172.21.15.148:0/1921953063 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:02.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8f400640 1 --2- 172.21.15.148:0/1921953063 >> v2:172.21.15.157:3300/0 conn(0x7feb900cabe0 0x7feb900ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8ea00640 1 -- 172.21.15.148:0/1921953063 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562539475 0 0) 0x7feb9015f410 con 0x7feb900cd470 2024-04-26T23:13:02.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8ea00640 1 -- 172.21.15.148:0/1921953063 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb74003530 con 0x7feb900cd470 2024-04-26T23:13:02.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8f400640 1 -- 172.21.15.148:0/1921953063 >> v1:172.21.15.157:6789/0 conn(0x7feb90155f80 legacy=0x7feb900cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8f400640 1 -- 172.21.15.148:0/1921953063 >> v1:172.21.15.148:6789/0 conn(0x7feb900cd470 legacy=0x7feb9015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8f400640 1 -- 172.21.15.148:0/1921953063 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9015fcb0 con 0x7feb900cabe0 2024-04-26T23:13:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8f400640 1 --2- 172.21.15.148:0/1921953063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cabe0 0x7feb900ccf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0097c0 tx=0x7feb7c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b71d869b0a937a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.016+0000 7feb8ea00640 1 -- 172.21.15.148:0/1921953063 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0b5070 con 0x7feb900cabe0 2024-04-26T23:13:02.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb8ea00640 1 -- 172.21.15.148:0/1921953063 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0a8990 con 0x7feb900cabe0 2024-04-26T23:13:02.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb8ea00640 1 -- 172.21.15.148:0/1921953063 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0a8d40 con 0x7feb900cabe0 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- 172.21.15.148:0/1921953063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cabe0 msgr2=0x7feb900ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 --2- 172.21.15.148:0/1921953063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cabe0 0x7feb900ccf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0097c0 tx=0x7feb7c01ec90 comp rx=0 tx=0).stop 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- 172.21.15.148:0/1921953063 shutdown_connections 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 --2- 172.21.15.148:0/1921953063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cabe0 0x7feb900ccf30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- 172.21.15.148:0/1921953063 >> 172.21.15.148:0/1921953063 conn(0x7feb9006c380 msgr2=0x7feb9006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- 172.21.15.148:0/1921953063 shutdown_connections 2024-04-26T23:13:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- 172.21.15.148:0/1921953063 wait complete. 2024-04-26T23:13:02.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 Processor -- start 2024-04-26T23:13:02.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- start start 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb900cabe0 0x7feb90150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cd470 0x7feb901f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 0x7feb90154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb90156360 con 0x7feb90155f80 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb900cc7a0 con 0x7feb900cd470 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb97200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb9014aeb0 con 0x7feb900cabe0 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 0x7feb90154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 0x7feb90154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47994/0 (socket says 172.21.15.148:47994) 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 learned_addr learned my addr 172.21.15.148:0/273789161 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb8f400640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cd470 0x7feb901f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb900cabe0 0x7feb90150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb900cabe0 msgr2=0x7feb90150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb900cabe0 0x7feb90150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cd470 msgr2=0x7feb901f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900cd470 0x7feb901f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9014b5a0 con 0x7feb90155f80 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.020+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb900cabe0 0x7feb90150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb95200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 0x7feb90154b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c450 tx=0x7feb8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88017070 con 0x7feb90155f80 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb88005cf0 con 0x7feb90155f80 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9014b100 con 0x7feb90155f80 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880072b0 con 0x7feb90155f80 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9015f0c0 con 0x7feb90155f80 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb97200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 0x7feb9014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb901564e0 con 0x7feb901554e0 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 0x7feb9014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb8fe00640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb90077c20 con 0x7feb901554e0 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 0x7feb9014a2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb8000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb8801a070 con 0x7feb90155f80 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb70068380 0x7feb7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7feb88085f50 con 0x7feb90155f80 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80003b90 con 0x7feb901554e0 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feb80018070 con 0x7feb901554e0 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.024+0000 7feb8f400640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb70068380 0x7feb7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.028+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 msgr2=0x7feb9014a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.028+0000 7feb87e00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 0x7feb9014a2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb8000ecd0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.028+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 msgr2=0x7feb9014a2b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.028+0000 7feb87e00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb901554e0 0x7feb9014a2b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.028+0000 7feb8f400640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb70068380 0x7feb7006a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b2000 tx=0x7feb7c0aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.032+0000 7feb97200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 0x7feb9014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.032+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb900746c0 con 0x7feb9015ce60 2024-04-26T23:13:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.032+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 0x7feb9014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.032+0000 7feb8fe00640 1 -- 172.21.15.148:0/273789161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb900cc1d0 con 0x7feb9015ce60 2024-04-26T23:13:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb8fe00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 0x7feb9014a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb80001410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800050d0 con 0x7feb9015ce60 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 <== mon.1 v2:172.21.15.157:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5212 (secure 0 0 0) 0x7feb800050d0 con 0x7feb9015ce60 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 msgr2=0x7feb9014a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 0x7feb9014a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb80001410 comp rx=0 tx=0).stop 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 msgr2=0x7feb9014a7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb87e00640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9015ce60 0x7feb9014a7f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 64, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 137653, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:13:02.036 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:13:02.037 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.038 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:13:02.039 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:13:02.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.041 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:13:02.042 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:13:02.043 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:13:02.044 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:13:02.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": [ 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 6 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": [ 2024-04-26T23:13:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.049 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 5 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": [ 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:13:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb70068380 msgr2=0x7feb7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7feb70068380 0x7feb7006a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b2000 tx=0x7feb7c0aa070 comp rx=0 tx=0).stop 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 msgr2=0x7feb90154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 --2- 172.21.15.148:0/273789161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb90155f80 0x7feb90154b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c450 tx=0x7feb8800c910 comp rx=0 tx=0).stop 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 reap_dead start 2024-04-26T23:13:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb95200640 1 -- 172.21.15.148:0/273789161 reap_dead start 2024-04-26T23:13:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 shutdown_connections 2024-04-26T23:13:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 >> 172.21.15.148:0/273789161 conn(0x7feb9006c380 msgr2=0x7feb900c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 shutdown_connections 2024-04-26T23:13:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.036+0000 7feb97200640 1 -- 172.21.15.148:0/273789161 wait complete. 2024-04-26T23:13:02.054 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:13:02.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:13:02.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:13:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.192+0000 7fd946000640 1 Processor -- start 2024-04-26T23:13:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.192+0000 7fd946000640 1 -- start start 2024-04-26T23:13:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd946000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd940153ea0 0x7fd9400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd946000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd9400cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd946000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9400c9f80 con 0x7fd9400cf8a0 2024-04-26T23:13:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd946000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fd940154280 con 0x7fd940153ea0 2024-04-26T23:13:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd946000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400c4470 con 0x7fd9400c6250 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd940153ea0 0x7fd9400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93fe00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd9400cf8a0 0x7fd94015d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33972/0 (socket says 172.21.15.148:33972) 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93fe00640 1 -- 172.21.15.148:0/1254548615 learned_addr learned my addr 172.21.15.148:0/1254548615 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93ea00640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd9400cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93f400640 1 -- 172.21.15.148:0/1254548615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 msgr2=0x7fd9400cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93f400640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd9400cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93f400640 1 -- 172.21.15.148:0/1254548615 >> v1:172.21.15.148:6789/0 conn(0x7fd9400cf8a0 legacy=0x7fd94015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.196+0000 7fd93f400640 1 -- 172.21.15.148:0/1254548615 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9400ca260 con 0x7fd940153ea0 2024-04-26T23:13:02.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd93f400640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd940153ea0 0x7fd9400709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097c0 tx=0x7fd93001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46452d9fb68473e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd93e000640 1 -- 172.21.15.148:0/1254548615 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300ab600 con 0x7fd940153ea0 2024-04-26T23:13:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd93e000640 1 -- 172.21.15.148:0/1254548615 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9300b0070 con 0x7fd940153ea0 2024-04-26T23:13:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd93e000640 1 -- 172.21.15.148:0/1254548615 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300ab9c0 con 0x7fd940153ea0 2024-04-26T23:13:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- 172.21.15.148:0/1254548615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd940153ea0 msgr2=0x7fd9400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd940153ea0 0x7fd9400709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097c0 tx=0x7fd93001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- 172.21.15.148:0/1254548615 shutdown_connections 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd9400cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- 172.21.15.148:0/1254548615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd940153ea0 0x7fd9400709e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- 172.21.15.148:0/1254548615 >> 172.21.15.148:0/1254548615 conn(0x7fd940068140 msgr2=0x7fd940068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- 172.21.15.148:0/1254548615 shutdown_connections 2024-04-26T23:13:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- 172.21.15.148:0/1254548615 wait complete. 2024-04-26T23:13:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 Processor -- start 2024-04-26T23:13:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- start start 2024-04-26T23:13:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd940145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd940153ea0 0x7fd9401532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd940071860 con 0x7fd9400cf8a0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd9400c4c80 con 0x7fd940153ea0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.200+0000 7fd946000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400719e0 con 0x7fd9400c6250 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48008/0 (socket says 172.21.15.148:48008) 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 -- 172.21.15.148:0/4107654677 learned_addr learned my addr 172.21.15.148:0/4107654677 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93f400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd940145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93fe00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd940153ea0 0x7fd9401532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 msgr2=0x7fd940145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c6250 0x7fd940145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd940153ea0 msgr2=0x7fd9401532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd940153ea0 0x7fd9401532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94015c930 con 0x7fd9400cf8a0 2024-04-26T23:13:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93ea00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d620 tx=0x7fd92c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00b620 con 0x7fd9400cf8a0 2024-04-26T23:13:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c019070 con 0x7fd9400cf8a0 2024-04-26T23:13:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94015cc10 con 0x7fd9400cf8a0 2024-04-26T23:13:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00b9e0 con 0x7fd9400cf8a0 2024-04-26T23:13:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9400c8740 con 0x7fd9400cf8a0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd946000640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 0x7fd9401f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400c8d90 con 0x7fd94014fdf0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93f400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 0x7fd9401f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd92c00bb80 con 0x7fd9400cf8a0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93f400640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd940077c20 con 0x7fd94014fdf0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd93f400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 0x7fd9401f4f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd940076590 tx=0x7fd930019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.204+0000 7fd937400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd920068380 0x7fd92006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd92c087220 con 0x7fd9400cf8a0 2024-04-26T23:13:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300c1680 con 0x7fd94014fdf0 2024-04-26T23:13:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd93fe00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd920068380 0x7fd92006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd9300b0040 con 0x7fd94014fdf0 2024-04-26T23:13:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 msgr2=0x7fd9401f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 0x7fd9401f4f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd940076590 tx=0x7fd930019180 comp rx=0 tx=0).stop 2024-04-26T23:13:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 msgr2=0x7fd9401f4f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd937400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd94014fdf0 0x7fd9401f4f60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.208+0000 7fd93fe00640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd920068380 0x7fd92006a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd938005c10 tx=0x7fd938009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.212+0000 7fd946000640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 0x7fd9401f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.212+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd9400caee0 con 0x7fd9400c8910 2024-04-26T23:13:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.212+0000 7fd93f400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 0x7fd9401f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.212+0000 7fd93f400640 1 -- 172.21.15.148:0/4107654677 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd940071520 con 0x7fd9400c8910 2024-04-26T23:13:02.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd93f400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 0x7fd9401f54a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd93001aa90 tx=0x7fd930009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300c1b80 con 0x7fd9400c8910 2024-04-26T23:13:02.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 <== mon.2 v2:172.21.15.157:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4558 (secure 0 0 0) 0x7fd930003620 con 0x7fd9400c8910 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 msgr2=0x7fd9401f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 0x7fd9401f54a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd93001aa90 tx=0x7fd930009190 comp rx=0 tx=0).stop 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 msgr2=0x7fd9401f54a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd937400640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9400c8910 0x7fd9401f54a0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd93001aa90 tx=0x7fd930009190 comp rx=0 tx=0).stop 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:13:02.215 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "peon", 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "election_epoch": 64, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 25647, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum": [ 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: 0, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: 1, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_age": 2, 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "required_con": "2450521708007866372", 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "required_mon": [ 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.216 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "quorum_mon": [ 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.217 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "outside_quorum": [], 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "extra_probe_peers": [], 2024-04-26T23:13:02.218 INFO:teuthology.orchestra.run.smithi148.stdout: "sync_provider": [], 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "monmap": { 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 1, 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "fsid": "d6966320-e81f-47bf-b2a0-b4169b90f47b", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "modified": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "created": "2024-04-26T23:03:44.286356Z", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release": 19, 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "min_mon_release_name": "squid", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "election_strategy": 1, 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "disallowed_leaders: ": "", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false, 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "tiebreaker_mon": "", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "removed_ranks: ": "", 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "features": { 2024-04-26T23:13:02.219 INFO:teuthology.orchestra.run.smithi148.stdout: "persistent": [ 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "kraken", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "luminous", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "mimic", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap-prune", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "nautilus", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "elector-pinging", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "reef", 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "squid" 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "optional": [] 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.220 INFO:teuthology.orchestra.run.smithi148.stdout: "mons": [ 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 0, 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "a", 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:3300", 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789", 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6789/0", 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.148:6789/0", 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 1, 2024-04-26T23:13:02.222 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "b", 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3300", 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789", 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.223 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6789/0", 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6789/0", 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "rank": 2, 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "c", 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addrs": { 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:3301", 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790", 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 0 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.157:6790/0", 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "public_addr": "172.21.15.157:6790/0", 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "priority": 0, 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "weight": 0, 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_location": "{}" 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "feature_map": { 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": [ 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "client": [ 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "release": "luminous", 2024-04-26T23:13:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 1 2024-04-26T23:13:02.227 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-26T23:13:02.227 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-26T23:13:02.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-26T23:13:02.227 INFO:teuthology.orchestra.run.smithi148.stdout: "stretch_mode": false 2024-04-26T23:13:02.227 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd920068380 msgr2=0x7fd92006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fd920068380 0x7fd92006a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd938005c10 tx=0x7fd938009040 comp rx=0 tx=0).stop 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 msgr2=0x7fd940152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d620 tx=0x7fd92c00dae0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd93fe00640 1 -- 172.21.15.148:0/4107654677 reap_dead start 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 shutdown_connections 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 --2- 172.21.15.148:0/4107654677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9400cf8a0 0x7fd940152d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 >> 172.21.15.148:0/4107654677 conn(0x7fd940068140 msgr2=0x7fd9400cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 shutdown_connections 2024-04-26T23:13:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.216+0000 7fd946000640 1 -- 172.21.15.148:0/4107654677 wait complete. 2024-04-26T23:13:02.233 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:13:02.233 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:13:02.234 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:13:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 Processor -- start 2024-04-26T23:13:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 -- start start 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45c4152bc0 0x7f45c40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f45c40c9340 0x7f45c4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c4152fa0 con 0x7f45c40732b0 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f45c4073700 con 0x7f45c4152bc0 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c9400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f45c4159790 con 0x7f45c40c9340 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45c4152bc0 0x7f45c40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45c4152bc0 0x7f45c40c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48016/0 (socket says 172.21.15.148:48016) 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 -- 172.21.15.148:0/279584797 learned_addr learned my addr 172.21.15.148:0/279584797 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c1e00640 1 --2- 172.21.15.148:0/279584797 >> v2:172.21.15.157:3300/0 conn(0x7f45c40c9340 0x7f45c4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 -- 172.21.15.148:0/279584797 >> v2:172.21.15.157:3300/0 conn(0x7f45c40c9340 msgr2=0x7f45c4072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 --2- 172.21.15.148:0/279584797 >> v2:172.21.15.157:3300/0 conn(0x7f45c40c9340 0x7f45c4072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 -- 172.21.15.148:0/279584797 >> v1:172.21.15.157:6789/0 conn(0x7f45c40732b0 legacy=0x7f45c40c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.376+0000 7f45c2800640 1 -- 172.21.15.148:0/279584797 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c4158930 con 0x7f45c4152bc0 2024-04-26T23:13:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c2800640 1 --2- 172.21.15.148:0/279584797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c40c8e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45c4071cb0 tx=0x7f45b401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4204d3d30dcb7e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c1400640 1 -- 172.21.15.148:0/279584797 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b40b5070 con 0x7f45c4152bc0 2024-04-26T23:13:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c1400640 1 -- 172.21.15.148:0/279584797 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b40a89d0 con 0x7f45c4152bc0 2024-04-26T23:13:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c1400640 1 -- 172.21.15.148:0/279584797 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b40a8da0 con 0x7f45c4152bc0 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 -- 172.21.15.148:0/279584797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 msgr2=0x7f45c40c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 --2- 172.21.15.148:0/279584797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c40c8e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45c4071cb0 tx=0x7f45b401ecd0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 -- 172.21.15.148:0/279584797 shutdown_connections 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 --2- 172.21.15.148:0/279584797 >> v2:172.21.15.157:3300/0 conn(0x7f45c40c9340 0x7f45c4072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 --2- 172.21.15.148:0/279584797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c40c8e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 -- 172.21.15.148:0/279584797 >> 172.21.15.148:0/279584797 conn(0x7f45c406c380 msgr2=0x7f45c406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 -- 172.21.15.148:0/279584797 shutdown_connections 2024-04-26T23:13:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.380+0000 7f45c9400640 1 -- 172.21.15.148:0/279584797 wait complete. 2024-04-26T23:13:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 Processor -- start 2024-04-26T23:13:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- start start 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40732b0 0x7f45c4147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c40c9340 0x7f45c41458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41591d0 con 0x7f45c4152bc0 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4158ef0 con 0x7f45c40c9340 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f45c41594b0 con 0x7f45c40732b0 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48018/0 (socket says 172.21.15.148:48018) 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 -- 172.21.15.148:0/1852017038 learned_addr learned my addr 172.21.15.148:0/1852017038 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c1e00640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c40c9340 0x7f45c41458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c2800640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40732b0 0x7f45c4147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 -- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40732b0 msgr2=0x7f45c4147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40732b0 0x7f45c4147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 -- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c40c9340 msgr2=0x7f45c41458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c40c9340 0x7f45c41458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 -- 172.21.15.148:0/1852017038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c41f5c20 con 0x7f45c4152bc0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c3200640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00b9a0 tx=0x7f45bc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc019070 con 0x7f45c4152bc0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc00cba0 con 0x7f45c4152bc0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc014440 con 0x7f45c4152bc0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c415cba0 con 0x7f45c4152bc0 2024-04-26T23:13:02.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41f5e90 con 0x7f45c4152bc0 2024-04-26T23:13:02.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.384+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c4077c20 con 0x7f45c4152bc0 2024-04-26T23:13:02.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.388+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45bc01c070 con 0x7f45c4152bc0 2024-04-26T23:13:02.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.388+0000 7f45baa00640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:02.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.388+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f45bc0869d0 con 0x7f45c4152bc0 2024-04-26T23:13:02.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.388+0000 7f45c2800640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:02.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.388+0000 7f45c2800640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45b40b2000 tx=0x7f45b4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:02.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.392+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45bc056b80 con 0x7f45c4152bc0 2024-04-26T23:13:02.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f45c40c9940 con 0x7f45c4152bc0 2024-04-26T23:13:02.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45baa00640 1 -- 172.21.15.148:0/1852017038 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f45bc056480 con 0x7f45c4152bc0 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 msgr2=0x7f45a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45b40b2000 tx=0x7f45b4008040 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 msgr2=0x7f45c4142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00b9a0 tx=0x7f45bc00be60 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 shutdown_connections 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f45a4068380 0x7f45a406a840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45c4152bc0 0x7f45c4142530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45c40c9340 0x7f45c41458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 --2- 172.21.15.148:0/1852017038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45c40732b0 0x7f45c4147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 >> 172.21.15.148:0/1852017038 conn(0x7f45c406c380 msgr2=0x7f45c4144c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 shutdown_connections 2024-04-26T23:13:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:02.612+0000 7f45c9400640 1 -- 172.21.15.148:0/1852017038 wait complete. 2024-04-26T23:13:02.634 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:13:03.300 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T23:13:03.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T23:13:04.252 DEBUG:teuthology.parallel:result is None 2024-04-26T23:13:04.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T23:13:04.280 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T23:13:04.281 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-04-26T23:13:04.291 INFO:tasks.mon_thrash:joining mon_thrasher 2024-04-26T23:13:12.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:13:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 Processor -- start 2024-04-26T23:13:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 -- start start 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9998152d40 0x7f99980c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9998070d30 0x7f999815c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99980c9620 con 0x7f99980c8680 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f99980711a0 con 0x7f9998152d40 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f999d800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f99980c9950 con 0x7f9998070d30 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9998152d40 0x7f99980c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f99980c8680 0x7f99980ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32918/0 (socket says 172.21.15.148:32918) 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996000640 1 -- 172.21.15.148:0/3479071712 learned_addr learned my addr 172.21.15.148:0/3479071712 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9997400640 1 --2- 172.21.15.148:0/3479071712 >> v2:172.21.15.157:3300/0 conn(0x7f9998070d30 0x7f999815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996a00640 1 -- 172.21.15.148:0/3479071712 >> v2:172.21.15.157:3300/0 conn(0x7f9998070d30 msgr2=0x7f999815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996a00640 1 --2- 172.21.15.148:0/3479071712 >> v2:172.21.15.157:3300/0 conn(0x7f9998070d30 0x7f999815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996a00640 1 -- 172.21.15.148:0/3479071712 >> v1:172.21.15.148:6789/0 conn(0x7f99980c8680 legacy=0x7f99980ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9996a00640 1 -- 172.21.15.148:0/3479071712 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980c5a20 con 0x7f9998152d40 2024-04-26T23:13:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.784+0000 7f9995600640 1 -- 172.21.15.148:0/3479071712 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900012829 0 0) 0x7f99980c9620 con 0x7f99980c8680 2024-04-26T23:13:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f9996a00640 1 --2- 172.21.15.148:0/3479071712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f99980c9de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9998068c80 tx=0x7f998801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369487edc87ed015 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f9995600640 1 -- 172.21.15.148:0/3479071712 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99880b5070 con 0x7f9998152d40 2024-04-26T23:13:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f9995600640 1 -- 172.21.15.148:0/3479071712 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99880a8970 con 0x7f9998152d40 2024-04-26T23:13:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f9995600640 1 -- 172.21.15.148:0/3479071712 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99880a8d40 con 0x7f9998152d40 2024-04-26T23:13:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- 172.21.15.148:0/3479071712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 msgr2=0x7f99980c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 --2- 172.21.15.148:0/3479071712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f99980c9de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9998068c80 tx=0x7f998801ec70 comp rx=0 tx=0).stop 2024-04-26T23:13:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- 172.21.15.148:0/3479071712 shutdown_connections 2024-04-26T23:13:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 --2- 172.21.15.148:0/3479071712 >> v2:172.21.15.157:3300/0 conn(0x7f9998070d30 0x7f999815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 --2- 172.21.15.148:0/3479071712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f99980c9de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- 172.21.15.148:0/3479071712 >> 172.21.15.148:0/3479071712 conn(0x7f9998073240 msgr2=0x7f9998073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- 172.21.15.148:0/3479071712 shutdown_connections 2024-04-26T23:13:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- 172.21.15.148:0/3479071712 wait complete. 2024-04-26T23:13:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 Processor -- start 2024-04-26T23:13:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.788+0000 7f999d800640 1 -- start start 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 0x7f99981533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f99980c8680 0x7f9998149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9998153120 con 0x7f9998152d40 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99980715d0 con 0x7f9998070d30 2024-04-26T23:13:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f99980c5fe0 con 0x7f99980c8680 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60616/0 (socket says 172.21.15.148:60616) 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 -- 172.21.15.148:0/3904387238 learned_addr learned my addr 172.21.15.148:0/3904387238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9996a00640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 0x7f99981533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9996000640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f99980c8680 0x7f9998149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 -- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f99980c8680 msgr2=0x7f9998149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f99980c8680 0x7f9998149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 -- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 msgr2=0x7f99981533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 0x7f99981533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 -- 172.21.15.148:0/3904387238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980cd900 con 0x7f9998152d40 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9996a00640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 0x7f99981533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f9997400640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9990007e40 tx=0x7f999000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990014620 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9990019070 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990014a20 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99980cdbc0 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99980ce180 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.792+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9998077c20 con 0x7f9998152d40 2024-04-26T23:13:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.796+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9990014bc0 con 0x7f9998152d40 2024-04-26T23:13:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.796+0000 7f998ea00640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 0x7f997806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.796+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9990087690 con 0x7f9998152d40 2024-04-26T23:13:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.796+0000 7f9996a00640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 0x7f997806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.796+0000 7f9996a00640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 0x7f997806a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99880b2000 tx=0x7f99880aa070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.800+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f99900577b0 con 0x7f9998152d40 2024-04-26T23:13:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99980c6e40 con 0x7f9998152d40 2024-04-26T23:13:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f998ea00640 1 -- 172.21.15.148:0/3904387238 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7f99900570b0 con 0x7f9998152d40 2024-04-26T23:13:12.986 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:12.986 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:13:12.987 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:13:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 msgr2=0x7f997806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 0x7f997806a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99880b2000 tx=0x7f99880aa070 comp rx=0 tx=0).stop 2024-04-26T23:13:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 msgr2=0x7f999814a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9990007e40 tx=0x7f999000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 shutdown_connections 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f99780683b0 0x7f997806a870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9998152d40 0x7f999814a100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f99980c8680 0x7f9998149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 --2- 172.21.15.148:0/3904387238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9998070d30 0x7f99981533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 >> 172.21.15.148:0/3904387238 conn(0x7f9998073240 msgr2=0x7f999815b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 shutdown_connections 2024-04-26T23:13:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:12.988+0000 7f999d800640 1 -- 172.21.15.148:0/3904387238 wait complete. 2024-04-26T23:13:13.008 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:13:13.009 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:13:13.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.144+0000 7f2ee5000640 1 Processor -- start 2024-04-26T23:13:13.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.144+0000 7f2ee5000640 1 -- start start 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ee5000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ee015c7e0 0x7f2ee0167810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ee5000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00cfb50 con 0x7f2ee00b1d80 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ee5000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00cfe10 con 0x7f2ee00c6340 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ee5000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee00cce10 con 0x7f2ee015c7e0 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2edde00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2ee00b1d80 0x7f2ee006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32934/0 (socket says 172.21.15.148:32934) 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2edde00640 1 -- 172.21.15.148:0/1468186824 learned_addr learned my addr 172.21.15.148:0/1468186824 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:13.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ede800640 1 --2- 172.21.15.148:0/1468186824 >> v2:172.21.15.148:3300/0 conn(0x7f2ee015c7e0 0x7f2ee0167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ede800640 1 -- 172.21.15.148:0/1468186824 >> v1:172.21.15.157:6789/0 conn(0x7f2ee00c6340 legacy=0x7f2ee015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ede800640 1 -- 172.21.15.148:0/1468186824 >> v1:172.21.15.148:6789/0 conn(0x7f2ee00b1d80 legacy=0x7f2ee006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.148+0000 7f2ede800640 1 -- 172.21.15.148:0/1468186824 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee006d650 con 0x7f2ee015c7e0 2024-04-26T23:13:13.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ede800640 1 --2- 172.21.15.148:0/1468186824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee015c7e0 0x7f2ee0167810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097c0 tx=0x7f2ed801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9354c45cf72a967 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2edd400640 1 -- 172.21.15.148:0/1468186824 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80b5070 con 0x7f2ee015c7e0 2024-04-26T23:13:13.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2edd400640 1 -- 172.21.15.148:0/1468186824 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed80a8990 con 0x7f2ee015c7e0 2024-04-26T23:13:13.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2edd400640 1 -- 172.21.15.148:0/1468186824 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80a8d60 con 0x7f2ee015c7e0 2024-04-26T23:13:13.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- 172.21.15.148:0/1468186824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee015c7e0 msgr2=0x7f2ee0167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 --2- 172.21.15.148:0/1468186824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee015c7e0 0x7f2ee0167810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097c0 tx=0x7f2ed801ec90 comp rx=0 tx=0).stop 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- 172.21.15.148:0/1468186824 shutdown_connections 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 --2- 172.21.15.148:0/1468186824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee015c7e0 0x7f2ee0167810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- 172.21.15.148:0/1468186824 >> 172.21.15.148:0/1468186824 conn(0x7f2ee0071160 msgr2=0x7f2ee0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- 172.21.15.148:0/1468186824 shutdown_connections 2024-04-26T23:13:13.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- 172.21.15.148:0/1468186824 wait complete. 2024-04-26T23:13:13.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 Processor -- start 2024-04-26T23:13:13.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- start start 2024-04-26T23:13:13.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ee00c6340 0x7f2ee00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 0x7f2ee01f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00b2160 con 0x7f2ee00b1d80 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee006dc10 con 0x7f2ee015c7e0 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.152+0000 7f2ee5000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee0071970 con 0x7f2ee00c6340 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60636/0 (socket says 172.21.15.148:60636) 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 -- 172.21.15.148:0/3511069894 learned_addr learned my addr 172.21.15.148:0/3511069894 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ed5400640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ee00c6340 0x7f2ee00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ede800640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 0x7f2ee01f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 -- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ee00c6340 msgr2=0x7f2ee00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ee00c6340 0x7f2ee00b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 -- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 msgr2=0x7f2ee01f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 0x7f2ee01f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 -- 172.21.15.148:0/3511069894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0156e40 con 0x7f2ee00b1d80 2024-04-26T23:13:13.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ede800640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 0x7f2ee01f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:13.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2edde00640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c500 tx=0x7f2ed000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0017070 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0005cf0 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee0157120 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00072f0 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee01f5560 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee01f50a0 con 0x7f2ee00b1d80 2024-04-26T23:13:13.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.156+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ed001a070 con 0x7f2ee00b1d80 2024-04-26T23:13:13.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.160+0000 7f2ed6a00640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 0x7f2ebc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.160+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2ed0086180 con 0x7f2ee00b1d80 2024-04-26T23:13:13.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.160+0000 7f2ed5400640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 0x7f2ebc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.160+0000 7f2ed5400640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 0x7f2ebc06a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ee01ef760 tx=0x7f2ec8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.164+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ee01f50a0 con 0x7f2ee00b1d80 2024-04-26T23:13:13.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2ee0077c20 con 0x7f2ee00b1d80 2024-04-26T23:13:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ed6a00640 1 -- 172.21.15.148:0/3511069894 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f2ed0055c50 con 0x7f2ee00b1d80 2024-04-26T23:13:13.387 INFO:teuthology.orchestra.run.smithi148.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","modified":"2024-04-26T23:03:44.286356Z","created":"2024-04-26T23:03:44.286356Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3301","nonce":0},{"type":"v1","addr":"172.21.15.157:6790","nonce":0}]},"addr":"172.21.15.157:6790/0","public_addr":"172.21.15.157:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 msgr2=0x7f2ebc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 0x7f2ebc06a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ee01ef760 tx=0x7f2ec8009040 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 msgr2=0x7f2ee0156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c500 tx=0x7f2ed000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 shutdown_connections 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2ebc068380 0x7f2ebc06a840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ee015c7e0 0x7f2ee01f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ee00c6340 0x7f2ee00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 --2- 172.21.15.148:0/3511069894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ee00b1d80 0x7f2ee0156790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 >> 172.21.15.148:0/3511069894 conn(0x7f2ee0071160 msgr2=0x7f2ee01599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 shutdown_connections 2024-04-26T23:13:13.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.388+0000 7f2ee5000640 1 -- 172.21.15.148:0/3511069894 wait complete. 2024-04-26T23:13:13.410 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:13:13.410 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T23:13:13.419 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T23:13:13.419 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:13:13.420 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:13:13.428 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-26T23:13:13.428 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:13:13.481 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:13:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 Processor -- start 2024-04-26T23:13:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 -- start start 2024-04-26T23:13:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c4c152120 0x7f4c4c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c4c072e90 con 0x7f4c4c0708f0 2024-04-26T23:13:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4c4c0c8f40 con 0x7f4c4c152120 2024-04-26T23:13:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c50c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c0c9190 con 0x7f4c4c072a40 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c49e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4c4c152120 0x7f4c4c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:38838/0 (socket says 172.21.15.148:38838) 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 -- 172.21.15.148:0/696814717 learned_addr learned my addr 172.21.15.148:0/696814717 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 -- 172.21.15.148:0/696814717 >> v2:172.21.15.157:3300/0 conn(0x7f4c4c152120 msgr2=0x7f4c4c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 --2- 172.21.15.148:0/696814717 >> v2:172.21.15.157:3300/0 conn(0x7f4c4c152120 0x7f4c4c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 -- 172.21.15.148:0/696814717 >> v1:172.21.15.157:6789/0 conn(0x7f4c4c0708f0 legacy=0x7f4c4c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.664+0000 7f4c4a800640 1 -- 172.21.15.148:0/696814717 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0c7c20 con 0x7f4c4c072a40 2024-04-26T23:13:13.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c4a800640 1 --2- 172.21.15.148:0/696814717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef246e2844ea58a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c48a00640 1 -- 172.21.15.148:0/696814717 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440a5680 con 0x7f4c4c072a40 2024-04-26T23:13:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c48a00640 1 -- 172.21.15.148:0/696814717 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c440a5820 con 0x7f4c4c072a40 2024-04-26T23:13:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c48a00640 1 -- 172.21.15.148:0/696814717 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440a5bf0 con 0x7f4c4c072a40 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 -- 172.21.15.148:0/696814717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 msgr2=0x7f4c4c06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 --2- 172.21.15.148:0/696814717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4401ca30 comp rx=0 tx=0).stop 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 -- 172.21.15.148:0/696814717 shutdown_connections 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 --2- 172.21.15.148:0/696814717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c072a40 0x7f4c4c06fb60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 --2- 172.21.15.148:0/696814717 >> v2:172.21.15.157:3300/0 conn(0x7f4c4c152120 0x7f4c4c1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 -- 172.21.15.148:0/696814717 >> 172.21.15.148:0/696814717 conn(0x7f4c4c06c380 msgr2=0x7f4c4c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:13.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 -- 172.21.15.148:0/696814717 shutdown_connections 2024-04-26T23:13:13.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.668+0000 7f4c50c00640 1 -- 172.21.15.148:0/696814717 wait complete. 2024-04-26T23:13:13.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 Processor -- start 2024-04-26T23:13:13.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- start start 2024-04-26T23:13:13.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0708f0 0x7f4c4c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c152120 0x7f4c4c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c152680 con 0x7f4c4c072a40 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c152500 con 0x7f4c4c0708f0 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c073120 con 0x7f4c4c152120 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60648/0 (socket says 172.21.15.148:60648) 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 -- 172.21.15.148:0/2085205094 learned_addr learned my addr 172.21.15.148:0/2085205094 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c4a800640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c152120 0x7f4c4c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49e00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0708f0 0x7f4c4c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 -- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c152120 msgr2=0x7f4c4c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c152120 0x7f4c4c146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 -- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0708f0 msgr2=0x7f4c4c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0708f0 0x7f4c4c0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 -- 172.21.15.148:0/2085205094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c157510 con 0x7f4c4c072a40 2024-04-26T23:13:13.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c49400640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c400 tx=0x7f4c3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38017070 con 0x7f4c4c072a40 2024-04-26T23:13:13.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c38005310 con 0x7f4c4c072a40 2024-04-26T23:13:13.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c380054c0 con 0x7f4c4c072a40 2024-04-26T23:13:13.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c157b50 con 0x7f4c4c072a40 2024-04-26T23:13:13.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.672+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0cb800 con 0x7f4c4c072a40 2024-04-26T23:13:13.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c077c20 con 0x7f4c4c072a40 2024-04-26T23:13:13.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c3801a070 con 0x7f4c4c072a40 2024-04-26T23:13:13.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c42000640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 0x7f4c2c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:13.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4c380860b0 con 0x7f4c4c072a40 2024-04-26T23:13:13.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c49e00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 0x7f4c2c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:13.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.676+0000 7f4c49e00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 0x7f4c2c06a8c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009ac0 tx=0x7f4c3c009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:13.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.680+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c38055b70 con 0x7f4c4c072a40 2024-04-26T23:13:13.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.840+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c4c0c5e20 con 0x7f4c4c072a40 2024-04-26T23:13:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.840+0000 7f4c42000640 1 -- 172.21.15.148:0/2085205094 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18925 (secure 0 0 0) 0x7f4c38059e70 con 0x7f4c4c072a40 2024-04-26T23:13:13.840 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:13.840 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:05:29.036622+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 msgr2=0x7f4c2c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 0x7f4c2c06a8c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009ac0 tx=0x7f4c3c009190 comp rx=0 tx=0).stop 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 msgr2=0x7f4c4c1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c400 tx=0x7f4c3800c8c0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 shutdown_connections 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4c2c068400 0x7f4c2c06a8c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c152120 0x7f4c4c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4c072a40 0x7f4c4c1461c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 --2- 172.21.15.148:0/2085205094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0708f0 0x7f4c4c0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:13.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 >> 172.21.15.148:0/2085205094 conn(0x7f4c4c06c380 msgr2=0x7f4c4c0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:13.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 shutdown_connections 2024-04-26T23:13:13.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:13.844+0000 7f4c50c00640 1 -- 172.21.15.148:0/2085205094 wait complete. 2024-04-26T23:13:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:04:33.886491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:04:37.655445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:04:38.707996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T23:04:42.177236+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T23:13:13.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:13:14.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.008+0000 7faa73e00640 1 Processor -- start 2024-04-26T23:13:14.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 -- start start 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159130 0x7faa7415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa74159510 0x7faa740cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740ca710 con 0x7faa7415c930 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7faa740ca4e0 con 0x7faa74159510 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faa74070cc0 con 0x7faa74159130 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa74159510 0x7faa740cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa74159510 0x7faa740cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60652/0 (socket says 172.21.15.148:60652) 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 -- 172.21.15.148:0/3836131300 learned_addr learned my addr 172.21.15.148:0/3836131300 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa73400640 1 --1- 172.21.15.148:0/3836131300 >> v1:172.21.15.148:6789/0 conn(0x7faa7415c930 0x7faa7415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32938/0 (socket says 172.21.15.148:32938) 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72a00640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159130 0x7faa7415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 -- 172.21.15.148:0/3836131300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159130 msgr2=0x7faa7415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159130 0x7faa7415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 -- 172.21.15.148:0/3836131300 >> v1:172.21.15.148:6789/0 conn(0x7faa7415c930 legacy=0x7faa7415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.012+0000 7faa72000640 1 -- 172.21.15.148:0/3836131300 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74070fa0 con 0x7faa74159510 2024-04-26T23:13:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa72000640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa74159510 0x7faa740cf220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa60009870 tx=0x7faa6001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd32db67b72fbd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa71600640 1 -- 172.21.15.148:0/3836131300 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600b5070 con 0x7faa74159510 2024-04-26T23:13:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa71600640 1 -- 172.21.15.148:0/3836131300 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600a8a50 con 0x7faa74159510 2024-04-26T23:13:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa71600640 1 -- 172.21.15.148:0/3836131300 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600a8e20 con 0x7faa74159510 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- 172.21.15.148:0/3836131300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa74159510 msgr2=0x7faa740cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa74159510 0x7faa740cf220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa60009870 tx=0x7faa6001ed50 comp rx=0 tx=0).stop 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- 172.21.15.148:0/3836131300 shutdown_connections 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa74159510 0x7faa740cf220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 --2- 172.21.15.148:0/3836131300 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159130 0x7faa7415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- 172.21.15.148:0/3836131300 >> 172.21.15.148:0/3836131300 conn(0x7faa7406c980 msgr2=0x7faa74068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- 172.21.15.148:0/3836131300 shutdown_connections 2024-04-26T23:13:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- 172.21.15.148:0/3836131300 wait complete. 2024-04-26T23:13:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 Processor -- start 2024-04-26T23:13:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.016+0000 7faa73e00640 1 -- start start 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa74159130 0x7faa741541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 0x7faa74151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa74071610 con 0x7faa7415c930 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faa740c9cd0 con 0x7faa74159130 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faa7406f2e0 con 0x7faa74159510 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60656/0 (socket says 172.21.15.148:60656) 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 -- 172.21.15.148:0/109969413 learned_addr learned my addr 172.21.15.148:0/109969413 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa72a00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa74159130 0x7faa741541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa72000640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 0x7faa74151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 -- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 msgr2=0x7faa74151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 0x7faa74151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 -- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa74159130 msgr2=0x7faa741541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa74159130 0x7faa741541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 -- 172.21.15.148:0/109969413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740c56b0 con 0x7faa7415c930 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa72000640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 0x7faa74151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73400640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c700 tx=0x7faa6c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c017070 con 0x7faa7415c930 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c00ce10 con 0x7faa7415c930 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00a7e0 con 0x7faa7415c930 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa740cd760 con 0x7faa7415c930 2024-04-26T23:13:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74153920 con 0x7faa7415c930 2024-04-26T23:13:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa740506d0 con 0x7faa7415c930 2024-04-26T23:13:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.020+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa6c01a070 con 0x7faa7415c930 2024-04-26T23:13:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.024+0000 7faa6aa00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 0x7faa5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.024+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faa6c086270 con 0x7faa7415c930 2024-04-26T23:13:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.024+0000 7faa72a00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 0x7faa5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.024+0000 7faa72a00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 0x7faa5406a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa64007a60 tx=0x7faa64008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.028+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa6c055d40 con 0x7faa7415c930 2024-04-26T23:13:14.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.184+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa741586a0 con 0x7faa7415c930 2024-04-26T23:13:14.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.184+0000 7faa6aa00640 1 -- 172.21.15.148:0/109969413 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7faa6c05a040 con 0x7faa7415c930 2024-04-26T23:13:14.184 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-04-26T23:13:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 msgr2=0x7faa5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 0x7faa5406a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa64007a60 tx=0x7faa64008040 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 msgr2=0x7faa740b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c700 tx=0x7faa6c00cbc0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 shutdown_connections 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7faa540683b0 0x7faa5406a870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7415c930 0x7faa740b0920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa74159510 0x7faa74151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 --2- 172.21.15.148:0/109969413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa74159130 0x7faa741541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 >> 172.21.15.148:0/109969413 conn(0x7faa7406c980 msgr2=0x7faa740c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 shutdown_connections 2024-04-26T23:13:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.188+0000 7faa73e00640 1 -- 172.21.15.148:0/109969413 wait complete. 2024-04-26T23:13:14.189 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:13:14.192 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:13:14.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:13:14.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.392+0000 7fa6c8600640 1 Processor -- start 2024-04-26T23:13:14.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 -- start start 2024-04-26T23:13:14.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6c0152d00 0x7fa6c00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0073230 0x7fa6c0073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c0073bb0 con 0x7fa6c0158a80 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c00c4b30 con 0x7fa6c0152d00 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c8600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c00c6f60 con 0x7fa6c0073230 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c6600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa6c0158a80 0x7fa6c0158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32946/0 (socket says 172.21.15.148:32946) 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c6600640 1 -- 172.21.15.148:0/653377909 learned_addr learned my addr 172.21.15.148:0/653377909 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5200640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0073230 0x7fa6c0073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/653377909 >> v2:172.21.15.157:3300/0 conn(0x7fa6c0152d00 0x7fa6c00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853021979 0 0) 0x7fa6c0073bb0 con 0x7fa6c0158a80 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a8003530 con 0x7fa6c0158a80 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5c00640 1 -- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0073230 msgr2=0x7fa6c0073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0073230 0x7fa6c0073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 703322381 0 0) 0x7fa6a8003530 con 0x7fa6c0158a80 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5c00640 1 -- 172.21.15.148:0/653377909 >> v1:172.21.15.148:6789/0 conn(0x7fa6c0158a80 legacy=0x7fa6c0158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.396+0000 7fa6c5c00640 1 -- 172.21.15.148:0/653377909 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c00c7240 con 0x7fa6c0152d00 2024-04-26T23:13:14.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0152d00 0x7fa6c00c97d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097c0 tx=0x7fa6b401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43d882976794e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40b0070 con 0x7fa6c0152d00 2024-04-26T23:13:14.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b40ab400 con 0x7fa6c0152d00 2024-04-26T23:13:14.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6bfe00640 1 -- 172.21.15.148:0/653377909 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8001a00 con 0x7fa6c0152d00 2024-04-26T23:13:14.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0152d00 msgr2=0x7fa6c00c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0152d00 0x7fa6c00c97d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097c0 tx=0x7fa6b401c3c0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- 172.21.15.148:0/653377909 shutdown_connections 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0073230 0x7fa6c0073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 --2- 172.21.15.148:0/653377909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0152d00 0x7fa6c00c97d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- 172.21.15.148:0/653377909 >> 172.21.15.148:0/653377909 conn(0x7fa6c00c9d10 msgr2=0x7fa6c00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- 172.21.15.148:0/653377909 shutdown_connections 2024-04-26T23:13:14.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- 172.21.15.148:0/653377909 wait complete. 2024-04-26T23:13:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 Processor -- start 2024-04-26T23:13:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.400+0000 7fa6c8600640 1 -- start start 2024-04-26T23:13:14.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0152d00 0x7fa6c01503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0158a80 0x7fa6c0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00c4890 con 0x7fa6c0073230 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00c4710 con 0x7fa6c0158a80 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c0163c10 con 0x7fa6c0152d00 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60660/0 (socket says 172.21.15.148:60660) 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 -- 172.21.15.148:0/1336149110 learned_addr learned my addr 172.21.15.148:0/1336149110 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5200640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0152d00 0x7fa6c01503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c6600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0158a80 0x7fa6c0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 -- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0152d00 msgr2=0x7fa6c01503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0152d00 0x7fa6c01503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 -- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0158a80 msgr2=0x7fa6c0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0158a80 0x7fa6c0157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 -- 172.21.15.148:0/1336149110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c0151d30 con 0x7fa6c0073230 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c5c00640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40ae040 tx=0x7fa6b4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40b0040 con 0x7fa6c0073230 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b40bb070 con 0x7fa6c0073230 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003aa0 con 0x7fa6c0073230 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c01520c0 con 0x7fa6c0073230 2024-04-26T23:13:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c0165f10 con 0x7fa6c0073230 2024-04-26T23:13:14.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.404+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c0152570 con 0x7fa6c0073230 2024-04-26T23:13:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.408+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6b40b3070 con 0x7fa6c0073230 2024-04-26T23:13:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.408+0000 7fa6bd600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 0x7fa6a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.408+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6b4120ba0 con 0x7fa6c0073230 2024-04-26T23:13:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.408+0000 7fa6c5200640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 0x7fa6a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.408+0000 7fa6c5200640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 0x7fa6a006a870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0158540 tx=0x7fa6ac008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.412+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6c0152570 con 0x7fa6c0073230 2024-04-26T23:13:14.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.568+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa6c0070a80 con 0x7fa6c0073230 2024-04-26T23:13:14.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.568+0000 7fa6bd600640 1 -- 172.21.15.148:0/1336149110 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fa6b4015fb0 con 0x7fa6c0073230 2024-04-26T23:13:14.569 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 msgr2=0x7fa6a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 0x7fa6a006a870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0158540 tx=0x7fa6ac008040 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 msgr2=0x7fa6c0165890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40ae040 tx=0x7fa6b4019160 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 shutdown_connections 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fa6a00683b0 0x7fa6a006a870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6c0158a80 0x7fa6c0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa6c0152d00 0x7fa6c01503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 --2- 172.21.15.148:0/1336149110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6c0073230 0x7fa6c0165890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 >> 172.21.15.148:0/1336149110 conn(0x7fa6c00c9d10 msgr2=0x7fa6c0073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 shutdown_connections 2024-04-26T23:13:14.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.572+0000 7fa6c8600640 1 -- 172.21.15.148:0/1336149110 wait complete. 2024-04-26T23:13:14.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:13:14.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 Processor -- start 2024-04-26T23:13:14.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 -- start start 2024-04-26T23:13:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f08901540b0 0x7f08900cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08900c4b60 0x7f089015d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08900c6660 con 0x7f08900c4710 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f08900cca20 con 0x7f08900c4b60 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0896e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f08900cc740 con 0x7f08901540b0 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08900c4b60 0x7f089015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08900c4b60 0x7f089015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60670/0 (socket says 172.21.15.148:60670) 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 -- 172.21.15.148:0/3062580656 learned_addr learned my addr 172.21.15.148:0/3062580656 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f088f400640 1 --1- 172.21.15.148:0/3062580656 >> v1:172.21.15.148:6789/0 conn(0x7f08900c4710 0x7f0890071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32950/0 (socket says 172.21.15.148:32950) 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f088fe00640 1 --2- 172.21.15.148:0/3062580656 >> v2:172.21.15.157:3300/0 conn(0x7f08901540b0 0x7f08900cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 -- 172.21.15.148:0/3062580656 >> v2:172.21.15.157:3300/0 conn(0x7f08901540b0 msgr2=0x7f08900cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 --2- 172.21.15.148:0/3062580656 >> v2:172.21.15.157:3300/0 conn(0x7f08901540b0 0x7f08900cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 -- 172.21.15.148:0/3062580656 >> v1:172.21.15.148:6789/0 conn(0x7f08900c4710 legacy=0x7f0890071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f0894e00640 1 -- 172.21.15.148:0/3062580656 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900cb580 con 0x7f08900c4b60 2024-04-26T23:13:14.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.732+0000 7f088ea00640 1 -- 172.21.15.148:0/3062580656 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694865551 0 0) 0x7f08900c6660 con 0x7f08900c4710 2024-04-26T23:13:14.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0894e00640 1 --2- 172.21.15.148:0/3062580656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08900c4b60 0x7f089015d480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08900b50d0 tx=0x7f088801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2da72007b7dfa4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f088ea00640 1 -- 172.21.15.148:0/3062580656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880b4070 con 0x7f08900c4b60 2024-04-26T23:13:14.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f088ea00640 1 -- 172.21.15.148:0/3062580656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08880af400 con 0x7f08900c4b60 2024-04-26T23:13:14.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f088ea00640 1 -- 172.21.15.148:0/3062580656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880af7d0 con 0x7f08900c4b60 2024-04-26T23:13:14.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 -- 172.21.15.148:0/3062580656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08900c4b60 msgr2=0x7f089015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 --2- 172.21.15.148:0/3062580656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08900c4b60 0x7f089015d480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08900b50d0 tx=0x7f088801f1e0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 -- 172.21.15.148:0/3062580656 shutdown_connections 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 --2- 172.21.15.148:0/3062580656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08900c4b60 0x7f089015d480 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 --2- 172.21.15.148:0/3062580656 >> v2:172.21.15.157:3300/0 conn(0x7f08901540b0 0x7f08900cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 -- 172.21.15.148:0/3062580656 >> 172.21.15.148:0/3062580656 conn(0x7f0890070570 msgr2=0x7f089006f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 -- 172.21.15.148:0/3062580656 shutdown_connections 2024-04-26T23:13:14.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 -- 172.21.15.148:0/3062580656 wait complete. 2024-04-26T23:13:14.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.736+0000 7f0896e00640 1 Processor -- start 2024-04-26T23:13:14.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- start start 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08900c4710 0x7f08901477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 0x7f089015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0890072650 con 0x7f0890148060 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08900cbb40 con 0x7f08900c4710 2024-04-26T23:13:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08900727d0 con 0x7f08900c4b60 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60680/0 (socket says 172.21.15.148:60680) 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 -- 172.21.15.148:0/150191536 learned_addr learned my addr 172.21.15.148:0/150191536 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f088fe00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08900c4710 0x7f08901477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f088f400640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 0x7f089015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 -- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 msgr2=0x7f089015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 0x7f089015b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 -- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08900c4710 msgr2=0x7f08901477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08900c4710 0x7f08901477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 -- 172.21.15.148:0/150191536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900c9570 con 0x7f0890148060 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f088f400640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 0x7f089015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0894e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f08880b2040 tx=0x7f088801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880be020 con 0x7f0890148060 2024-04-26T23:13:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08880afcc0 con 0x7f0890148060 2024-04-26T23:13:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0890158db0 con 0x7f0890148060 2024-04-26T23:13:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880b4040 con 0x7f0890148060 2024-04-26T23:13:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0890159350 con 0x7f0890148060 2024-04-26T23:13:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.740+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0890077c20 con 0x7f0890148060 2024-04-26T23:13:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.744+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08880c1020 con 0x7f0890148060 2024-04-26T23:13:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.744+0000 7f0887e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 0x7f087006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.744+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0888124ea0 con 0x7f0890148060 2024-04-26T23:13:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.744+0000 7f088fe00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 0x7f087006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:14.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.744+0000 7f088fe00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 0x7f087006a870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0880009a50 tx=0x7f0880008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:14.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.748+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08880c8030 con 0x7f0890148060 2024-04-26T23:13:14.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f08900ccdf0 con 0x7f0890148060 2024-04-26T23:13:14.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0887e00640 1 -- 172.21.15.148:0/150191536 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f0888018d40 con 0x7f0890148060 2024-04-26T23:13:14.908 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-04-26T23:13:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 msgr2=0x7f087006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 0x7f087006a870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0880009a50 tx=0x7f0880008040 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 msgr2=0x7f089015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f08880b2040 tx=0x7f088801bf80 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 shutdown_connections 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08700683b0 0x7f087006a870 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0890148060 0x7f089015bc20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08900c4b60 0x7f089015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.908+0000 7f0896e00640 1 --2- 172.21.15.148:0/150191536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08900c4710 0x7f08901477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.912+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 >> 172.21.15.148:0/150191536 conn(0x7f0890070570 msgr2=0x7f08900cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.912+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 shutdown_connections 2024-04-26T23:13:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:14.912+0000 7f0896e00640 1 -- 172.21.15.148:0/150191536 wait complete. 2024-04-26T23:13:14.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T23:13:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 Processor -- start 2024-04-26T23:13:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 -- start start 2024-04-26T23:13:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f8c073940 0x7f0f8c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 0x7f0f8c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8c0c4b30 con 0x7f0f8c152d00 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0f8c0c6f60 con 0x7f0f8c073940 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f93e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0f8c0c7240 con 0x7f0f8c15c070 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f90a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f8c073940 0x7f0f8c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f90a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f8c073940 0x7f0f8c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60694/0 (socket says 172.21.15.148:60694) 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.108+0000 7f0f90a00640 1 -- 172.21.15.148:0/3587630478 learned_addr learned my addr 172.21.15.148:0/3587630478 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f91e00640 1 --2- 172.21.15.148:0/3587630478 >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 0x7f0f8c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f90a00640 1 -- 172.21.15.148:0/3587630478 >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 msgr2=0x7f0f8c15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f90a00640 1 --2- 172.21.15.148:0/3587630478 >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 0x7f0f8c15c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f90a00640 1 -- 172.21.15.148:0/3587630478 >> v1:172.21.15.148:6789/0 conn(0x7f0f8c152d00 legacy=0x7f0f8c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f90a00640 1 -- 172.21.15.148:0/3587630478 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c0c7520 con 0x7f0f8c073940 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f8be00640 1 -- 172.21.15.148:0/3587630478 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571434981 0 0) 0x7f0f8c0c4b30 con 0x7f0f8c152d00 2024-04-26T23:13:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f91e00640 1 --2- 172.21.15.148:0/3587630478 >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 0x7f0f8c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f90a00640 1 --2- 172.21.15.148:0/3587630478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c073940 0x7f0f8c0c97d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0747d0 tx=0x7f0f7801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe601ddab71e904 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f8be00640 1 -- 172.21.15.148:0/3587630478 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f780aa620 con 0x7f0f8c073940 2024-04-26T23:13:15.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f8be00640 1 -- 172.21.15.148:0/3587630478 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f780af070 con 0x7f0f8c073940 2024-04-26T23:13:15.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.112+0000 7f0f8be00640 1 -- 172.21.15.148:0/3587630478 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f780aa9e0 con 0x7f0f8c073940 2024-04-26T23:13:15.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- 172.21.15.148:0/3587630478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c073940 msgr2=0x7f0f8c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- 172.21.15.148:0/3587630478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c073940 0x7f0f8c0c97d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0747d0 tx=0x7f0f7801c520 comp rx=0 tx=0).stop 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- 172.21.15.148:0/3587630478 shutdown_connections 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- 172.21.15.148:0/3587630478 >> v2:172.21.15.157:3300/0 conn(0x7f0f8c15c070 0x7f0f8c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- 172.21.15.148:0/3587630478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c073940 0x7f0f8c0c97d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- 172.21.15.148:0/3587630478 >> 172.21.15.148:0/3587630478 conn(0x7f0f8c0c9d10 msgr2=0x7f0f8c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- 172.21.15.148:0/3587630478 shutdown_connections 2024-04-26T23:13:15.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- 172.21.15.148:0/3587630478 wait complete. 2024-04-26T23:13:15.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 Processor -- start 2024-04-26T23:13:15.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- start start 2024-04-26T23:13:15.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f8c073940 0x7f0f8c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f8c152d00 0x7f0f8c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c15cf70 con 0x7f0f8c15c070 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c15cdf0 con 0x7f0f8c073940 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f93e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c165c20 con 0x7f0f8c152d00 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60700/0 (socket says 172.21.15.148:60700) 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 -- 172.21.15.148:0/4201925023 learned_addr learned my addr 172.21.15.148:0/4201925023 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:15.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f90a00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f8c152d00 0x7f0f8c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91400640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f8c073940 0x7f0f8c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 -- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f8c152d00 msgr2=0x7f0f8c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f8c152d00 0x7f0f8c145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 -- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f8c073940 msgr2=0x7f0f8c14e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f8c073940 0x7f0f8c14e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 -- 172.21.15.148:0/4201925023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c148ec0 con 0x7f0f8c15c070 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.116+0000 7f0f91e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007e20 tx=0x7f0f8400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401a070 con 0x7f0f8c15c070 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f84003ba0 con 0x7f0f8c15c070 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400de80 con 0x7f0f8c15c070 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c0cca30 con 0x7f0f8c15c070 2024-04-26T23:13:15.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c14ede0 con 0x7f0f8c15c070 2024-04-26T23:13:15.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8c077c20 con 0x7f0f8c15c070 2024-04-26T23:13:15.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f8401d070 con 0x7f0f8c15c070 2024-04-26T23:13:15.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 0x7f0f6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0f84086ff0 con 0x7f0f8c15c070 2024-04-26T23:13:15.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.120+0000 7f0f91400640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 0x7f0f6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.124+0000 7f0f91400640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 0x7f0f6c06a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000f70 tx=0x7f0f80009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.124+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0f84010070 con 0x7f0f8c15c070 2024-04-26T23:13:15.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.280+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0f8c156430 con 0x7f0f8c15c070 2024-04-26T23:13:15.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.280+0000 7f0f89600640 1 -- 172.21.15.148:0/4201925023 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0f84056ae0 con 0x7f0f8c15c070 2024-04-26T23:13:15.280 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-04-26T23:13:15.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 msgr2=0x7f0f6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 0x7f0f6c06a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000f70 tx=0x7f0f80009040 comp rx=0 tx=0).stop 2024-04-26T23:13:15.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 msgr2=0x7f0f8c1460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007e20 tx=0x7f0f8400d4a0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 shutdown_connections 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0f6c068380 0x7f0f6c06a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f8c15c070 0x7f0f8c1460b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f8c152d00 0x7f0f8c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 --2- 172.21.15.148:0/4201925023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f8c073940 0x7f0f8c14e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 >> 172.21.15.148:0/4201925023 conn(0x7f0f8c0c9d10 msgr2=0x7f0f8c147d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 shutdown_connections 2024-04-26T23:13:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.284+0000 7f0f93e00640 1 -- 172.21.15.148:0/4201925023 wait complete. 2024-04-26T23:13:15.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:13:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 Processor -- start 2024-04-26T23:13:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 -- start start 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f39380cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380ca5a0 con 0x7f393815ca20 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380ca880 con 0x7f3938159320 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f39380cab60 con 0x7f3938071630 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f392e000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f393815ca20 0x7f39380cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32980/0 (socket says 172.21.15.148:32980) 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f392e000640 1 -- 172.21.15.148:0/3699630829 learned_addr learned my addr 172.21.15.148:0/3699630829 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3937400640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f39380cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883912511 0 0) 0x7f39380ca5a0 con 0x7f393815ca20 2024-04-26T23:13:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f391c003530 con 0x7f393815ca20 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807943870 0 0) 0x7f39380ca880 con 0x7f3938159320 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39380ca5a0 con 0x7f3938159320 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2981189069 0 0) 0x7f391c003530 con 0x7f393815ca20 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 msgr2=0x7f39380cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f39380cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 >> v1:172.21.15.157:6789/0 conn(0x7f3938159320 legacy=0x7f393815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3938159700 con 0x7f393815ca20 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f39280016a0 con 0x7f393815ca20 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 >> v1:172.21.15.148:6789/0 conn(0x7f393815ca20 legacy=0x7f39380cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f391c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f391c004130 0x7f391c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f391c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f39380cab60 con 0x7f391c004d50 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f391c00bb10 con 0x7f391c004130 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.440+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f391c00bd10 con 0x7f3938071630 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f391c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f392e000640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f391c004130 0x7f391c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3936a00640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f391c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 -- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 msgr2=0x7f391c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:15.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3938071630 0x7f391c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 -- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f391c004130 msgr2=0x7f391c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f391c004130 0x7f391c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 -- 172.21.15.148:0/3699630829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c003530 con 0x7f391c004d50 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f391c0051d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3930009f90 tx=0x7f393001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6592b1d36da0bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b2070 con 0x7f391c004d50 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39300a5c50 con 0x7f391c004d50 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3936000640 1 -- 172.21.15.148:0/3699630829 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930009c10 con 0x7f391c004d50 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937e00640 1 -- 172.21.15.148:0/3699630829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 msgr2=0x7f391c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937e00640 1 --2- 172.21.15.148:0/3699630829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f391c0051d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3930009f90 tx=0x7f393001cc40 comp rx=0 tx=0).stop 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937400640 1 -- 172.21.15.148:0/3699630829 reap_dead start 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937e00640 1 -- 172.21.15.148:0/3699630829 shutdown_connections 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937e00640 1 -- 172.21.15.148:0/3699630829 >> 172.21.15.148:0/3699630829 conn(0x7f393806c980 msgr2=0x7f3938068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.444+0000 7f3937e00640 1 -- 172.21.15.148:0/3699630829 shutdown_connections 2024-04-26T23:13:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- 172.21.15.148:0/3699630829 wait complete. 2024-04-26T23:13:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 Processor -- start 2024-04-26T23:13:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- start start 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39380b02e0 0x7f39380cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39381f1490 0x7f39381f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f393806f2e0 con 0x7f391c004d50 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f39380d0010 con 0x7f39380b02e0 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f393806f460 con 0x7f39381f1490 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60718/0 (socket says 172.21.15.148:60718) 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 -- 172.21.15.148:0/2084666254 learned_addr learned my addr 172.21.15.148:0/2084666254 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937400640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39381f1490 0x7f39381f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f392e000640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39380b02e0 0x7f39380cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 -- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39381f1490 msgr2=0x7f39381f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39381f1490 0x7f39381f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 -- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39380b02e0 msgr2=0x7f39380cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39380b02e0 0x7f39380cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 -- 172.21.15.148:0/2084666254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380c8060 con 0x7f391c004d50 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3936a00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f392000e7b0 tx=0x7f392000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392000ee60 con 0x7f391c004d50 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3920018070 con 0x7f391c004d50 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392000c6c0 con 0x7f391c004d50 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381f5860 con 0x7f391c004d50 2024-04-26T23:13:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.448+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39380c7dc0 con 0x7f391c004d50 2024-04-26T23:13:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39380506d0 con 0x7f391c004d50 2024-04-26T23:13:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f392000c860 con 0x7f391c004d50 2024-04-26T23:13:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f392f400640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 0x7f391406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f39200869b0 con 0x7f391c004d50 2024-04-26T23:13:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f392e000640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 0x7f391406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.452+0000 7f392e000640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 0x7f391406a870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3928001060 tx=0x7f3928009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:15.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.456+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3920056a40 con 0x7f391c004d50 2024-04-26T23:13:15.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3938071410 con 0x7f391c004d50 2024-04-26T23:13:15.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f392f400640 1 -- 172.21.15.148:0/2084666254 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f3920056340 con 0x7f391c004d50 2024-04-26T23:13:15.626 INFO:teuthology.orchestra.run.smithi148.stderr:listed 0 entries 2024-04-26T23:13:15.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 msgr2=0x7f391406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 0x7f391406a870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3928001060 tx=0x7f3928009040 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 msgr2=0x7f39380b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f392000e7b0 tx=0x7f392000ec70 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 shutdown_connections 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f39140683b0 0x7f391406a870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39381f1490 0x7f39381f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39380b02e0 0x7f39380cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 --2- 172.21.15.148:0/2084666254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c004d50 0x7f39380b13f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 >> 172.21.15.148:0/2084666254 conn(0x7f393806c980 msgr2=0x7f3938156920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 shutdown_connections 2024-04-26T23:13:15.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:15.628+0000 7f3937e00640 1 -- 172.21.15.148:0/2084666254 wait complete. 2024-04-26T23:13:15.648 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:13:15.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:13:15.648 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T23:13:15.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:13:15.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:13:15.734 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:13:15.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:13:15.746 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-04-26T23:13:15.797 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:13:15.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:13:15.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:13:15.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:13:15.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-04-26T23:13:16.048 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T23:13:16.058 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:13:16.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:13:16.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 Processor -- start 2024-04-26T23:13:16.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 -- start start 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff6780c9e50 0x7ff67815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff67815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780ca650 con 0x7ff6780b1e10 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff6780cc9b0 con 0x7ff6780c9e50 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff680000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff67815f990 con 0x7ff6780c62c0 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff67d600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff6780b1e10 0x7ff678071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:32986/0 (socket says 172.21.15.148:32986) 2024-04-26T23:13:16.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff67d600640 1 -- 172.21.15.148:0/3749893625 learned_addr learned my addr 172.21.15.148:0/3749893625 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff67e000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff67815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff67cc00640 1 --2- 172.21.15.148:0/3749893625 >> v2:172.21.15.157:3300/0 conn(0x7ff6780c9e50 0x7ff67815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929250268 0 0) 0x7ff6780ca650 con 0x7ff6780b1e10 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff660003530 con 0x7ff6780b1e10 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638221420 0 0) 0x7ff660003530 con 0x7ff6780b1e10 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 msgr2=0x7ff67815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff67815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 >> v2:172.21.15.157:3300/0 conn(0x7ff6780c9e50 msgr2=0x7ff67815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 --2- 172.21.15.148:0/3749893625 >> v2:172.21.15.157:3300/0 conn(0x7ff6780c9e50 0x7ff67815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6780ca910 con 0x7ff6780b1e10 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7ff66c001680 con 0x7ff6780b1e10 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 >> v1:172.21.15.148:6789/0 conn(0x7ff6780b1e10 legacy=0x7ff678071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6600039c0 0x7ff660003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff660004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660004d50 0x7ff6600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff67815f990 con 0x7ff660004d50 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff66000b9d0 con 0x7ff6600039c0 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.200+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff66000bb50 con 0x7ff6780c62c0 2024-04-26T23:13:16.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660004d50 0x7ff6600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67cc00640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff660004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67d600640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6600039c0 0x7ff660003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 -- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 msgr2=0x7ff660004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6780c62c0 0x7ff660004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 -- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6600039c0 msgr2=0x7ff660003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6600039c0 0x7ff660003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 -- 172.21.15.148:0/3749893625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff660003530 con 0x7ff660004d50 2024-04-26T23:13:16.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff67e000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660004d50 0x7ff6600051d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff670009fc0 tx=0x7ff67001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d3a4465c3f50fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6700b2070 con 0x7ff660004d50 2024-04-26T23:13:16.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6700a5c90 con 0x7ff660004d50 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.204+0000 7ff677e00640 1 -- 172.21.15.148:0/3749893625 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670009c10 con 0x7ff660004d50 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- 172.21.15.148:0/3749893625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660004d50 msgr2=0x7ff6600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 --2- 172.21.15.148:0/3749893625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660004d50 0x7ff6600051d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff670009fc0 tx=0x7ff67001cc80 comp rx=0 tx=0).stop 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67e000640 1 -- 172.21.15.148:0/3749893625 reap_dead start 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- 172.21.15.148:0/3749893625 shutdown_connections 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- 172.21.15.148:0/3749893625 >> 172.21.15.148:0/3749893625 conn(0x7ff678070550 msgr2=0x7ff67806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- 172.21.15.148:0/3749893625 shutdown_connections 2024-04-26T23:13:16.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- 172.21.15.148:0/3749893625 wait complete. 2024-04-26T23:13:16.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 Processor -- start 2024-04-26T23:13:16.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- start start 2024-04-26T23:13:16.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 0x7ff6781f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff678159450 0x7ff6780c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff67815f340 con 0x7ff6780c7960 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780caed0 con 0x7ff678158b30 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff680000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff67815f620 con 0x7ff678159450 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60730/0 (socket says 172.21.15.148:60730) 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 -- 172.21.15.148:0/962953454 learned_addr learned my addr 172.21.15.148:0/962953454 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67d600640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 0x7ff6781f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67e000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff678159450 0x7ff6780c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 -- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff678159450 msgr2=0x7ff6780c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff678159450 0x7ff6780c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 -- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 msgr2=0x7ff6781f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 0x7ff6781f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 -- 172.21.15.148:0/962953454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67815c4d0 con 0x7ff6780c7960 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67d600640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 0x7ff6781f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.208+0000 7ff67cc00640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6640119e0 tx=0x7ff664011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664019070 con 0x7ff6780c7960 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664004240 con 0x7ff6780c7960 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6780cf690 con 0x7ff6780c7960 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66400f910 con 0x7ff6780c7960 2024-04-26T23:13:16.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6780b46a0 con 0x7ff6780c7960 2024-04-26T23:13:16.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6780696e0 con 0x7ff6780c7960 2024-04-26T23:13:16.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff66401c070 con 0x7ff6780c7960 2024-04-26T23:13:16.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 0x7ff65806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff664087420 con 0x7ff6780c7960 2024-04-26T23:13:16.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.212+0000 7ff67d600640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 0x7ff65806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.216+0000 7ff67d600640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 0x7ff65806a870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000c10 tx=0x7ff66c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.216+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff67815c4d0 con 0x7ff6780c7960 2024-04-26T23:13:16.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.372+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6780ccb70 con 0x7ff6580683b0 2024-04-26T23:13:16.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.400+0000 7ff675600640 1 -- 172.21.15.148:0/962953454 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334853 (secure 0 0 0) 0x7ff6780ccb70 con 0x7ff6580683b0 2024-04-26T23:13:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:13:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 msgr2=0x7ff65806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 0x7ff65806a870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000c10 tx=0x7ff66c009040 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 msgr2=0x7ff678158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6640119e0 tx=0x7ff664011ea0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 shutdown_connections 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff6580683b0 0x7ff65806a870 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff678159450 0x7ff6780c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6780c7960 0x7ff678158f10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 --2- 172.21.15.148:0/962953454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff678158b30 0x7ff6781f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 >> 172.21.15.148:0/962953454 conn(0x7ff678070550 msgr2=0x7ff67815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 shutdown_connections 2024-04-26T23:13:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.404+0000 7ff680000640 1 -- 172.21.15.148:0/962953454 wait complete. 2024-04-26T23:13:16.424 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-26T23:13:16.048599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350269,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31499,"num_write_kb":4538324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46685,"ondisk_log_size":46685,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615362,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2750144,"num_objects":-392,"num_object_clones":0,"num_object_copies":-1568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-392,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":460,"num_write_kb":1675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005694"},"pg_stats":[{"pgid":"2.1f","version":"26'75","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.213694+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:13:01.213694+0000","last_peered":"2024-04-26T23:13:01.213694+0000","last_clean":"2024-04-26T23:13:01.213694+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:01.213694+0000","last_undegraded":"2024-04-26T23:13:01.213694+0000","last_fullsized":"2024-04-26T23:13:01.213694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.040183+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:13:04.040183+0000","last_peered":"2024-04-26T23:13:04.040183+0000","last_clean":"2024-04-26T23:13:04.040183+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:04.040183+0000","last_undegraded":"2024-04-26T23:13:04.040183+0000","last_fullsized":"2024-04-26T23:13:04.040183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067372+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:13:04.067372+0000","last_peered":"2024-04-26T23:13:04.067372+0000","last_clean":"2024-04-26T23:13:04.067372+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:04.067372+0000","last_undegraded":"2024-04-26T23:13:04.067372+0000","last_fullsized":"2024-04-26T23:13:04.067372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'91","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.067222+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:12:57.067222+0000","last_peered":"2024-04-26T23:12:57.067222+0000","last_clean":"2024-04-26T23:12:57.067222+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:12:57.067222+0000","last_undegraded":"2024-04-26T23:12:57.067222+0000","last_fullsized":"2024-04-26T23:12:57.067222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'176","reported_seq":204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.167686+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:13:03.167686+0000","last_peered":"2024-04-26T23:13:03.167686+0000","last_clean":"2024-04-26T23:13:03.167686+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:03.167686+0000","last_undegraded":"2024-04-26T23:13:03.167686+0000","last_fullsized":"2024-04-26T23:13:03.167686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054083+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:13:04.054083+0000","last_peered":"2024-04-26T23:13:04.054083+0000","last_clean":"2024-04-26T23:13:04.054083+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:04.054083+0000","last_undegraded":"2024-04-26T23:13:04.054083+0000","last_fullsized":"2024-04-26T23:13:04.054083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'372","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252017+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:13:03.252017+0000","last_peered":"2024-04-26T23:13:03.252017+0000","last_clean":"2024-04-26T23:13:03.252017+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:03.252017+0000","last_undegraded":"2024-04-26T23:13:03.252017+0000","last_fullsized":"2024-04-26T23:13:03.252017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116350+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:13:03.116350+0000","last_peered":"2024-04-26T23:13:03.116350+0000","last_clean":"2024-04-26T23:13:03.116350+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:03.116350+0000","last_undegraded":"2024-04-26T23:13:03.116350+0000","last_fullsized":"2024-04-26T23:13:03.116350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034589+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:13:04.034589+0000","last_peered":"2024-04-26T23:13:04.034589+0000","last_clean":"2024-04-26T23:13:04.034589+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:04.034589+0000","last_undegraded":"2024-04-26T23:13:04.034589+0000","last_fullsized":"2024-04-26T23:13:04.034589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.688103+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:13:01.688103+0000","last_peered":"2024-04-26T23:13:01.688103+0000","last_clean":"2024-04-26T23:13:01.688103+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:01.688103+0000","last_undegraded":"2024-04-26T23:13:01.688103+0000","last_fullsized":"2024-04-26T23:13:01.688103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.269082+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:13:03.269082+0000","last_peered":"2024-04-26T23:13:03.269082+0000","last_clean":"2024-04-26T23:13:03.269082+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:03.269082+0000","last_undegraded":"2024-04-26T23:13:03.269082+0000","last_fullsized":"2024-04-26T23:13:03.269082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.020337+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:13:04.020337+0000","last_peered":"2024-04-26T23:13:04.020337+0000","last_clean":"2024-04-26T23:13:04.020337+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:04.020337+0000","last_undegraded":"2024-04-26T23:13:04.020337+0000","last_fullsized":"2024-04-26T23:13:04.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'212","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.079509+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:13:04.079509+0000","last_peered":"2024-04-26T23:13:04.079509+0000","last_clean":"2024-04-26T23:13:04.079509+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:04.079509+0000","last_undegraded":"2024-04-26T23:13:04.079509+0000","last_fullsized":"2024-04-26T23:13:04.079509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'276","reported_seq":305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.042364+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:12:58.042364+0000","last_peered":"2024-04-26T23:12:58.042364+0000","last_clean":"2024-04-26T23:12:58.042364+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:12:58.042364+0000","last_undegraded":"2024-04-26T23:12:58.042364+0000","last_fullsized":"2024-04-26T23:12:58.042364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":936,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255123+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:13:03.255123+0000","last_peered":"2024-04-26T23:13:03.255123+0000","last_clean":"2024-04-26T23:13:03.255123+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:03.255123+0000","last_undegraded":"2024-04-26T23:13:03.255123+0000","last_fullsized":"2024-04-26T23:13:03.255123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'205","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.019779+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:12:58.019779+0000","last_peered":"2024-04-26T23:12:58.019779+0000","last_clean":"2024-04-26T23:12:58.019779+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:12:58.019779+0000","last_undegraded":"2024-04-26T23:12:58.019779+0000","last_fullsized":"2024-04-26T23:12:58.019779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'169","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.000147+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:12:54.000147+0000","last_peered":"2024-04-26T23:12:54.000147+0000","last_clean":"2024-04-26T23:12:54.000147+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:12:54.000147+0000","last_undegraded":"2024-04-26T23:12:54.000147+0000","last_fullsized":"2024-04-26T23:12:54.000147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.073540+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:13:04.073540+0000","last_peered":"2024-04-26T23:13:04.073540+0000","last_clean":"2024-04-26T23:13:04.073540+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:04.073540+0000","last_undegraded":"2024-04-26T23:13:04.073540+0000","last_fullsized":"2024-04-26T23:13:04.073540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.240985+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:13:01.240985+0000","last_peered":"2024-04-26T23:13:01.240985+0000","last_clean":"2024-04-26T23:13:01.240985+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:01.240985+0000","last_undegraded":"2024-04-26T23:13:01.240985+0000","last_fullsized":"2024-04-26T23:13:01.240985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'122","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.254675+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:13:09.254675+0000","last_peered":"2024-04-26T23:13:09.254675+0000","last_clean":"2024-04-26T23:13:09.254675+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:09.254675+0000","last_undegraded":"2024-04-26T23:13:09.254675+0000","last_fullsized":"2024-04-26T23:13:09.254675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588254,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":2583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.050381+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:13:04.050381+0000","last_peered":"2024-04-26T23:13:04.050381+0000","last_clean":"2024-04-26T23:13:04.050381+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:04.050381+0000","last_undegraded":"2024-04-26T23:13:04.050381+0000","last_fullsized":"2024-04-26T23:13:04.050381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.027703+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:13:04.027703+0000","last_peered":"2024-04-26T23:13:04.027703+0000","last_clean":"2024-04-26T23:13:04.027703+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:04.027703+0000","last_undegraded":"2024-04-26T23:13:04.027703+0000","last_fullsized":"2024-04-26T23:13:04.027703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'456","reported_seq":485,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.220210+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:12:57.220210+0000","last_peered":"2024-04-26T23:12:57.220210+0000","last_clean":"2024-04-26T23:12:57.220210+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:12:57.220210+0000","last_undegraded":"2024-04-26T23:12:57.220210+0000","last_fullsized":"2024-04-26T23:12:57.220210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":786,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.094073+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:13:04.094073+0000","last_peered":"2024-04-26T23:13:04.094073+0000","last_clean":"2024-04-26T23:13:04.094073+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:04.094073+0000","last_undegraded":"2024-04-26T23:13:04.094073+0000","last_fullsized":"2024-04-26T23:13:04.094073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'217","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.098959+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:13:04.098959+0000","last_peered":"2024-04-26T23:13:04.098959+0000","last_clean":"2024-04-26T23:13:04.098959+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:04.098959+0000","last_undegraded":"2024-04-26T23:13:04.098959+0000","last_fullsized":"2024-04-26T23:13:04.098959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197749+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:13:01.197749+0000","last_peered":"2024-04-26T23:13:01.197749+0000","last_clean":"2024-04-26T23:13:01.197749+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:01.197749+0000","last_undegraded":"2024-04-26T23:13:01.197749+0000","last_fullsized":"2024-04-26T23:13:01.197749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082156+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:13:04.082156+0000","last_peered":"2024-04-26T23:13:04.082156+0000","last_clean":"2024-04-26T23:13:04.082156+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:04.082156+0000","last_undegraded":"2024-04-26T23:13:04.082156+0000","last_fullsized":"2024-04-26T23:13:04.082156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'172","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.195989+0000","last_change":"2024-04-26T23:05:29.215214+0000","last_active":"2024-04-26T23:13:01.195989+0000","last_peered":"2024-04-26T23:13:01.195989+0000","last_clean":"2024-04-26T23:13:01.195989+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:01.195989+0000","last_undegraded":"2024-04-26T23:13:01.195989+0000","last_fullsized":"2024-04-26T23:13:01.195989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:30.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'406","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.595774+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:13:09.595774+0000","last_peered":"2024-04-26T23:13:09.595774+0000","last_clean":"2024-04-26T23:13:09.595774+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:09.595774+0000","last_undegraded":"2024-04-26T23:13:09.595774+0000","last_fullsized":"2024-04-26T23:13:09.595774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.256926+0000","last_change":"2024-04-26T23:05:29.212929+0000","last_active":"2024-04-26T23:13:03.256926+0000","last_peered":"2024-04-26T23:13:03.256926+0000","last_clean":"2024-04-26T23:13:03.256926+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:03.256926+0000","last_undegraded":"2024-04-26T23:13:03.256926+0000","last_fullsized":"2024-04-26T23:13:03.256926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:28.986125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'186","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.062062+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:13:04.062062+0000","last_peered":"2024-04-26T23:13:04.062062+0000","last_clean":"2024-04-26T23:13:04.062062+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:04.062062+0000","last_undegraded":"2024-04-26T23:13:04.062062+0000","last_fullsized":"2024-04-26T23:13:04.062062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'171","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.987978+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:12:58.987978+0000","last_peered":"2024-04-26T23:12:58.987978+0000","last_clean":"2024-04-26T23:12:58.987978+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:12:58.987978+0000","last_undegraded":"2024-04-26T23:12:58.987978+0000","last_fullsized":"2024-04-26T23:12:58.987978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044116+0000","last_change":"2024-04-26T23:05:29.212941+0000","last_active":"2024-04-26T23:13:04.044116+0000","last_peered":"2024-04-26T23:13:04.044116+0000","last_clean":"2024-04-26T23:13:04.044116+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:04.044116+0000","last_undegraded":"2024-04-26T23:13:04.044116+0000","last_fullsized":"2024-04-26T23:13:04.044116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:42.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'208","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.059143+0000","last_change":"2024-04-26T23:05:29.048153+0000","last_active":"2024-04-26T23:13:04.059143+0000","last_peered":"2024-04-26T23:13:04.059143+0000","last_clean":"2024-04-26T23:13:04.059143+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:04.059143+0000","last_undegraded":"2024-04-26T23:13:04.059143+0000","last_fullsized":"2024-04-26T23:13:04.059143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:28.287516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.048786+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:12:58.048786+0000","last_peered":"2024-04-26T23:12:58.048786+0000","last_clean":"2024-04-26T23:12:58.048786+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:12:58.048786+0000","last_undegraded":"2024-04-26T23:12:58.048786+0000","last_fullsized":"2024-04-26T23:12:58.048786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.102733+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:13:04.102733+0000","last_peered":"2024-04-26T23:13:04.102733+0000","last_clean":"2024-04-26T23:13:04.102733+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:04.102733+0000","last_undegraded":"2024-04-26T23:13:04.102733+0000","last_fullsized":"2024-04-26T23:13:04.102733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.199414+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:13:03.199414+0000","last_peered":"2024-04-26T23:13:03.199414+0000","last_clean":"2024-04-26T23:13:03.199414+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:03.199414+0000","last_undegraded":"2024-04-26T23:13:03.199414+0000","last_fullsized":"2024-04-26T23:13:03.199414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'594","reported_seq":623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.067632+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:12:51.067632+0000","last_peered":"2024-04-26T23:12:51.067632+0000","last_clean":"2024-04-26T23:12:51.067632+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:12:51.067632+0000","last_undegraded":"2024-04-26T23:12:51.067632+0000","last_fullsized":"2024-04-26T23:12:51.067632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.112304+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:13:04.112304+0000","last_peered":"2024-04-26T23:13:04.112304+0000","last_clean":"2024-04-26T23:13:04.112304+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:04.112304+0000","last_undegraded":"2024-04-26T23:13:04.112304+0000","last_fullsized":"2024-04-26T23:13:04.112304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'202","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.085665+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:13:01.085665+0000","last_peered":"2024-04-26T23:13:01.085665+0000","last_clean":"2024-04-26T23:13:01.085665+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:01.085665+0000","last_undegraded":"2024-04-26T23:13:01.085665+0000","last_fullsized":"2024-04-26T23:13:01.085665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'373","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:08.985628+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:13:08.985628+0000","last_peered":"2024-04-26T23:13:08.985628+0000","last_clean":"2024-04-26T23:13:08.985628+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:08.985628+0000","last_undegraded":"2024-04-26T23:13:08.985628+0000","last_fullsized":"2024-04-26T23:13:08.985628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018167+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:13:04.018167+0000","last_peered":"2024-04-26T23:13:04.018167+0000","last_clean":"2024-04-26T23:13:04.018167+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:04.018167+0000","last_undegraded":"2024-04-26T23:13:04.018167+0000","last_fullsized":"2024-04-26T23:13:04.018167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'189","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044088+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:13:04.044088+0000","last_peered":"2024-04-26T23:13:04.044088+0000","last_clean":"2024-04-26T23:13:04.044088+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:04.044088+0000","last_undegraded":"2024-04-26T23:13:04.044088+0000","last_fullsized":"2024-04-26T23:13:04.044088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'256","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.194247+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:12:57.194247+0000","last_peered":"2024-04-26T23:12:57.194247+0000","last_clean":"2024-04-26T23:12:57.194247+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:12:57.194247+0000","last_undegraded":"2024-04-26T23:12:57.194247+0000","last_fullsized":"2024-04-26T23:12:57.194247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.095976+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:13:04.095976+0000","last_peered":"2024-04-26T23:13:04.095976+0000","last_clean":"2024-04-26T23:13:04.095976+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:04.095976+0000","last_undegraded":"2024-04-26T23:13:04.095976+0000","last_fullsized":"2024-04-26T23:13:04.095976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.992440+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:13:03.992440+0000","last_peered":"2024-04-26T23:13:03.992440+0000","last_clean":"2024-04-26T23:13:03.992440+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:03.992440+0000","last_undegraded":"2024-04-26T23:13:03.992440+0000","last_fullsized":"2024-04-26T23:13:03.992440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255579+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:13:03.255579+0000","last_peered":"2024-04-26T23:13:03.255579+0000","last_clean":"2024-04-26T23:13:03.255579+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:03.255579+0000","last_undegraded":"2024-04-26T23:13:03.255579+0000","last_fullsized":"2024-04-26T23:13:03.255579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:10:38.964109+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:10:38.964109+0000","last_peered":"2024-04-26T23:10:38.964109+0000","last_clean":"2024-04-26T23:10:38.964109+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:10:38.964109+0000","last_undegraded":"2024-04-26T23:10:38.964109+0000","last_fullsized":"2024-04-26T23:10:38.964109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.089012+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:13:04.089012+0000","last_peered":"2024-04-26T23:13:04.089012+0000","last_clean":"2024-04-26T23:13:04.089012+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:04.089012+0000","last_undegraded":"2024-04-26T23:13:04.089012+0000","last_fullsized":"2024-04-26T23:13:04.089012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'203","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.151687+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:13:01.151687+0000","last_peered":"2024-04-26T23:13:01.151687+0000","last_clean":"2024-04-26T23:13:01.151687+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:01.151687+0000","last_undegraded":"2024-04-26T23:13:01.151687+0000","last_fullsized":"2024-04-26T23:13:01.151687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'67","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.253000+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:13:01.253000+0000","last_peered":"2024-04-26T23:13:01.253000+0000","last_clean":"2024-04-26T23:13:01.253000+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:01.253000+0000","last_undegraded":"2024-04-26T23:13:01.253000+0000","last_fullsized":"2024-04-26T23:13:01.253000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082677+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:13:04.082677+0000","last_peered":"2024-04-26T23:13:04.082677+0000","last_clean":"2024-04-26T23:13:04.082677+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:04.082677+0000","last_undegraded":"2024-04-26T23:13:04.082677+0000","last_fullsized":"2024-04-26T23:13:04.082677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'218","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.065785+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:13:04.065785+0000","last_peered":"2024-04-26T23:13:04.065785+0000","last_clean":"2024-04-26T23:13:04.065785+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:04.065785+0000","last_undegraded":"2024-04-26T23:13:04.065785+0000","last_fullsized":"2024-04-26T23:13:04.065785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'563","reported_seq":592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.143897+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:12:57.143897+0000","last_peered":"2024-04-26T23:12:57.143897+0000","last_clean":"2024-04-26T23:12:57.143897+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:12:57.143897+0000","last_undegraded":"2024-04-26T23:12:57.143897+0000","last_fullsized":"2024-04-26T23:12:57.143897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.250455+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:13:03.250455+0000","last_peered":"2024-04-26T23:13:03.250455+0000","last_clean":"2024-04-26T23:13:03.250455+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:03.250455+0000","last_undegraded":"2024-04-26T23:13:03.250455+0000","last_fullsized":"2024-04-26T23:13:03.250455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.001204+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:13:04.001204+0000","last_peered":"2024-04-26T23:13:04.001204+0000","last_clean":"2024-04-26T23:13:04.001204+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:04.001204+0000","last_undegraded":"2024-04-26T23:13:04.001204+0000","last_fullsized":"2024-04-26T23:13:04.001204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'297","reported_seq":325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:50.985566+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:12:50.985566+0000","last_peered":"2024-04-26T23:12:50.985566+0000","last_clean":"2024-04-26T23:12:50.985566+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:12:50.985566+0000","last_undegraded":"2024-04-26T23:12:50.985566+0000","last_fullsized":"2024-04-26T23:12:50.985566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106115+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:13:04.106115+0000","last_peered":"2024-04-26T23:13:04.106115+0000","last_clean":"2024-04-26T23:13:04.106115+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:04.106115+0000","last_undegraded":"2024-04-26T23:13:04.106115+0000","last_fullsized":"2024-04-26T23:13:04.106115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.195787+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:13:03.195787+0000","last_peered":"2024-04-26T23:13:03.195787+0000","last_clean":"2024-04-26T23:13:03.195787+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:03.195787+0000","last_undegraded":"2024-04-26T23:13:03.195787+0000","last_fullsized":"2024-04-26T23:13:03.195787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'168","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.153589+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:13:03.153589+0000","last_peered":"2024-04-26T23:13:03.153589+0000","last_clean":"2024-04-26T23:13:03.153589+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:03.153589+0000","last_undegraded":"2024-04-26T23:13:03.153589+0000","last_fullsized":"2024-04-26T23:13:03.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034681+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:13:04.034681+0000","last_peered":"2024-04-26T23:13:04.034681+0000","last_clean":"2024-04-26T23:13:04.034681+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:04.034681+0000","last_undegraded":"2024-04-26T23:13:04.034681+0000","last_fullsized":"2024-04-26T23:13:04.034681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'229","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074985+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:13:04.074985+0000","last_peered":"2024-04-26T23:13:04.074985+0000","last_clean":"2024-04-26T23:13:04.074985+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:04.074985+0000","last_undegraded":"2024-04-26T23:13:04.074985+0000","last_fullsized":"2024-04-26T23:13:04.074985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'366","reported_seq":394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.200579+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:13:01.200579+0000","last_peered":"2024-04-26T23:13:01.200579+0000","last_clean":"2024-04-26T23:13:01.200579+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:01.200579+0000","last_undegraded":"2024-04-26T23:13:01.200579+0000","last_fullsized":"2024-04-26T23:13:01.200579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.009350+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:13:04.009350+0000","last_peered":"2024-04-26T23:13:04.009350+0000","last_clean":"2024-04-26T23:13:04.009350+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:04.009350+0000","last_undegraded":"2024-04-26T23:13:04.009350+0000","last_fullsized":"2024-04-26T23:13:04.009350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.187252+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:13:03.187252+0000","last_peered":"2024-04-26T23:13:03.187252+0000","last_clean":"2024-04-26T23:13:03.187252+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:03.187252+0000","last_undegraded":"2024-04-26T23:13:03.187252+0000","last_fullsized":"2024-04-26T23:13:03.187252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.963043+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:12:51.963043+0000","last_peered":"2024-04-26T23:12:51.963043+0000","last_clean":"2024-04-26T23:12:51.963043+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:12:51.963043+0000","last_undegraded":"2024-04-26T23:12:51.963043+0000","last_fullsized":"2024-04-26T23:12:51.963043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.209932+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:13:03.209932+0000","last_peered":"2024-04-26T23:13:03.209932+0000","last_clean":"2024-04-26T23:13:03.209932+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:03.209932+0000","last_undegraded":"2024-04-26T23:13:03.209932+0000","last_fullsized":"2024-04-26T23:13:03.209932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'184","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.208283+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:13:03.208283+0000","last_peered":"2024-04-26T23:13:03.208283+0000","last_clean":"2024-04-26T23:13:03.208283+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:03.208283+0000","last_undegraded":"2024-04-26T23:13:03.208283+0000","last_fullsized":"2024-04-26T23:13:03.208283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'63","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.113749+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:13:04.113749+0000","last_peered":"2024-04-26T23:13:04.113749+0000","last_clean":"2024-04-26T23:13:04.113749+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:04.113749+0000","last_undegraded":"2024-04-26T23:13:04.113749+0000","last_fullsized":"2024-04-26T23:13:04.113749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.998275+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:13:03.998275+0000","last_peered":"2024-04-26T23:13:03.998275+0000","last_clean":"2024-04-26T23:13:03.998275+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:03.998275+0000","last_undegraded":"2024-04-26T23:13:03.998275+0000","last_fullsized":"2024-04-26T23:13:03.998275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.091837+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:13:04.091837+0000","last_peered":"2024-04-26T23:13:04.091837+0000","last_clean":"2024-04-26T23:13:04.091837+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:04.091837+0000","last_undegraded":"2024-04-26T23:13:04.091837+0000","last_fullsized":"2024-04-26T23:13:04.091837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'656","reported_seq":685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.989193+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:12:51.989193+0000","last_peered":"2024-04-26T23:12:51.989193+0000","last_clean":"2024-04-26T23:12:51.989193+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:12:51.989193+0000","last_undegraded":"2024-04-26T23:12:51.989193+0000","last_fullsized":"2024-04-26T23:12:51.989193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.068538+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:13:04.068538+0000","last_peered":"2024-04-26T23:13:04.068538+0000","last_clean":"2024-04-26T23:13:04.068538+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:04.068538+0000","last_undegraded":"2024-04-26T23:13:04.068538+0000","last_fullsized":"2024-04-26T23:13:04.068538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.031804+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:13:04.031804+0000","last_peered":"2024-04-26T23:13:04.031804+0000","last_clean":"2024-04-26T23:13:04.031804+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:04.031804+0000","last_undegraded":"2024-04-26T23:13:04.031804+0000","last_fullsized":"2024-04-26T23:13:04.031804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'356","reported_seq":385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.065249+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:12:57.065249+0000","last_peered":"2024-04-26T23:12:57.065249+0000","last_clean":"2024-04-26T23:12:57.065249+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:12:57.065249+0000","last_undegraded":"2024-04-26T23:12:57.065249+0000","last_fullsized":"2024-04-26T23:12:57.065249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082592+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:13:04.082592+0000","last_peered":"2024-04-26T23:13:04.082592+0000","last_clean":"2024-04-26T23:13:04.082592+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:04.082592+0000","last_undegraded":"2024-04-26T23:13:04.082592+0000","last_fullsized":"2024-04-26T23:13:04.082592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.196995+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:13:03.196995+0000","last_peered":"2024-04-26T23:13:03.196995+0000","last_clean":"2024-04-26T23:13:03.196995+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:03.196995+0000","last_undegraded":"2024-04-26T23:13:03.196995+0000","last_fullsized":"2024-04-26T23:13:03.196995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'334","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.988158+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:13:04.988158+0000","last_peered":"2024-04-26T23:13:04.988158+0000","last_clean":"2024-04-26T23:13:04.988158+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:04.988158+0000","last_undegraded":"2024-04-26T23:13:04.988158+0000","last_fullsized":"2024-04-26T23:13:04.988158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.038541+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:13:04.038541+0000","last_peered":"2024-04-26T23:13:04.038541+0000","last_clean":"2024-04-26T23:13:04.038541+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:04.038541+0000","last_undegraded":"2024-04-26T23:13:04.038541+0000","last_fullsized":"2024-04-26T23:13:04.038541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'182","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.194161+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:13:03.194161+0000","last_peered":"2024-04-26T23:13:03.194161+0000","last_clean":"2024-04-26T23:13:03.194161+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:03.194161+0000","last_undegraded":"2024-04-26T23:13:03.194161+0000","last_fullsized":"2024-04-26T23:13:03.194161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'106","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.104165+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:13:03.104165+0000","last_peered":"2024-04-26T23:13:03.104165+0000","last_clean":"2024-04-26T23:13:03.104165+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:03.104165+0000","last_undegraded":"2024-04-26T23:13:03.104165+0000","last_fullsized":"2024-04-26T23:13:03.104165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.060188+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:13:04.060188+0000","last_peered":"2024-04-26T23:13:04.060188+0000","last_clean":"2024-04-26T23:13:04.060188+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:04.060188+0000","last_undegraded":"2024-04-26T23:13:04.060188+0000","last_fullsized":"2024-04-26T23:13:04.060188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'206","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116203+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:13:03.116203+0000","last_peered":"2024-04-26T23:13:03.116203+0000","last_clean":"2024-04-26T23:13:03.116203+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:03.116203+0000","last_undegraded":"2024-04-26T23:13:03.116203+0000","last_fullsized":"2024-04-26T23:13:03.116203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.102867+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:12:57.102867+0000","last_peered":"2024-04-26T23:12:57.102867+0000","last_clean":"2024-04-26T23:12:57.102867+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:12:57.102867+0000","last_undegraded":"2024-04-26T23:12:57.102867+0000","last_fullsized":"2024-04-26T23:12:57.102867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074896+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:13:04.074896+0000","last_peered":"2024-04-26T23:13:04.074896+0000","last_clean":"2024-04-26T23:13:04.074896+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:04.074896+0000","last_undegraded":"2024-04-26T23:13:04.074896+0000","last_fullsized":"2024-04-26T23:13:04.074896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.041470+0000","last_change":"2024-04-26T23:05:29.212676+0000","last_active":"2024-04-26T23:13:04.041470+0000","last_peered":"2024-04-26T23:13:04.041470+0000","last_clean":"2024-04-26T23:13:04.041470+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:04.041470+0000","last_undegraded":"2024-04-26T23:13:04.041470+0000","last_fullsized":"2024-04-26T23:13:04.041470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:47.644852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'208","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013473+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:13:04.013473+0000","last_peered":"2024-04-26T23:13:04.013473+0000","last_clean":"2024-04-26T23:13:04.013473+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:04.013473+0000","last_undegraded":"2024-04-26T23:13:04.013473+0000","last_fullsized":"2024-04-26T23:13:04.013473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'834","reported_seq":862,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.056585+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:12:57.056585+0000","last_peered":"2024-04-26T23:12:57.056585+0000","last_clean":"2024-04-26T23:12:57.056585+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:12:57.056585+0000","last_undegraded":"2024-04-26T23:12:57.056585+0000","last_fullsized":"2024-04-26T23:12:57.056585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.263878+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:13:03.263878+0000","last_peered":"2024-04-26T23:13:03.263878+0000","last_clean":"2024-04-26T23:13:03.263878+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:03.263878+0000","last_undegraded":"2024-04-26T23:13:03.263878+0000","last_fullsized":"2024-04-26T23:13:03.263878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'210","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.131862+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:13:03.131862+0000","last_peered":"2024-04-26T23:13:03.131862+0000","last_clean":"2024-04-26T23:13:03.131862+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:03.131862+0000","last_undegraded":"2024-04-26T23:13:03.131862+0000","last_fullsized":"2024-04-26T23:13:03.131862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'78","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.115707+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:12:57.115707+0000","last_peered":"2024-04-26T23:12:57.115707+0000","last_clean":"2024-04-26T23:12:57.115707+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:12:57.115707+0000","last_undegraded":"2024-04-26T23:12:57.115707+0000","last_fullsized":"2024-04-26T23:12:57.115707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.090911+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:12:54.090911+0000","last_peered":"2024-04-26T23:12:54.090911+0000","last_clean":"2024-04-26T23:12:54.090911+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:12:54.090911+0000","last_undegraded":"2024-04-26T23:12:54.090911+0000","last_fullsized":"2024-04-26T23:12:54.090911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'176","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.217035+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:13:03.217035+0000","last_peered":"2024-04-26T23:13:03.217035+0000","last_clean":"2024-04-26T23:13:03.217035+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:03.217035+0000","last_undegraded":"2024-04-26T23:13:03.217035+0000","last_fullsized":"2024-04-26T23:13:03.217035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.045723+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:13:04.045723+0000","last_peered":"2024-04-26T23:13:04.045723+0000","last_clean":"2024-04-26T23:13:04.045723+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:04.045723+0000","last_undegraded":"2024-04-26T23:13:04.045723+0000","last_fullsized":"2024-04-26T23:13:04.045723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'73","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:52.063000+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:12:52.063000+0000","last_peered":"2024-04-26T23:12:52.063000+0000","last_clean":"2024-04-26T23:12:52.063000+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:12:52.063000+0000","last_undegraded":"2024-04-26T23:12:52.063000+0000","last_fullsized":"2024-04-26T23:12:52.063000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.248546+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:13:03.248546+0000","last_peered":"2024-04-26T23:13:03.248546+0000","last_clean":"2024-04-26T23:13:03.248546+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:03.248546+0000","last_undegraded":"2024-04-26T23:13:03.248546+0000","last_fullsized":"2024-04-26T23:13:03.248546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.274282+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:13:03.274282+0000","last_peered":"2024-04-26T23:13:03.274282+0000","last_clean":"2024-04-26T23:13:03.274282+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:03.274282+0000","last_undegraded":"2024-04-26T23:13:03.274282+0000","last_fullsized":"2024-04-26T23:13:03.274282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'215","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.069454+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:13:04.069454+0000","last_peered":"2024-04-26T23:13:04.069454+0000","last_clean":"2024-04-26T23:13:04.069454+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:04.069454+0000","last_undegraded":"2024-04-26T23:13:04.069454+0000","last_fullsized":"2024-04-26T23:13:04.069454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991598+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:13:03.991598+0000","last_peered":"2024-04-26T23:13:03.991598+0000","last_clean":"2024-04-26T23:13:03.991598+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:03.991598+0000","last_undegraded":"2024-04-26T23:13:03.991598+0000","last_fullsized":"2024-04-26T23:13:03.991598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067391+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:13:04.067391+0000","last_peered":"2024-04-26T23:13:04.067391+0000","last_clean":"2024-04-26T23:13:04.067391+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:04.067391+0000","last_undegraded":"2024-04-26T23:13:04.067391+0000","last_fullsized":"2024-04-26T23:13:04.067391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'197","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044137+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:13:04.044137+0000","last_peered":"2024-04-26T23:13:04.044137+0000","last_clean":"2024-04-26T23:13:04.044137+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:04.044137+0000","last_undegraded":"2024-04-26T23:13:04.044137+0000","last_fullsized":"2024-04-26T23:13:04.044137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'188","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106791+0000","last_change":"2024-04-26T23:05:29.866675+0000","last_active":"2024-04-26T23:13:04.106791+0000","last_peered":"2024-04-26T23:13:04.106791+0000","last_clean":"2024-04-26T23:13:04.106791+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:04.106791+0000","last_undegraded":"2024-04-26T23:13:04.106791+0000","last_fullsized":"2024-04-26T23:13:04.106791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.339856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113993+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:13:03.113993+0000","last_peered":"2024-04-26T23:13:03.113993+0000","last_clean":"2024-04-26T23:13:03.113993+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:03.113993+0000","last_undegraded":"2024-04-26T23:13:03.113993+0000","last_fullsized":"2024-04-26T23:13:03.113993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'225","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.154286+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:13:03.154286+0000","last_peered":"2024-04-26T23:13:03.154286+0000","last_clean":"2024-04-26T23:13:03.154286+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:03.154286+0000","last_undegraded":"2024-04-26T23:13:03.154286+0000","last_fullsized":"2024-04-26T23:13:03.154286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.993050+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:13:03.993050+0000","last_peered":"2024-04-26T23:13:03.993050+0000","last_clean":"2024-04-26T23:13:03.993050+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:03.993050+0000","last_undegraded":"2024-04-26T23:13:03.993050+0000","last_fullsized":"2024-04-26T23:13:03.993050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.107190+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:13:04.107190+0000","last_peered":"2024-04-26T23:13:04.107190+0000","last_clean":"2024-04-26T23:13:04.107190+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:04.107190+0000","last_undegraded":"2024-04-26T23:13:04.107190+0000","last_fullsized":"2024-04-26T23:13:04.107190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.232291+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:13:03.232291+0000","last_peered":"2024-04-26T23:13:03.232291+0000","last_clean":"2024-04-26T23:13:03.232291+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:03.232291+0000","last_undegraded":"2024-04-26T23:13:03.232291+0000","last_fullsized":"2024-04-26T23:13:03.232291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'203","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.089904+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:13:03.089904+0000","last_peered":"2024-04-26T23:13:03.089904+0000","last_clean":"2024-04-26T23:13:03.089904+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:03.089904+0000","last_undegraded":"2024-04-26T23:13:03.089904+0000","last_fullsized":"2024-04-26T23:13:03.089904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'192","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.244803+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:13:03.244803+0000","last_peered":"2024-04-26T23:13:03.244803+0000","last_clean":"2024-04-26T23:13:03.244803+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:03.244803+0000","last_undegraded":"2024-04-26T23:13:03.244803+0000","last_fullsized":"2024-04-26T23:13:03.244803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'211","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197658+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:13:01.197658+0000","last_peered":"2024-04-26T23:13:01.197658+0000","last_clean":"2024-04-26T23:13:01.197658+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:01.197658+0000","last_undegraded":"2024-04-26T23:13:01.197658+0000","last_fullsized":"2024-04-26T23:13:01.197658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255089+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:13:03.255089+0000","last_peered":"2024-04-26T23:13:03.255089+0000","last_clean":"2024-04-26T23:13:03.255089+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:03.255089+0000","last_undegraded":"2024-04-26T23:13:03.255089+0000","last_fullsized":"2024-04-26T23:13:03.255089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'197","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.087851+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:13:04.087851+0000","last_peered":"2024-04-26T23:13:04.087851+0000","last_clean":"2024-04-26T23:13:04.087851+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:04.087851+0000","last_undegraded":"2024-04-26T23:13:04.087851+0000","last_fullsized":"2024-04-26T23:13:04.087851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'200","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018127+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:13:04.018127+0000","last_peered":"2024-04-26T23:13:04.018127+0000","last_clean":"2024-04-26T23:13:04.018127+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:04.018127+0000","last_undegraded":"2024-04-26T23:13:04.018127+0000","last_fullsized":"2024-04-26T23:13:04.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.046234+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:13:04.046234+0000","last_peered":"2024-04-26T23:13:04.046234+0000","last_clean":"2024-04-26T23:13:04.046234+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:04.046234+0000","last_undegraded":"2024-04-26T23:13:04.046234+0000","last_fullsized":"2024-04-26T23:13:04.046234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'209","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.171578+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:13:01.171578+0000","last_peered":"2024-04-26T23:13:01.171578+0000","last_clean":"2024-04-26T23:13:01.171578+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:01.171578+0000","last_undegraded":"2024-04-26T23:13:01.171578+0000","last_fullsized":"2024-04-26T23:13:01.171578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'206","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.240112+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:13:03.240112+0000","last_peered":"2024-04-26T23:13:03.240112+0000","last_clean":"2024-04-26T23:13:03.240112+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:03.240112+0000","last_undegraded":"2024-04-26T23:13:03.240112+0000","last_fullsized":"2024-04-26T23:13:03.240112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113318+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:13:03.113318+0000","last_peered":"2024-04-26T23:13:03.113318+0000","last_clean":"2024-04-26T23:13:03.113318+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:03.113318+0000","last_undegraded":"2024-04-26T23:13:03.113318+0000","last_fullsized":"2024-04-26T23:13:03.113318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'175","reported_seq":202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991944+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:13:03.991944+0000","last_peered":"2024-04-26T23:13:03.991944+0000","last_clean":"2024-04-26T23:13:03.991944+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:03.991944+0000","last_undegraded":"2024-04-26T23:13:03.991944+0000","last_fullsized":"2024-04-26T23:13:03.991944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'180","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.874959+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:13:03.874959+0000","last_peered":"2024-04-26T23:13:03.874959+0000","last_clean":"2024-04-26T23:13:03.874959+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:03.874959+0000","last_undegraded":"2024-04-26T23:13:03.874959+0000","last_fullsized":"2024-04-26T23:13:03.874959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.259873+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:13:03.259873+0000","last_peered":"2024-04-26T23:13:03.259873+0000","last_clean":"2024-04-26T23:13:03.259873+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:03.259873+0000","last_undegraded":"2024-04-26T23:13:03.259873+0000","last_fullsized":"2024-04-26T23:13:03.259873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.205157+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:13:03.205157+0000","last_peered":"2024-04-26T23:13:03.205157+0000","last_clean":"2024-04-26T23:13:03.205157+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:03.205157+0000","last_undegraded":"2024-04-26T23:13:03.205157+0000","last_fullsized":"2024-04-26T23:13:03.205157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054939+0000","last_change":"2024-04-26T23:05:29.413874+0000","last_active":"2024-04-26T23:13:04.054939+0000","last_peered":"2024-04-26T23:13:04.054939+0000","last_clean":"2024-04-26T23:13:04.054939+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:04.054939+0000","last_undegraded":"2024-04-26T23:13:04.054939+0000","last_fullsized":"2024-04-26T23:13:04.054939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:56.983137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'207","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.157614+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:13:03.157614+0000","last_peered":"2024-04-26T23:13:03.157614+0000","last_clean":"2024-04-26T23:13:03.157614+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:03.157614+0000","last_undegraded":"2024-04-26T23:13:03.157614+0000","last_fullsized":"2024-04-26T23:13:03.157614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013347+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:13:04.013347+0000","last_peered":"2024-04-26T23:13:04.013347+0000","last_clean":"2024-04-26T23:13:04.013347+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:04.013347+0000","last_undegraded":"2024-04-26T23:13:04.013347+0000","last_fullsized":"2024-04-26T23:13:04.013347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.221659+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:13:03.221659+0000","last_peered":"2024-04-26T23:13:03.221659+0000","last_clean":"2024-04-26T23:13:03.221659+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:03.221659+0000","last_undegraded":"2024-04-26T23:13:03.221659+0000","last_fullsized":"2024-04-26T23:13:03.221659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.043108+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:13:04.043108+0000","last_peered":"2024-04-26T23:13:04.043108+0000","last_clean":"2024-04-26T23:13:04.043108+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:04.043108+0000","last_undegraded":"2024-04-26T23:13:04.043108+0000","last_fullsized":"2024-04-26T23:13:04.043108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.149593+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:13:03.149593+0000","last_peered":"2024-04-26T23:13:03.149593+0000","last_clean":"2024-04-26T23:13:03.149593+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:03.149593+0000","last_undegraded":"2024-04-26T23:13:03.149593+0000","last_fullsized":"2024-04-26T23:13:03.149593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.239348+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:13:03.239348+0000","last_peered":"2024-04-26T23:13:03.239348+0000","last_clean":"2024-04-26T23:13:03.239348+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:03.239348+0000","last_undegraded":"2024-04-26T23:13:03.239348+0000","last_fullsized":"2024-04-26T23:13:03.239348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'199","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252333+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:13:03.252333+0000","last_peered":"2024-04-26T23:13:03.252333+0000","last_clean":"2024-04-26T23:13:03.252333+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:03.252333+0000","last_undegraded":"2024-04-26T23:13:03.252333+0000","last_fullsized":"2024-04-26T23:13:03.252333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12703,"ondisk_log_size":12703,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146759901,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6967,"num_write_kb":149051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293519802,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8240,"ondisk_log_size":8240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53625849,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452197,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40337844,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921128,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:13:16.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:13:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.600+0000 7f4551a00640 1 Processor -- start 2024-04-26T23:13:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.600+0000 7f4551a00640 1 -- start start 2024-04-26T23:13:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4551a00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f454c072d70 0x7f454c0731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4551a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f454c0c9b60 0x7f454c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4551a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454c152fa0 con 0x7f454c152bc0 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4551a00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f454c073700 con 0x7f454c072d70 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4551a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f454c159790 con 0x7f454c0c9b60 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f454c072d70 0x7f454c0731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f454c072d70 0x7f454c0731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44434/0 (socket says 172.21.15.148:44434) 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 -- 172.21.15.148:0/3505843942 learned_addr learned my addr 172.21.15.148:0/3505843942 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f454aa00640 1 --1- 172.21.15.148:0/3505843942 >> v1:172.21.15.148:6789/0 conn(0x7f454c152bc0 0x7f454c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54500/0 (socket says 172.21.15.148:54500) 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f454b400640 1 --2- 172.21.15.148:0/3505843942 >> v2:172.21.15.157:3300/0 conn(0x7f454c0c9b60 0x7f454c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 -- 172.21.15.148:0/3505843942 >> v2:172.21.15.157:3300/0 conn(0x7f454c0c9b60 msgr2=0x7f454c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 --2- 172.21.15.148:0/3505843942 >> v2:172.21.15.157:3300/0 conn(0x7f454c0c9b60 0x7f454c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 -- 172.21.15.148:0/3505843942 >> v1:172.21.15.148:6789/0 conn(0x7f454c152bc0 legacy=0x7f454c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.604+0000 7f4542000640 1 -- 172.21.15.148:0/3505843942 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c158930 con 0x7f454c072d70 2024-04-26T23:13:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4542000640 1 --2- 172.21.15.148:0/3505843942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c072d70 0x7f454c0731c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f454c158820 tx=0x7f453401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f1d44c018aed37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f454a000640 1 -- 172.21.15.148:0/3505843942 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340b4070 con 0x7f454c072d70 2024-04-26T23:13:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f454a000640 1 -- 172.21.15.148:0/3505843942 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45340af400 con 0x7f454c072d70 2024-04-26T23:13:16.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f454a000640 1 -- 172.21.15.148:0/3505843942 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340af7d0 con 0x7f454c072d70 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- 172.21.15.148:0/3505843942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c072d70 msgr2=0x7f454c0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 --2- 172.21.15.148:0/3505843942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c072d70 0x7f454c0731c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f454c158820 tx=0x7f453401f1e0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- 172.21.15.148:0/3505843942 shutdown_connections 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 --2- 172.21.15.148:0/3505843942 >> v2:172.21.15.157:3300/0 conn(0x7f454c0c9b60 0x7f454c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 --2- 172.21.15.148:0/3505843942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c072d70 0x7f454c0731c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- 172.21.15.148:0/3505843942 >> 172.21.15.148:0/3505843942 conn(0x7f454c06c380 msgr2=0x7f454c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- 172.21.15.148:0/3505843942 shutdown_connections 2024-04-26T23:13:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- 172.21.15.148:0/3505843942 wait complete. 2024-04-26T23:13:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 Processor -- start 2024-04-26T23:13:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.608+0000 7f4551a00640 1 -- start start 2024-04-26T23:13:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f454c072d70 0x7f454c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 0x7f454c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1591d0 con 0x7f454c0c9b60 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f454c158ef0 con 0x7f454c152bc0 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f454c1594b0 con 0x7f454c072d70 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44440/0 (socket says 172.21.15.148:44440) 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 -- 172.21.15.148:0/201003216 learned_addr learned my addr 172.21.15.148:0/201003216 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f454aa00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f454c072d70 0x7f454c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f454b400640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 0x7f454c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 -- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f454c072d70 msgr2=0x7f454c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f454c072d70 0x7f454c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 -- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 msgr2=0x7f454c1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 0x7f454c1576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 -- 172.21.15.148:0/201003216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c146cc0 con 0x7f454c0c9b60 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f454b400640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 0x7f454c1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4542000640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f453401bdf0 tx=0x7f453401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340b4040 con 0x7f454c0c9b60 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45340c0070 con 0x7f454c0c9b60 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c146fa0 con 0x7f454c0c9b60 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534009510 con 0x7f454c0c9b60 2024-04-26T23:13:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c147560 con 0x7f454c0c9b60 2024-04-26T23:13:16.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c077c20 con 0x7f454c0c9b60 2024-04-26T23:13:16.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.612+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45340ba660 con 0x7f454c0c9b60 2024-04-26T23:13:16.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.616+0000 7f4543400640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 0x7f452806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.616+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4534125160 con 0x7f454c0c9b60 2024-04-26T23:13:16.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.616+0000 7f454aa00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 0x7f452806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.616+0000 7f454aa00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 0x7f452806a840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f70 tx=0x7f453c007cd0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:16.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.616+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4534018d40 con 0x7f454c0c9b60 2024-04-26T23:13:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.772+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f454c1f3330 con 0x7f4528068380 2024-04-26T23:13:16.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4543400640 1 -- 172.21.15.148:0/201003216 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334853 (secure 0 0 0) 0x7f454c1f3330 con 0x7f4528068380 2024-04-26T23:13:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:13:16.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 msgr2=0x7f452806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 0x7f452806a840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f70 tx=0x7f453c007cd0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 msgr2=0x7f454c1f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f453401bdf0 tx=0x7f453401bf80 comp rx=0 tx=0).stop 2024-04-26T23:13:16.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 shutdown_connections 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f4528068380 0x7f452806a840 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f454c152bc0 0x7f454c1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f454c0c9b60 0x7f454c1f2df0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 --2- 172.21.15.148:0/201003216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f454c072d70 0x7f454c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 >> 172.21.15.148:0/201003216 conn(0x7f454c06c380 msgr2=0x7f454c0c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 shutdown_connections 2024-04-26T23:13:16.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.800+0000 7f4551a00640 1 -- 172.21.15.148:0/201003216 wait complete. 2024-04-26T23:13:16.819 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-26T23:13:16.048599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350269,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31499,"num_write_kb":4538324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46685,"ondisk_log_size":46685,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615362,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2750144,"num_objects":-392,"num_object_clones":0,"num_object_copies":-1568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-392,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":460,"num_write_kb":1675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005694"},"pg_stats":[{"pgid":"2.1f","version":"26'75","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.213694+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:13:01.213694+0000","last_peered":"2024-04-26T23:13:01.213694+0000","last_clean":"2024-04-26T23:13:01.213694+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:01.213694+0000","last_undegraded":"2024-04-26T23:13:01.213694+0000","last_fullsized":"2024-04-26T23:13:01.213694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.040183+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:13:04.040183+0000","last_peered":"2024-04-26T23:13:04.040183+0000","last_clean":"2024-04-26T23:13:04.040183+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:04.040183+0000","last_undegraded":"2024-04-26T23:13:04.040183+0000","last_fullsized":"2024-04-26T23:13:04.040183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067372+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:13:04.067372+0000","last_peered":"2024-04-26T23:13:04.067372+0000","last_clean":"2024-04-26T23:13:04.067372+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:04.067372+0000","last_undegraded":"2024-04-26T23:13:04.067372+0000","last_fullsized":"2024-04-26T23:13:04.067372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'91","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.067222+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:12:57.067222+0000","last_peered":"2024-04-26T23:12:57.067222+0000","last_clean":"2024-04-26T23:12:57.067222+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:12:57.067222+0000","last_undegraded":"2024-04-26T23:12:57.067222+0000","last_fullsized":"2024-04-26T23:12:57.067222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'176","reported_seq":204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.167686+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:13:03.167686+0000","last_peered":"2024-04-26T23:13:03.167686+0000","last_clean":"2024-04-26T23:13:03.167686+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:03.167686+0000","last_undegraded":"2024-04-26T23:13:03.167686+0000","last_fullsized":"2024-04-26T23:13:03.167686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054083+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:13:04.054083+0000","last_peered":"2024-04-26T23:13:04.054083+0000","last_clean":"2024-04-26T23:13:04.054083+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:04.054083+0000","last_undegraded":"2024-04-26T23:13:04.054083+0000","last_fullsized":"2024-04-26T23:13:04.054083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'372","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252017+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:13:03.252017+0000","last_peered":"2024-04-26T23:13:03.252017+0000","last_clean":"2024-04-26T23:13:03.252017+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:03.252017+0000","last_undegraded":"2024-04-26T23:13:03.252017+0000","last_fullsized":"2024-04-26T23:13:03.252017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116350+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:13:03.116350+0000","last_peered":"2024-04-26T23:13:03.116350+0000","last_clean":"2024-04-26T23:13:03.116350+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:03.116350+0000","last_undegraded":"2024-04-26T23:13:03.116350+0000","last_fullsized":"2024-04-26T23:13:03.116350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034589+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:13:04.034589+0000","last_peered":"2024-04-26T23:13:04.034589+0000","last_clean":"2024-04-26T23:13:04.034589+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:04.034589+0000","last_undegraded":"2024-04-26T23:13:04.034589+0000","last_fullsized":"2024-04-26T23:13:04.034589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.688103+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:13:01.688103+0000","last_peered":"2024-04-26T23:13:01.688103+0000","last_clean":"2024-04-26T23:13:01.688103+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:01.688103+0000","last_undegraded":"2024-04-26T23:13:01.688103+0000","last_fullsized":"2024-04-26T23:13:01.688103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.269082+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:13:03.269082+0000","last_peered":"2024-04-26T23:13:03.269082+0000","last_clean":"2024-04-26T23:13:03.269082+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:03.269082+0000","last_undegraded":"2024-04-26T23:13:03.269082+0000","last_fullsized":"2024-04-26T23:13:03.269082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.020337+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:13:04.020337+0000","last_peered":"2024-04-26T23:13:04.020337+0000","last_clean":"2024-04-26T23:13:04.020337+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:04.020337+0000","last_undegraded":"2024-04-26T23:13:04.020337+0000","last_fullsized":"2024-04-26T23:13:04.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'212","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.079509+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:13:04.079509+0000","last_peered":"2024-04-26T23:13:04.079509+0000","last_clean":"2024-04-26T23:13:04.079509+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:04.079509+0000","last_undegraded":"2024-04-26T23:13:04.079509+0000","last_fullsized":"2024-04-26T23:13:04.079509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'276","reported_seq":305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.042364+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:12:58.042364+0000","last_peered":"2024-04-26T23:12:58.042364+0000","last_clean":"2024-04-26T23:12:58.042364+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:12:58.042364+0000","last_undegraded":"2024-04-26T23:12:58.042364+0000","last_fullsized":"2024-04-26T23:12:58.042364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":936,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255123+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:13:03.255123+0000","last_peered":"2024-04-26T23:13:03.255123+0000","last_clean":"2024-04-26T23:13:03.255123+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:03.255123+0000","last_undegraded":"2024-04-26T23:13:03.255123+0000","last_fullsized":"2024-04-26T23:13:03.255123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'205","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.019779+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:12:58.019779+0000","last_peered":"2024-04-26T23:12:58.019779+0000","last_clean":"2024-04-26T23:12:58.019779+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:12:58.019779+0000","last_undegraded":"2024-04-26T23:12:58.019779+0000","last_fullsized":"2024-04-26T23:12:58.019779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'169","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.000147+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:12:54.000147+0000","last_peered":"2024-04-26T23:12:54.000147+0000","last_clean":"2024-04-26T23:12:54.000147+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:12:54.000147+0000","last_undegraded":"2024-04-26T23:12:54.000147+0000","last_fullsized":"2024-04-26T23:12:54.000147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.073540+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:13:04.073540+0000","last_peered":"2024-04-26T23:13:04.073540+0000","last_clean":"2024-04-26T23:13:04.073540+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:04.073540+0000","last_undegraded":"2024-04-26T23:13:04.073540+0000","last_fullsized":"2024-04-26T23:13:04.073540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.240985+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:13:01.240985+0000","last_peered":"2024-04-26T23:13:01.240985+0000","last_clean":"2024-04-26T23:13:01.240985+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:01.240985+0000","last_undegraded":"2024-04-26T23:13:01.240985+0000","last_fullsized":"2024-04-26T23:13:01.240985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'122","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.254675+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:13:09.254675+0000","last_peered":"2024-04-26T23:13:09.254675+0000","last_clean":"2024-04-26T23:13:09.254675+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:09.254675+0000","last_undegraded":"2024-04-26T23:13:09.254675+0000","last_fullsized":"2024-04-26T23:13:09.254675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588254,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":2583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.050381+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:13:04.050381+0000","last_peered":"2024-04-26T23:13:04.050381+0000","last_clean":"2024-04-26T23:13:04.050381+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:04.050381+0000","last_undegraded":"2024-04-26T23:13:04.050381+0000","last_fullsized":"2024-04-26T23:13:04.050381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.027703+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:13:04.027703+0000","last_peered":"2024-04-26T23:13:04.027703+0000","last_clean":"2024-04-26T23:13:04.027703+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:04.027703+0000","last_undegraded":"2024-04-26T23:13:04.027703+0000","last_fullsized":"2024-04-26T23:13:04.027703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'456","reported_seq":485,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.220210+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:12:57.220210+0000","last_peered":"2024-04-26T23:12:57.220210+0000","last_clean":"2024-04-26T23:12:57.220210+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:12:57.220210+0000","last_undegraded":"2024-04-26T23:12:57.220210+0000","last_fullsized":"2024-04-26T23:12:57.220210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":786,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.094073+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:13:04.094073+0000","last_peered":"2024-04-26T23:13:04.094073+0000","last_clean":"2024-04-26T23:13:04.094073+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:04.094073+0000","last_undegraded":"2024-04-26T23:13:04.094073+0000","last_fullsized":"2024-04-26T23:13:04.094073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'217","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.098959+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:13:04.098959+0000","last_peered":"2024-04-26T23:13:04.098959+0000","last_clean":"2024-04-26T23:13:04.098959+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:04.098959+0000","last_undegraded":"2024-04-26T23:13:04.098959+0000","last_fullsized":"2024-04-26T23:13:04.098959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197749+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:13:01.197749+0000","last_peered":"2024-04-26T23:13:01.197749+0000","last_clean":"2024-04-26T23:13:01.197749+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:01.197749+0000","last_undegraded":"2024-04-26T23:13:01.197749+0000","last_fullsized":"2024-04-26T23:13:01.197749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082156+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:13:04.082156+0000","last_peered":"2024-04-26T23:13:04.082156+0000","last_clean":"2024-04-26T23:13:04.082156+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:04.082156+0000","last_undegraded":"2024-04-26T23:13:04.082156+0000","last_fullsized":"2024-04-26T23:13:04.082156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'172","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.195989+0000","last_change":"2024-04-26T23:05:29.215214+0000","last_active":"2024-04-26T23:13:01.195989+0000","last_peered":"2024-04-26T23:13:01.195989+0000","last_clean":"2024-04-26T23:13:01.195989+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:01.195989+0000","last_undegraded":"2024-04-26T23:13:01.195989+0000","last_fullsized":"2024-04-26T23:13:01.195989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:30.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'406","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.595774+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:13:09.595774+0000","last_peered":"2024-04-26T23:13:09.595774+0000","last_clean":"2024-04-26T23:13:09.595774+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:09.595774+0000","last_undegraded":"2024-04-26T23:13:09.595774+0000","last_fullsized":"2024-04-26T23:13:09.595774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.256926+0000","last_change":"2024-04-26T23:05:29.212929+0000","last_active":"2024-04-26T23:13:03.256926+0000","last_peered":"2024-04-26T23:13:03.256926+0000","last_clean":"2024-04-26T23:13:03.256926+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:03.256926+0000","last_undegraded":"2024-04-26T23:13:03.256926+0000","last_fullsized":"2024-04-26T23:13:03.256926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:28.986125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'186","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.062062+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:13:04.062062+0000","last_peered":"2024-04-26T23:13:04.062062+0000","last_clean":"2024-04-26T23:13:04.062062+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:04.062062+0000","last_undegraded":"2024-04-26T23:13:04.062062+0000","last_fullsized":"2024-04-26T23:13:04.062062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'171","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.987978+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:12:58.987978+0000","last_peered":"2024-04-26T23:12:58.987978+0000","last_clean":"2024-04-26T23:12:58.987978+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:12:58.987978+0000","last_undegraded":"2024-04-26T23:12:58.987978+0000","last_fullsized":"2024-04-26T23:12:58.987978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044116+0000","last_change":"2024-04-26T23:05:29.212941+0000","last_active":"2024-04-26T23:13:04.044116+0000","last_peered":"2024-04-26T23:13:04.044116+0000","last_clean":"2024-04-26T23:13:04.044116+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:04.044116+0000","last_undegraded":"2024-04-26T23:13:04.044116+0000","last_fullsized":"2024-04-26T23:13:04.044116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:42.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'208","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.059143+0000","last_change":"2024-04-26T23:05:29.048153+0000","last_active":"2024-04-26T23:13:04.059143+0000","last_peered":"2024-04-26T23:13:04.059143+0000","last_clean":"2024-04-26T23:13:04.059143+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:04.059143+0000","last_undegraded":"2024-04-26T23:13:04.059143+0000","last_fullsized":"2024-04-26T23:13:04.059143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:28.287516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.048786+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:12:58.048786+0000","last_peered":"2024-04-26T23:12:58.048786+0000","last_clean":"2024-04-26T23:12:58.048786+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:12:58.048786+0000","last_undegraded":"2024-04-26T23:12:58.048786+0000","last_fullsized":"2024-04-26T23:12:58.048786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.102733+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:13:04.102733+0000","last_peered":"2024-04-26T23:13:04.102733+0000","last_clean":"2024-04-26T23:13:04.102733+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:04.102733+0000","last_undegraded":"2024-04-26T23:13:04.102733+0000","last_fullsized":"2024-04-26T23:13:04.102733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.199414+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:13:03.199414+0000","last_peered":"2024-04-26T23:13:03.199414+0000","last_clean":"2024-04-26T23:13:03.199414+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:03.199414+0000","last_undegraded":"2024-04-26T23:13:03.199414+0000","last_fullsized":"2024-04-26T23:13:03.199414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'594","reported_seq":623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.067632+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:12:51.067632+0000","last_peered":"2024-04-26T23:12:51.067632+0000","last_clean":"2024-04-26T23:12:51.067632+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:12:51.067632+0000","last_undegraded":"2024-04-26T23:12:51.067632+0000","last_fullsized":"2024-04-26T23:12:51.067632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.112304+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:13:04.112304+0000","last_peered":"2024-04-26T23:13:04.112304+0000","last_clean":"2024-04-26T23:13:04.112304+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:04.112304+0000","last_undegraded":"2024-04-26T23:13:04.112304+0000","last_fullsized":"2024-04-26T23:13:04.112304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'202","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.085665+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:13:01.085665+0000","last_peered":"2024-04-26T23:13:01.085665+0000","last_clean":"2024-04-26T23:13:01.085665+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:01.085665+0000","last_undegraded":"2024-04-26T23:13:01.085665+0000","last_fullsized":"2024-04-26T23:13:01.085665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'373","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:08.985628+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:13:08.985628+0000","last_peered":"2024-04-26T23:13:08.985628+0000","last_clean":"2024-04-26T23:13:08.985628+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:08.985628+0000","last_undegraded":"2024-04-26T23:13:08.985628+0000","last_fullsized":"2024-04-26T23:13:08.985628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018167+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:13:04.018167+0000","last_peered":"2024-04-26T23:13:04.018167+0000","last_clean":"2024-04-26T23:13:04.018167+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:04.018167+0000","last_undegraded":"2024-04-26T23:13:04.018167+0000","last_fullsized":"2024-04-26T23:13:04.018167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'189","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044088+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:13:04.044088+0000","last_peered":"2024-04-26T23:13:04.044088+0000","last_clean":"2024-04-26T23:13:04.044088+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:04.044088+0000","last_undegraded":"2024-04-26T23:13:04.044088+0000","last_fullsized":"2024-04-26T23:13:04.044088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'256","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.194247+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:12:57.194247+0000","last_peered":"2024-04-26T23:12:57.194247+0000","last_clean":"2024-04-26T23:12:57.194247+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:12:57.194247+0000","last_undegraded":"2024-04-26T23:12:57.194247+0000","last_fullsized":"2024-04-26T23:12:57.194247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.095976+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:13:04.095976+0000","last_peered":"2024-04-26T23:13:04.095976+0000","last_clean":"2024-04-26T23:13:04.095976+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:04.095976+0000","last_undegraded":"2024-04-26T23:13:04.095976+0000","last_fullsized":"2024-04-26T23:13:04.095976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.992440+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:13:03.992440+0000","last_peered":"2024-04-26T23:13:03.992440+0000","last_clean":"2024-04-26T23:13:03.992440+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:03.992440+0000","last_undegraded":"2024-04-26T23:13:03.992440+0000","last_fullsized":"2024-04-26T23:13:03.992440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255579+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:13:03.255579+0000","last_peered":"2024-04-26T23:13:03.255579+0000","last_clean":"2024-04-26T23:13:03.255579+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:03.255579+0000","last_undegraded":"2024-04-26T23:13:03.255579+0000","last_fullsized":"2024-04-26T23:13:03.255579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:10:38.964109+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:10:38.964109+0000","last_peered":"2024-04-26T23:10:38.964109+0000","last_clean":"2024-04-26T23:10:38.964109+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:10:38.964109+0000","last_undegraded":"2024-04-26T23:10:38.964109+0000","last_fullsized":"2024-04-26T23:10:38.964109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.089012+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:13:04.089012+0000","last_peered":"2024-04-26T23:13:04.089012+0000","last_clean":"2024-04-26T23:13:04.089012+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:04.089012+0000","last_undegraded":"2024-04-26T23:13:04.089012+0000","last_fullsized":"2024-04-26T23:13:04.089012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'203","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.151687+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:13:01.151687+0000","last_peered":"2024-04-26T23:13:01.151687+0000","last_clean":"2024-04-26T23:13:01.151687+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:01.151687+0000","last_undegraded":"2024-04-26T23:13:01.151687+0000","last_fullsized":"2024-04-26T23:13:01.151687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'67","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.253000+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:13:01.253000+0000","last_peered":"2024-04-26T23:13:01.253000+0000","last_clean":"2024-04-26T23:13:01.253000+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:01.253000+0000","last_undegraded":"2024-04-26T23:13:01.253000+0000","last_fullsized":"2024-04-26T23:13:01.253000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082677+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:13:04.082677+0000","last_peered":"2024-04-26T23:13:04.082677+0000","last_clean":"2024-04-26T23:13:04.082677+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:04.082677+0000","last_undegraded":"2024-04-26T23:13:04.082677+0000","last_fullsized":"2024-04-26T23:13:04.082677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'218","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.065785+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:13:04.065785+0000","last_peered":"2024-04-26T23:13:04.065785+0000","last_clean":"2024-04-26T23:13:04.065785+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:04.065785+0000","last_undegraded":"2024-04-26T23:13:04.065785+0000","last_fullsized":"2024-04-26T23:13:04.065785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'563","reported_seq":592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.143897+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:12:57.143897+0000","last_peered":"2024-04-26T23:12:57.143897+0000","last_clean":"2024-04-26T23:12:57.143897+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:12:57.143897+0000","last_undegraded":"2024-04-26T23:12:57.143897+0000","last_fullsized":"2024-04-26T23:12:57.143897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.250455+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:13:03.250455+0000","last_peered":"2024-04-26T23:13:03.250455+0000","last_clean":"2024-04-26T23:13:03.250455+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:03.250455+0000","last_undegraded":"2024-04-26T23:13:03.250455+0000","last_fullsized":"2024-04-26T23:13:03.250455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.001204+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:13:04.001204+0000","last_peered":"2024-04-26T23:13:04.001204+0000","last_clean":"2024-04-26T23:13:04.001204+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:04.001204+0000","last_undegraded":"2024-04-26T23:13:04.001204+0000","last_fullsized":"2024-04-26T23:13:04.001204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'297","reported_seq":325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:50.985566+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:12:50.985566+0000","last_peered":"2024-04-26T23:12:50.985566+0000","last_clean":"2024-04-26T23:12:50.985566+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:12:50.985566+0000","last_undegraded":"2024-04-26T23:12:50.985566+0000","last_fullsized":"2024-04-26T23:12:50.985566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106115+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:13:04.106115+0000","last_peered":"2024-04-26T23:13:04.106115+0000","last_clean":"2024-04-26T23:13:04.106115+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:04.106115+0000","last_undegraded":"2024-04-26T23:13:04.106115+0000","last_fullsized":"2024-04-26T23:13:04.106115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.195787+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:13:03.195787+0000","last_peered":"2024-04-26T23:13:03.195787+0000","last_clean":"2024-04-26T23:13:03.195787+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:03.195787+0000","last_undegraded":"2024-04-26T23:13:03.195787+0000","last_fullsized":"2024-04-26T23:13:03.195787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'168","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.153589+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:13:03.153589+0000","last_peered":"2024-04-26T23:13:03.153589+0000","last_clean":"2024-04-26T23:13:03.153589+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:03.153589+0000","last_undegraded":"2024-04-26T23:13:03.153589+0000","last_fullsized":"2024-04-26T23:13:03.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034681+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:13:04.034681+0000","last_peered":"2024-04-26T23:13:04.034681+0000","last_clean":"2024-04-26T23:13:04.034681+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:04.034681+0000","last_undegraded":"2024-04-26T23:13:04.034681+0000","last_fullsized":"2024-04-26T23:13:04.034681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'229","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074985+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:13:04.074985+0000","last_peered":"2024-04-26T23:13:04.074985+0000","last_clean":"2024-04-26T23:13:04.074985+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:04.074985+0000","last_undegraded":"2024-04-26T23:13:04.074985+0000","last_fullsized":"2024-04-26T23:13:04.074985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'366","reported_seq":394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.200579+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:13:01.200579+0000","last_peered":"2024-04-26T23:13:01.200579+0000","last_clean":"2024-04-26T23:13:01.200579+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:01.200579+0000","last_undegraded":"2024-04-26T23:13:01.200579+0000","last_fullsized":"2024-04-26T23:13:01.200579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.009350+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:13:04.009350+0000","last_peered":"2024-04-26T23:13:04.009350+0000","last_clean":"2024-04-26T23:13:04.009350+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:04.009350+0000","last_undegraded":"2024-04-26T23:13:04.009350+0000","last_fullsized":"2024-04-26T23:13:04.009350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.187252+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:13:03.187252+0000","last_peered":"2024-04-26T23:13:03.187252+0000","last_clean":"2024-04-26T23:13:03.187252+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:03.187252+0000","last_undegraded":"2024-04-26T23:13:03.187252+0000","last_fullsized":"2024-04-26T23:13:03.187252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.963043+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:12:51.963043+0000","last_peered":"2024-04-26T23:12:51.963043+0000","last_clean":"2024-04-26T23:12:51.963043+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:12:51.963043+0000","last_undegraded":"2024-04-26T23:12:51.963043+0000","last_fullsized":"2024-04-26T23:12:51.963043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.209932+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:13:03.209932+0000","last_peered":"2024-04-26T23:13:03.209932+0000","last_clean":"2024-04-26T23:13:03.209932+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:03.209932+0000","last_undegraded":"2024-04-26T23:13:03.209932+0000","last_fullsized":"2024-04-26T23:13:03.209932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'184","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.208283+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:13:03.208283+0000","last_peered":"2024-04-26T23:13:03.208283+0000","last_clean":"2024-04-26T23:13:03.208283+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:03.208283+0000","last_undegraded":"2024-04-26T23:13:03.208283+0000","last_fullsized":"2024-04-26T23:13:03.208283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'63","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.113749+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:13:04.113749+0000","last_peered":"2024-04-26T23:13:04.113749+0000","last_clean":"2024-04-26T23:13:04.113749+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:04.113749+0000","last_undegraded":"2024-04-26T23:13:04.113749+0000","last_fullsized":"2024-04-26T23:13:04.113749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.998275+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:13:03.998275+0000","last_peered":"2024-04-26T23:13:03.998275+0000","last_clean":"2024-04-26T23:13:03.998275+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:03.998275+0000","last_undegraded":"2024-04-26T23:13:03.998275+0000","last_fullsized":"2024-04-26T23:13:03.998275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.091837+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:13:04.091837+0000","last_peered":"2024-04-26T23:13:04.091837+0000","last_clean":"2024-04-26T23:13:04.091837+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:04.091837+0000","last_undegraded":"2024-04-26T23:13:04.091837+0000","last_fullsized":"2024-04-26T23:13:04.091837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'656","reported_seq":685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.989193+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:12:51.989193+0000","last_peered":"2024-04-26T23:12:51.989193+0000","last_clean":"2024-04-26T23:12:51.989193+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:12:51.989193+0000","last_undegraded":"2024-04-26T23:12:51.989193+0000","last_fullsized":"2024-04-26T23:12:51.989193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.068538+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:13:04.068538+0000","last_peered":"2024-04-26T23:13:04.068538+0000","last_clean":"2024-04-26T23:13:04.068538+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:04.068538+0000","last_undegraded":"2024-04-26T23:13:04.068538+0000","last_fullsized":"2024-04-26T23:13:04.068538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.031804+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:13:04.031804+0000","last_peered":"2024-04-26T23:13:04.031804+0000","last_clean":"2024-04-26T23:13:04.031804+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:04.031804+0000","last_undegraded":"2024-04-26T23:13:04.031804+0000","last_fullsized":"2024-04-26T23:13:04.031804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'356","reported_seq":385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.065249+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:12:57.065249+0000","last_peered":"2024-04-26T23:12:57.065249+0000","last_clean":"2024-04-26T23:12:57.065249+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:12:57.065249+0000","last_undegraded":"2024-04-26T23:12:57.065249+0000","last_fullsized":"2024-04-26T23:12:57.065249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082592+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:13:04.082592+0000","last_peered":"2024-04-26T23:13:04.082592+0000","last_clean":"2024-04-26T23:13:04.082592+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:04.082592+0000","last_undegraded":"2024-04-26T23:13:04.082592+0000","last_fullsized":"2024-04-26T23:13:04.082592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.196995+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:13:03.196995+0000","last_peered":"2024-04-26T23:13:03.196995+0000","last_clean":"2024-04-26T23:13:03.196995+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:03.196995+0000","last_undegraded":"2024-04-26T23:13:03.196995+0000","last_fullsized":"2024-04-26T23:13:03.196995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'334","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.988158+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:13:04.988158+0000","last_peered":"2024-04-26T23:13:04.988158+0000","last_clean":"2024-04-26T23:13:04.988158+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:04.988158+0000","last_undegraded":"2024-04-26T23:13:04.988158+0000","last_fullsized":"2024-04-26T23:13:04.988158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.038541+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:13:04.038541+0000","last_peered":"2024-04-26T23:13:04.038541+0000","last_clean":"2024-04-26T23:13:04.038541+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:04.038541+0000","last_undegraded":"2024-04-26T23:13:04.038541+0000","last_fullsized":"2024-04-26T23:13:04.038541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'182","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.194161+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:13:03.194161+0000","last_peered":"2024-04-26T23:13:03.194161+0000","last_clean":"2024-04-26T23:13:03.194161+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:03.194161+0000","last_undegraded":"2024-04-26T23:13:03.194161+0000","last_fullsized":"2024-04-26T23:13:03.194161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'106","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.104165+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:13:03.104165+0000","last_peered":"2024-04-26T23:13:03.104165+0000","last_clean":"2024-04-26T23:13:03.104165+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:03.104165+0000","last_undegraded":"2024-04-26T23:13:03.104165+0000","last_fullsized":"2024-04-26T23:13:03.104165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.060188+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:13:04.060188+0000","last_peered":"2024-04-26T23:13:04.060188+0000","last_clean":"2024-04-26T23:13:04.060188+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:04.060188+0000","last_undegraded":"2024-04-26T23:13:04.060188+0000","last_fullsized":"2024-04-26T23:13:04.060188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'206","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116203+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:13:03.116203+0000","last_peered":"2024-04-26T23:13:03.116203+0000","last_clean":"2024-04-26T23:13:03.116203+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:03.116203+0000","last_undegraded":"2024-04-26T23:13:03.116203+0000","last_fullsized":"2024-04-26T23:13:03.116203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.102867+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:12:57.102867+0000","last_peered":"2024-04-26T23:12:57.102867+0000","last_clean":"2024-04-26T23:12:57.102867+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:12:57.102867+0000","last_undegraded":"2024-04-26T23:12:57.102867+0000","last_fullsized":"2024-04-26T23:12:57.102867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074896+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:13:04.074896+0000","last_peered":"2024-04-26T23:13:04.074896+0000","last_clean":"2024-04-26T23:13:04.074896+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:04.074896+0000","last_undegraded":"2024-04-26T23:13:04.074896+0000","last_fullsized":"2024-04-26T23:13:04.074896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.041470+0000","last_change":"2024-04-26T23:05:29.212676+0000","last_active":"2024-04-26T23:13:04.041470+0000","last_peered":"2024-04-26T23:13:04.041470+0000","last_clean":"2024-04-26T23:13:04.041470+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:04.041470+0000","last_undegraded":"2024-04-26T23:13:04.041470+0000","last_fullsized":"2024-04-26T23:13:04.041470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:47.644852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'208","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013473+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:13:04.013473+0000","last_peered":"2024-04-26T23:13:04.013473+0000","last_clean":"2024-04-26T23:13:04.013473+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:04.013473+0000","last_undegraded":"2024-04-26T23:13:04.013473+0000","last_fullsized":"2024-04-26T23:13:04.013473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'834","reported_seq":862,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.056585+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:12:57.056585+0000","last_peered":"2024-04-26T23:12:57.056585+0000","last_clean":"2024-04-26T23:12:57.056585+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:12:57.056585+0000","last_undegraded":"2024-04-26T23:12:57.056585+0000","last_fullsized":"2024-04-26T23:12:57.056585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.263878+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:13:03.263878+0000","last_peered":"2024-04-26T23:13:03.263878+0000","last_clean":"2024-04-26T23:13:03.263878+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:03.263878+0000","last_undegraded":"2024-04-26T23:13:03.263878+0000","last_fullsized":"2024-04-26T23:13:03.263878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'210","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.131862+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:13:03.131862+0000","last_peered":"2024-04-26T23:13:03.131862+0000","last_clean":"2024-04-26T23:13:03.131862+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:03.131862+0000","last_undegraded":"2024-04-26T23:13:03.131862+0000","last_fullsized":"2024-04-26T23:13:03.131862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'78","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.115707+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:12:57.115707+0000","last_peered":"2024-04-26T23:12:57.115707+0000","last_clean":"2024-04-26T23:12:57.115707+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:12:57.115707+0000","last_undegraded":"2024-04-26T23:12:57.115707+0000","last_fullsized":"2024-04-26T23:12:57.115707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.090911+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:12:54.090911+0000","last_peered":"2024-04-26T23:12:54.090911+0000","last_clean":"2024-04-26T23:12:54.090911+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:12:54.090911+0000","last_undegraded":"2024-04-26T23:12:54.090911+0000","last_fullsized":"2024-04-26T23:12:54.090911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'176","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.217035+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:13:03.217035+0000","last_peered":"2024-04-26T23:13:03.217035+0000","last_clean":"2024-04-26T23:13:03.217035+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:03.217035+0000","last_undegraded":"2024-04-26T23:13:03.217035+0000","last_fullsized":"2024-04-26T23:13:03.217035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.045723+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:13:04.045723+0000","last_peered":"2024-04-26T23:13:04.045723+0000","last_clean":"2024-04-26T23:13:04.045723+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:04.045723+0000","last_undegraded":"2024-04-26T23:13:04.045723+0000","last_fullsized":"2024-04-26T23:13:04.045723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'73","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:52.063000+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:12:52.063000+0000","last_peered":"2024-04-26T23:12:52.063000+0000","last_clean":"2024-04-26T23:12:52.063000+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:12:52.063000+0000","last_undegraded":"2024-04-26T23:12:52.063000+0000","last_fullsized":"2024-04-26T23:12:52.063000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.248546+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:13:03.248546+0000","last_peered":"2024-04-26T23:13:03.248546+0000","last_clean":"2024-04-26T23:13:03.248546+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:03.248546+0000","last_undegraded":"2024-04-26T23:13:03.248546+0000","last_fullsized":"2024-04-26T23:13:03.248546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.274282+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:13:03.274282+0000","last_peered":"2024-04-26T23:13:03.274282+0000","last_clean":"2024-04-26T23:13:03.274282+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:03.274282+0000","last_undegraded":"2024-04-26T23:13:03.274282+0000","last_fullsized":"2024-04-26T23:13:03.274282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'215","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.069454+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:13:04.069454+0000","last_peered":"2024-04-26T23:13:04.069454+0000","last_clean":"2024-04-26T23:13:04.069454+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:04.069454+0000","last_undegraded":"2024-04-26T23:13:04.069454+0000","last_fullsized":"2024-04-26T23:13:04.069454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991598+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:13:03.991598+0000","last_peered":"2024-04-26T23:13:03.991598+0000","last_clean":"2024-04-26T23:13:03.991598+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:03.991598+0000","last_undegraded":"2024-04-26T23:13:03.991598+0000","last_fullsized":"2024-04-26T23:13:03.991598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067391+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:13:04.067391+0000","last_peered":"2024-04-26T23:13:04.067391+0000","last_clean":"2024-04-26T23:13:04.067391+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:04.067391+0000","last_undegraded":"2024-04-26T23:13:04.067391+0000","last_fullsized":"2024-04-26T23:13:04.067391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'197","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044137+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:13:04.044137+0000","last_peered":"2024-04-26T23:13:04.044137+0000","last_clean":"2024-04-26T23:13:04.044137+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:04.044137+0000","last_undegraded":"2024-04-26T23:13:04.044137+0000","last_fullsized":"2024-04-26T23:13:04.044137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'188","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106791+0000","last_change":"2024-04-26T23:05:29.866675+0000","last_active":"2024-04-26T23:13:04.106791+0000","last_peered":"2024-04-26T23:13:04.106791+0000","last_clean":"2024-04-26T23:13:04.106791+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:04.106791+0000","last_undegraded":"2024-04-26T23:13:04.106791+0000","last_fullsized":"2024-04-26T23:13:04.106791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.339856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113993+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:13:03.113993+0000","last_peered":"2024-04-26T23:13:03.113993+0000","last_clean":"2024-04-26T23:13:03.113993+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:03.113993+0000","last_undegraded":"2024-04-26T23:13:03.113993+0000","last_fullsized":"2024-04-26T23:13:03.113993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'225","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.154286+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:13:03.154286+0000","last_peered":"2024-04-26T23:13:03.154286+0000","last_clean":"2024-04-26T23:13:03.154286+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:03.154286+0000","last_undegraded":"2024-04-26T23:13:03.154286+0000","last_fullsized":"2024-04-26T23:13:03.154286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.993050+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:13:03.993050+0000","last_peered":"2024-04-26T23:13:03.993050+0000","last_clean":"2024-04-26T23:13:03.993050+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:03.993050+0000","last_undegraded":"2024-04-26T23:13:03.993050+0000","last_fullsized":"2024-04-26T23:13:03.993050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.107190+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:13:04.107190+0000","last_peered":"2024-04-26T23:13:04.107190+0000","last_clean":"2024-04-26T23:13:04.107190+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:04.107190+0000","last_undegraded":"2024-04-26T23:13:04.107190+0000","last_fullsized":"2024-04-26T23:13:04.107190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.232291+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:13:03.232291+0000","last_peered":"2024-04-26T23:13:03.232291+0000","last_clean":"2024-04-26T23:13:03.232291+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:03.232291+0000","last_undegraded":"2024-04-26T23:13:03.232291+0000","last_fullsized":"2024-04-26T23:13:03.232291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'203","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.089904+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:13:03.089904+0000","last_peered":"2024-04-26T23:13:03.089904+0000","last_clean":"2024-04-26T23:13:03.089904+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:03.089904+0000","last_undegraded":"2024-04-26T23:13:03.089904+0000","last_fullsized":"2024-04-26T23:13:03.089904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'192","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.244803+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:13:03.244803+0000","last_peered":"2024-04-26T23:13:03.244803+0000","last_clean":"2024-04-26T23:13:03.244803+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:03.244803+0000","last_undegraded":"2024-04-26T23:13:03.244803+0000","last_fullsized":"2024-04-26T23:13:03.244803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'211","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197658+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:13:01.197658+0000","last_peered":"2024-04-26T23:13:01.197658+0000","last_clean":"2024-04-26T23:13:01.197658+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:01.197658+0000","last_undegraded":"2024-04-26T23:13:01.197658+0000","last_fullsized":"2024-04-26T23:13:01.197658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255089+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:13:03.255089+0000","last_peered":"2024-04-26T23:13:03.255089+0000","last_clean":"2024-04-26T23:13:03.255089+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:03.255089+0000","last_undegraded":"2024-04-26T23:13:03.255089+0000","last_fullsized":"2024-04-26T23:13:03.255089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'197","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.087851+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:13:04.087851+0000","last_peered":"2024-04-26T23:13:04.087851+0000","last_clean":"2024-04-26T23:13:04.087851+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:04.087851+0000","last_undegraded":"2024-04-26T23:13:04.087851+0000","last_fullsized":"2024-04-26T23:13:04.087851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'200","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018127+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:13:04.018127+0000","last_peered":"2024-04-26T23:13:04.018127+0000","last_clean":"2024-04-26T23:13:04.018127+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:04.018127+0000","last_undegraded":"2024-04-26T23:13:04.018127+0000","last_fullsized":"2024-04-26T23:13:04.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.046234+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:13:04.046234+0000","last_peered":"2024-04-26T23:13:04.046234+0000","last_clean":"2024-04-26T23:13:04.046234+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:04.046234+0000","last_undegraded":"2024-04-26T23:13:04.046234+0000","last_fullsized":"2024-04-26T23:13:04.046234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'209","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.171578+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:13:01.171578+0000","last_peered":"2024-04-26T23:13:01.171578+0000","last_clean":"2024-04-26T23:13:01.171578+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:01.171578+0000","last_undegraded":"2024-04-26T23:13:01.171578+0000","last_fullsized":"2024-04-26T23:13:01.171578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'206","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.240112+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:13:03.240112+0000","last_peered":"2024-04-26T23:13:03.240112+0000","last_clean":"2024-04-26T23:13:03.240112+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:03.240112+0000","last_undegraded":"2024-04-26T23:13:03.240112+0000","last_fullsized":"2024-04-26T23:13:03.240112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113318+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:13:03.113318+0000","last_peered":"2024-04-26T23:13:03.113318+0000","last_clean":"2024-04-26T23:13:03.113318+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:03.113318+0000","last_undegraded":"2024-04-26T23:13:03.113318+0000","last_fullsized":"2024-04-26T23:13:03.113318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'175","reported_seq":202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991944+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:13:03.991944+0000","last_peered":"2024-04-26T23:13:03.991944+0000","last_clean":"2024-04-26T23:13:03.991944+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:03.991944+0000","last_undegraded":"2024-04-26T23:13:03.991944+0000","last_fullsized":"2024-04-26T23:13:03.991944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'180","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.874959+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:13:03.874959+0000","last_peered":"2024-04-26T23:13:03.874959+0000","last_clean":"2024-04-26T23:13:03.874959+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:03.874959+0000","last_undegraded":"2024-04-26T23:13:03.874959+0000","last_fullsized":"2024-04-26T23:13:03.874959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.259873+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:13:03.259873+0000","last_peered":"2024-04-26T23:13:03.259873+0000","last_clean":"2024-04-26T23:13:03.259873+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:03.259873+0000","last_undegraded":"2024-04-26T23:13:03.259873+0000","last_fullsized":"2024-04-26T23:13:03.259873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.205157+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:13:03.205157+0000","last_peered":"2024-04-26T23:13:03.205157+0000","last_clean":"2024-04-26T23:13:03.205157+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:03.205157+0000","last_undegraded":"2024-04-26T23:13:03.205157+0000","last_fullsized":"2024-04-26T23:13:03.205157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054939+0000","last_change":"2024-04-26T23:05:29.413874+0000","last_active":"2024-04-26T23:13:04.054939+0000","last_peered":"2024-04-26T23:13:04.054939+0000","last_clean":"2024-04-26T23:13:04.054939+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:04.054939+0000","last_undegraded":"2024-04-26T23:13:04.054939+0000","last_fullsized":"2024-04-26T23:13:04.054939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:56.983137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'207","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.157614+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:13:03.157614+0000","last_peered":"2024-04-26T23:13:03.157614+0000","last_clean":"2024-04-26T23:13:03.157614+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:03.157614+0000","last_undegraded":"2024-04-26T23:13:03.157614+0000","last_fullsized":"2024-04-26T23:13:03.157614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013347+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:13:04.013347+0000","last_peered":"2024-04-26T23:13:04.013347+0000","last_clean":"2024-04-26T23:13:04.013347+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:04.013347+0000","last_undegraded":"2024-04-26T23:13:04.013347+0000","last_fullsized":"2024-04-26T23:13:04.013347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.221659+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:13:03.221659+0000","last_peered":"2024-04-26T23:13:03.221659+0000","last_clean":"2024-04-26T23:13:03.221659+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:03.221659+0000","last_undegraded":"2024-04-26T23:13:03.221659+0000","last_fullsized":"2024-04-26T23:13:03.221659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.043108+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:13:04.043108+0000","last_peered":"2024-04-26T23:13:04.043108+0000","last_clean":"2024-04-26T23:13:04.043108+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:04.043108+0000","last_undegraded":"2024-04-26T23:13:04.043108+0000","last_fullsized":"2024-04-26T23:13:04.043108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.149593+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:13:03.149593+0000","last_peered":"2024-04-26T23:13:03.149593+0000","last_clean":"2024-04-26T23:13:03.149593+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:03.149593+0000","last_undegraded":"2024-04-26T23:13:03.149593+0000","last_fullsized":"2024-04-26T23:13:03.149593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.239348+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:13:03.239348+0000","last_peered":"2024-04-26T23:13:03.239348+0000","last_clean":"2024-04-26T23:13:03.239348+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:03.239348+0000","last_undegraded":"2024-04-26T23:13:03.239348+0000","last_fullsized":"2024-04-26T23:13:03.239348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'199","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252333+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:13:03.252333+0000","last_peered":"2024-04-26T23:13:03.252333+0000","last_clean":"2024-04-26T23:13:03.252333+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:03.252333+0000","last_undegraded":"2024-04-26T23:13:03.252333+0000","last_fullsized":"2024-04-26T23:13:03.252333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12703,"ondisk_log_size":12703,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146759901,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6967,"num_write_kb":149051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293519802,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8240,"ondisk_log_size":8240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53625849,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452197,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40337844,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921128,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:13:16.824 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:13:16.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:13:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 Processor -- start 2024-04-26T23:13:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 -- start start 2024-04-26T23:13:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0608072d70 0x7f06080731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06080c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0608152fa0 con 0x7f0608152bc0 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0608073700 con 0x7f0608072d70 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:16.996+0000 7f060ec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0608159790 con 0x7f06080c9b60 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0608072d70 0x7f06080731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0608072d70 0x7f06080731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44444/0 (socket says 172.21.15.148:44444) 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 -- 172.21.15.148:0/1540903951 learned_addr learned my addr 172.21.15.148:0/1540903951 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f060cc00640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06080c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 -- 172.21.15.148:0/1540903951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 msgr2=0x7f06080c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06080c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 -- 172.21.15.148:0/1540903951 >> v1:172.21.15.157:6789/0 conn(0x7f0608152bc0 legacy=0x7f06080c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 -- 172.21.15.148:0/1540903951 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0608158930 con 0x7f0608072d70 2024-04-26T23:13:17.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f05ff400640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06080731c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009e50 tx=0x7f05f001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b32af456c63f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f0607400640 1 -- 172.21.15.148:0/1540903951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00b4070 con 0x7f0608072d70 2024-04-26T23:13:17.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f0607400640 1 -- 172.21.15.148:0/1540903951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f00af400 con 0x7f0608072d70 2024-04-26T23:13:17.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.000+0000 7f0607400640 1 -- 172.21.15.148:0/1540903951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00af7d0 con 0x7f0608072d70 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- 172.21.15.148:0/1540903951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 msgr2=0x7f06080731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06080731c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009e50 tx=0x7f05f001f210 comp rx=0 tx=0).stop 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- 172.21.15.148:0/1540903951 shutdown_connections 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06080c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- 172.21.15.148:0/1540903951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06080731c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- 172.21.15.148:0/1540903951 >> 172.21.15.148:0/1540903951 conn(0x7f060806c380 msgr2=0x7f060806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- 172.21.15.148:0/1540903951 shutdown_connections 2024-04-26T23:13:17.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- 172.21.15.148:0/1540903951 wait complete. 2024-04-26T23:13:17.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 Processor -- start 2024-04-26T23:13:17.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- start start 2024-04-26T23:13:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06081f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0608152bc0 0x7f06081ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f06081591d0 con 0x7f0608072d70 2024-04-26T23:13:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0608158ef0 con 0x7f0608152bc0 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060ec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f06081594b0 con 0x7f06080c9b60 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44456/0 (socket says 172.21.15.148:44456) 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 -- 172.21.15.148:0/389713958 learned_addr learned my addr 172.21.15.148:0/389713958 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f05ff400640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06081f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f060cc00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0608152bc0 0x7f06081ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 -- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 msgr2=0x7f06081f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06081f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 -- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0608152bc0 msgr2=0x7f06081ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0608152bc0 0x7f06081ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 -- 172.21.15.148:0/389713958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0608150420 con 0x7f0608072d70 2024-04-26T23:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0607e00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c3a0 tx=0x7f05f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.004+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8016070 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f80052d0 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8007260 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06080cbe50 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06080cc0f0 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0608077c20 con 0x7f0608072d70 2024-04-26T23:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05f8007400 con 0x7f0608072d70 2024-04-26T23:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f0604c00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 0x7f05e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f05f80887a0 con 0x7f0608072d70 2024-04-26T23:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.008+0000 7f05ff400640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 0x7f05e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.012+0000 7f05ff400640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 0x7f05e406a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05f00b1000 tx=0x7f05f00aa000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.012+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f05f8005480 con 0x7f0608072d70 2024-04-26T23:13:17.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.168+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06080c9940 con 0x7f05e4068380 2024-04-26T23:13:17.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.188+0000 7f0604c00640 1 -- 172.21.15.148:0/389713958 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334853 (secure 0 0 0) 0x7f06080c9940 con 0x7f05e4068380 2024-04-26T23:13:17.192 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:17.194 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:13:17.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 msgr2=0x7f05e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 0x7f05e406a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05f00b1000 tx=0x7f05f00aa000 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 msgr2=0x7f06081f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c3a0 tx=0x7f05f800c860 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 shutdown_connections 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f05e4068380 0x7f05e406a840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0608152bc0 0x7f06081ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06080c9b60 0x7f06081f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 --2- 172.21.15.148:0/389713958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0608072d70 0x7f06081f1fa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 >> 172.21.15.148:0/389713958 conn(0x7f060806c380 msgr2=0x7f06080c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 shutdown_connections 2024-04-26T23:13:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.196+0000 7f060ec00640 1 -- 172.21.15.148:0/389713958 wait complete. 2024-04-26T23:13:17.213 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-26T23:13:16.048599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350269,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31499,"num_write_kb":4538324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46685,"ondisk_log_size":46685,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615362,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2750144,"num_objects":-392,"num_object_clones":0,"num_object_copies":-1568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-392,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":460,"num_write_kb":1675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005694"},"pg_stats":[{"pgid":"2.1f","version":"26'75","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.213694+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:13:01.213694+0000","last_peered":"2024-04-26T23:13:01.213694+0000","last_clean":"2024-04-26T23:13:01.213694+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:01.213694+0000","last_undegraded":"2024-04-26T23:13:01.213694+0000","last_fullsized":"2024-04-26T23:13:01.213694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.040183+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:13:04.040183+0000","last_peered":"2024-04-26T23:13:04.040183+0000","last_clean":"2024-04-26T23:13:04.040183+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:04.040183+0000","last_undegraded":"2024-04-26T23:13:04.040183+0000","last_fullsized":"2024-04-26T23:13:04.040183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067372+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:13:04.067372+0000","last_peered":"2024-04-26T23:13:04.067372+0000","last_clean":"2024-04-26T23:13:04.067372+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:04.067372+0000","last_undegraded":"2024-04-26T23:13:04.067372+0000","last_fullsized":"2024-04-26T23:13:04.067372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'91","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.067222+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:12:57.067222+0000","last_peered":"2024-04-26T23:12:57.067222+0000","last_clean":"2024-04-26T23:12:57.067222+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:12:57.067222+0000","last_undegraded":"2024-04-26T23:12:57.067222+0000","last_fullsized":"2024-04-26T23:12:57.067222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'176","reported_seq":204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.167686+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:13:03.167686+0000","last_peered":"2024-04-26T23:13:03.167686+0000","last_clean":"2024-04-26T23:13:03.167686+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:03.167686+0000","last_undegraded":"2024-04-26T23:13:03.167686+0000","last_fullsized":"2024-04-26T23:13:03.167686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054083+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:13:04.054083+0000","last_peered":"2024-04-26T23:13:04.054083+0000","last_clean":"2024-04-26T23:13:04.054083+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:04.054083+0000","last_undegraded":"2024-04-26T23:13:04.054083+0000","last_fullsized":"2024-04-26T23:13:04.054083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'372","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252017+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:13:03.252017+0000","last_peered":"2024-04-26T23:13:03.252017+0000","last_clean":"2024-04-26T23:13:03.252017+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:03.252017+0000","last_undegraded":"2024-04-26T23:13:03.252017+0000","last_fullsized":"2024-04-26T23:13:03.252017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116350+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:13:03.116350+0000","last_peered":"2024-04-26T23:13:03.116350+0000","last_clean":"2024-04-26T23:13:03.116350+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:03.116350+0000","last_undegraded":"2024-04-26T23:13:03.116350+0000","last_fullsized":"2024-04-26T23:13:03.116350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034589+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:13:04.034589+0000","last_peered":"2024-04-26T23:13:04.034589+0000","last_clean":"2024-04-26T23:13:04.034589+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:04.034589+0000","last_undegraded":"2024-04-26T23:13:04.034589+0000","last_fullsized":"2024-04-26T23:13:04.034589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.688103+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:13:01.688103+0000","last_peered":"2024-04-26T23:13:01.688103+0000","last_clean":"2024-04-26T23:13:01.688103+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:01.688103+0000","last_undegraded":"2024-04-26T23:13:01.688103+0000","last_fullsized":"2024-04-26T23:13:01.688103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.269082+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:13:03.269082+0000","last_peered":"2024-04-26T23:13:03.269082+0000","last_clean":"2024-04-26T23:13:03.269082+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:03.269082+0000","last_undegraded":"2024-04-26T23:13:03.269082+0000","last_fullsized":"2024-04-26T23:13:03.269082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.020337+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:13:04.020337+0000","last_peered":"2024-04-26T23:13:04.020337+0000","last_clean":"2024-04-26T23:13:04.020337+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:04.020337+0000","last_undegraded":"2024-04-26T23:13:04.020337+0000","last_fullsized":"2024-04-26T23:13:04.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'212","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.079509+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:13:04.079509+0000","last_peered":"2024-04-26T23:13:04.079509+0000","last_clean":"2024-04-26T23:13:04.079509+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:04.079509+0000","last_undegraded":"2024-04-26T23:13:04.079509+0000","last_fullsized":"2024-04-26T23:13:04.079509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'276","reported_seq":305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.042364+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:12:58.042364+0000","last_peered":"2024-04-26T23:12:58.042364+0000","last_clean":"2024-04-26T23:12:58.042364+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:12:58.042364+0000","last_undegraded":"2024-04-26T23:12:58.042364+0000","last_fullsized":"2024-04-26T23:12:58.042364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":936,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255123+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:13:03.255123+0000","last_peered":"2024-04-26T23:13:03.255123+0000","last_clean":"2024-04-26T23:13:03.255123+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:03.255123+0000","last_undegraded":"2024-04-26T23:13:03.255123+0000","last_fullsized":"2024-04-26T23:13:03.255123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'205","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.019779+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:12:58.019779+0000","last_peered":"2024-04-26T23:12:58.019779+0000","last_clean":"2024-04-26T23:12:58.019779+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:12:58.019779+0000","last_undegraded":"2024-04-26T23:12:58.019779+0000","last_fullsized":"2024-04-26T23:12:58.019779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'169","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.000147+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:12:54.000147+0000","last_peered":"2024-04-26T23:12:54.000147+0000","last_clean":"2024-04-26T23:12:54.000147+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:12:54.000147+0000","last_undegraded":"2024-04-26T23:12:54.000147+0000","last_fullsized":"2024-04-26T23:12:54.000147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.073540+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:13:04.073540+0000","last_peered":"2024-04-26T23:13:04.073540+0000","last_clean":"2024-04-26T23:13:04.073540+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:04.073540+0000","last_undegraded":"2024-04-26T23:13:04.073540+0000","last_fullsized":"2024-04-26T23:13:04.073540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.240985+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:13:01.240985+0000","last_peered":"2024-04-26T23:13:01.240985+0000","last_clean":"2024-04-26T23:13:01.240985+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:01.240985+0000","last_undegraded":"2024-04-26T23:13:01.240985+0000","last_fullsized":"2024-04-26T23:13:01.240985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'122","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.254675+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:13:09.254675+0000","last_peered":"2024-04-26T23:13:09.254675+0000","last_clean":"2024-04-26T23:13:09.254675+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:09.254675+0000","last_undegraded":"2024-04-26T23:13:09.254675+0000","last_fullsized":"2024-04-26T23:13:09.254675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588254,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":2583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.050381+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:13:04.050381+0000","last_peered":"2024-04-26T23:13:04.050381+0000","last_clean":"2024-04-26T23:13:04.050381+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:04.050381+0000","last_undegraded":"2024-04-26T23:13:04.050381+0000","last_fullsized":"2024-04-26T23:13:04.050381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.027703+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:13:04.027703+0000","last_peered":"2024-04-26T23:13:04.027703+0000","last_clean":"2024-04-26T23:13:04.027703+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:04.027703+0000","last_undegraded":"2024-04-26T23:13:04.027703+0000","last_fullsized":"2024-04-26T23:13:04.027703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'456","reported_seq":485,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.220210+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:12:57.220210+0000","last_peered":"2024-04-26T23:12:57.220210+0000","last_clean":"2024-04-26T23:12:57.220210+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:12:57.220210+0000","last_undegraded":"2024-04-26T23:12:57.220210+0000","last_fullsized":"2024-04-26T23:12:57.220210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":786,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.094073+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:13:04.094073+0000","last_peered":"2024-04-26T23:13:04.094073+0000","last_clean":"2024-04-26T23:13:04.094073+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:04.094073+0000","last_undegraded":"2024-04-26T23:13:04.094073+0000","last_fullsized":"2024-04-26T23:13:04.094073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'217","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.098959+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:13:04.098959+0000","last_peered":"2024-04-26T23:13:04.098959+0000","last_clean":"2024-04-26T23:13:04.098959+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:04.098959+0000","last_undegraded":"2024-04-26T23:13:04.098959+0000","last_fullsized":"2024-04-26T23:13:04.098959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197749+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:13:01.197749+0000","last_peered":"2024-04-26T23:13:01.197749+0000","last_clean":"2024-04-26T23:13:01.197749+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:01.197749+0000","last_undegraded":"2024-04-26T23:13:01.197749+0000","last_fullsized":"2024-04-26T23:13:01.197749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082156+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:13:04.082156+0000","last_peered":"2024-04-26T23:13:04.082156+0000","last_clean":"2024-04-26T23:13:04.082156+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:04.082156+0000","last_undegraded":"2024-04-26T23:13:04.082156+0000","last_fullsized":"2024-04-26T23:13:04.082156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'172","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.195989+0000","last_change":"2024-04-26T23:05:29.215214+0000","last_active":"2024-04-26T23:13:01.195989+0000","last_peered":"2024-04-26T23:13:01.195989+0000","last_clean":"2024-04-26T23:13:01.195989+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:01.195989+0000","last_undegraded":"2024-04-26T23:13:01.195989+0000","last_fullsized":"2024-04-26T23:13:01.195989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:30.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'406","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:09.595774+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:13:09.595774+0000","last_peered":"2024-04-26T23:13:09.595774+0000","last_clean":"2024-04-26T23:13:09.595774+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:09.595774+0000","last_undegraded":"2024-04-26T23:13:09.595774+0000","last_fullsized":"2024-04-26T23:13:09.595774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.256926+0000","last_change":"2024-04-26T23:05:29.212929+0000","last_active":"2024-04-26T23:13:03.256926+0000","last_peered":"2024-04-26T23:13:03.256926+0000","last_clean":"2024-04-26T23:13:03.256926+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:03.256926+0000","last_undegraded":"2024-04-26T23:13:03.256926+0000","last_fullsized":"2024-04-26T23:13:03.256926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:28.986125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'186","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.062062+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:13:04.062062+0000","last_peered":"2024-04-26T23:13:04.062062+0000","last_clean":"2024-04-26T23:13:04.062062+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:04.062062+0000","last_undegraded":"2024-04-26T23:13:04.062062+0000","last_fullsized":"2024-04-26T23:13:04.062062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'171","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.987978+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:12:58.987978+0000","last_peered":"2024-04-26T23:12:58.987978+0000","last_clean":"2024-04-26T23:12:58.987978+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:12:58.987978+0000","last_undegraded":"2024-04-26T23:12:58.987978+0000","last_fullsized":"2024-04-26T23:12:58.987978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044116+0000","last_change":"2024-04-26T23:05:29.212941+0000","last_active":"2024-04-26T23:13:04.044116+0000","last_peered":"2024-04-26T23:13:04.044116+0000","last_clean":"2024-04-26T23:13:04.044116+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:04.044116+0000","last_undegraded":"2024-04-26T23:13:04.044116+0000","last_fullsized":"2024-04-26T23:13:04.044116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:42.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'208","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.059143+0000","last_change":"2024-04-26T23:05:29.048153+0000","last_active":"2024-04-26T23:13:04.059143+0000","last_peered":"2024-04-26T23:13:04.059143+0000","last_clean":"2024-04-26T23:13:04.059143+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:04.059143+0000","last_undegraded":"2024-04-26T23:13:04.059143+0000","last_fullsized":"2024-04-26T23:13:04.059143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:28.287516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.048786+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:12:58.048786+0000","last_peered":"2024-04-26T23:12:58.048786+0000","last_clean":"2024-04-26T23:12:58.048786+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:12:58.048786+0000","last_undegraded":"2024-04-26T23:12:58.048786+0000","last_fullsized":"2024-04-26T23:12:58.048786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.102733+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:13:04.102733+0000","last_peered":"2024-04-26T23:13:04.102733+0000","last_clean":"2024-04-26T23:13:04.102733+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:04.102733+0000","last_undegraded":"2024-04-26T23:13:04.102733+0000","last_fullsized":"2024-04-26T23:13:04.102733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.199414+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:13:03.199414+0000","last_peered":"2024-04-26T23:13:03.199414+0000","last_clean":"2024-04-26T23:13:03.199414+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:03.199414+0000","last_undegraded":"2024-04-26T23:13:03.199414+0000","last_fullsized":"2024-04-26T23:13:03.199414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'594","reported_seq":623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.067632+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:12:51.067632+0000","last_peered":"2024-04-26T23:12:51.067632+0000","last_clean":"2024-04-26T23:12:51.067632+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:12:51.067632+0000","last_undegraded":"2024-04-26T23:12:51.067632+0000","last_fullsized":"2024-04-26T23:12:51.067632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.112304+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:13:04.112304+0000","last_peered":"2024-04-26T23:13:04.112304+0000","last_clean":"2024-04-26T23:13:04.112304+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:04.112304+0000","last_undegraded":"2024-04-26T23:13:04.112304+0000","last_fullsized":"2024-04-26T23:13:04.112304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'202","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.085665+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:13:01.085665+0000","last_peered":"2024-04-26T23:13:01.085665+0000","last_clean":"2024-04-26T23:13:01.085665+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:01.085665+0000","last_undegraded":"2024-04-26T23:13:01.085665+0000","last_fullsized":"2024-04-26T23:13:01.085665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'373","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:08.985628+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:13:08.985628+0000","last_peered":"2024-04-26T23:13:08.985628+0000","last_clean":"2024-04-26T23:13:08.985628+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:08.985628+0000","last_undegraded":"2024-04-26T23:13:08.985628+0000","last_fullsized":"2024-04-26T23:13:08.985628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018167+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:13:04.018167+0000","last_peered":"2024-04-26T23:13:04.018167+0000","last_clean":"2024-04-26T23:13:04.018167+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:04.018167+0000","last_undegraded":"2024-04-26T23:13:04.018167+0000","last_fullsized":"2024-04-26T23:13:04.018167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'189","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044088+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:13:04.044088+0000","last_peered":"2024-04-26T23:13:04.044088+0000","last_clean":"2024-04-26T23:13:04.044088+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:04.044088+0000","last_undegraded":"2024-04-26T23:13:04.044088+0000","last_fullsized":"2024-04-26T23:13:04.044088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'256","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.194247+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:12:57.194247+0000","last_peered":"2024-04-26T23:12:57.194247+0000","last_clean":"2024-04-26T23:12:57.194247+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:12:57.194247+0000","last_undegraded":"2024-04-26T23:12:57.194247+0000","last_fullsized":"2024-04-26T23:12:57.194247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.095976+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:13:04.095976+0000","last_peered":"2024-04-26T23:13:04.095976+0000","last_clean":"2024-04-26T23:13:04.095976+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:04.095976+0000","last_undegraded":"2024-04-26T23:13:04.095976+0000","last_fullsized":"2024-04-26T23:13:04.095976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.992440+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:13:03.992440+0000","last_peered":"2024-04-26T23:13:03.992440+0000","last_clean":"2024-04-26T23:13:03.992440+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:03.992440+0000","last_undegraded":"2024-04-26T23:13:03.992440+0000","last_fullsized":"2024-04-26T23:13:03.992440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255579+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:13:03.255579+0000","last_peered":"2024-04-26T23:13:03.255579+0000","last_clean":"2024-04-26T23:13:03.255579+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:03.255579+0000","last_undegraded":"2024-04-26T23:13:03.255579+0000","last_fullsized":"2024-04-26T23:13:03.255579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:10:38.964109+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:10:38.964109+0000","last_peered":"2024-04-26T23:10:38.964109+0000","last_clean":"2024-04-26T23:10:38.964109+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:10:38.964109+0000","last_undegraded":"2024-04-26T23:10:38.964109+0000","last_fullsized":"2024-04-26T23:10:38.964109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.089012+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:13:04.089012+0000","last_peered":"2024-04-26T23:13:04.089012+0000","last_clean":"2024-04-26T23:13:04.089012+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:04.089012+0000","last_undegraded":"2024-04-26T23:13:04.089012+0000","last_fullsized":"2024-04-26T23:13:04.089012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'203","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.151687+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:13:01.151687+0000","last_peered":"2024-04-26T23:13:01.151687+0000","last_clean":"2024-04-26T23:13:01.151687+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:01.151687+0000","last_undegraded":"2024-04-26T23:13:01.151687+0000","last_fullsized":"2024-04-26T23:13:01.151687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'67","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.253000+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:13:01.253000+0000","last_peered":"2024-04-26T23:13:01.253000+0000","last_clean":"2024-04-26T23:13:01.253000+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:01.253000+0000","last_undegraded":"2024-04-26T23:13:01.253000+0000","last_fullsized":"2024-04-26T23:13:01.253000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082677+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:13:04.082677+0000","last_peered":"2024-04-26T23:13:04.082677+0000","last_clean":"2024-04-26T23:13:04.082677+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:04.082677+0000","last_undegraded":"2024-04-26T23:13:04.082677+0000","last_fullsized":"2024-04-26T23:13:04.082677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'218","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.065785+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:13:04.065785+0000","last_peered":"2024-04-26T23:13:04.065785+0000","last_clean":"2024-04-26T23:13:04.065785+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:04.065785+0000","last_undegraded":"2024-04-26T23:13:04.065785+0000","last_fullsized":"2024-04-26T23:13:04.065785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'563","reported_seq":592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.143897+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:12:57.143897+0000","last_peered":"2024-04-26T23:12:57.143897+0000","last_clean":"2024-04-26T23:12:57.143897+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:12:57.143897+0000","last_undegraded":"2024-04-26T23:12:57.143897+0000","last_fullsized":"2024-04-26T23:12:57.143897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.250455+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:13:03.250455+0000","last_peered":"2024-04-26T23:13:03.250455+0000","last_clean":"2024-04-26T23:13:03.250455+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:03.250455+0000","last_undegraded":"2024-04-26T23:13:03.250455+0000","last_fullsized":"2024-04-26T23:13:03.250455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.001204+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:13:04.001204+0000","last_peered":"2024-04-26T23:13:04.001204+0000","last_clean":"2024-04-26T23:13:04.001204+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:04.001204+0000","last_undegraded":"2024-04-26T23:13:04.001204+0000","last_fullsized":"2024-04-26T23:13:04.001204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'297","reported_seq":325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:50.985566+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:12:50.985566+0000","last_peered":"2024-04-26T23:12:50.985566+0000","last_clean":"2024-04-26T23:12:50.985566+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:12:50.985566+0000","last_undegraded":"2024-04-26T23:12:50.985566+0000","last_fullsized":"2024-04-26T23:12:50.985566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106115+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:13:04.106115+0000","last_peered":"2024-04-26T23:13:04.106115+0000","last_clean":"2024-04-26T23:13:04.106115+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:04.106115+0000","last_undegraded":"2024-04-26T23:13:04.106115+0000","last_fullsized":"2024-04-26T23:13:04.106115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.195787+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:13:03.195787+0000","last_peered":"2024-04-26T23:13:03.195787+0000","last_clean":"2024-04-26T23:13:03.195787+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:03.195787+0000","last_undegraded":"2024-04-26T23:13:03.195787+0000","last_fullsized":"2024-04-26T23:13:03.195787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'168","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.153589+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:13:03.153589+0000","last_peered":"2024-04-26T23:13:03.153589+0000","last_clean":"2024-04-26T23:13:03.153589+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:03.153589+0000","last_undegraded":"2024-04-26T23:13:03.153589+0000","last_fullsized":"2024-04-26T23:13:03.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034681+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:13:04.034681+0000","last_peered":"2024-04-26T23:13:04.034681+0000","last_clean":"2024-04-26T23:13:04.034681+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:04.034681+0000","last_undegraded":"2024-04-26T23:13:04.034681+0000","last_fullsized":"2024-04-26T23:13:04.034681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'229","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074985+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:13:04.074985+0000","last_peered":"2024-04-26T23:13:04.074985+0000","last_clean":"2024-04-26T23:13:04.074985+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:04.074985+0000","last_undegraded":"2024-04-26T23:13:04.074985+0000","last_fullsized":"2024-04-26T23:13:04.074985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'366","reported_seq":394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.200579+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:13:01.200579+0000","last_peered":"2024-04-26T23:13:01.200579+0000","last_clean":"2024-04-26T23:13:01.200579+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:01.200579+0000","last_undegraded":"2024-04-26T23:13:01.200579+0000","last_fullsized":"2024-04-26T23:13:01.200579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.009350+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:13:04.009350+0000","last_peered":"2024-04-26T23:13:04.009350+0000","last_clean":"2024-04-26T23:13:04.009350+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:04.009350+0000","last_undegraded":"2024-04-26T23:13:04.009350+0000","last_fullsized":"2024-04-26T23:13:04.009350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.187252+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:13:03.187252+0000","last_peered":"2024-04-26T23:13:03.187252+0000","last_clean":"2024-04-26T23:13:03.187252+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:03.187252+0000","last_undegraded":"2024-04-26T23:13:03.187252+0000","last_fullsized":"2024-04-26T23:13:03.187252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.963043+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:12:51.963043+0000","last_peered":"2024-04-26T23:12:51.963043+0000","last_clean":"2024-04-26T23:12:51.963043+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:12:51.963043+0000","last_undegraded":"2024-04-26T23:12:51.963043+0000","last_fullsized":"2024-04-26T23:12:51.963043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.209932+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:13:03.209932+0000","last_peered":"2024-04-26T23:13:03.209932+0000","last_clean":"2024-04-26T23:13:03.209932+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:03.209932+0000","last_undegraded":"2024-04-26T23:13:03.209932+0000","last_fullsized":"2024-04-26T23:13:03.209932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'184","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.208283+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:13:03.208283+0000","last_peered":"2024-04-26T23:13:03.208283+0000","last_clean":"2024-04-26T23:13:03.208283+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:03.208283+0000","last_undegraded":"2024-04-26T23:13:03.208283+0000","last_fullsized":"2024-04-26T23:13:03.208283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'63","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.113749+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:13:04.113749+0000","last_peered":"2024-04-26T23:13:04.113749+0000","last_clean":"2024-04-26T23:13:04.113749+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:04.113749+0000","last_undegraded":"2024-04-26T23:13:04.113749+0000","last_fullsized":"2024-04-26T23:13:04.113749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.998275+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:13:03.998275+0000","last_peered":"2024-04-26T23:13:03.998275+0000","last_clean":"2024-04-26T23:13:03.998275+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:03.998275+0000","last_undegraded":"2024-04-26T23:13:03.998275+0000","last_fullsized":"2024-04-26T23:13:03.998275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.091837+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:13:04.091837+0000","last_peered":"2024-04-26T23:13:04.091837+0000","last_clean":"2024-04-26T23:13:04.091837+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:04.091837+0000","last_undegraded":"2024-04-26T23:13:04.091837+0000","last_fullsized":"2024-04-26T23:13:04.091837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'656","reported_seq":685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.989193+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:12:51.989193+0000","last_peered":"2024-04-26T23:12:51.989193+0000","last_clean":"2024-04-26T23:12:51.989193+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:12:51.989193+0000","last_undegraded":"2024-04-26T23:12:51.989193+0000","last_fullsized":"2024-04-26T23:12:51.989193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.068538+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:13:04.068538+0000","last_peered":"2024-04-26T23:13:04.068538+0000","last_clean":"2024-04-26T23:13:04.068538+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:04.068538+0000","last_undegraded":"2024-04-26T23:13:04.068538+0000","last_fullsized":"2024-04-26T23:13:04.068538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.031804+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:13:04.031804+0000","last_peered":"2024-04-26T23:13:04.031804+0000","last_clean":"2024-04-26T23:13:04.031804+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:04.031804+0000","last_undegraded":"2024-04-26T23:13:04.031804+0000","last_fullsized":"2024-04-26T23:13:04.031804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'356","reported_seq":385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.065249+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:12:57.065249+0000","last_peered":"2024-04-26T23:12:57.065249+0000","last_clean":"2024-04-26T23:12:57.065249+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:12:57.065249+0000","last_undegraded":"2024-04-26T23:12:57.065249+0000","last_fullsized":"2024-04-26T23:12:57.065249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082592+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:13:04.082592+0000","last_peered":"2024-04-26T23:13:04.082592+0000","last_clean":"2024-04-26T23:13:04.082592+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:04.082592+0000","last_undegraded":"2024-04-26T23:13:04.082592+0000","last_fullsized":"2024-04-26T23:13:04.082592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.196995+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:13:03.196995+0000","last_peered":"2024-04-26T23:13:03.196995+0000","last_clean":"2024-04-26T23:13:03.196995+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:03.196995+0000","last_undegraded":"2024-04-26T23:13:03.196995+0000","last_fullsized":"2024-04-26T23:13:03.196995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'334","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.988158+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:13:04.988158+0000","last_peered":"2024-04-26T23:13:04.988158+0000","last_clean":"2024-04-26T23:13:04.988158+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:04.988158+0000","last_undegraded":"2024-04-26T23:13:04.988158+0000","last_fullsized":"2024-04-26T23:13:04.988158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.038541+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:13:04.038541+0000","last_peered":"2024-04-26T23:13:04.038541+0000","last_clean":"2024-04-26T23:13:04.038541+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:04.038541+0000","last_undegraded":"2024-04-26T23:13:04.038541+0000","last_fullsized":"2024-04-26T23:13:04.038541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'182","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.194161+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:13:03.194161+0000","last_peered":"2024-04-26T23:13:03.194161+0000","last_clean":"2024-04-26T23:13:03.194161+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:03.194161+0000","last_undegraded":"2024-04-26T23:13:03.194161+0000","last_fullsized":"2024-04-26T23:13:03.194161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'106","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.104165+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:13:03.104165+0000","last_peered":"2024-04-26T23:13:03.104165+0000","last_clean":"2024-04-26T23:13:03.104165+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:03.104165+0000","last_undegraded":"2024-04-26T23:13:03.104165+0000","last_fullsized":"2024-04-26T23:13:03.104165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.060188+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:13:04.060188+0000","last_peered":"2024-04-26T23:13:04.060188+0000","last_clean":"2024-04-26T23:13:04.060188+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:04.060188+0000","last_undegraded":"2024-04-26T23:13:04.060188+0000","last_fullsized":"2024-04-26T23:13:04.060188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'206","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.116203+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:13:03.116203+0000","last_peered":"2024-04-26T23:13:03.116203+0000","last_clean":"2024-04-26T23:13:03.116203+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:03.116203+0000","last_undegraded":"2024-04-26T23:13:03.116203+0000","last_fullsized":"2024-04-26T23:13:03.116203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.102867+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:12:57.102867+0000","last_peered":"2024-04-26T23:12:57.102867+0000","last_clean":"2024-04-26T23:12:57.102867+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:12:57.102867+0000","last_undegraded":"2024-04-26T23:12:57.102867+0000","last_fullsized":"2024-04-26T23:12:57.102867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074896+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:13:04.074896+0000","last_peered":"2024-04-26T23:13:04.074896+0000","last_clean":"2024-04-26T23:13:04.074896+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:04.074896+0000","last_undegraded":"2024-04-26T23:13:04.074896+0000","last_fullsized":"2024-04-26T23:13:04.074896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.041470+0000","last_change":"2024-04-26T23:05:29.212676+0000","last_active":"2024-04-26T23:13:04.041470+0000","last_peered":"2024-04-26T23:13:04.041470+0000","last_clean":"2024-04-26T23:13:04.041470+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:04.041470+0000","last_undegraded":"2024-04-26T23:13:04.041470+0000","last_fullsized":"2024-04-26T23:13:04.041470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:47.644852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'208","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013473+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:13:04.013473+0000","last_peered":"2024-04-26T23:13:04.013473+0000","last_clean":"2024-04-26T23:13:04.013473+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:04.013473+0000","last_undegraded":"2024-04-26T23:13:04.013473+0000","last_fullsized":"2024-04-26T23:13:04.013473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'834","reported_seq":862,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.056585+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:12:57.056585+0000","last_peered":"2024-04-26T23:12:57.056585+0000","last_clean":"2024-04-26T23:12:57.056585+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:12:57.056585+0000","last_undegraded":"2024-04-26T23:12:57.056585+0000","last_fullsized":"2024-04-26T23:12:57.056585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.263878+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:13:03.263878+0000","last_peered":"2024-04-26T23:13:03.263878+0000","last_clean":"2024-04-26T23:13:03.263878+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:03.263878+0000","last_undegraded":"2024-04-26T23:13:03.263878+0000","last_fullsized":"2024-04-26T23:13:03.263878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'210","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.131862+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:13:03.131862+0000","last_peered":"2024-04-26T23:13:03.131862+0000","last_clean":"2024-04-26T23:13:03.131862+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:03.131862+0000","last_undegraded":"2024-04-26T23:13:03.131862+0000","last_fullsized":"2024-04-26T23:13:03.131862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'78","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.115707+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:12:57.115707+0000","last_peered":"2024-04-26T23:12:57.115707+0000","last_clean":"2024-04-26T23:12:57.115707+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:12:57.115707+0000","last_undegraded":"2024-04-26T23:12:57.115707+0000","last_fullsized":"2024-04-26T23:12:57.115707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.090911+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:12:54.090911+0000","last_peered":"2024-04-26T23:12:54.090911+0000","last_clean":"2024-04-26T23:12:54.090911+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:12:54.090911+0000","last_undegraded":"2024-04-26T23:12:54.090911+0000","last_fullsized":"2024-04-26T23:12:54.090911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'176","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.217035+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:13:03.217035+0000","last_peered":"2024-04-26T23:13:03.217035+0000","last_clean":"2024-04-26T23:13:03.217035+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:03.217035+0000","last_undegraded":"2024-04-26T23:13:03.217035+0000","last_fullsized":"2024-04-26T23:13:03.217035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.045723+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:13:04.045723+0000","last_peered":"2024-04-26T23:13:04.045723+0000","last_clean":"2024-04-26T23:13:04.045723+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:04.045723+0000","last_undegraded":"2024-04-26T23:13:04.045723+0000","last_fullsized":"2024-04-26T23:13:04.045723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'73","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:52.063000+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:12:52.063000+0000","last_peered":"2024-04-26T23:12:52.063000+0000","last_clean":"2024-04-26T23:12:52.063000+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:12:52.063000+0000","last_undegraded":"2024-04-26T23:12:52.063000+0000","last_fullsized":"2024-04-26T23:12:52.063000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.248546+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:13:03.248546+0000","last_peered":"2024-04-26T23:13:03.248546+0000","last_clean":"2024-04-26T23:13:03.248546+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:03.248546+0000","last_undegraded":"2024-04-26T23:13:03.248546+0000","last_fullsized":"2024-04-26T23:13:03.248546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.274282+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:13:03.274282+0000","last_peered":"2024-04-26T23:13:03.274282+0000","last_clean":"2024-04-26T23:13:03.274282+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:03.274282+0000","last_undegraded":"2024-04-26T23:13:03.274282+0000","last_fullsized":"2024-04-26T23:13:03.274282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'215","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.069454+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:13:04.069454+0000","last_peered":"2024-04-26T23:13:04.069454+0000","last_clean":"2024-04-26T23:13:04.069454+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:04.069454+0000","last_undegraded":"2024-04-26T23:13:04.069454+0000","last_fullsized":"2024-04-26T23:13:04.069454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991598+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:13:03.991598+0000","last_peered":"2024-04-26T23:13:03.991598+0000","last_clean":"2024-04-26T23:13:03.991598+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:03.991598+0000","last_undegraded":"2024-04-26T23:13:03.991598+0000","last_fullsized":"2024-04-26T23:13:03.991598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067391+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:13:04.067391+0000","last_peered":"2024-04-26T23:13:04.067391+0000","last_clean":"2024-04-26T23:13:04.067391+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:04.067391+0000","last_undegraded":"2024-04-26T23:13:04.067391+0000","last_fullsized":"2024-04-26T23:13:04.067391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'197","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044137+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:13:04.044137+0000","last_peered":"2024-04-26T23:13:04.044137+0000","last_clean":"2024-04-26T23:13:04.044137+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:04.044137+0000","last_undegraded":"2024-04-26T23:13:04.044137+0000","last_fullsized":"2024-04-26T23:13:04.044137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'188","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106791+0000","last_change":"2024-04-26T23:05:29.866675+0000","last_active":"2024-04-26T23:13:04.106791+0000","last_peered":"2024-04-26T23:13:04.106791+0000","last_clean":"2024-04-26T23:13:04.106791+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:04.106791+0000","last_undegraded":"2024-04-26T23:13:04.106791+0000","last_fullsized":"2024-04-26T23:13:04.106791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.339856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'195","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113993+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:13:03.113993+0000","last_peered":"2024-04-26T23:13:03.113993+0000","last_clean":"2024-04-26T23:13:03.113993+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:03.113993+0000","last_undegraded":"2024-04-26T23:13:03.113993+0000","last_fullsized":"2024-04-26T23:13:03.113993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'225","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.154286+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:13:03.154286+0000","last_peered":"2024-04-26T23:13:03.154286+0000","last_clean":"2024-04-26T23:13:03.154286+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:03.154286+0000","last_undegraded":"2024-04-26T23:13:03.154286+0000","last_fullsized":"2024-04-26T23:13:03.154286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.993050+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:13:03.993050+0000","last_peered":"2024-04-26T23:13:03.993050+0000","last_clean":"2024-04-26T23:13:03.993050+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:03.993050+0000","last_undegraded":"2024-04-26T23:13:03.993050+0000","last_fullsized":"2024-04-26T23:13:03.993050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.107190+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:13:04.107190+0000","last_peered":"2024-04-26T23:13:04.107190+0000","last_clean":"2024-04-26T23:13:04.107190+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:04.107190+0000","last_undegraded":"2024-04-26T23:13:04.107190+0000","last_fullsized":"2024-04-26T23:13:04.107190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.232291+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:13:03.232291+0000","last_peered":"2024-04-26T23:13:03.232291+0000","last_clean":"2024-04-26T23:13:03.232291+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:03.232291+0000","last_undegraded":"2024-04-26T23:13:03.232291+0000","last_fullsized":"2024-04-26T23:13:03.232291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'203","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.089904+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:13:03.089904+0000","last_peered":"2024-04-26T23:13:03.089904+0000","last_clean":"2024-04-26T23:13:03.089904+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:03.089904+0000","last_undegraded":"2024-04-26T23:13:03.089904+0000","last_fullsized":"2024-04-26T23:13:03.089904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'192","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.244803+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:13:03.244803+0000","last_peered":"2024-04-26T23:13:03.244803+0000","last_clean":"2024-04-26T23:13:03.244803+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:03.244803+0000","last_undegraded":"2024-04-26T23:13:03.244803+0000","last_fullsized":"2024-04-26T23:13:03.244803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'211","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.197658+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:13:01.197658+0000","last_peered":"2024-04-26T23:13:01.197658+0000","last_clean":"2024-04-26T23:13:01.197658+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:01.197658+0000","last_undegraded":"2024-04-26T23:13:01.197658+0000","last_fullsized":"2024-04-26T23:13:01.197658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255089+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:13:03.255089+0000","last_peered":"2024-04-26T23:13:03.255089+0000","last_clean":"2024-04-26T23:13:03.255089+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:03.255089+0000","last_undegraded":"2024-04-26T23:13:03.255089+0000","last_fullsized":"2024-04-26T23:13:03.255089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'197","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.087851+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:13:04.087851+0000","last_peered":"2024-04-26T23:13:04.087851+0000","last_clean":"2024-04-26T23:13:04.087851+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:04.087851+0000","last_undegraded":"2024-04-26T23:13:04.087851+0000","last_fullsized":"2024-04-26T23:13:04.087851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'200","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018127+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:13:04.018127+0000","last_peered":"2024-04-26T23:13:04.018127+0000","last_clean":"2024-04-26T23:13:04.018127+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:04.018127+0000","last_undegraded":"2024-04-26T23:13:04.018127+0000","last_fullsized":"2024-04-26T23:13:04.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.046234+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:13:04.046234+0000","last_peered":"2024-04-26T23:13:04.046234+0000","last_clean":"2024-04-26T23:13:04.046234+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:04.046234+0000","last_undegraded":"2024-04-26T23:13:04.046234+0000","last_fullsized":"2024-04-26T23:13:04.046234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'209","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.171578+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:13:01.171578+0000","last_peered":"2024-04-26T23:13:01.171578+0000","last_clean":"2024-04-26T23:13:01.171578+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:01.171578+0000","last_undegraded":"2024-04-26T23:13:01.171578+0000","last_fullsized":"2024-04-26T23:13:01.171578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'206","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.240112+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:13:03.240112+0000","last_peered":"2024-04-26T23:13:03.240112+0000","last_clean":"2024-04-26T23:13:03.240112+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:03.240112+0000","last_undegraded":"2024-04-26T23:13:03.240112+0000","last_fullsized":"2024-04-26T23:13:03.240112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'194","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.113318+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:13:03.113318+0000","last_peered":"2024-04-26T23:13:03.113318+0000","last_clean":"2024-04-26T23:13:03.113318+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:03.113318+0000","last_undegraded":"2024-04-26T23:13:03.113318+0000","last_fullsized":"2024-04-26T23:13:03.113318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'175","reported_seq":202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.991944+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:13:03.991944+0000","last_peered":"2024-04-26T23:13:03.991944+0000","last_clean":"2024-04-26T23:13:03.991944+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:03.991944+0000","last_undegraded":"2024-04-26T23:13:03.991944+0000","last_fullsized":"2024-04-26T23:13:03.991944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'180","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.874959+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:13:03.874959+0000","last_peered":"2024-04-26T23:13:03.874959+0000","last_clean":"2024-04-26T23:13:03.874959+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:03.874959+0000","last_undegraded":"2024-04-26T23:13:03.874959+0000","last_fullsized":"2024-04-26T23:13:03.874959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.259873+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:13:03.259873+0000","last_peered":"2024-04-26T23:13:03.259873+0000","last_clean":"2024-04-26T23:13:03.259873+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:03.259873+0000","last_undegraded":"2024-04-26T23:13:03.259873+0000","last_fullsized":"2024-04-26T23:13:03.259873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.205157+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:13:03.205157+0000","last_peered":"2024-04-26T23:13:03.205157+0000","last_clean":"2024-04-26T23:13:03.205157+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:03.205157+0000","last_undegraded":"2024-04-26T23:13:03.205157+0000","last_fullsized":"2024-04-26T23:13:03.205157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054939+0000","last_change":"2024-04-26T23:05:29.413874+0000","last_active":"2024-04-26T23:13:04.054939+0000","last_peered":"2024-04-26T23:13:04.054939+0000","last_clean":"2024-04-26T23:13:04.054939+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:04.054939+0000","last_undegraded":"2024-04-26T23:13:04.054939+0000","last_fullsized":"2024-04-26T23:13:04.054939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:56.983137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'207","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.157614+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:13:03.157614+0000","last_peered":"2024-04-26T23:13:03.157614+0000","last_clean":"2024-04-26T23:13:03.157614+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:03.157614+0000","last_undegraded":"2024-04-26T23:13:03.157614+0000","last_fullsized":"2024-04-26T23:13:03.157614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'185","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.013347+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:13:04.013347+0000","last_peered":"2024-04-26T23:13:04.013347+0000","last_clean":"2024-04-26T23:13:04.013347+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:04.013347+0000","last_undegraded":"2024-04-26T23:13:04.013347+0000","last_fullsized":"2024-04-26T23:13:04.013347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.221659+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:13:03.221659+0000","last_peered":"2024-04-26T23:13:03.221659+0000","last_clean":"2024-04-26T23:13:03.221659+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:03.221659+0000","last_undegraded":"2024-04-26T23:13:03.221659+0000","last_fullsized":"2024-04-26T23:13:03.221659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.043108+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:13:04.043108+0000","last_peered":"2024-04-26T23:13:04.043108+0000","last_clean":"2024-04-26T23:13:04.043108+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:04.043108+0000","last_undegraded":"2024-04-26T23:13:04.043108+0000","last_fullsized":"2024-04-26T23:13:04.043108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'183","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.149593+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:13:03.149593+0000","last_peered":"2024-04-26T23:13:03.149593+0000","last_clean":"2024-04-26T23:13:03.149593+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:03.149593+0000","last_undegraded":"2024-04-26T23:13:03.149593+0000","last_fullsized":"2024-04-26T23:13:03.149593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.239348+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:13:03.239348+0000","last_peered":"2024-04-26T23:13:03.239348+0000","last_clean":"2024-04-26T23:13:03.239348+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:03.239348+0000","last_undegraded":"2024-04-26T23:13:03.239348+0000","last_fullsized":"2024-04-26T23:13:03.239348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'199","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252333+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:13:03.252333+0000","last_peered":"2024-04-26T23:13:03.252333+0000","last_clean":"2024-04-26T23:13:03.252333+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:03.252333+0000","last_undegraded":"2024-04-26T23:13:03.252333+0000","last_fullsized":"2024-04-26T23:13:03.252333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12703,"ondisk_log_size":12703,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146759901,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6967,"num_write_kb":149051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293519802,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8240,"ondisk_log_size":8240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53625849,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452197,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40337844,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921128,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:13:17.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:13:17.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.392+0000 7f9ad1600640 1 Processor -- start 2024-04-26T23:13:17.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.392+0000 7f9ad1600640 1 -- start start 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ad1600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9acc152bc0 0x7f9acc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ad1600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9acc0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ad1600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9acc152fa0 con 0x7f9acc0c9340 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ad1600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9acc159790 con 0x7f9acc152bc0 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ad1600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc158930 con 0x7f9acc073480 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9aca000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9acc0c9340 0x7f9acc072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54504/0 (socket says 172.21.15.148:54504) 2024-04-26T23:13:17.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9aca000640 1 -- 172.21.15.148:0/2090981432 learned_addr learned my addr 172.21.15.148:0/2090981432 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9acc0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acaa00640 1 --2- 172.21.15.148:0/2090981432 >> v2:172.21.15.157:3300/0 conn(0x7f9acc152bc0 0x7f9acc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321497242 0 0) 0x7f9acc152fa0 con 0x7f9acc0c9340 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab0003530 con 0x7f9acc0c9340 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374956303 0 0) 0x7f9ab0003530 con 0x7f9acc0c9340 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 msgr2=0x7f9acc0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9acc0c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 >> v2:172.21.15.157:3300/0 conn(0x7f9acc152bc0 msgr2=0x7f9acc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 --2- 172.21.15.148:0/2090981432 >> v2:172.21.15.157:3300/0 conn(0x7f9acc152bc0 0x7f9acc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc158c10 con 0x7f9acc0c9340 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f9ab8001680 con 0x7f9acc0c9340 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 >> v1:172.21.15.148:6789/0 conn(0x7f9acc0c9340 legacy=0x7f9acc072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9ab00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab0003f40 0x7f9ab0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab0004d50 0x7f9ab00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc159790 con 0x7f9ab0004d50 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc158930 con 0x7f9ab0003f40 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab000ba00 con 0x7f9acc073480 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab0004d50 0x7f9ab00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9aca000640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab0003f40 0x7f9ab0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acaa00640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9ab00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 -- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 msgr2=0x7f9ab00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc073480 0x7f9ab00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 -- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab0003f40 msgr2=0x7f9ab0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab0003f40 0x7f9ab0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9acb400640 1 -- 172.21.15.148:0/2090981432 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0003530 con 0x7f9ab0004d50 2024-04-26T23:13:17.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.396+0000 7f9aca000640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab0003f40 0x7f9ab0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9acb400640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab0004d50 0x7f9ab00051d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009ae0 tx=0x7f9ac401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12f90df6ee5b694 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40b2070 con 0x7f9ab0004d50 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac40a5660 con 0x7f9ab0004d50 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ac9600640 1 -- 172.21.15.148:0/2090981432 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40096b0 con 0x7f9ab0004d50 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- 172.21.15.148:0/2090981432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab0004d50 msgr2=0x7f9ab00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 --2- 172.21.15.148:0/2090981432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab0004d50 0x7f9ab00051d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009ae0 tx=0x7f9ac401ca70 comp rx=0 tx=0).stop 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9acb400640 1 -- 172.21.15.148:0/2090981432 reap_dead start 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- 172.21.15.148:0/2090981432 shutdown_connections 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- 172.21.15.148:0/2090981432 >> 172.21.15.148:0/2090981432 conn(0x7f9acc06c380 msgr2=0x7f9acc06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- 172.21.15.148:0/2090981432 shutdown_connections 2024-04-26T23:13:17.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- 172.21.15.148:0/2090981432 wait complete. 2024-04-26T23:13:17.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 Processor -- start 2024-04-26T23:13:17.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.400+0000 7f9ad1600640 1 -- start start 2024-04-26T23:13:17.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc15ca00 0x7f9acc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 0x7f9acc15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc1594b0 con 0x7f9acc147c30 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc1591d0 con 0x7f9acc148010 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc0c47d0 con 0x7f9acc15ca00 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44466/0 (socket says 172.21.15.148:44466) 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 -- 172.21.15.148:0/732194655 learned_addr learned my addr 172.21.15.148:0/732194655 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acb400640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 0x7f9acc15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9aca000640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc15ca00 0x7f9acc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 -- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc15ca00 msgr2=0x7f9acc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc15ca00 0x7f9acc15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 -- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 msgr2=0x7f9acc15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 0x7f9acc15a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 -- 172.21.15.148:0/732194655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc1486c0 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acb400640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 0x7f9acc15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9acaa00640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007f30 tx=0x7f9abc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc01a020 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc016470 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc016860 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc1f2040 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1f25e0 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc077c20 con 0x7f9acc147c30 2024-04-26T23:13:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.404+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9abc01d020 con 0x7f9acc147c30 2024-04-26T23:13:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.408+0000 7f9ac2a00640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 0x7f9aac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.408+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9abc087e50 con 0x7f9acc147c30 2024-04-26T23:13:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.408+0000 7f9aca000640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 0x7f9aac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.408+0000 7f9aca000640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 0x7f9aac06a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9acc15ce00 tx=0x7f9ab8005d50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.412+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9abc024030 con 0x7f9acc147c30 2024-04-26T23:13:17.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.568+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9acc0c5d80 con 0x7f9acc147c30 2024-04-26T23:13:17.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.568+0000 7f9ac2a00640 1 -- 172.21.15.148:0/732194655 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18925 (secure 0 0 0) 0x7f9abc057f70 con 0x7f9acc147c30 2024-04-26T23:13:17.569 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:17.569 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:05:29.036622+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 msgr2=0x7f9aac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 0x7f9aac06a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9acc15ce00 tx=0x7f9ab8005d50 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 msgr2=0x7f9acc15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007f30 tx=0x7f9abc011660 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 shutdown_connections 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aac068380 0x7f9aac06a840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9acc148010 0x7f9acc15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9acc15ca00 0x7f9acc15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 --2- 172.21.15.148:0/732194655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc147c30 0x7f9acc15c4c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:17.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 >> 172.21.15.148:0/732194655 conn(0x7f9acc06c380 msgr2=0x7f9acc0c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:17.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 shutdown_connections 2024-04-26T23:13:17.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:17.572+0000 7f9ad1600640 1 -- 172.21.15.148:0/732194655 wait complete. 2024-04-26T23:13:18.590 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T23:13:18.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:18.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.740+0000 7f475ae00640 1 Processor -- start 2024-04-26T23:13:18.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.740+0000 7f475ae00640 1 -- start start 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4754156010 0x7f47540cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f47540cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f475415bf70 0x7f475415c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f475415f270 con 0x7f4754156010 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f475415c960 con 0x7f475415bf70 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f475ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f475415f4c0 con 0x7f47540cd4d0 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4754156010 0x7f47540cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4754156010 0x7f47540cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44480/0 (socket says 172.21.15.148:44480) 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 -- 172.21.15.148:0/1093693327 learned_addr learned my addr 172.21.15.148:0/1093693327 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f474b400640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f47540cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4758e00640 1 --2- 172.21.15.148:0/1093693327 >> v2:172.21.15.157:3300/0 conn(0x7f475415bf70 0x7f475415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 -- 172.21.15.148:0/1093693327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 msgr2=0x7f47540cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:18.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f47540cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 -- 172.21.15.148:0/1093693327 >> v2:172.21.15.157:3300/0 conn(0x7f475415bf70 msgr2=0x7f475415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:18.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 --2- 172.21.15.148:0/1093693327 >> v2:172.21.15.157:3300/0 conn(0x7f475415bf70 0x7f475415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.744+0000 7f4753e00640 1 -- 172.21.15.148:0/1093693327 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475415f7a0 con 0x7f4754156010 2024-04-26T23:13:18.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f4753e00640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4754156010 0x7f47540cc400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f475406e880 tx=0x7f474401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f347d91e177e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f4753400640 1 -- 172.21.15.148:0/1093693327 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47440a5840 con 0x7f4754156010 2024-04-26T23:13:18.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f4753400640 1 -- 172.21.15.148:0/1093693327 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47440a59e0 con 0x7f4754156010 2024-04-26T23:13:18.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f4753400640 1 -- 172.21.15.148:0/1093693327 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47440a5db0 con 0x7f4754156010 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- 172.21.15.148:0/1093693327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4754156010 msgr2=0x7f47540cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4754156010 0x7f47540cc400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f475406e880 tx=0x7f474401c9c0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- 172.21.15.148:0/1093693327 shutdown_connections 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 --2- 172.21.15.148:0/1093693327 >> v2:172.21.15.157:3300/0 conn(0x7f475415bf70 0x7f475415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f47540cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 --2- 172.21.15.148:0/1093693327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4754156010 0x7f47540cc400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- 172.21.15.148:0/1093693327 >> 172.21.15.148:0/1093693327 conn(0x7f475406c380 msgr2=0x7f475406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- 172.21.15.148:0/1093693327 shutdown_connections 2024-04-26T23:13:18.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- 172.21.15.148:0/1093693327 wait complete. 2024-04-26T23:13:18.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 Processor -- start 2024-04-26T23:13:18.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.748+0000 7f475ae00640 1 -- start start 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f475415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4754156010 0x7f47541f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 0x7f47540cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47540ca9b0 con 0x7f475415bf70 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f47541563f0 con 0x7f4754156010 2024-04-26T23:13:18.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f47540cab30 con 0x7f47540cd4d0 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 0x7f47540cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 0x7f47540cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44484/0 (socket says 172.21.15.148:44484) 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 -- 172.21.15.148:0/1997041543 learned_addr learned my addr 172.21.15.148:0/1997041543 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4753e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f475415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f474b400640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4754156010 0x7f47541f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 -- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 msgr2=0x7f475415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f47540cd4d0 0x7f475415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 -- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4754156010 msgr2=0x7f47541f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4754156010 0x7f47541f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47540c6f50 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f474b400640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4754156010 0x7f47541f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4758e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 0x7f47540cc660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f474c00d4e0 tx=0x7f474c00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c0125f0 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c019070 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c0129f0 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4754156710 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47541f7e30 con 0x7f475415bf70 2024-04-26T23:13:18.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4754077c20 con 0x7f475415bf70 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.752+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f474c012b90 con 0x7f475415bf70 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f47300683b0 0x7f473006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f474c087070 con 0x7f475415bf70 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7f4730071dd0 0x7f4730074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4730074940 con 0x7f4730071dd0 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f474c08e050 con 0x7f475415bf70 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4753e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f47300683b0 0x7f473006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f474b400640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7f4730071dd0 0x7f4730074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f474b400640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7f4730071dd0 0x7f4730074270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4753e00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f47300683b0 0x7f473006a870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47440ae000 tx=0x7f47440a7070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.756+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== osd.0 v2:172.21.15.148:6808/2413441377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4730074940 con 0x7f4730071dd0 2024-04-26T23:13:18.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 --> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f47540cc1e0 con 0x7f4730071dd0 2024-04-26T23:13:18.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f4750c00640 1 -- 172.21.15.148:0/1997041543 <== osd.0 v2:172.21.15.148:6808/2413441377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f47540cc1e0 con 0x7f4730071dd0 2024-04-26T23:13:18.768 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:18.769 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:18.769 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7f4730071dd0 msgr2=0x7f4730074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:6808/2413441377,v1:172.21.15.148:6809/2413441377] conn(0x7f4730071dd0 0x7f4730074270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f47300683b0 msgr2=0x7f473006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f47300683b0 0x7f473006a870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47440ae000 tx=0x7f47440a7070 comp rx=0 tx=0).stop 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 msgr2=0x7f47540cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.768+0000 7f475ae00640 1 --2- 172.21.15.148:0/1997041543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f475415bf70 0x7f47540cc660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f474c00d4e0 tx=0x7f474c00d9a0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.772+0000 7f4758e00640 1 -- 172.21.15.148:0/1997041543 reap_dead start 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.772+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 shutdown_connections 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.772+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 >> 172.21.15.148:0/1997041543 conn(0x7f475406c380 msgr2=0x7f47541544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.772+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 shutdown_connections 2024-04-26T23:13:18.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.772+0000 7f475ae00640 1 -- 172.21.15.148:0/1997041543 wait complete. 2024-04-26T23:13:18.788 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T23:13:18.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.924+0000 7fbcefe00640 1 Processor -- start 2024-04-26T23:13:18.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.924+0000 7fbcefe00640 1 -- start start 2024-04-26T23:13:18.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbcefe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbcf0071630 0x7fbcf015f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbcefe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf00cb520 con 0x7fbcf00cbae0 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbcefe00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf0071260 con 0x7fbcf0071630 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbcefe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf00ca910 con 0x7fbcf01592b0 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbce6000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbcf0071630 0x7fbcf015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52016/0 (socket says 172.21.15.148:52016) 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 -- 172.21.15.148:0/2985254354 learned_addr learned my addr 172.21.15.148:0/2985254354 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 -- 172.21.15.148:0/2985254354 >> v2:172.21.15.157:3300/0 conn(0x7fbcf0071630 msgr2=0x7fbcf015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:18.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 --2- 172.21.15.148:0/2985254354 >> v2:172.21.15.157:3300/0 conn(0x7fbcf0071630 0x7fbcf015f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 -- 172.21.15.148:0/2985254354 >> v1:172.21.15.157:6789/0 conn(0x7fbcf00cbae0 legacy=0x7fbcf00cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.928+0000 7fbceea00640 1 -- 172.21.15.148:0/2985254354 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00cb800 con 0x7fbcf01592b0 2024-04-26T23:13:18.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbceea00640 1 --2- 172.21.15.148:0/2985254354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009870 tx=0x7fbce001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a63e98c0164e5a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcee000640 1 -- 172.21.15.148:0/2985254354 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b2070 con 0x7fbcf01592b0 2024-04-26T23:13:18.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcee000640 1 -- 172.21.15.148:0/2985254354 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce00a9070 con 0x7fbcf01592b0 2024-04-26T23:13:18.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcee000640 1 -- 172.21.15.148:0/2985254354 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00ad880 con 0x7fbcf01592b0 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- 172.21.15.148:0/2985254354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 msgr2=0x7fbcf0070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 --2- 172.21.15.148:0/2985254354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009870 tx=0x7fbce001c560 comp rx=0 tx=0).stop 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- 172.21.15.148:0/2985254354 shutdown_connections 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 --2- 172.21.15.148:0/2985254354 >> v2:172.21.15.157:3300/0 conn(0x7fbcf0071630 0x7fbcf015f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 --2- 172.21.15.148:0/2985254354 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf0070b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- 172.21.15.148:0/2985254354 >> 172.21.15.148:0/2985254354 conn(0x7fbcf006c980 msgr2=0x7fbcf0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:18.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- 172.21.15.148:0/2985254354 shutdown_connections 2024-04-26T23:13:18.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- 172.21.15.148:0/2985254354 wait complete. 2024-04-26T23:13:18.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 Processor -- start 2024-04-26T23:13:18.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.932+0000 7fbcefe00640 1 -- start start 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf00cbae0 0x7fbcf00c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf006f460 con 0x7fbcf0071630 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf006f2e0 con 0x7fbcf00cbae0 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf015f7d0 con 0x7fbcf01592b0 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44498/0 (socket says 172.21.15.148:44498) 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 -- 172.21.15.148:0/928233832 learned_addr learned my addr 172.21.15.148:0/928233832 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:18.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcef400640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbce6000640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf00cbae0 0x7fbcf00c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 -- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 msgr2=0x7fbcf00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf00c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 -- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf00cbae0 msgr2=0x7fbcf00c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf00cbae0 0x7fbcf00c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 -- 172.21.15.148:0/928233832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00c6900 con 0x7fbcf0071630 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbceea00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbce001ac10 tx=0x7fbce0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00bc020 con 0x7fbcf0071630 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce00aed90 con 0x7fbcf0071630 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf00c6be0 con 0x7fbcf0071630 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b2040 con 0x7fbcf0071630 2024-04-26T23:13:18.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf00c71a0 con 0x7fbcf0071630 2024-04-26T23:13:18.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf00c6690 con 0x7fbcf0071630 2024-04-26T23:13:18.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.936+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbce00bf020 con 0x7fbcf0071630 2024-04-26T23:13:18.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.940+0000 7fbce7400640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 0x7fbccc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:18.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.940+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbce0120bb0 con 0x7fbcf0071630 2024-04-26T23:13:18.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.940+0000 7fbce6000640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 0x7fbccc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:18.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.940+0000 7fbce6000640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 0x7fbccc06a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0153710 tx=0x7fbcd800b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:18.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:18.944+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbce0016150 con 0x7fbcf0071630 2024-04-26T23:13:19.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.100+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbcf00506d0 con 0x7fbccc068380 2024-04-26T23:13:19.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.100+0000 7fbce7400640 1 -- 172.21.15.148:0/928233832 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbcf00506d0 con 0x7fbccc068380 2024-04-26T23:13:19.100 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 msgr2=0x7fbccc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 0x7fbccc06a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0153710 tx=0x7fbcd800b040 comp rx=0 tx=0).stop 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 msgr2=0x7fbcf0152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbce001ac10 tx=0x7fbce0019300 comp rx=0 tx=0).stop 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 shutdown_connections 2024-04-26T23:13:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fbccc068380 0x7fbccc06a840 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcf01592b0 0x7fbcf00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcf00cbae0 0x7fbcf00c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 --2- 172.21.15.148:0/928233832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcf0071630 0x7fbcf0152e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 >> 172.21.15.148:0/928233832 conn(0x7fbcf006c980 msgr2=0x7fbcf00c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 shutdown_connections 2024-04-26T23:13:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.104+0000 7fbcefe00640 1 -- 172.21.15.148:0/928233832 wait complete. 2024-04-26T23:13:19.122 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T23:13:19.122 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:19.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.264+0000 7fc585800640 1 Processor -- start 2024-04-26T23:13:19.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.264+0000 7fc585800640 1 -- start start 2024-04-26T23:13:19.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc585800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc5800c9470 0x7fc5800c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc585800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58015a820 con 0x7fc5801541d0 2024-04-26T23:13:19.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc585800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5800c7c90 con 0x7fc580153df0 2024-04-26T23:13:19.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc585800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7fc5800c98c0 con 0x7fc5800c9470 2024-04-26T23:13:19.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc57f400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc5800c9470 0x7fc5800c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc576000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc5801541d0 0x7fc5800c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54508/0 (socket says 172.21.15.148:54508) 2024-04-26T23:13:19.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc576000640 1 -- 172.21.15.148:0/3777029249 learned_addr learned my addr 172.21.15.148:0/3777029249 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:19.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc57f400640 1 -- 172.21.15.148:0/3777029249 >> v1:172.21.15.157:6789/0 conn(0x7fc580153df0 legacy=0x7fc5800c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:19.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc57f400640 1 -- 172.21.15.148:0/3777029249 >> v1:172.21.15.148:6789/0 conn(0x7fc5801541d0 legacy=0x7fc5800c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.268+0000 7fc57f400640 1 -- 172.21.15.148:0/3777029249 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58015aac0 con 0x7fc5800c9470 2024-04-26T23:13:19.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc57f400640 1 --2- 172.21.15.148:0/3777029249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5800c9470 0x7fc5800c5830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc578009d90 tx=0x7fc57801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2017956f5849a34d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc57e000640 1 -- 172.21.15.148:0/3777029249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b2070 con 0x7fc5800c9470 2024-04-26T23:13:19.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc57e000640 1 -- 172.21.15.148:0/3777029249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780a5980 con 0x7fc5800c9470 2024-04-26T23:13:19.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc57e000640 1 -- 172.21.15.148:0/3777029249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a5d50 con 0x7fc5800c9470 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- 172.21.15.148:0/3777029249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5800c9470 msgr2=0x7fc5800c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 --2- 172.21.15.148:0/3777029249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5800c9470 0x7fc5800c5830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc578009d90 tx=0x7fc57801c8a0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- 172.21.15.148:0/3777029249 shutdown_connections 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 --2- 172.21.15.148:0/3777029249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5800c9470 0x7fc5800c5830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- 172.21.15.148:0/3777029249 >> 172.21.15.148:0/3777029249 conn(0x7fc5800c9d10 msgr2=0x7fc5800ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- 172.21.15.148:0/3777029249 shutdown_connections 2024-04-26T23:13:19.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- 172.21.15.148:0/3777029249 wait complete. 2024-04-26T23:13:19.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 Processor -- start 2024-04-26T23:13:19.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- start start 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5800c9470 0x7fc58013d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 0x7fc5801410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5801541d0 0x7fc580139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800c5ef0 con 0x7fc580153df0 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800c5d70 con 0x7fc5801541d0 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc585800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc5800c75b0 con 0x7fc5800c9470 2024-04-26T23:13:19.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc576000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 0x7fc5801410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc576000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 0x7fc5801410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44514/0 (socket says 172.21.15.148:44514) 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.272+0000 7fc576000640 1 -- 172.21.15.148:0/1258139391 learned_addr learned my addr 172.21.15.148:0/1258139391 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc57ea00640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5800c9470 0x7fc58013d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc57f400640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5801541d0 0x7fc580139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 -- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5800c9470 msgr2=0x7fc58013d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5800c9470 0x7fc58013d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 -- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5801541d0 msgr2=0x7fc580139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5801541d0 0x7fc580139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc580158960 con 0x7fc580153df0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc57ea00640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5800c9470 0x7fc58013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc576000640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 0x7fc5801410e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c310 tx=0x7fc56800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568017070 con 0x7fc580153df0 2024-04-26T23:13:19.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc568005cf0 con 0x7fc580153df0 2024-04-26T23:13:19.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568007310 con 0x7fc580153df0 2024-04-26T23:13:19.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5800cc8d0 con 0x7fc580153df0 2024-04-26T23:13:19.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5800cb830 con 0x7fc580153df0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc580077c20 con 0x7fc580153df0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc56801a070 con 0x7fc580153df0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc55c0683b0 0x7fc55c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.276+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc5680860d0 con 0x7fc580153df0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc577400640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7fc55c071dc0 0x7fc55c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc568016ec0 con 0x7fc55c071dc0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc56808d050 con 0x7fc580153df0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc57ea00640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc55c0683b0 0x7fc55c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc57f400640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7fc55c071dc0 0x7fc55c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc57f400640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7fc55c071dc0 0x7fc55c074260 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc57ea00640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc55c0683b0 0x7fc55c06a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc570003ec0 tx=0x7fc570009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.280+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== osd.1 v2:172.21.15.148:6800/2370517083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc568016ec0 con 0x7fc55c071dc0 2024-04-26T23:13:19.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 --> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc580158390 con 0x7fc55c071dc0 2024-04-26T23:13:19.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc577400640 1 -- 172.21.15.148:0/1258139391 <== osd.1 v2:172.21.15.148:6800/2370517083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc580158390 con 0x7fc55c071dc0 2024-04-26T23:13:19.292 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:19.292 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:19.292 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7fc55c071dc0 msgr2=0x7fc55c074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:6800/2370517083,v1:172.21.15.148:6801/2370517083] conn(0x7fc55c071dc0 0x7fc55c074260 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc55c0683b0 msgr2=0x7fc55c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc55c0683b0 0x7fc55c06a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc570003ec0 tx=0x7fc570009040 comp rx=0 tx=0).stop 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 msgr2=0x7fc5801410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 --2- 172.21.15.148:0/1258139391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc580153df0 0x7fc5801410e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c310 tx=0x7fc56800c7d0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc57f400640 1 -- 172.21.15.148:0/1258139391 reap_dead start 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 shutdown_connections 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 >> 172.21.15.148:0/1258139391 conn(0x7fc5800c9d10 msgr2=0x7fc5800c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 shutdown_connections 2024-04-26T23:13:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.292+0000 7fc585800640 1 -- 172.21.15.148:0/1258139391 wait complete. 2024-04-26T23:13:19.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T23:13:19.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 Processor -- start 2024-04-26T23:13:19.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 -- start start 2024-04-26T23:13:19.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c153eb0 0x7ff58c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff58c06ff50 0x7ff58c0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58c0c96a0 con 0x7ff58c06f460 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c15ac00 con 0x7ff58c06ff50 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.448+0000 7ff592000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c0c9980 con 0x7ff58c153eb0 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff58c06ff50 0x7ff58c0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff58c06ff50 0x7ff58c0c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44520/0 (socket says 172.21.15.148:44520) 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 -- 172.21.15.148:0/2406538573 learned_addr learned my addr 172.21.15.148:0/2406538573 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58b400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff58c06f460 0x7ff58c06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54520/0 (socket says 172.21.15.148:54520) 2024-04-26T23:13:19.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff582a00640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c153eb0 0x7ff58c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 -- 172.21.15.148:0/2406538573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c153eb0 msgr2=0x7ff58c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:19.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c153eb0 0x7ff58c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 -- 172.21.15.148:0/2406538573 >> v1:172.21.15.148:6789/0 conn(0x7ff58c06f460 legacy=0x7ff58c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 -- 172.21.15.148:0/2406538573 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c070610 con 0x7ff58c06ff50 2024-04-26T23:13:19.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58be00640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0c5640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff584009870 tx=0x7ff58401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c12cb563b7c68f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58aa00640 1 -- 172.21.15.148:0/2406538573 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5840b5070 con 0x7ff58c06ff50 2024-04-26T23:13:19.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58aa00640 1 -- 172.21.15.148:0/2406538573 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5840a8a50 con 0x7ff58c06ff50 2024-04-26T23:13:19.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.452+0000 7ff58aa00640 1 -- 172.21.15.148:0/2406538573 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5840a8e20 con 0x7ff58c06ff50 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2406538573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 msgr2=0x7ff58c0c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0c5640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff584009870 tx=0x7ff58401ed50 comp rx=0 tx=0).stop 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2406538573 shutdown_connections 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0c5640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- 172.21.15.148:0/2406538573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c153eb0 0x7ff58c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2406538573 >> 172.21.15.148:0/2406538573 conn(0x7ff58c0c9d10 msgr2=0x7ff58c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2406538573 shutdown_connections 2024-04-26T23:13:19.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2406538573 wait complete. 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 Processor -- start 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- start start 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 0x7ff58c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff58c149760 0x7ff58c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0c4d70 con 0x7ff58c06ff50 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0c5120 con 0x7ff58c149760 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c0c4ef0 con 0x7ff58c06f460 2024-04-26T23:13:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44522/0 (socket says 172.21.15.148:44522) 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 -- 172.21.15.148:0/2824434589 learned_addr learned my addr 172.21.15.148:0/2824434589 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff58b400640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 0x7ff58c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff58be00640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff58c149760 0x7ff58c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 -- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 msgr2=0x7ff58c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 0x7ff58c1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 -- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff58c149760 msgr2=0x7ff58c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff58c149760 0x7ff58c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 -- 172.21.15.148:0/2824434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c1efd00 con 0x7ff58c06ff50 2024-04-26T23:13:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff58b400640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 0x7ff58c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff582a00640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57400e870 tx=0x7ff57400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574017070 con 0x7ff58c06ff50 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57400c8e0 con 0x7ff58c06ff50 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.456+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c1effe0 con 0x7ff58c06ff50 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57400cc90 con 0x7ff58c06ff50 2024-04-26T23:13:19.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1f05a0 con 0x7ff58c06ff50 2024-04-26T23:13:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c077c20 con 0x7ff58c06ff50 2024-04-26T23:13:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff57401a070 con 0x7ff58c06ff50 2024-04-26T23:13:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff583e00640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 0x7ff56806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff574086fe0 con 0x7ff58c06ff50 2024-04-26T23:13:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff58b400640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 0x7ff56806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.460+0000 7ff58b400640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 0x7ff56806a870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff57c005fd0 tx=0x7ff57c005b80 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.464+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff574057140 con 0x7ff58c06ff50 2024-04-26T23:13:19.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.620+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff58c070c20 con 0x7ff5680683b0 2024-04-26T23:13:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.620+0000 7ff583e00640 1 -- 172.21.15.148:0/2824434589 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff58c070c20 con 0x7ff5680683b0 2024-04-26T23:13:19.621 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T23:13:19.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 msgr2=0x7ff56806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 0x7ff56806a870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff57c005fd0 tx=0x7ff57c005b80 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 msgr2=0x7ff58c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57400e870 tx=0x7ff57400ec70 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 shutdown_connections 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff5680683b0 0x7ff56806a870 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff58c149760 0x7ff58c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff58c06ff50 0x7ff58c0cbe80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 --2- 172.21.15.148:0/2824434589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff58c06f460 0x7ff58c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 >> 172.21.15.148:0/2824434589 conn(0x7ff58c0c9d10 msgr2=0x7ff58c0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 shutdown_connections 2024-04-26T23:13:19.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.624+0000 7ff592000640 1 -- 172.21.15.148:0/2824434589 wait complete. 2024-04-26T23:13:19.643 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T23:13:19.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:19.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 Processor -- start 2024-04-26T23:13:19.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 -- start start 2024-04-26T23:13:19.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f52940c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52940c5120 0x7f52940c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529415a820 con 0x7f5294153df0 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f52940c7c90 con 0x7f52940c5120 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f529415aac0 con 0x7f52941541d0 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f5299600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5294153df0 0x7f52940c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54526/0 (socket says 172.21.15.148:54526) 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f5299600640 1 -- 172.21.15.148:0/1192525458 learned_addr learned my addr 172.21.15.148:0/1192525458 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529a000640 1 --2- 172.21.15.148:0/1192525458 >> v2:172.21.15.148:3300/0 conn(0x7f52940c5120 0x7f52940c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f5298c00640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f52940c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f5293e00640 1 -- 172.21.15.148:0/1192525458 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017748098 0 0) 0x7f529415a820 con 0x7f5294153df0 2024-04-26T23:13:19.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f5293e00640 1 -- 172.21.15.148:0/1192525458 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c003530 con 0x7f5294153df0 2024-04-26T23:13:19.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.784+0000 7f529a000640 1 -- 172.21.15.148:0/1192525458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 msgr2=0x7f52940c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:19.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529a000640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f52940c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529a000640 1 -- 172.21.15.148:0/1192525458 >> v1:172.21.15.148:6789/0 conn(0x7f5294153df0 legacy=0x7f52940c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529a000640 1 -- 172.21.15.148:0/1192525458 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940c7f50 con 0x7f52940c5120 2024-04-26T23:13:19.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529a000640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52940c5550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac0e8343298463 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f5293e00640 1 -- 172.21.15.148:0/1192525458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c0b2070 con 0x7f52940c5120 2024-04-26T23:13:19.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f5293e00640 1 -- 172.21.15.148:0/1192525458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c0a59c0 con 0x7f52940c5120 2024-04-26T23:13:19.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f5293e00640 1 -- 172.21.15.148:0/1192525458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a5d90 con 0x7f52940c5120 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 -- 172.21.15.148:0/1192525458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 msgr2=0x7f52940c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52940c5550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c01c8e0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 -- 172.21.15.148:0/1192525458 shutdown_connections 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52940c5550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 --2- 172.21.15.148:0/1192525458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f52940c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 -- 172.21.15.148:0/1192525458 >> 172.21.15.148:0/1192525458 conn(0x7f52940c9d10 msgr2=0x7f52940ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 -- 172.21.15.148:0/1192525458 shutdown_connections 2024-04-26T23:13:19.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.788+0000 7f529c000640 1 -- 172.21.15.148:0/1192525458 wait complete. 2024-04-26T23:13:19.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 Processor -- start 2024-04-26T23:13:19.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- start start 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52941f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5294153df0 0x7f52941f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f5294157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52940c8e60 con 0x7f52940c5120 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f52940c5ea0 con 0x7f5294153df0 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f52940c8fe0 con 0x7f52941541d0 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52941f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52941f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44530/0 (socket says 172.21.15.148:44530) 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 -- 172.21.15.148:0/873293382 learned_addr learned my addr 172.21.15.148:0/873293382 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5298c00640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5294153df0 0x7f52941f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529a000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f5294157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 -- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 msgr2=0x7f5294157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f52941541d0 0x7f5294157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 -- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5294153df0 msgr2=0x7f52941f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5294153df0 0x7f52941f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5294149ab0 con 0x7f52940c5120 2024-04-26T23:13:19.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5299600640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52941f5290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52880010f0 tx=0x7f528800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288017070 con 0x7f52940c5120 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5288005d10 con 0x7f52940c5120 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288007310 con 0x7f52940c5120 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5294149d90 con 0x7f52940c5120 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.792+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941f4a90 con 0x7f52940c5120 2024-04-26T23:13:19.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5294077c20 con 0x7f52940c5120 2024-04-26T23:13:19.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f528801a070 con 0x7f52940c5120 2024-04-26T23:13:19.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f52740683b0 0x7f527406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5288086260 con 0x7f52940c5120 2024-04-26T23:13:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f5274071dc0 0x7f5274074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5274074930 con 0x7f5274071dc0 2024-04-26T23:13:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f528808d050 con 0x7f52940c5120 2024-04-26T23:13:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5298c00640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f52740683b0 0x7f527406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f529a000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f5274071dc0 0x7f5274074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f529a000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f5274071dc0 0x7f5274074260 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.796+0000 7f5298c00640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f52740683b0 0x7f527406a870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5294147c60 tx=0x7f5280009190 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.800+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== osd.2 v2:172.21.15.148:6817/2623535582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5274074930 con 0x7f5274071dc0 2024-04-26T23:13:19.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 --> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5294157720 con 0x7f5274071dc0 2024-04-26T23:13:19.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f5291600640 1 -- 172.21.15.148:0/873293382 <== osd.2 v2:172.21.15.148:6817/2623535582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5294157720 con 0x7f5274071dc0 2024-04-26T23:13:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:19.811 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f5274071dc0 msgr2=0x7f5274074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:6817/2623535582,v1:172.21.15.148:6818/2623535582] conn(0x7f5274071dc0 0x7f5274074260 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f52740683b0 msgr2=0x7f527406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f52740683b0 0x7f527406a870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5294147c60 tx=0x7f5280009190 comp rx=0 tx=0).stop 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 msgr2=0x7f52941f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 --2- 172.21.15.148:0/873293382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52940c5120 0x7f52941f5290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52880010f0 tx=0x7f528800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529a000640 1 -- 172.21.15.148:0/873293382 reap_dead start 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 shutdown_connections 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 >> 172.21.15.148:0/873293382 conn(0x7f52940c9d10 msgr2=0x7f52940ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 shutdown_connections 2024-04-26T23:13:19.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.812+0000 7f529c000640 1 -- 172.21.15.148:0/873293382 wait complete. 2024-04-26T23:13:19.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T23:13:19.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 Processor -- start 2024-04-26T23:13:19.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 -- start start 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5c1c06ff50 0x7f5c1c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1c0c96a0 con 0x7f5c1c06f460 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1c0c9980 con 0x7f5c1c153eb0 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c24000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1c15ac00 con 0x7f5c1c06ff50 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c21600640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5c1c06f460 0x7f5c1c06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54538/0 (socket says 172.21.15.148:54538) 2024-04-26T23:13:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c21600640 1 -- 172.21.15.148:0/2435179645 learned_addr learned my addr 172.21.15.148:0/2435179645 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:19.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c22000640 1 --2- 172.21.15.148:0/2435179645 >> v2:172.21.15.157:3300/0 conn(0x7f5c1c06ff50 0x7f5c1c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018470191 0 0) 0x7f5c1c0c96a0 con 0x7f5c1c06f460 2024-04-26T23:13:19.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c04003530 con 0x7f5c1c06f460 2024-04-26T23:13:19.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c22000640 1 -- 172.21.15.148:0/2435179645 >> v1:172.21.15.157:6789/0 conn(0x7f5c1c153eb0 legacy=0x7f5c1c0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c22000640 1 -- 172.21.15.148:0/2435179645 >> v1:172.21.15.148:6789/0 conn(0x7f5c1c06f460 legacy=0x7f5c1c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2718671695 0 0) 0x7f5c04003530 con 0x7f5c1c06f460 2024-04-26T23:13:19.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.968+0000 7f5c22000640 1 -- 172.21.15.148:0/2435179645 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c070610 con 0x7f5c1c06ff50 2024-04-26T23:13:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c22000640 1 --2- 172.21.15.148:0/2435179645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06ff50 0x7f5c1c15a6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009d90 tx=0x7f5c1401f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e85656075ac01b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140b5070 con 0x7f5c1c06ff50 2024-04-26T23:13:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c140a8c10 con 0x7f5c1c06ff50 2024-04-26T23:13:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c1be00640 1 -- 172.21.15.148:0/2435179645 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10001680 con 0x7f5c1c06ff50 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 -- 172.21.15.148:0/2435179645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06ff50 msgr2=0x7f5c1c15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 --2- 172.21.15.148:0/2435179645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06ff50 0x7f5c1c15a6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009d90 tx=0x7f5c1401f080 comp rx=0 tx=0).stop 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 -- 172.21.15.148:0/2435179645 shutdown_connections 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 --2- 172.21.15.148:0/2435179645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06ff50 0x7f5c1c15a6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 -- 172.21.15.148:0/2435179645 >> 172.21.15.148:0/2435179645 conn(0x7f5c1c0c9d10 msgr2=0x7f5c1c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 -- 172.21.15.148:0/2435179645 shutdown_connections 2024-04-26T23:13:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.972+0000 7f5c24000640 1 -- 172.21.15.148:0/2435179645 wait complete. 2024-04-26T23:13:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 Processor -- start 2024-04-26T23:13:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- start start 2024-04-26T23:13:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06f460 0x7f5c1c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c1c06ff50 0x7f5c1c14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0c4d70 con 0x7f5c1c14ec30 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c0c5120 con 0x7f5c1c06f460 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c0c4ef0 con 0x7f5c1c06ff50 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44544/0 (socket says 172.21.15.148:44544) 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 -- 172.21.15.148:0/936295657 learned_addr learned my addr 172.21.15.148:0/936295657 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c21600640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06f460 0x7f5c1c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c20c00640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c1c06ff50 0x7f5c1c14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 -- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c1c06ff50 msgr2=0x7f5c1c14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c1c06ff50 0x7f5c1c14e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 -- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06f460 msgr2=0x7f5c1c147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06f460 0x7f5c1c147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 -- 172.21.15.148:0/936295657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c154560 con 0x7f5c1c14ec30 2024-04-26T23:13:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c22000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c140b3040 tx=0x7f5c1401be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140b5040 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c140c1070 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14004480 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c1f20d0 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.976+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c0733e0 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c077c20 con 0x7f5c1c14ec30 2024-04-26T23:13:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c14004620 con 0x7f5c1c14ec30 2024-04-26T23:13:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c19600640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 0x7f5bfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5c14125060 con 0x7f5c1c14ec30 2024-04-26T23:13:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c21600640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 0x7f5bfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:19.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.980+0000 7f5c21600640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 0x7f5bfc06a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5c10005890 tx=0x7f5c10005800 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:19.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:19.984+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c14018be0 con 0x7f5c1c14ec30 2024-04-26T23:13:20.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.140+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5c1c070c20 con 0x7f5bfc068380 2024-04-26T23:13:20.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c19600640 1 -- 172.21.15.148:0/936295657 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c1c070c20 con 0x7f5bfc068380 2024-04-26T23:13:20.142 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 msgr2=0x7f5bfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 0x7f5bfc06a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5c10005890 tx=0x7f5c10005800 comp rx=0 tx=0).stop 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 msgr2=0x7f5c1c14ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c140b3040 tx=0x7f5c1401be20 comp rx=0 tx=0).stop 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 shutdown_connections 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5bfc068380 0x7f5bfc06a840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c1c14ec30 0x7f5c1c14ae00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5c1c06ff50 0x7f5c1c14e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 --2- 172.21.15.148:0/936295657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c1c06f460 0x7f5c1c147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 >> 172.21.15.148:0/936295657 conn(0x7f5c1c0c9d10 msgr2=0x7f5c1c0c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 shutdown_connections 2024-04-26T23:13:20.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.144+0000 7f5c24000640 1 -- 172.21.15.148:0/936295657 wait complete. 2024-04-26T23:13:20.163 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T23:13:20.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:20.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.312+0000 7f670ac00640 1 Processor -- start 2024-04-26T23:13:20.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.312+0000 7f670ac00640 1 -- start start 2024-04-26T23:13:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670ac00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f670406c5e0 0x7f67040ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670ac00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f670406c9c0 0x7f670415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670ac00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67040cb350 con 0x7f67040c8d30 2024-04-26T23:13:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670ac00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f67040cb5f0 con 0x7f670406c9c0 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670ac00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f67040cb8b0 con 0x7f670406c5e0 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f670406c9c0 0x7f670415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670a200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f67040c8d30 0x7f67041534c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54546/0 (socket says 172.21.15.148:54546) 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f670a200640 1 -- 172.21.15.148:0/1611812423 learned_addr learned my addr 172.21.15.148:0/1611812423 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f670406c9c0 0x7f670415cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44546/0 (socket says 172.21.15.148:44546) 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6709800640 1 --2- 172.21.15.148:0/1611812423 >> v2:172.21.15.157:3300/0 conn(0x7f670406c5e0 0x7f67040ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 -- 172.21.15.148:0/1611812423 >> v2:172.21.15.157:3300/0 conn(0x7f670406c5e0 msgr2=0x7f67040ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 --2- 172.21.15.148:0/1611812423 >> v2:172.21.15.157:3300/0 conn(0x7f670406c5e0 0x7f67040ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 -- 172.21.15.148:0/1611812423 >> v1:172.21.15.148:6789/0 conn(0x7f67040c8d30 legacy=0x7f67041534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6708e00640 1 -- 172.21.15.148:0/1611812423 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67040cbb90 con 0x7f670406c9c0 2024-04-26T23:13:20.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.316+0000 7f6703e00640 1 -- 172.21.15.148:0/1611812423 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016536083 0 0) 0x7f67040cb350 con 0x7f67040c8d30 2024-04-26T23:13:20.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f6708e00640 1 --2- 172.21.15.148:0/1611812423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f670406c9c0 0x7f670415cdb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f66f00097c0 tx=0x7f66f001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dddb66e1673b4eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f6703e00640 1 -- 172.21.15.148:0/1611812423 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00b5070 con 0x7f670406c9c0 2024-04-26T23:13:20.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f6703e00640 1 -- 172.21.15.148:0/1611812423 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00a8950 con 0x7f670406c9c0 2024-04-26T23:13:20.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f6703e00640 1 -- 172.21.15.148:0/1611812423 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00a8d20 con 0x7f670406c9c0 2024-04-26T23:13:20.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- 172.21.15.148:0/1611812423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f670406c9c0 msgr2=0x7f670415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- 172.21.15.148:0/1611812423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f670406c9c0 0x7f670415cdb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f66f00097c0 tx=0x7f66f001ec50 comp rx=0 tx=0).stop 2024-04-26T23:13:20.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- 172.21.15.148:0/1611812423 shutdown_connections 2024-04-26T23:13:20.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- 172.21.15.148:0/1611812423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f670406c9c0 0x7f670415cdb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- 172.21.15.148:0/1611812423 >> v2:172.21.15.157:3300/0 conn(0x7f670406c5e0 0x7f67040ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- 172.21.15.148:0/1611812423 >> 172.21.15.148:0/1611812423 conn(0x7f670406f010 msgr2=0x7f670406f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- 172.21.15.148:0/1611812423 shutdown_connections 2024-04-26T23:13:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- 172.21.15.148:0/1611812423 wait complete. 2024-04-26T23:13:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 Processor -- start 2024-04-26T23:13:20.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- start start 2024-04-26T23:13:20.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f670406c5e0 0x7f670414af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f670406c9c0 0x7f67041f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 0x7f67041f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6704071ae0 con 0x7f67040c8d30 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67040715c0 con 0x7f670406c9c0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.320+0000 7f670ac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6704070d40 con 0x7f670406c5e0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 0x7f67041f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 0x7f67041f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44552/0 (socket says 172.21.15.148:44552) 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 -- 172.21.15.148:0/3479777514 learned_addr learned my addr 172.21.15.148:0/3479777514 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6709800640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f670406c5e0 0x7f670414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6708e00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f670406c9c0 0x7f67041f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 -- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f670406c5e0 msgr2=0x7f670414af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f670406c5e0 0x7f670414af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 -- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f670406c9c0 msgr2=0x7f67041f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f670406c9c0 0x7f67041f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670415a9f0 con 0x7f67040c8d30 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670a200640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 0x7f67041f52d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c7a0 tx=0x7f66fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc018070 con 0x7f67040c8d30 2024-04-26T23:13:20.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc00a640 con 0x7f67040c8d30 2024-04-26T23:13:20.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67040c6d30 con 0x7f67040c8d30 2024-04-26T23:13:20.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00aa70 con 0x7f67040c8d30 2024-04-26T23:13:20.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67041544f0 con 0x7f67040c8d30 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67041f4940 con 0x7f67040c8d30 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66fc01b070 con 0x7f67040c8d30 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66e4068380 0x7f66e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.324+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f66fc0862e0 con 0x7f67040c8d30 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6701600640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7f66e4071d90 0x7f66e4074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66e4074900 con 0x7f66e4071d90 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f66fc08d050 con 0x7f67040c8d30 2024-04-26T23:13:20.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6709800640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66e4068380 0x7f66e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6708e00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7f66e4071d90 0x7f66e4074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6708e00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7f66e4071d90 0x7f66e4074230 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6709800640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66e4068380 0x7f66e406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66f80079c0 tx=0x7f66f8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.328+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== osd.3 v2:172.21.15.148:6816/3094791832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66e4074900 con 0x7f66e4071d90 2024-04-26T23:13:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 --> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67040506d0 con 0x7f66e4071d90 2024-04-26T23:13:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f6701600640 1 -- 172.21.15.148:0/3479777514 <== osd.3 v2:172.21.15.148:6816/3094791832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67040506d0 con 0x7f66e4071d90 2024-04-26T23:13:20.340 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:20.340 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:20.340 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7f66e4071d90 msgr2=0x7f66e4074230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:6816/3094791832,v1:172.21.15.148:6819/3094791832] conn(0x7f66e4071d90 0x7f66e4074230 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66e4068380 msgr2=0x7f66e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f66e4068380 0x7f66e406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66f80079c0 tx=0x7f66f8008040 comp rx=0 tx=0).stop 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 msgr2=0x7f67041f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 --2- 172.21.15.148:0/3479777514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67040c8d30 0x7f67041f52d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c7a0 tx=0x7f66fc00cc60 comp rx=0 tx=0).stop 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670a200640 1 -- 172.21.15.148:0/3479777514 reap_dead start 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 shutdown_connections 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 >> 172.21.15.148:0/3479777514 conn(0x7f670406f010 msgr2=0x7f6704159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 shutdown_connections 2024-04-26T23:13:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.340+0000 7f670ac00640 1 -- 172.21.15.148:0/3479777514 wait complete. 2024-04-26T23:13:20.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T23:13:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.496+0000 7f084c200640 1 Processor -- start 2024-04-26T23:13:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.496+0000 7f084c200640 1 -- start start 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084c200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 0x7f084415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084c200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f084406ff50 0x7f08440c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084c200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08440c96a0 con 0x7f084406f460 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084c200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f084415ac00 con 0x7f084406ff50 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084c200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08440c9980 con 0x7f0844153eb0 2024-04-26T23:13:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f0848e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 0x7f084415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f084406ff50 0x7f08440c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f0848e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 0x7f084415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52102/0 (socket says 172.21.15.148:52102) 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f084406ff50 0x7f08440c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:57794/0 (socket says 172.21.15.148:57794) 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f0848e00640 1 -- 172.21.15.148:0/87768741 learned_addr learned my addr 172.21.15.148:0/87768741 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 -- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 msgr2=0x7f084415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 --2- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 0x7f084415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 -- 172.21.15.148:0/87768741 >> v1:172.21.15.157:6789/0 conn(0x7f084406f460 legacy=0x7f084406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.500+0000 7f084a200640 1 -- 172.21.15.148:0/87768741 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844070610 con 0x7f084406ff50 2024-04-26T23:13:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084a200640 1 --2- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f084406ff50 0x7f08440c5640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f083c009d90 tx=0x7f083c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4d6476c6cbb700 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f0843e00640 1 -- 172.21.15.148:0/87768741 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0b4070 con 0x7f084406ff50 2024-04-26T23:13:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f0843e00640 1 -- 172.21.15.148:0/87768741 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c0af600 con 0x7f084406ff50 2024-04-26T23:13:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f0843e00640 1 -- 172.21.15.148:0/87768741 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0af9d0 con 0x7f084406ff50 2024-04-26T23:13:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 -- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f084406ff50 msgr2=0x7f08440c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 --2- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f084406ff50 0x7f08440c5640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f083c009d90 tx=0x7f083c01f150 comp rx=0 tx=0).stop 2024-04-26T23:13:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 -- 172.21.15.148:0/87768741 shutdown_connections 2024-04-26T23:13:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 --2- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f084406ff50 0x7f08440c5640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 --2- 172.21.15.148:0/87768741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0844153eb0 0x7f084415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 -- 172.21.15.148:0/87768741 >> 172.21.15.148:0/87768741 conn(0x7f08440c9d10 msgr2=0x7f08440ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 -- 172.21.15.148:0/87768741 shutdown_connections 2024-04-26T23:13:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.504+0000 7f084c200640 1 -- 172.21.15.148:0/87768741 wait complete. 2024-04-26T23:13:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 Processor -- start 2024-04-26T23:13:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- start start 2024-04-26T23:13:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f084406f460 0x7f08441482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 0x7f0844143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c4d70 con 0x7f084406ff50 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c5120 con 0x7f08441f5b70 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08440c4ef0 con 0x7f084406f460 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44554/0 (socket says 172.21.15.148:44554) 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 -- 172.21.15.148:0/619174280 learned_addr learned my addr 172.21.15.148:0/619174280 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084a200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 0x7f0844143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0849800640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f084406f460 0x7f08441482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 -- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f084406f460 msgr2=0x7f08441482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f084406f460 0x7f08441482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 -- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 msgr2=0x7f0844143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 0x7f0844143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 -- 172.21.15.148:0/619174280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844158db0 con 0x7f084406ff50 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084a200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 0x7f0844143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0848e00640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f083000e7f0 tx=0x7f083000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830017070 con 0x7f084406ff50 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083000c940 con 0x7f084406ff50 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0844159090 con 0x7f084406ff50 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083000cd30 con 0x7f084406ff50 2024-04-26T23:13:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0844147ac0 con 0x7f084406ff50 2024-04-26T23:13:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.508+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0844077c20 con 0x7f084406ff50 2024-04-26T23:13:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.512+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f083001a070 con 0x7f084406ff50 2024-04-26T23:13:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.512+0000 7f0841600640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 0x7f082406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.512+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0830087090 con 0x7f084406ff50 2024-04-26T23:13:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.512+0000 7f0849800640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 0x7f082406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.512+0000 7f0849800640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 0x7f082406a870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0838001650 tx=0x7f0838009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.516+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08300571b0 con 0x7f084406ff50 2024-04-26T23:13:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.672+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f0844070c20 con 0x7f08240683b0 2024-04-26T23:13:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.672+0000 7f0841600640 1 -- 172.21.15.148:0/619174280 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0844070c20 con 0x7f08240683b0 2024-04-26T23:13:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T23:13:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 msgr2=0x7f082406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 0x7f082406a870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0838001650 tx=0x7f0838009040 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 msgr2=0x7f0844072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f083000e7f0 tx=0x7f083000ecb0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 shutdown_connections 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f08240683b0 0x7f082406a870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08441f5b70 0x7f0844143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f084406ff50 0x7f0844072740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 --2- 172.21.15.148:0/619174280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f084406f460 0x7f08441482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 >> 172.21.15.148:0/619174280 conn(0x7f08440c9d10 msgr2=0x7f08440cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 shutdown_connections 2024-04-26T23:13:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.676+0000 7f084c200640 1 -- 172.21.15.148:0/619174280 wait complete. 2024-04-26T23:13:20.694 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T23:13:20.694 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:20.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 Processor -- start 2024-04-26T23:13:20.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 -- start start 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ac415c0e0 0x7f9ac415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9ac40c9760 0x7f9ac4073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac415ce80 con 0x7f9ac415ca00 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40c6f80 con 0x7f9ac415c0e0 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9aca600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40c7520 con 0x7f9ac40c9760 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ac415c0e0 0x7f9ac415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ac415c0e0 0x7f9ac415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44560/0 (socket says 172.21.15.148:44560) 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 -- 172.21.15.148:0/3415718844 learned_addr learned my addr 172.21.15.148:0/3415718844 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:20.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9abaa00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9ac415ca00 0x7f9ac4152880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54558/0 (socket says 172.21.15.148:54558) 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3e00640 1 --2- 172.21.15.148:0/3415718844 >> v2:172.21.15.157:3300/0 conn(0x7f9ac40c9760 0x7f9ac4073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 -- 172.21.15.148:0/3415718844 >> v2:172.21.15.157:3300/0 conn(0x7f9ac40c9760 msgr2=0x7f9ac4073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 --2- 172.21.15.148:0/3415718844 >> v2:172.21.15.157:3300/0 conn(0x7f9ac40c9760 0x7f9ac4073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 -- 172.21.15.148:0/3415718844 >> v1:172.21.15.148:6789/0 conn(0x7f9ac415ca00 legacy=0x7f9ac4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac3400640 1 -- 172.21.15.148:0/3415718844 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac40c7240 con 0x7f9ac415c0e0 2024-04-26T23:13:20.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.836+0000 7f9ac2a00640 1 -- 172.21.15.148:0/3415718844 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904081445 0 0) 0x7f9ac415ce80 con 0x7f9ac415ca00 2024-04-26T23:13:20.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9ac3400640 1 --2- 172.21.15.148:0/3415718844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac415c0e0 0x7f9ac415c4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4159b00 tx=0x7f9ab401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21442593fcee3e34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9ac2a00640 1 -- 172.21.15.148:0/3415718844 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b4070 con 0x7f9ac415c0e0 2024-04-26T23:13:20.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9ac2a00640 1 -- 172.21.15.148:0/3415718844 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab40af400 con 0x7f9ac415c0e0 2024-04-26T23:13:20.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9ac2a00640 1 -- 172.21.15.148:0/3415718844 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40af7d0 con 0x7f9ac415c0e0 2024-04-26T23:13:20.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 -- 172.21.15.148:0/3415718844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac415c0e0 msgr2=0x7f9ac415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 --2- 172.21.15.148:0/3415718844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac415c0e0 0x7f9ac415c4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4159b00 tx=0x7f9ab401f1e0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 -- 172.21.15.148:0/3415718844 shutdown_connections 2024-04-26T23:13:20.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 --2- 172.21.15.148:0/3415718844 >> v2:172.21.15.157:3300/0 conn(0x7f9ac40c9760 0x7f9ac4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 --2- 172.21.15.148:0/3415718844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac415c0e0 0x7f9ac415c4c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 -- 172.21.15.148:0/3415718844 >> 172.21.15.148:0/3415718844 conn(0x7f9ac40c9d10 msgr2=0x7f9ac40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 -- 172.21.15.148:0/3415718844 shutdown_connections 2024-04-26T23:13:20.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.840+0000 7f9aca600640 1 -- 172.21.15.148:0/3415718844 wait complete. 2024-04-26T23:13:20.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 Processor -- start 2024-04-26T23:13:20.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- start start 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 0x7f9ac41f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9ac415c0e0 0x7f9ac406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ac415ca00 0x7f9ac415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40c4d70 con 0x7f9ac40c9760 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40c4a90 con 0x7f9ac415ca00 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac40723d0 con 0x7f9ac415c0e0 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 0x7f9ac41f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 0x7f9ac41f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44574/0 (socket says 172.21.15.148:44574) 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 -- 172.21.15.148:0/771009303 learned_addr learned my addr 172.21.15.148:0/771009303 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3e00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ac415ca00 0x7f9ac415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9abaa00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9ac415c0e0 0x7f9ac406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 -- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9ac415c0e0 msgr2=0x7f9ac406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9ac415c0e0 0x7f9ac406fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 -- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ac415ca00 msgr2=0x7f9ac415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ac415ca00 0x7f9ac415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac41f1fe0 con 0x7f9ac40c9760 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3e00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ac415ca00 0x7f9ac415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9abaa00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9ac415c0e0 0x7f9ac406fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9ac3400640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 0x7f9ac41f1aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ab401ce10 tx=0x7f9ab401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b4040 con 0x7f9ac40c9760 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab40c0070 con 0x7f9ac40c9760 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac414d020 con 0x7f9ac40c9760 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4009510 con 0x7f9ac40c9760 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac414d5c0 con 0x7f9ac40c9760 2024-04-26T23:13:20.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.844+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ac4077c20 con 0x7f9ac40c9760 2024-04-26T23:13:20.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ab40ba660 con 0x7f9ac40c9760 2024-04-26T23:13:20.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aa00683b0 0x7f9aa006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9ab4125fd0 con 0x7f9ac40c9760 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7f9aa0071dd0 0x7f9aa0074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ab400ae60 con 0x7f9aa0071dd0 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ab4126380 con 0x7f9ac40c9760 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abaa00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aa00683b0 0x7f9aa006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9ac3e00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7f9aa0071dd0 0x7f9aa0074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9abaa00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aa00683b0 0x7f9aa006a870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4158f80 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.848+0000 7f9ac3e00640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7f9aa0071dd0 0x7f9aa0074270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:20.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.852+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== osd.4 v2:172.21.15.157:6810/734957518 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ab400ae60 con 0x7f9aa0071dd0 2024-04-26T23:13:20.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 --> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ac4073f60 con 0x7f9aa0071dd0 2024-04-26T23:13:20.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9abbe00640 1 -- 172.21.15.148:0/771009303 <== osd.4 v2:172.21.15.157:6810/734957518 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9ac4073f60 con 0x7f9aa0071dd0 2024-04-26T23:13:20.863 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:20.863 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:20.863 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7f9aa0071dd0 msgr2=0x7f9aa0074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6810/734957518,v1:172.21.15.157:6812/734957518] conn(0x7f9aa0071dd0 0x7f9aa0074270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aa00683b0 msgr2=0x7f9aa006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9aa00683b0 0x7f9aa006a870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4158f80 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 msgr2=0x7f9ac41f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 --2- 172.21.15.148:0/771009303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac40c9760 0x7f9ac41f1aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ab401ce10 tx=0x7f9ab401bf80 comp rx=0 tx=0).stop 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9ac3e00640 1 -- 172.21.15.148:0/771009303 reap_dead start 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 shutdown_connections 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 >> 172.21.15.148:0/771009303 conn(0x7f9ac40c9d10 msgr2=0x7f9ac40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 shutdown_connections 2024-04-26T23:13:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:20.864+0000 7f9aca600640 1 -- 172.21.15.148:0/771009303 wait complete. 2024-04-26T23:13:20.882 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T23:13:21.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 Processor -- start 2024-04-26T23:13:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 -- start start 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1c88070500 0x7f1c88158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880cc330 con 0x7f1c88070e20 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1c88071270 con 0x7f1c88070500 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.024+0000 7f1c90400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880cce60 con 0x7f1c880cbe60 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1c88070500 0x7f1c88158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8d000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8d000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52138/0 (socket says 172.21.15.148:52138) 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8d000640 1 -- 172.21.15.148:0/3270675724 learned_addr learned my addr 172.21.15.148:0/3270675724 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 -- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 msgr2=0x7f1c880708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 -- 172.21.15.148:0/3270675724 >> v1:172.21.15.157:6789/0 conn(0x7f1c88070e20 legacy=0x7f1c880c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 -- 172.21.15.148:0/3270675724 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880cd140 con 0x7f1c88070500 2024-04-26T23:13:21.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8d000640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:13:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.028+0000 7f1c8da00640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070500 0x7f1c88158a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c880cc500 tx=0x7f1c7c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d75d3c66f6f8367 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c87e00640 1 -- 172.21.15.148:0/3270675724 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0b5070 con 0x7f1c88070500 2024-04-26T23:13:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c87e00640 1 -- 172.21.15.148:0/3270675724 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0a8990 con 0x7f1c88070500 2024-04-26T23:13:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c87e00640 1 -- 172.21.15.148:0/3270675724 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0a8d60 con 0x7f1c88070500 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070500 msgr2=0x7f1c88158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070500 0x7f1c88158a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c880cc500 tx=0x7f1c7c01ec90 comp rx=0 tx=0).stop 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- 172.21.15.148:0/3270675724 shutdown_connections 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c880708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- 172.21.15.148:0/3270675724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070500 0x7f1c88158a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- 172.21.15.148:0/3270675724 >> 172.21.15.148:0/3270675724 conn(0x7f1c8806c380 msgr2=0x7f1c8806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- 172.21.15.148:0/3270675724 shutdown_connections 2024-04-26T23:13:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- 172.21.15.148:0/3270675724 wait complete. 2024-04-26T23:13:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 Processor -- start 2024-04-26T23:13:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- start start 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070e20 0x7f1c8814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c88156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c880c70a0 con 0x7f1c88070500 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1c881525e0 con 0x7f1c88070e20 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c90400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880c7220 con 0x7f1c880cbe60 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c8da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c8da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44580/0 (socket says 172.21.15.148:44580) 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c8da00640 1 -- 172.21.15.148:0/2065186940 learned_addr learned my addr 172.21.15.148:0/2065186940 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c8d000640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070e20 0x7f1c8814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.032+0000 7f1c8e400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c88156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 -- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 msgr2=0x7f1c88156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c88156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 -- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070e20 msgr2=0x7f1c8814b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070e20 0x7f1c8814b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 -- 172.21.15.148:0/2065186940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880ca3e0 con 0x7f1c88070500 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8e400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c88156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8da00640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0b3040 tx=0x7f1c7c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0bf070 con 0x7f1c88070500 2024-04-26T23:13:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0b06e0 con 0x7f1c88070500 2024-04-26T23:13:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0b5040 con 0x7f1c88070500 2024-04-26T23:13:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c881f1bc0 con 0x7f1c88070500 2024-04-26T23:13:21.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c881f2180 con 0x7f1c88070500 2024-04-26T23:13:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c88077c20 con 0x7f1c88070500 2024-04-26T23:13:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c7c0b0ad0 con 0x7f1c88070500 2024-04-26T23:13:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 0x7f1c6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1c7c123690 con 0x7f1c88070500 2024-04-26T23:13:21.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.036+0000 7f1c8d000640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 0x7f1c6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.040+0000 7f1c8d000640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 0x7f1c6806a870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c88148c20 tx=0x7f1c74009240 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.040+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c7c0187f0 con 0x7f1c88070500 2024-04-26T23:13:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.208+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1c8813d2d0 con 0x7f1c680683b0 2024-04-26T23:13:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.208+0000 7f1c85600640 1 -- 172.21.15.148:0/2065186940 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1c74011950 con 0x7f1c680683b0 2024-04-26T23:13:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 msgr2=0x7f1c6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 0x7f1c6806a870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c88148c20 tx=0x7f1c74009240 comp rx=0 tx=0).stop 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 msgr2=0x7f1c880c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0b3040 tx=0x7f1c7c01ba30 comp rx=0 tx=0).stop 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 shutdown_connections 2024-04-26T23:13:21.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f1c680683b0 0x7f1c6806a870 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c880cbe60 0x7f1c88156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c88070e20 0x7f1c8814b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 --2- 172.21.15.148:0/2065186940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c88070500 0x7f1c880c89b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 >> 172.21.15.148:0/2065186940 conn(0x7f1c8806c380 msgr2=0x7f1c88155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 shutdown_connections 2024-04-26T23:13:21.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.212+0000 7f1c90400640 1 -- 172.21.15.148:0/2065186940 wait complete. 2024-04-26T23:13:21.231 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T23:13:21.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 Processor -- start 2024-04-26T23:13:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 -- start start 2024-04-26T23:13:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 0x7f158c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c070380 con 0x7f158c15fbb0 2024-04-26T23:13:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f158c070660 con 0x7f158c06e440 2024-04-26T23:13:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f1591800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f158c070940 con 0x7f158c155ee0 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f158aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f158b400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 0x7f158c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f158aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.148:52152/0 (socket says 172.21.15.148:52152) 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f158b400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 0x7f158c0c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:57842/0 (socket says 172.21.15.148:57842) 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.372+0000 7f158aa00640 1 -- 172.21.15.148:0/489446204 learned_addr learned my addr 172.21.15.148:0/489446204 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f158aa00640 1 -- 172.21.15.148:0/489446204 >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 msgr2=0x7f158c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f158aa00640 1 --2- 172.21.15.148:0/489446204 >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 0x7f158c0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f158aa00640 1 -- 172.21.15.148:0/489446204 >> v1:172.21.15.157:6789/0 conn(0x7f158c15fbb0 legacy=0x7f158c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f158aa00640 1 -- 172.21.15.148:0/489446204 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c070c20 con 0x7f158c155ee0 2024-04-26T23:13:21.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f158aa00640 1 --2- 172.21.15.148:0/489446204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f157c009870 tx=0x7f157c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265cfea1ad2ee9d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f1589600640 1 -- 172.21.15.148:0/489446204 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0ab430 con 0x7f158c155ee0 2024-04-26T23:13:21.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f1589600640 1 -- 172.21.15.148:0/489446204 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c0b0070 con 0x7f158c155ee0 2024-04-26T23:13:21.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.376+0000 7f1589600640 1 -- 172.21.15.148:0/489446204 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0ab7f0 con 0x7f158c155ee0 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/489446204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 msgr2=0x7f158c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- 172.21.15.148:0/489446204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f157c009870 tx=0x7f157c01c560 comp rx=0 tx=0).stop 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/489446204 shutdown_connections 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- 172.21.15.148:0/489446204 >> v2:172.21.15.157:3300/0 conn(0x7f158c06e440 0x7f158c0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- 172.21.15.148:0/489446204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c155ee0 0x7f158c06d490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/489446204 >> 172.21.15.148:0/489446204 conn(0x7f158c071f60 msgr2=0x7f158c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/489446204 shutdown_connections 2024-04-26T23:13:21.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/489446204 wait complete. 2024-04-26T23:13:21.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 Processor -- start 2024-04-26T23:13:21.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- start start 2024-04-26T23:13:21.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 0x7f158c154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c15fbb0 0x7f158c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c0cfe10 0x7f158c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0ca160 con 0x7f158c155ee0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0c9fe0 con 0x7f158c15fbb0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f158c15ff90 con 0x7f158c0cfe10 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 0x7f158c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 0x7f158c154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44592/0 (socket says 172.21.15.148:44592) 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 -- 172.21.15.148:0/2441525772 learned_addr learned my addr 172.21.15.148:0/2441525772 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158b400640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c0cfe10 0x7f158c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158a000640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c15fbb0 0x7f158c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 -- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c0cfe10 msgr2=0x7f158c1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c0cfe10 0x7f158c1574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 -- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c15fbb0 msgr2=0x7f158c14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c15fbb0 0x7f158c14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c0c9950 con 0x7f158c155ee0 2024-04-26T23:13:21.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158b400640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f158c0cfe10 0x7f158c1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:21.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158a000640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c15fbb0 0x7f158c14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:21.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f158aa00640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 0x7f158c154640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f157c01ce00 tx=0x7f157c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0abda0 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c0b43f0 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.380+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c0cd4d0 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c0b45c0 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c0cf190 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f158c0cf570 con 0x7f158c155ee0 2024-04-26T23:13:21.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f157c0c0030 con 0x7f158c155ee0 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f156c068380 0x7f156c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f157c120b40 con 0x7f158c155ee0 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7f156c071d90 0x7f156c074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f157c0bbe80 con 0x7f156c071d90 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f157c120ef0 con 0x7f158c155ee0 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f158a000640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f156c068380 0x7f156c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.384+0000 7f158b400640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7f156c071d90 0x7f156c074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.388+0000 7f158a000640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f156c068380 0x7f156c06a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f158c1580e0 tx=0x7f1578009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.388+0000 7f158b400640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7f156c071d90 0x7f156c074230 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.388+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== osd.5 v2:172.21.15.157:6800/549691601 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f157c0bbe80 con 0x7f156c071d90 2024-04-26T23:13:21.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.400+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 --> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f158c077c20 con 0x7f156c071d90 2024-04-26T23:13:21.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.400+0000 7f1582a00640 1 -- 172.21.15.148:0/2441525772 <== osd.5 v2:172.21.15.157:6800/549691601 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f158c077c20 con 0x7f156c071d90 2024-04-26T23:13:21.401 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:21.401 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:21.401 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7f156c071d90 msgr2=0x7f156c074230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6800/549691601,v1:172.21.15.157:6801/549691601] conn(0x7f156c071d90 0x7f156c074230 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f156c068380 msgr2=0x7f156c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f156c068380 0x7f156c06a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f158c1580e0 tx=0x7f1578009040 comp rx=0 tx=0).stop 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 msgr2=0x7f158c154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 --2- 172.21.15.148:0/2441525772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c155ee0 0x7f158c154640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f157c01ce00 tx=0x7f157c019300 comp rx=0 tx=0).stop 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f158b400640 1 -- 172.21.15.148:0/2441525772 reap_dead start 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 shutdown_connections 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 >> 172.21.15.148:0/2441525772 conn(0x7f158c071f60 msgr2=0x7f158c15eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 shutdown_connections 2024-04-26T23:13:21.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.404+0000 7f1591800640 1 -- 172.21.15.148:0/2441525772 wait complete. 2024-04-26T23:13:21.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T23:13:21.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 Processor -- start 2024-04-26T23:13:21.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 -- start start 2024-04-26T23:13:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1f015d8a0 0x7ff1f0070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f00c49e0 con 0x7ff1f00c44a0 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f00cbb50 con 0x7ff1f015d8a0 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f8200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f00caf80 con 0x7ff1f0157250 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1f015d8a0 0x7ff1f0070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1f015d8a0 0x7ff1f0070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44598/0 (socket says 172.21.15.148:44598) 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 -- 172.21.15.148:0/221743888 learned_addr learned my addr 172.21.15.148:0/221743888 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f5800640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 -- 172.21.15.148:0/221743888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 msgr2=0x7ff1f006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f006ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 -- 172.21.15.148:0/221743888 >> v1:172.21.15.148:6789/0 conn(0x7ff1f00c44a0 legacy=0x7ff1f015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1f6200640 1 -- 172.21.15.148:0/221743888 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f00c6450 con 0x7ff1f015d8a0 2024-04-26T23:13:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.560+0000 7ff1efe00640 1 -- 172.21.15.148:0/221743888 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441361696 0 0) 0x7ff1f00c49e0 con 0x7ff1f00c44a0 2024-04-26T23:13:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f6200640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f0070440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009e50 tx=0x7ff1e801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f177898877f264c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1efe00640 1 -- 172.21.15.148:0/221743888 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80a5750 con 0x7ff1f015d8a0 2024-04-26T23:13:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1efe00640 1 -- 172.21.15.148:0/221743888 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80a58f0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1efe00640 1 -- 172.21.15.148:0/221743888 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80a5cc0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 -- 172.21.15.148:0/221743888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 msgr2=0x7ff1f0070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f0070440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009e50 tx=0x7ff1e801c9a0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 -- 172.21.15.148:0/221743888 shutdown_connections 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f0070440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 --2- 172.21.15.148:0/221743888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f006ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 -- 172.21.15.148:0/221743888 >> 172.21.15.148:0/221743888 conn(0x7ff1f0068140 msgr2=0x7ff1f0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 -- 172.21.15.148:0/221743888 shutdown_connections 2024-04-26T23:13:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.564+0000 7ff1f8200640 1 -- 172.21.15.148:0/221743888 wait complete. 2024-04-26T23:13:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 Processor -- start 2024-04-26T23:13:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- start start 2024-04-26T23:13:21.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 0x7ff1f01422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f0142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f00b26c0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0157630 con 0x7ff1f00c44a0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f00b2840 con 0x7ff1f0157250 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44600/0 (socket says 172.21.15.148:44600) 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 -- 172.21.15.148:0/1342952139 learned_addr learned my addr 172.21.15.148:0/1342952139 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f4e00640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f0142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f5800640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 0x7ff1f01422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 -- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 msgr2=0x7ff1f0142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f0142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 -- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 msgr2=0x7ff1f01422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 0x7ff1f01422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 -- 172.21.15.148:0/1342952139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f0144be0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f5800640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 0x7ff1f01422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:21.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f6200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff1e801a5d0 tx=0x7ff1e8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80b8670 con 0x7ff1f015d8a0 2024-04-26T23:13:21.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80be070 con 0x7ff1f015d8a0 2024-04-26T23:13:21.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f0141840 con 0x7ff1f015d8a0 2024-04-26T23:13:21.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80b8a30 con 0x7ff1f015d8a0 2024-04-26T23:13:21.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f00c6d80 con 0x7ff1f015d8a0 2024-04-26T23:13:21.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.568+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f00c6fc0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.572+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1e80b8bd0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.572+0000 7ff1ed600640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.572+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff1e8121ef0 con 0x7ff1f015d8a0 2024-04-26T23:13:21.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.572+0000 7ff1f5800640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.572+0000 7ff1f5800640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0007a70 tx=0x7ff1e0008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.576+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff1e8016620 con 0x7ff1f015d8a0 2024-04-26T23:13:21.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.732+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff1f0077c20 con 0x7ff1d4068380 2024-04-26T23:13:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.732+0000 7ff1ed600640 1 -- 172.21.15.148:0/1342952139 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff1f0077c20 con 0x7ff1d4068380 2024-04-26T23:13:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T23:13:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 msgr2=0x7ff1d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0007a70 tx=0x7ff1e0008040 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 msgr2=0x7ff1f013eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff1e801a5d0 tx=0x7ff1e8019740 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 shutdown_connections 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7ff1d4068380 0x7ff1d406a840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1f015d8a0 0x7ff1f013eab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1f0157250 0x7ff1f0142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 --2- 172.21.15.148:0/1342952139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1f00c44a0 0x7ff1f01422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 >> 172.21.15.148:0/1342952139 conn(0x7ff1f0068140 msgr2=0x7ff1f006feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 shutdown_connections 2024-04-26T23:13:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.736+0000 7ff1f8200640 1 -- 172.21.15.148:0/1342952139 wait complete. 2024-04-26T23:13:21.753 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T23:13:21.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:21.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 Processor -- start 2024-04-26T23:13:21.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 -- start start 2024-04-26T23:13:21.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f927c06e440 0x7f927c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c070380 con 0x7f927c06d490 2024-04-26T23:13:21.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c070660 con 0x7f927c155ee0 2024-04-26T23:13:21.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9282a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f927c06d8d0 con 0x7f927c06e440 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9273400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f927c06d490 0x7f927c06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54576/0 (socket says 172.21.15.148:54576) 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9273400640 1 -- 172.21.15.148:0/1672581717 learned_addr learned my addr 172.21.15.148:0/1672581717 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f9280a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f927c06e440 0x7f927c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658694153 0 0) 0x7f927c070380 con 0x7f927c06d490 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9260003530 con 0x7f927c06d490 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2552096550 0 0) 0x7f9260003530 con 0x7f927c06d490 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f927c06e440 msgr2=0x7f927c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f927c06e440 0x7f927c0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 >> v1:172.21.15.157:6789/0 conn(0x7f927c155ee0 legacy=0x7f927c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c070940 con 0x7f927c06d490 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f92640016a0 con 0x7f927c06d490 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 >> v1:172.21.15.148:6789/0 conn(0x7f927c06d490 legacy=0x7f927c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92600039f0 0x7f9260003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260004810 0x7f9260004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9260005190 0x7f926000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f926000bfa0 con 0x7f9260005190 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f926000c120 con 0x7f92600039f0 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.896+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f926000c2a0 con 0x7f9260004810 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9260005190 0x7f926000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f927be00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92600039f0 0x7f9260003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9273400640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260004810 0x7f9260004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 -- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260004810 msgr2=0x7f9260004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260004810 0x7f9260004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 -- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92600039f0 msgr2=0x7f9260003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92600039f0 0x7f9260003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 -- 172.21.15.148:0/1672581717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9260003530 con 0x7f9260005190 2024-04-26T23:13:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f9280a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9260005190 0x7f926000b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f927c072aa0 tx=0x7f927401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea8b1b22fb529fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740b2070 con 0x7f9260005190 2024-04-26T23:13:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92740a5c30 con 0x7f9260005190 2024-04-26T23:13:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.900+0000 7f927b400640 1 -- 172.21.15.148:0/1672581717 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274009c10 con 0x7f9260005190 2024-04-26T23:13:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- 172.21.15.148:0/1672581717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9260005190 msgr2=0x7f926000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 --2- 172.21.15.148:0/1672581717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9260005190 0x7f926000b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f927c072aa0 tx=0x7f927401cc20 comp rx=0 tx=0).stop 2024-04-26T23:13:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 -- 172.21.15.148:0/1672581717 reap_dead start 2024-04-26T23:13:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- 172.21.15.148:0/1672581717 shutdown_connections 2024-04-26T23:13:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- 172.21.15.148:0/1672581717 >> 172.21.15.148:0/1672581717 conn(0x7f927c071f60 msgr2=0x7f927c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- 172.21.15.148:0/1672581717 shutdown_connections 2024-04-26T23:13:21.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- 172.21.15.148:0/1672581717 wait complete. 2024-04-26T23:13:21.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 Processor -- start 2024-04-26T23:13:21.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- start start 2024-04-26T23:13:21.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260005190 0x7f927c1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c1f4bf0 0x7f927c1f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 0x7f927c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1562c0 con 0x7f927c0cdcb0 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f927c070f00 con 0x7f927c1f4bf0 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9282a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f927c0c9fe0 con 0x7f9260005190 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 0x7f927c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 0x7f927c0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44616/0 (socket says 172.21.15.148:44616) 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 -- 172.21.15.148:0/3835875126 learned_addr learned my addr 172.21.15.148:0/3835875126 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9273400640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c1f4bf0 0x7f927c1f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f927be00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260005190 0x7f927c1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 -- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260005190 msgr2=0x7f927c1f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9260005190 0x7f927c1f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 -- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c1f4bf0 msgr2=0x7f927c1f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c1f4bf0 0x7f927c1f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0ce6a0 con 0x7f927c0cdcb0 2024-04-26T23:13:21.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.904+0000 7f9280a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 0x7f927c0ce160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f927401d4c0 tx=0x7f9274009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740bd070 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92740adb50 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740b2040 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c1f1e90 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c156be0 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f927c1f47f0 con 0x7f927c0cdcb0 2024-04-26T23:13:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92740039a0 con 0x7f927c0cdcb0 2024-04-26T23:13:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9258068380 0x7f925806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9274120d60 con 0x7f927c0cdcb0 2024-04-26T23:13:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f9258071da0 0x7f9258074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92740afe90 con 0x7f9258071da0 2024-04-26T23:13:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9274123380 con 0x7f927c0cdcb0 2024-04-26T23:13:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f927be00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9258068380 0x7f925806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.908+0000 7f9273400640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f9258071da0 0x7f9258074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.912+0000 7f9273400640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f9258071da0 0x7f9258074240 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.912+0000 7f927be00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9258068380 0x7f925806a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f926c000c10 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:21.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.912+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== osd.6 v2:172.21.15.157:6824/1080565004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92740afe90 con 0x7f9258071da0 2024-04-26T23:13:21.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.924+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 --> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f927c077c20 con 0x7f9258071da0 2024-04-26T23:13:21.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.924+0000 7f9278c00640 1 -- 172.21.15.148:0/3835875126 <== osd.6 v2:172.21.15.157:6824/1080565004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f927c077c20 con 0x7f9258071da0 2024-04-26T23:13:21.925 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:21.925 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:21.925 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f9258071da0 msgr2=0x7f9258074240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6824/1080565004,v1:172.21.15.157:6825/1080565004] conn(0x7f9258071da0 0x7f9258074240 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9258068380 msgr2=0x7f925806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9258068380 0x7f925806a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f926c000c10 tx=0x7f926c009040 comp rx=0 tx=0).stop 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 msgr2=0x7f927c0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 --2- 172.21.15.148:0/3835875126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c0cdcb0 0x7f927c0ce160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f927401d4c0 tx=0x7f9274009750 comp rx=0 tx=0).stop 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9280a00640 1 -- 172.21.15.148:0/3835875126 reap_dead start 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 shutdown_connections 2024-04-26T23:13:21.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 >> 172.21.15.148:0/3835875126 conn(0x7f927c071f60 msgr2=0x7f927c0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:21.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 shutdown_connections 2024-04-26T23:13:21.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:21.928+0000 7f9282a00640 1 -- 172.21.15.148:0/3835875126 wait complete. 2024-04-26T23:13:21.943 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T23:13:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.080+0000 7f60ae800640 1 Processor -- start 2024-04-26T23:13:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.080+0000 7f60ae800640 1 -- start start 2024-04-26T23:13:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60ae800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f60a8165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60ae800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a80c49e0 con 0x7f60a8157250 2024-04-26T23:13:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60ae800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a80caf80 con 0x7f60a80c44a0 2024-04-26T23:13:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60ae800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f60a80cbb50 con 0x7f60a815d8a0 2024-04-26T23:13:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7400640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f60a8157250 0x7f60a806ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54586/0 (socket says 172.21.15.148:54586) 2024-04-26T23:13:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7400640 1 -- 172.21.15.148:0/4215867125 learned_addr learned my addr 172.21.15.148:0/4215867125 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f60a8165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326698045 0 0) 0x7f60a80c49e0 con 0x7f60a8157250 2024-04-26T23:13:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608c003530 con 0x7f60a8157250 2024-04-26T23:13:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158170944 0 0) 0x7f60a80caf80 con 0x7f60a80c44a0 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a80c49e0 con 0x7f60a80c44a0 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 924853972 0 0) 0x7f608c003530 con 0x7f60a8157250 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 msgr2=0x7f60a8165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f60a8165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 >> v1:172.21.15.157:6789/0 conn(0x7f60a80c44a0 legacy=0x7f60a815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a80c6450 con 0x7f60a8157250 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f6098001a00 con 0x7f60a8157250 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 >> v1:172.21.15.148:6789/0 conn(0x7f60a8157250 legacy=0x7f60a806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f608c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f608c0040e0 0x7f608c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c004d50 0x7f608c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60a80cbb50 con 0x7f608c004d50 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f608c00bb60 con 0x7f608c0040e0 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f608c00bd30 con 0x7f60a815d8a0 2024-04-26T23:13:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c004d50 0x7f608c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f609ea00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f608c0040e0 0x7f608c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7400640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f608c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 -- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 msgr2=0x7f608c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f608c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 -- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f608c0040e0 msgr2=0x7f608c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f608c0040e0 0x7f608c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7e00640 1 -- 172.21.15.148:0/4215867125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c003530 con 0x7f608c004d50 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.084+0000 7f60a7400640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a815d8a0 0x7f608c003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:22.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60a7e00640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c004d50 0x7f608c0051d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ae0 tx=0x7f60a001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a11fd1d3db99f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a00b2070 con 0x7f608c004d50 2024-04-26T23:13:22.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6090001d40 con 0x7f608c004d50 2024-04-26T23:13:22.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60a6a00640 1 -- 172.21.15.148:0/4215867125 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a00096b0 con 0x7f608c004d50 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- 172.21.15.148:0/4215867125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c004d50 msgr2=0x7f608c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 --2- 172.21.15.148:0/4215867125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c004d50 0x7f608c0051d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ae0 tx=0x7f60a001ca70 comp rx=0 tx=0).stop 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60a7e00640 1 -- 172.21.15.148:0/4215867125 reap_dead start 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- 172.21.15.148:0/4215867125 shutdown_connections 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- 172.21.15.148:0/4215867125 >> 172.21.15.148:0/4215867125 conn(0x7f60a8068140 msgr2=0x7f60a8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- 172.21.15.148:0/4215867125 shutdown_connections 2024-04-26T23:13:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- 172.21.15.148:0/4215867125 wait complete. 2024-04-26T23:13:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 Processor -- start 2024-04-26T23:13:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.088+0000 7f60ae800640 1 -- start start 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 0x7f60a81f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 0x7f60a8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60a80cb7e0 con 0x7f60a814d470 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f60a80cb500 con 0x7f60a814d090 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f60a8157630 con 0x7f60a80b3560 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44632/0 (socket says 172.21.15.148:44632) 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 -- 172.21.15.148:0/2780244292 learned_addr learned my addr 172.21.15.148:0/2780244292 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60a7e00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 0x7f60a8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60a7400640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 0x7f60a81f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 -- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 msgr2=0x7f60a8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 0x7f60a8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 -- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 msgr2=0x7f60a81f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 0x7f60a81f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 -- 172.21.15.148:0/2780244292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a80b47b0 con 0x7f60a814d470 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60a7e00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 0x7f60a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60a7400640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 0x7f60a81f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609ea00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6090007c80 tx=0x7f6090012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090012ea0 con 0x7f60a814d470 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609001b070 con 0x7f60a814d470 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090010db0 con 0x7f60a814d470 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a80b4a90 con 0x7f60a814d470 2024-04-26T23:13:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a80b2d60 con 0x7f60a814d470 2024-04-26T23:13:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a80b2b80 con 0x7f60a814d470 2024-04-26T23:13:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.092+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6090016480 con 0x7f60a814d470 2024-04-26T23:13:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.096+0000 7f609fe00640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 0x7f608406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.096+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f609008a2f0 con 0x7f60a814d470 2024-04-26T23:13:22.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.096+0000 7f60a7400640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 0x7f608406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.096+0000 7f60a7400640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 0x7f608406a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6098001590 tx=0x7f6098009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.100+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f60a80b2b80 con 0x7f60a814d470 2024-04-26T23:13:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f60a80b4fb0 con 0x7f6084068380 2024-04-26T23:13:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f609fe00640 1 -- 172.21.15.148:0/2780244292 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60a80b4fb0 con 0x7f6084068380 2024-04-26T23:13:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 msgr2=0x7f608406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 0x7f608406a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6098001590 tx=0x7f6098009040 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 msgr2=0x7f60a81521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6090007c80 tx=0x7f6090012c50 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 shutdown_connections 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f6084068380 0x7f608406a840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60a80b3560 0x7f60a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60a814d470 0x7f60a81521f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 --2- 172.21.15.148:0/2780244292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60a814d090 0x7f60a81f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 >> 172.21.15.148:0/2780244292 conn(0x7f60a8068140 msgr2=0x7f60a8154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.264+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 shutdown_connections 2024-04-26T23:13:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.268+0000 7f60ae800640 1 -- 172.21.15.148:0/2780244292 wait complete. 2024-04-26T23:13:22.284 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T23:13:22.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:13:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.424+0000 7f5409200640 1 Processor -- start 2024-04-26T23:13:22.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 -- start start 2024-04-26T23:13:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54040c6660 0x7f54040703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54040c6a40 0x7f54040c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f54041593f0 0x7f54040c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5404158f60 con 0x7f54040c6a40 2024-04-26T23:13:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f540406f7f0 con 0x7f54041593f0 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5409200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f540406f230 con 0x7f54040c6660 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54040c6a40 0x7f54040c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54040c6a40 0x7f54040c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44648/0 (socket says 172.21.15.148:44648) 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 -- 172.21.15.148:0/2699675760 learned_addr learned my addr 172.21.15.148:0/2699675760 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5403400640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54040c6660 0x7f54040703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f5403e00640 1 --2- 172.21.15.148:0/2699675760 >> v2:172.21.15.157:3300/0 conn(0x7f54041593f0 0x7f54040c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 -- 172.21.15.148:0/2699675760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54040c6660 msgr2=0x7f54040703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54040c6660 0x7f54040703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 -- 172.21.15.148:0/2699675760 >> v2:172.21.15.157:3300/0 conn(0x7f54041593f0 msgr2=0x7f54040c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 --2- 172.21.15.148:0/2699675760 >> v2:172.21.15.157:3300/0 conn(0x7f54041593f0 0x7f54040c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.428+0000 7f53faa00640 1 -- 172.21.15.148:0/2699675760 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540406f510 con 0x7f54040c6a40 2024-04-26T23:13:22.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f53faa00640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040c8320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5404068c60 tx=0x7f53ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f75d24ba2cecf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5402a00640 1 -- 172.21.15.148:0/2699675760 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0a6040 con 0x7f54040c6a40 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5402a00640 1 -- 172.21.15.148:0/2699675760 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0af070 con 0x7f54040c6a40 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5402a00640 1 -- 172.21.15.148:0/2699675760 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0aa860 con 0x7f54040c6a40 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- 172.21.15.148:0/2699675760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 msgr2=0x7f54040c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040c8320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5404068c60 tx=0x7f53ec01c520 comp rx=0 tx=0).stop 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- 172.21.15.148:0/2699675760 shutdown_connections 2024-04-26T23:13:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040c8320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 --2- 172.21.15.148:0/2699675760 >> v2:172.21.15.157:3300/0 conn(0x7f54041593f0 0x7f54040c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 --2- 172.21.15.148:0/2699675760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54040c6660 0x7f54040703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- 172.21.15.148:0/2699675760 >> 172.21.15.148:0/2699675760 conn(0x7f540406c380 msgr2=0x7f540406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- 172.21.15.148:0/2699675760 shutdown_connections 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- 172.21.15.148:0/2699675760 wait complete. 2024-04-26T23:13:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 Processor -- start 2024-04-26T23:13:22.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.432+0000 7f5409200640 1 -- start start 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54040c6660 0x7f54041f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54041593f0 0x7f540406fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54040c8110 con 0x7f54040c6a40 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f54040c7f90 con 0x7f54040c6660 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f540415bd00 con 0x7f54041593f0 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44658/0 (socket says 172.21.15.148:44658) 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 -- 172.21.15.148:0/311949182 learned_addr learned my addr 172.21.15.148:0/311949182 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5403400640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54040c6660 0x7f54041f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5403e00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54041593f0 0x7f540406fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 -- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54041593f0 msgr2=0x7f540406fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54041593f0 0x7f540406fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 -- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54040c6660 msgr2=0x7f54041f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54040c6660 0x7f54041f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54041f8d40 con 0x7f54040c6a40 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53faa00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040ccb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53ec01abd0 tx=0x7f53ec01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0aadf0 con 0x7f54040c6a40 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0bd3f0 con 0x7f54040c6a40 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040cb310 con 0x7f54040c6a40 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0bd7a0 con 0x7f54040c6a40 2024-04-26T23:13:22.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040cb8d0 con 0x7f54040c6a40 2024-04-26T23:13:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54041f83e0 con 0x7f54040c6a40 2024-04-26T23:13:22.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.436+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53ec0b33f0 con 0x7f54040c6a40 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f53e0068380 0x7f53e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f53ec121180 con 0x7f54040c6a40 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f53e0071da0 0x7f53e0074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53ec001d40 con 0x7f53e0071da0 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53ec121530 con 0x7f54040c6a40 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f5403400640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f53e0068380 0x7f53e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f5403e00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f53e0071da0 0x7f53e0074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f5403400640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f53e0068380 0x7f53e006a840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009af0 tx=0x7f53f4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f5403e00640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f53e0071da0 0x7f53e0074240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.440+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== osd.7 v2:172.21.15.157:6808/939880062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53ec001d40 con 0x7f53e0071da0 2024-04-26T23:13:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 --> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54040506d0 con 0x7f53e0071da0 2024-04-26T23:13:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f53fbe00640 1 -- 172.21.15.148:0/311949182 <== osd.7 v2:172.21.15.157:6808/939880062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54040506d0 con 0x7f53e0071da0 2024-04-26T23:13:22.454 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-26T23:13:22.455 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:13:22.455 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f53e0071da0 msgr2=0x7f53e0074240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6808/939880062,v1:172.21.15.157:6809/939880062] conn(0x7f53e0071da0 0x7f53e0074240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f53e0068380 msgr2=0x7f53e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f53e0068380 0x7f53e006a840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009af0 tx=0x7f53f4008040 comp rx=0 tx=0).stop 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 msgr2=0x7f54040ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 --2- 172.21.15.148:0/311949182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54040c6a40 0x7f54040ccb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53ec01abd0 tx=0x7f53ec01ad60 comp rx=0 tx=0).stop 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5403e00640 1 -- 172.21.15.148:0/311949182 reap_dead start 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 shutdown_connections 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 >> 172.21.15.148:0/311949182 conn(0x7f540406c380 msgr2=0x7f540415c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 shutdown_connections 2024-04-26T23:13:22.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.456+0000 7f5409200640 1 -- 172.21.15.148:0/311949182 wait complete. 2024-04-26T23:13:22.473 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T23:13:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 Processor -- start 2024-04-26T23:13:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 -- start start 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 0x7f805815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8058070f10 0x7f8058159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80580b3dd0 con 0x7f80580c6140 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f805815a160 con 0x7f8058070f10 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8057200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f80580b3b80 con 0x7f8058070b30 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8058070f10 0x7f8058159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8058070f10 0x7f8058159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44664/0 (socket says 172.21.15.148:44664) 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 -- 172.21.15.148:0/3336435742 learned_addr learned my addr 172.21.15.148:0/3336435742 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8055e00640 1 --2- 172.21.15.148:0/3336435742 >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 0x7f805815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 -- 172.21.15.148:0/3336435742 >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 msgr2=0x7f805815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 --2- 172.21.15.148:0/3336435742 >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 0x7f805815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 -- 172.21.15.148:0/3336435742 >> v1:172.21.15.157:6789/0 conn(0x7f80580c6140 legacy=0x7f80580c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:13:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f804fe00640 1 -- 172.21.15.148:0/3336435742 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80580b40b0 con 0x7f8058070f10 2024-04-26T23:13:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.612+0000 7f8055e00640 1 --2- 172.21.15.148:0/3336435742 >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 0x7f805815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f804fe00640 1 --2- 172.21.15.148:0/3336435742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f8058159c20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8058068cd0 tx=0x7f804001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b782e2d505fb404 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8055400640 1 -- 172.21.15.148:0/3336435742 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400b5070 con 0x7f8058070f10 2024-04-26T23:13:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8055400640 1 -- 172.21.15.148:0/3336435742 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80400a89d0 con 0x7f8058070f10 2024-04-26T23:13:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8055400640 1 -- 172.21.15.148:0/3336435742 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400a8da0 con 0x7f8058070f10 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 -- 172.21.15.148:0/3336435742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 msgr2=0x7f8058159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 --2- 172.21.15.148:0/3336435742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f8058159c20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8058068cd0 tx=0x7f804001ecd0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 -- 172.21.15.148:0/3336435742 shutdown_connections 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 --2- 172.21.15.148:0/3336435742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f8058159c20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 --2- 172.21.15.148:0/3336435742 >> v2:172.21.15.157:3300/0 conn(0x7f8058070b30 0x7f805815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 -- 172.21.15.148:0/3336435742 >> 172.21.15.148:0/3336435742 conn(0x7f805806c980 msgr2=0x7f8058068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 -- 172.21.15.148:0/3336435742 shutdown_connections 2024-04-26T23:13:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.616+0000 7f8057200640 1 -- 172.21.15.148:0/3336435742 wait complete. 2024-04-26T23:13:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 Processor -- start 2024-04-26T23:13:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- start start 2024-04-26T23:13:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 0x7f80580cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 0x7f80581f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f805815d510 con 0x7f8058070f10 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f805815d230 con 0x7f80580c6140 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8058071840 con 0x7f8058070b30 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44672/0 (socket says 172.21.15.148:44672) 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 -- 172.21.15.148:0/728405653 learned_addr learned my addr 172.21.15.148:0/728405653 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8055e00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 0x7f80580cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8056800640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 0x7f80581f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 -- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 msgr2=0x7f80580cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 0x7f80580cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 -- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 msgr2=0x7f80581f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 0x7f80581f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 -- 172.21.15.148:0/728405653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058152900 con 0x7f8058070f10 2024-04-26T23:13:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8055e00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 0x7f80580cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8056800640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 0x7f80581f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804fe00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80400b3040 tx=0x7f804001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400c0070 con 0x7f8058070f10 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80400b0b60 con 0x7f8058070f10 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400b5070 con 0x7f8058070f10 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8058152be0 con 0x7f8058070f10 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80581531a0 con 0x7f8058070f10 2024-04-26T23:13:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.620+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80581533e0 con 0x7f8058070f10 2024-04-26T23:13:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.624+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80400ba3e0 con 0x7f8058070f10 2024-04-26T23:13:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.624+0000 7f804e000640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.624+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f80401241e0 con 0x7f8058070f10 2024-04-26T23:13:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.624+0000 7f8055e00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.624+0000 7f8055e00640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 0x7f803406a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8048008930 tx=0x7f8048008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.628+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f80581533e0 con 0x7f8058070f10 2024-04-26T23:13:22.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.784+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f80581f5d10 con 0x7f8034068380 2024-04-26T23:13:22.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.784+0000 7f804e000640 1 -- 172.21.15.148:0/728405653 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80581f5d10 con 0x7f8034068380 2024-04-26T23:13:22.785 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T23:13:22.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 msgr2=0x7f803406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 0x7f803406a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8048008930 tx=0x7f8048008040 comp rx=0 tx=0).stop 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 msgr2=0x7f80581f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80400b3040 tx=0x7f804001ba70 comp rx=0 tx=0).stop 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 shutdown_connections 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80580c6140 0x7f80581f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8058070f10 0x7f80581f1d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 --2- 172.21.15.148:0/728405653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8058070b30 0x7f80580cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 >> 172.21.15.148:0/728405653 conn(0x7f805806c980 msgr2=0x7f80580b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 shutdown_connections 2024-04-26T23:13:22.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.788+0000 7f8057200640 1 -- 172.21.15.148:0/728405653 wait complete. 2024-04-26T23:13:22.807 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:13:22.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 Processor -- start 2024-04-26T23:13:22.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 -- start start 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe180c63f0 0x7efe18165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180cb7f0 con 0x7efe181574b0 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180ca0d0 con 0x7efe180b47e0 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1fa00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7efe180ccd80 con 0x7efe180c63f0 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1da00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe180c63f0 0x7efe18165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1d000640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efe181574b0 0x7efe180ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54590/0 (socket says 172.21.15.148:54590) 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1d000640 1 -- 172.21.15.148:0/2612209056 learned_addr learned my addr 172.21.15.148:0/2612209056 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1da00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe180c63f0 0x7efe18165530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44686/0 (socket says 172.21.15.148:44686) 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1da00640 1 -- 172.21.15.148:0/2612209056 >> v1:172.21.15.157:6789/0 conn(0x7efe180b47e0 legacy=0x7efe1806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1da00640 1 -- 172.21.15.148:0/2612209056 >> v1:172.21.15.148:6789/0 conn(0x7efe181574b0 legacy=0x7efe180ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe17400640 1 -- 172.21.15.148:0/2612209056 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989679358 0 0) 0x7efe180cb7f0 con 0x7efe181574b0 2024-04-26T23:13:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.944+0000 7efe1da00640 1 -- 172.21.15.148:0/2612209056 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180cba90 con 0x7efe180c63f0 2024-04-26T23:13:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1da00640 1 --2- 172.21.15.148:0/2612209056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe18165530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe10009d90 tx=0x7efe1001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2003796b08258b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe17400640 1 -- 172.21.15.148:0/2612209056 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100b2070 con 0x7efe180c63f0 2024-04-26T23:13:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe17400640 1 -- 172.21.15.148:0/2612209056 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100a5830 con 0x7efe180c63f0 2024-04-26T23:13:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe17400640 1 -- 172.21.15.148:0/2612209056 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100a5c00 con 0x7efe180c63f0 2024-04-26T23:13:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 -- 172.21.15.148:0/2612209056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 msgr2=0x7efe18165530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 --2- 172.21.15.148:0/2612209056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe18165530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe10009d90 tx=0x7efe1001c970 comp rx=0 tx=0).stop 2024-04-26T23:13:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 -- 172.21.15.148:0/2612209056 shutdown_connections 2024-04-26T23:13:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 --2- 172.21.15.148:0/2612209056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe18165530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 -- 172.21.15.148:0/2612209056 >> 172.21.15.148:0/2612209056 conn(0x7efe18071160 msgr2=0x7efe18068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 -- 172.21.15.148:0/2612209056 shutdown_connections 2024-04-26T23:13:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.948+0000 7efe1fa00640 1 -- 172.21.15.148:0/2612209056 wait complete. 2024-04-26T23:13:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 Processor -- start 2024-04-26T23:13:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- start start 2024-04-26T23:13:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 0x7efe18156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 0x7efe180cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efe18168410 con 0x7efe180c63f0 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efe18168290 con 0x7efe181574b0 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efe18168590 con 0x7efe180b47e0 2024-04-26T23:13:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44698/0 (socket says 172.21.15.148:44698) 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 -- 172.21.15.148:0/1811639485 learned_addr learned my addr 172.21.15.148:0/1811639485 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1d000640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 0x7efe18156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1da00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 0x7efe180cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 -- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 msgr2=0x7efe18156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 0x7efe18156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 -- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 msgr2=0x7efe180cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 0x7efe180cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 -- 172.21.15.148:0/1811639485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18147430 con 0x7efe180c63f0 2024-04-26T23:13:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1da00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 0x7efe180cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1d000640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 0x7efe18156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe17e00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c500 tx=0x7efe0000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000052d0 con 0x7efe180c63f0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00005470 con 0x7efe180c63f0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00012830 con 0x7efe180c63f0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe18147710 con 0x7efe180c63f0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.952+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe180cd770 con 0x7efe180c63f0 2024-04-26T23:13:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe180cd970 con 0x7efe180c63f0 2024-04-26T23:13:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe000129d0 con 0x7efe180c63f0 2024-04-26T23:13:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe14c00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 0x7efdf406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efe00086a30 con 0x7efe180c63f0 2024-04-26T23:13:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe1d000640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 0x7efdf406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.956+0000 7efe1d000640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 0x7efdf406a870 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe08000f70 tx=0x7efe08007dd0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:22.960+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe180cd970 con 0x7efe180c63f0 2024-04-26T23:13:23.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.116+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe180cd280 con 0x7efdf40683b0 2024-04-26T23:13:23.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.140+0000 7efe14c00640 1 -- 172.21.15.148:0/1811639485 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334934 (secure 0 0 0) 0x7efe180cd280 con 0x7efdf40683b0 2024-04-26T23:13:23.143 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:23.145 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 msgr2=0x7efdf406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 0x7efdf406a870 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe08000f70 tx=0x7efe08007dd0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 msgr2=0x7efe181550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c500 tx=0x7efe0000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 shutdown_connections 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7efdf40683b0 0x7efdf406a870 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe181574b0 0x7efe180cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe180c63f0 0x7efe181550a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 --2- 172.21.15.148:0/1811639485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe180b47e0 0x7efe18156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 >> 172.21.15.148:0/1811639485 conn(0x7efe18071160 msgr2=0x7efe180ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 shutdown_connections 2024-04-26T23:13:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:23.144+0000 7efe1fa00640 1 -- 172.21.15.148:0/1811639485 wait complete. 2024-04-26T23:13:23.162 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-04-26T23:13:22.051366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350518,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31503,"num_write_kb":4538326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47188,"ondisk_log_size":47188,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615860,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,6,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9470,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005586"},"pg_stats":[{"pgid":"2.1f","version":"26'75","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.213694+0000","last_change":"2024-04-26T23:04:39.154780+0000","last_active":"2024-04-26T23:13:01.213694+0000","last_peered":"2024-04-26T23:13:01.213694+0000","last_clean":"2024-04-26T23:13:01.213694+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:01.213694+0000","last_undegraded":"2024-04-26T23:13:01.213694+0000","last_fullsized":"2024-04-26T23:13:01.213694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:24.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.749127+0000","last_change":"2024-04-26T23:04:40.169445+0000","last_active":"2024-04-26T23:13:15.749127+0000","last_peered":"2024-04-26T23:13:15.749127+0000","last_clean":"2024-04-26T23:13:15.749127+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:15.749127+0000","last_undegraded":"2024-04-26T23:13:15.749127+0000","last_fullsized":"2024-04-26T23:13:15.749127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:41.600838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.067372+0000","last_change":"2024-04-26T23:04:44.388589+0000","last_active":"2024-04-26T23:13:04.067372+0000","last_peered":"2024-04-26T23:13:04.067372+0000","last_clean":"2024-04-26T23:13:04.067372+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:04.067372+0000","last_undegraded":"2024-04-26T23:13:04.067372+0000","last_fullsized":"2024-04-26T23:13:04.067372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:18.425411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'91","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.067222+0000","last_change":"2024-04-26T23:04:39.132872+0000","last_active":"2024-04-26T23:12:57.067222+0000","last_peered":"2024-04-26T23:12:57.067222+0000","last_clean":"2024-04-26T23:12:57.067222+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:12:57.067222+0000","last_undegraded":"2024-04-26T23:12:57.067222+0000","last_fullsized":"2024-04-26T23:12:57.067222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:46.773966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.737812+0000","last_change":"2024-04-26T23:04:40.169337+0000","last_active":"2024-04-26T23:13:15.737812+0000","last_peered":"2024-04-26T23:13:15.737812+0000","last_clean":"2024-04-26T23:13:15.737812+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:15.737812+0000","last_undegraded":"2024-04-26T23:13:15.737812+0000","last_fullsized":"2024-04-26T23:13:15.737812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:17.751199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.054083+0000","last_change":"2024-04-26T23:04:44.222283+0000","last_active":"2024-04-26T23:13:04.054083+0000","last_peered":"2024-04-26T23:13:04.054083+0000","last_clean":"2024-04-26T23:13:04.054083+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:04.054083+0000","last_undegraded":"2024-04-26T23:13:04.054083+0000","last_fullsized":"2024-04-26T23:13:04.054083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:52.869064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'372","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.252017+0000","last_change":"2024-04-26T23:04:39.159218+0000","last_active":"2024-04-26T23:13:03.252017+0000","last_peered":"2024-04-26T23:13:03.252017+0000","last_clean":"2024-04-26T23:13:03.252017+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:03.252017+0000","last_undegraded":"2024-04-26T23:13:03.252017+0000","last_fullsized":"2024-04-26T23:13:03.252017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:57:08.664010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'194","reported_seq":220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.788810+0000","last_change":"2024-04-26T23:04:40.188017+0000","last_active":"2024-04-26T23:13:15.788810+0000","last_peered":"2024-04-26T23:13:15.788810+0000","last_clean":"2024-04-26T23:13:15.788810+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:15.788810+0000","last_undegraded":"2024-04-26T23:13:15.788810+0000","last_fullsized":"2024-04-26T23:13:15.788810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:13.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034589+0000","last_change":"2024-04-26T23:04:44.230460+0000","last_active":"2024-04-26T23:13:04.034589+0000","last_peered":"2024-04-26T23:13:04.034589+0000","last_clean":"2024-04-26T23:13:04.034589+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:04.034589+0000","last_undegraded":"2024-04-26T23:13:04.034589+0000","last_fullsized":"2024-04-26T23:13:04.034589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:04.701280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.688103+0000","last_change":"2024-04-26T23:04:39.159921+0000","last_active":"2024-04-26T23:13:01.688103+0000","last_peered":"2024-04-26T23:13:01.688103+0000","last_clean":"2024-04-26T23:13:01.688103+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:01.688103+0000","last_undegraded":"2024-04-26T23:13:01.688103+0000","last_fullsized":"2024-04-26T23:13:01.688103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:11.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'207","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.788130+0000","last_change":"2024-04-26T23:04:40.188520+0000","last_active":"2024-04-26T23:13:15.788130+0000","last_peered":"2024-04-26T23:13:15.788130+0000","last_clean":"2024-04-26T23:13:15.788130+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:15.788130+0000","last_undegraded":"2024-04-26T23:13:15.788130+0000","last_fullsized":"2024-04-26T23:13:15.788130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.873834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.020337+0000","last_change":"2024-04-26T23:04:44.213235+0000","last_active":"2024-04-26T23:13:04.020337+0000","last_peered":"2024-04-26T23:13:04.020337+0000","last_clean":"2024-04-26T23:13:04.020337+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:04.020337+0000","last_undegraded":"2024-04-26T23:13:04.020337+0000","last_fullsized":"2024-04-26T23:13:04.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:05.142158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'217","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.772613+0000","last_change":"2024-04-26T23:04:40.167697+0000","last_active":"2024-04-26T23:13:15.772613+0000","last_peered":"2024-04-26T23:13:15.772613+0000","last_clean":"2024-04-26T23:13:15.772613+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:15.772613+0000","last_undegraded":"2024-04-26T23:13:15.772613+0000","last_fullsized":"2024-04-26T23:13:15.772613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:38.273374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'276","reported_seq":305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.042364+0000","last_change":"2024-04-26T23:04:39.150955+0000","last_active":"2024-04-26T23:12:58.042364+0000","last_peered":"2024-04-26T23:12:58.042364+0000","last_clean":"2024-04-26T23:12:58.042364+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:12:58.042364+0000","last_undegraded":"2024-04-26T23:12:58.042364+0000","last_fullsized":"2024-04-26T23:12:58.042364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:02.687707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":936,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255123+0000","last_change":"2024-04-26T23:04:44.221337+0000","last_active":"2024-04-26T23:13:03.255123+0000","last_peered":"2024-04-26T23:13:03.255123+0000","last_clean":"2024-04-26T23:13:03.255123+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:03.255123+0000","last_undegraded":"2024-04-26T23:13:03.255123+0000","last_fullsized":"2024-04-26T23:13:03.255123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:18.965370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'213","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.725667+0000","last_change":"2024-04-26T23:04:40.153089+0000","last_active":"2024-04-26T23:13:15.725667+0000","last_peered":"2024-04-26T23:13:15.725667+0000","last_clean":"2024-04-26T23:13:15.725667+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:13:15.725667+0000","last_undegraded":"2024-04-26T23:13:15.725667+0000","last_fullsized":"2024-04-26T23:13:15.725667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:36.280065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'169","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.158426+0000","last_change":"2024-04-26T23:04:39.129628+0000","last_active":"2024-04-26T23:12:57.158426+0000","last_peered":"2024-04-26T23:12:57.158426+0000","last_clean":"2024-04-26T23:12:57.158426+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:12:57.158426+0000","last_undegraded":"2024-04-26T23:12:57.158426+0000","last_fullsized":"2024-04-26T23:12:57.158426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:52.084660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.073540+0000","last_change":"2024-04-26T23:04:44.225749+0000","last_active":"2024-04-26T23:13:04.073540+0000","last_peered":"2024-04-26T23:13:04.073540+0000","last_clean":"2024-04-26T23:13:04.073540+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:04.073540+0000","last_undegraded":"2024-04-26T23:13:04.073540+0000","last_fullsized":"2024-04-26T23:13:04.073540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:14.509266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'209","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.728377+0000","last_change":"2024-04-26T23:04:40.156779+0000","last_active":"2024-04-26T23:13:15.728377+0000","last_peered":"2024-04-26T23:13:15.728377+0000","last_clean":"2024-04-26T23:13:15.728377+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:15.728377+0000","last_undegraded":"2024-04-26T23:13:15.728377+0000","last_fullsized":"2024-04-26T23:13:15.728377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:01.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'124","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:16.655471+0000","last_change":"2024-04-26T23:04:39.124377+0000","last_active":"2024-04-26T23:13:16.655471+0000","last_peered":"2024-04-26T23:13:16.655471+0000","last_clean":"2024-04-26T23:13:16.655471+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:16.655471+0000","last_undegraded":"2024-04-26T23:13:16.655471+0000","last_fullsized":"2024-04-26T23:13:16.655471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:21.651826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588503,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":2585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.050381+0000","last_change":"2024-04-26T23:04:44.384063+0000","last_active":"2024-04-26T23:13:04.050381+0000","last_peered":"2024-04-26T23:13:04.050381+0000","last_clean":"2024-04-26T23:13:04.050381+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:04.050381+0000","last_undegraded":"2024-04-26T23:13:04.050381+0000","last_fullsized":"2024-04-26T23:13:04.050381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:02.254641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'226","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.691239+0000","last_change":"2024-04-26T23:04:40.178393+0000","last_active":"2024-04-26T23:13:15.691239+0000","last_peered":"2024-04-26T23:13:15.691239+0000","last_clean":"2024-04-26T23:13:15.691239+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:15.691239+0000","last_undegraded":"2024-04-26T23:13:15.691239+0000","last_fullsized":"2024-04-26T23:13:15.691239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:18.185712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'456","reported_seq":486,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.839909+0000","last_change":"2024-04-26T23:04:39.149482+0000","last_active":"2024-04-26T23:13:01.839909+0000","last_peered":"2024-04-26T23:13:01.839909+0000","last_clean":"2024-04-26T23:13:01.839909+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:13:01.839909+0000","last_undegraded":"2024-04-26T23:13:01.839909+0000","last_fullsized":"2024-04-26T23:13:01.839909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:30.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":786,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.094073+0000","last_change":"2024-04-26T23:04:44.225782+0000","last_active":"2024-04-26T23:13:04.094073+0000","last_peered":"2024-04-26T23:13:04.094073+0000","last_clean":"2024-04-26T23:13:04.094073+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:04.094073+0000","last_undegraded":"2024-04-26T23:13:04.094073+0000","last_fullsized":"2024-04-26T23:13:04.094073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:36.752754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.732250+0000","last_change":"2024-04-26T23:04:40.157987+0000","last_active":"2024-04-26T23:13:15.732250+0000","last_peered":"2024-04-26T23:13:15.732250+0000","last_clean":"2024-04-26T23:13:15.732250+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:15.732250+0000","last_undegraded":"2024-04-26T23:13:15.732250+0000","last_fullsized":"2024-04-26T23:13:15.732250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:41.204030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:08.987714+0000","last_change":"2024-04-26T23:04:39.134186+0000","last_active":"2024-04-26T23:13:08.987714+0000","last_peered":"2024-04-26T23:13:08.987714+0000","last_clean":"2024-04-26T23:13:08.987714+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:08.987714+0000","last_undegraded":"2024-04-26T23:13:08.987714+0000","last_fullsized":"2024-04-26T23:13:08.987714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:56.273944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082156+0000","last_change":"2024-04-26T23:04:44.388487+0000","last_active":"2024-04-26T23:13:04.082156+0000","last_peered":"2024-04-26T23:13:04.082156+0000","last_clean":"2024-04-26T23:13:04.082156+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:04.082156+0000","last_undegraded":"2024-04-26T23:13:04.082156+0000","last_fullsized":"2024-04-26T23:13:04.082156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:04.226135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.781394+0000","last_change":"2024-04-26T23:05:29.215214+0000","last_active":"2024-04-26T23:13:15.781394+0000","last_peered":"2024-04-26T23:13:15.781394+0000","last_clean":"2024-04-26T23:13:15.781394+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:15.781394+0000","last_undegraded":"2024-04-26T23:13:15.781394+0000","last_fullsized":"2024-04-26T23:13:15.781394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:32:30.350291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'407","reported_seq":437,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:16.598148+0000","last_change":"2024-04-26T23:04:39.128992+0000","last_active":"2024-04-26T23:13:16.598148+0000","last_peered":"2024-04-26T23:13:16.598148+0000","last_clean":"2024-04-26T23:13:16.598148+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:16.598148+0000","last_undegraded":"2024-04-26T23:13:16.598148+0000","last_fullsized":"2024-04-26T23:13:16.598148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:22.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.256926+0000","last_change":"2024-04-26T23:05:29.212929+0000","last_active":"2024-04-26T23:13:03.256926+0000","last_peered":"2024-04-26T23:13:03.256926+0000","last_clean":"2024-04-26T23:13:03.256926+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:03.256926+0000","last_undegraded":"2024-04-26T23:13:03.256926+0000","last_fullsized":"2024-04-26T23:13:03.256926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:28.986125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.727723+0000","last_change":"2024-04-26T23:04:40.159852+0000","last_active":"2024-04-26T23:13:15.727723+0000","last_peered":"2024-04-26T23:13:15.727723+0000","last_clean":"2024-04-26T23:13:15.727723+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:15.727723+0000","last_undegraded":"2024-04-26T23:13:15.727723+0000","last_fullsized":"2024-04-26T23:13:15.727723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.245208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'171","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.987978+0000","last_change":"2024-04-26T23:04:39.152383+0000","last_active":"2024-04-26T23:12:58.987978+0000","last_peered":"2024-04-26T23:12:58.987978+0000","last_clean":"2024-04-26T23:12:58.987978+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:12:58.987978+0000","last_undegraded":"2024-04-26T23:12:58.987978+0000","last_fullsized":"2024-04-26T23:12:58.987978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:55.972046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.044116+0000","last_change":"2024-04-26T23:05:29.212941+0000","last_active":"2024-04-26T23:13:04.044116+0000","last_peered":"2024-04-26T23:13:04.044116+0000","last_clean":"2024-04-26T23:13:04.044116+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:04.044116+0000","last_undegraded":"2024-04-26T23:13:04.044116+0000","last_fullsized":"2024-04-26T23:13:04.044116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:42.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'213","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.732975+0000","last_change":"2024-04-26T23:05:29.048153+0000","last_active":"2024-04-26T23:13:15.732975+0000","last_peered":"2024-04-26T23:13:15.732975+0000","last_clean":"2024-04-26T23:13:15.732975+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:15.732975+0000","last_undegraded":"2024-04-26T23:13:15.732975+0000","last_fullsized":"2024-04-26T23:13:15.732975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:28.287516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":97,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:58.048786+0000","last_change":"2024-04-26T23:04:39.129156+0000","last_active":"2024-04-26T23:12:58.048786+0000","last_peered":"2024-04-26T23:12:58.048786+0000","last_clean":"2024-04-26T23:12:58.048786+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:12:58.048786+0000","last_undegraded":"2024-04-26T23:12:58.048786+0000","last_fullsized":"2024-04-26T23:12:58.048786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:07.238020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.102733+0000","last_change":"2024-04-26T23:04:44.218477+0000","last_active":"2024-04-26T23:13:04.102733+0000","last_peered":"2024-04-26T23:13:04.102733+0000","last_clean":"2024-04-26T23:13:04.102733+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:04.102733+0000","last_undegraded":"2024-04-26T23:13:04.102733+0000","last_fullsized":"2024-04-26T23:13:04.102733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:23.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'198","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.713430+0000","last_change":"2024-04-26T23:04:40.153831+0000","last_active":"2024-04-26T23:13:15.713430+0000","last_peered":"2024-04-26T23:13:15.713430+0000","last_clean":"2024-04-26T23:13:15.713430+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:15.713430+0000","last_undegraded":"2024-04-26T23:13:15.713430+0000","last_fullsized":"2024-04-26T23:13:15.713430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:04.372758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'594","reported_seq":623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.067632+0000","last_change":"2024-04-26T23:04:39.155998+0000","last_active":"2024-04-26T23:12:51.067632+0000","last_peered":"2024-04-26T23:12:51.067632+0000","last_clean":"2024-04-26T23:12:51.067632+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:12:51.067632+0000","last_undegraded":"2024-04-26T23:12:51.067632+0000","last_fullsized":"2024-04-26T23:12:51.067632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:54.821188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.112304+0000","last_change":"2024-04-26T23:04:44.226782+0000","last_active":"2024-04-26T23:13:04.112304+0000","last_peered":"2024-04-26T23:13:04.112304+0000","last_clean":"2024-04-26T23:13:04.112304+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:04.112304+0000","last_undegraded":"2024-04-26T23:13:04.112304+0000","last_fullsized":"2024-04-26T23:13:04.112304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:40.217236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'210","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.716974+0000","last_change":"2024-04-26T23:04:40.161015+0000","last_active":"2024-04-26T23:13:15.716974+0000","last_peered":"2024-04-26T23:13:15.716974+0000","last_clean":"2024-04-26T23:13:15.716974+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:15.716974+0000","last_undegraded":"2024-04-26T23:13:15.716974+0000","last_fullsized":"2024-04-26T23:13:15.716974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.448907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'373","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:08.985628+0000","last_change":"2024-04-26T23:04:39.126851+0000","last_active":"2024-04-26T23:13:08.985628+0000","last_peered":"2024-04-26T23:13:08.985628+0000","last_clean":"2024-04-26T23:13:08.985628+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:08.985628+0000","last_undegraded":"2024-04-26T23:13:08.985628+0000","last_fullsized":"2024-04-26T23:13:08.985628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:36.638277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.018167+0000","last_change":"2024-04-26T23:04:44.216250+0000","last_active":"2024-04-26T23:13:04.018167+0000","last_peered":"2024-04-26T23:13:04.018167+0000","last_clean":"2024-04-26T23:13:04.018167+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:04.018167+0000","last_undegraded":"2024-04-26T23:13:04.018167+0000","last_fullsized":"2024-04-26T23:13:04.018167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:39.965530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.744579+0000","last_change":"2024-04-26T23:04:40.155961+0000","last_active":"2024-04-26T23:13:15.744579+0000","last_peered":"2024-04-26T23:13:15.744579+0000","last_clean":"2024-04-26T23:13:15.744579+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:15.744579+0000","last_undegraded":"2024-04-26T23:13:15.744579+0000","last_fullsized":"2024-04-26T23:13:15.744579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:15.848575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'256","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.194247+0000","last_change":"2024-04-26T23:04:39.150828+0000","last_active":"2024-04-26T23:12:57.194247+0000","last_peered":"2024-04-26T23:12:57.194247+0000","last_clean":"2024-04-26T23:12:57.194247+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:12:57.194247+0000","last_undegraded":"2024-04-26T23:12:57.194247+0000","last_fullsized":"2024-04-26T23:12:57.194247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:30.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.095976+0000","last_change":"2024-04-26T23:04:44.385138+0000","last_active":"2024-04-26T23:13:04.095976+0000","last_peered":"2024-04-26T23:13:04.095976+0000","last_clean":"2024-04-26T23:13:04.095976+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:04.095976+0000","last_undegraded":"2024-04-26T23:13:04.095976+0000","last_fullsized":"2024-04-26T23:13:04.095976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.728919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.719417+0000","last_change":"2024-04-26T23:04:40.173733+0000","last_active":"2024-04-26T23:13:15.719417+0000","last_peered":"2024-04-26T23:13:15.719417+0000","last_clean":"2024-04-26T23:13:15.719417+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:15.719417+0000","last_undegraded":"2024-04-26T23:13:15.719417+0000","last_fullsized":"2024-04-26T23:13:15.719417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.246080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.255579+0000","last_change":"2024-04-26T23:04:39.140094+0000","last_active":"2024-04-26T23:13:03.255579+0000","last_peered":"2024-04-26T23:13:03.255579+0000","last_clean":"2024-04-26T23:13:03.255579+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:03.255579+0000","last_undegraded":"2024-04-26T23:13:03.255579+0000","last_fullsized":"2024-04-26T23:13:03.255579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:50.461556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:10:38.964109+0000","last_change":"2024-04-26T23:04:35.262072+0000","last_active":"2024-04-26T23:10:38.964109+0000","last_peered":"2024-04-26T23:10:38.964109+0000","last_clean":"2024-04-26T23:10:38.964109+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:10:38.964109+0000","last_undegraded":"2024-04-26T23:10:38.964109+0000","last_fullsized":"2024-04-26T23:10:38.964109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:34.044481+0000","last_clean_scrub_stamp":"2024-04-26T23:04:34.044481+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:30.413157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.089012+0000","last_change":"2024-04-26T23:04:44.384929+0000","last_active":"2024-04-26T23:13:04.089012+0000","last_peered":"2024-04-26T23:13:04.089012+0000","last_clean":"2024-04-26T23:13:04.089012+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:04.089012+0000","last_undegraded":"2024-04-26T23:13:04.089012+0000","last_fullsized":"2024-04-26T23:13:04.089012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:15.048961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'210","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.804742+0000","last_change":"2024-04-26T23:04:40.183032+0000","last_active":"2024-04-26T23:13:15.804742+0000","last_peered":"2024-04-26T23:13:15.804742+0000","last_clean":"2024-04-26T23:13:15.804742+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:15.804742+0000","last_undegraded":"2024-04-26T23:13:15.804742+0000","last_fullsized":"2024-04-26T23:13:15.804742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.316630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'67","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.253000+0000","last_change":"2024-04-26T23:04:39.156555+0000","last_active":"2024-04-26T23:13:01.253000+0000","last_peered":"2024-04-26T23:13:01.253000+0000","last_clean":"2024-04-26T23:13:01.253000+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:01.253000+0000","last_undegraded":"2024-04-26T23:13:01.253000+0000","last_fullsized":"2024-04-26T23:13:01.253000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:22.499685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082677+0000","last_change":"2024-04-26T23:04:44.385398+0000","last_active":"2024-04-26T23:13:04.082677+0000","last_peered":"2024-04-26T23:13:04.082677+0000","last_clean":"2024-04-26T23:13:04.082677+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:04.082677+0000","last_undegraded":"2024-04-26T23:13:04.082677+0000","last_fullsized":"2024-04-26T23:13:04.082677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:14.954509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.787542+0000","last_change":"2024-04-26T23:04:40.176312+0000","last_active":"2024-04-26T23:13:15.787542+0000","last_peered":"2024-04-26T23:13:15.787542+0000","last_clean":"2024-04-26T23:13:15.787542+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:15.787542+0000","last_undegraded":"2024-04-26T23:13:15.787542+0000","last_fullsized":"2024-04-26T23:13:15.787542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:40.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'563","reported_seq":592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.143897+0000","last_change":"2024-04-26T23:04:39.122557+0000","last_active":"2024-04-26T23:12:57.143897+0000","last_peered":"2024-04-26T23:12:57.143897+0000","last_clean":"2024-04-26T23:12:57.143897+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:12:57.143897+0000","last_undegraded":"2024-04-26T23:12:57.143897+0000","last_fullsized":"2024-04-26T23:12:57.143897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:57.637491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.250455+0000","last_change":"2024-04-26T23:04:44.211493+0000","last_active":"2024-04-26T23:13:03.250455+0000","last_peered":"2024-04-26T23:13:03.250455+0000","last_clean":"2024-04-26T23:13:03.250455+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:03.250455+0000","last_undegraded":"2024-04-26T23:13:03.250455+0000","last_fullsized":"2024-04-26T23:13:03.250455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:02.187628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.804977+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:13:15.804977+0000","last_peered":"2024-04-26T23:13:15.804977+0000","last_clean":"2024-04-26T23:13:15.804977+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:15.804977+0000","last_undegraded":"2024-04-26T23:13:15.804977+0000","last_fullsized":"2024-04-26T23:13:15.804977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:10.715066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'297","reported_seq":325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:50.985566+0000","last_change":"2024-04-26T23:04:39.121741+0000","last_active":"2024-04-26T23:12:50.985566+0000","last_peered":"2024-04-26T23:12:50.985566+0000","last_clean":"2024-04-26T23:12:50.985566+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:12:50.985566+0000","last_undegraded":"2024-04-26T23:12:50.985566+0000","last_fullsized":"2024-04-26T23:12:50.985566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:14.991060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.106115+0000","last_change":"2024-04-26T23:04:44.385149+0000","last_active":"2024-04-26T23:13:04.106115+0000","last_peered":"2024-04-26T23:13:04.106115+0000","last_clean":"2024-04-26T23:13:04.106115+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:04.106115+0000","last_undegraded":"2024-04-26T23:13:04.106115+0000","last_fullsized":"2024-04-26T23:13:04.106115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:01.770425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'193","reported_seq":220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.800472+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:13:15.800472+0000","last_peered":"2024-04-26T23:13:15.800472+0000","last_clean":"2024-04-26T23:13:15.800472+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:15.800472+0000","last_undegraded":"2024-04-26T23:13:15.800472+0000","last_fullsized":"2024-04-26T23:13:15.800472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.295113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'168","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.153589+0000","last_change":"2024-04-26T23:04:39.132895+0000","last_active":"2024-04-26T23:13:03.153589+0000","last_peered":"2024-04-26T23:13:03.153589+0000","last_clean":"2024-04-26T23:13:03.153589+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:03.153589+0000","last_undegraded":"2024-04-26T23:13:03.153589+0000","last_fullsized":"2024-04-26T23:13:03.153589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:57.371293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.034681+0000","last_change":"2024-04-26T23:04:44.229843+0000","last_active":"2024-04-26T23:13:04.034681+0000","last_peered":"2024-04-26T23:13:04.034681+0000","last_clean":"2024-04-26T23:13:04.034681+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:04.034681+0000","last_undegraded":"2024-04-26T23:13:04.034681+0000","last_fullsized":"2024-04-26T23:13:04.034681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:42.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.800274+0000","last_change":"2024-04-26T23:04:40.186916+0000","last_active":"2024-04-26T23:13:15.800274+0000","last_peered":"2024-04-26T23:13:15.800274+0000","last_clean":"2024-04-26T23:13:15.800274+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:15.800274+0000","last_undegraded":"2024-04-26T23:13:15.800274+0000","last_fullsized":"2024-04-26T23:13:15.800274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:47.089282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'366","reported_seq":394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:01.200579+0000","last_change":"2024-04-26T23:04:39.121492+0000","last_active":"2024-04-26T23:13:01.200579+0000","last_peered":"2024-04-26T23:13:01.200579+0000","last_clean":"2024-04-26T23:13:01.200579+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:01.200579+0000","last_undegraded":"2024-04-26T23:13:01.200579+0000","last_fullsized":"2024-04-26T23:13:01.200579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:46:23.519513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.009350+0000","last_change":"2024-04-26T23:04:44.225346+0000","last_active":"2024-04-26T23:13:04.009350+0000","last_peered":"2024-04-26T23:13:04.009350+0000","last_clean":"2024-04-26T23:13:04.009350+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:04.009350+0000","last_undegraded":"2024-04-26T23:13:04.009350+0000","last_fullsized":"2024-04-26T23:13:04.009350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:33.807882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.755092+0000","last_change":"2024-04-26T23:04:40.164600+0000","last_active":"2024-04-26T23:13:15.755092+0000","last_peered":"2024-04-26T23:13:15.755092+0000","last_clean":"2024-04-26T23:13:15.755092+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:15.755092+0000","last_undegraded":"2024-04-26T23:13:15.755092+0000","last_fullsized":"2024-04-26T23:13:15.755092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:07.782316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.963043+0000","last_change":"2024-04-26T23:04:39.148078+0000","last_active":"2024-04-26T23:12:51.963043+0000","last_peered":"2024-04-26T23:12:51.963043+0000","last_clean":"2024-04-26T23:12:51.963043+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:12:51.963043+0000","last_undegraded":"2024-04-26T23:12:51.963043+0000","last_fullsized":"2024-04-26T23:12:51.963043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:00.067160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.209932+0000","last_change":"2024-04-26T23:04:44.383575+0000","last_active":"2024-04-26T23:13:03.209932+0000","last_peered":"2024-04-26T23:13:03.209932+0000","last_clean":"2024-04-26T23:13:03.209932+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:03.209932+0000","last_undegraded":"2024-04-26T23:13:03.209932+0000","last_fullsized":"2024-04-26T23:13:03.209932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:03.286901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'199","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.802192+0000","last_change":"2024-04-26T23:04:40.186817+0000","last_active":"2024-04-26T23:13:15.802192+0000","last_peered":"2024-04-26T23:13:15.802192+0000","last_clean":"2024-04-26T23:13:15.802192+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:15.802192+0000","last_undegraded":"2024-04-26T23:13:15.802192+0000","last_fullsized":"2024-04-26T23:13:15.802192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:16.087517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'63","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.113749+0000","last_change":"2024-04-26T23:04:39.158787+0000","last_active":"2024-04-26T23:13:04.113749+0000","last_peered":"2024-04-26T23:13:04.113749+0000","last_clean":"2024-04-26T23:13:04.113749+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:04.113749+0000","last_undegraded":"2024-04-26T23:13:04.113749+0000","last_fullsized":"2024-04-26T23:13:04.113749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:11.422096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.998275+0000","last_change":"2024-04-26T23:04:44.378798+0000","last_active":"2024-04-26T23:13:03.998275+0000","last_peered":"2024-04-26T23:13:03.998275+0000","last_clean":"2024-04-26T23:13:03.998275+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:03.998275+0000","last_undegraded":"2024-04-26T23:13:03.998275+0000","last_fullsized":"2024-04-26T23:13:03.998275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'207","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.802823+0000","last_change":"2024-04-26T23:04:40.172736+0000","last_active":"2024-04-26T23:13:15.802823+0000","last_peered":"2024-04-26T23:13:15.802823+0000","last_clean":"2024-04-26T23:13:15.802823+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:15.802823+0000","last_undegraded":"2024-04-26T23:13:15.802823+0000","last_fullsized":"2024-04-26T23:13:15.802823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:17.455279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'656","reported_seq":685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:51.989193+0000","last_change":"2024-04-26T23:04:39.143135+0000","last_active":"2024-04-26T23:12:51.989193+0000","last_peered":"2024-04-26T23:12:51.989193+0000","last_clean":"2024-04-26T23:12:51.989193+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:12:51.989193+0000","last_undegraded":"2024-04-26T23:12:51.989193+0000","last_fullsized":"2024-04-26T23:12:51.989193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:25.443334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":805,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.068538+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:13:04.068538+0000","last_peered":"2024-04-26T23:13:04.068538+0000","last_clean":"2024-04-26T23:13:04.068538+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:04.068538+0000","last_undegraded":"2024-04-26T23:13:04.068538+0000","last_fullsized":"2024-04-26T23:13:04.068538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:14.458629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'208","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.788467+0000","last_change":"2024-04-26T23:04:40.173050+0000","last_active":"2024-04-26T23:13:15.788467+0000","last_peered":"2024-04-26T23:13:15.788467+0000","last_clean":"2024-04-26T23:13:15.788467+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:15.788467+0000","last_undegraded":"2024-04-26T23:13:15.788467+0000","last_fullsized":"2024-04-26T23:13:15.788467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:49.863744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'356","reported_seq":385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.065249+0000","last_change":"2024-04-26T23:04:39.128082+0000","last_active":"2024-04-26T23:12:57.065249+0000","last_peered":"2024-04-26T23:12:57.065249+0000","last_clean":"2024-04-26T23:12:57.065249+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:12:57.065249+0000","last_undegraded":"2024-04-26T23:12:57.065249+0000","last_fullsized":"2024-04-26T23:12:57.065249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:30.995826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.082592+0000","last_change":"2024-04-26T23:04:44.220783+0000","last_active":"2024-04-26T23:13:04.082592+0000","last_peered":"2024-04-26T23:13:04.082592+0000","last_clean":"2024-04-26T23:13:04.082592+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:04.082592+0000","last_undegraded":"2024-04-26T23:13:04.082592+0000","last_fullsized":"2024-04-26T23:13:04.082592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:41.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.803491+0000","last_change":"2024-04-26T23:04:40.179405+0000","last_active":"2024-04-26T23:13:15.803491+0000","last_peered":"2024-04-26T23:13:15.803491+0000","last_clean":"2024-04-26T23:13:15.803491+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:15.803491+0000","last_undegraded":"2024-04-26T23:13:15.803491+0000","last_fullsized":"2024-04-26T23:13:15.803491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:24.795363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'334","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.988158+0000","last_change":"2024-04-26T23:04:39.155662+0000","last_active":"2024-04-26T23:13:04.988158+0000","last_peered":"2024-04-26T23:13:04.988158+0000","last_clean":"2024-04-26T23:13:04.988158+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:04.988158+0000","last_undegraded":"2024-04-26T23:13:04.988158+0000","last_fullsized":"2024-04-26T23:13:04.988158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:02.026192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.038541+0000","last_change":"2024-04-26T23:04:44.223525+0000","last_active":"2024-04-26T23:13:04.038541+0000","last_peered":"2024-04-26T23:13:04.038541+0000","last_clean":"2024-04-26T23:13:04.038541+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:04.038541+0000","last_undegraded":"2024-04-26T23:13:04.038541+0000","last_fullsized":"2024-04-26T23:13:04.038541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:18.015561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'191","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.737594+0000","last_change":"2024-04-26T23:04:40.169187+0000","last_active":"2024-04-26T23:13:15.737594+0000","last_peered":"2024-04-26T23:13:15.737594+0000","last_clean":"2024-04-26T23:13:15.737594+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:15.737594+0000","last_undegraded":"2024-04-26T23:13:15.737594+0000","last_fullsized":"2024-04-26T23:13:15.737594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:33.817064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'106","reported_seq":134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.104165+0000","last_change":"2024-04-26T23:04:39.153897+0000","last_active":"2024-04-26T23:13:03.104165+0000","last_peered":"2024-04-26T23:13:03.104165+0000","last_clean":"2024-04-26T23:13:03.104165+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:03.104165+0000","last_undegraded":"2024-04-26T23:13:03.104165+0000","last_fullsized":"2024-04-26T23:13:03.104165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:53.577406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.060188+0000","last_change":"2024-04-26T23:04:44.215279+0000","last_active":"2024-04-26T23:13:04.060188+0000","last_peered":"2024-04-26T23:13:04.060188+0000","last_clean":"2024-04-26T23:13:04.060188+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:04.060188+0000","last_undegraded":"2024-04-26T23:13:04.060188+0000","last_fullsized":"2024-04-26T23:13:04.060188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:59.214258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'216","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.803613+0000","last_change":"2024-04-26T23:04:40.181130+0000","last_active":"2024-04-26T23:13:15.803613+0000","last_peered":"2024-04-26T23:13:15.803613+0000","last_clean":"2024-04-26T23:13:15.803613+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:15.803613+0000","last_undegraded":"2024-04-26T23:13:15.803613+0000","last_fullsized":"2024-04-26T23:13:15.803613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:23.429538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'77","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.102867+0000","last_change":"2024-04-26T23:04:39.142034+0000","last_active":"2024-04-26T23:12:57.102867+0000","last_peered":"2024-04-26T23:12:57.102867+0000","last_clean":"2024-04-26T23:12:57.102867+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:12:57.102867+0000","last_undegraded":"2024-04-26T23:12:57.102867+0000","last_fullsized":"2024-04-26T23:12:57.102867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:32.799162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.074896+0000","last_change":"2024-04-26T23:04:44.380387+0000","last_active":"2024-04-26T23:13:04.074896+0000","last_peered":"2024-04-26T23:13:04.074896+0000","last_clean":"2024-04-26T23:13:04.074896+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:04.074896+0000","last_undegraded":"2024-04-26T23:13:04.074896+0000","last_fullsized":"2024-04-26T23:13:04.074896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:48.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.041470+0000","last_change":"2024-04-26T23:05:29.212676+0000","last_active":"2024-04-26T23:13:04.041470+0000","last_peered":"2024-04-26T23:13:04.041470+0000","last_clean":"2024-04-26T23:13:04.041470+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:04.041470+0000","last_undegraded":"2024-04-26T23:13:04.041470+0000","last_fullsized":"2024-04-26T23:13:04.041470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:47.644852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.736602+0000","last_change":"2024-04-26T23:04:40.156877+0000","last_active":"2024-04-26T23:13:15.736602+0000","last_peered":"2024-04-26T23:13:15.736602+0000","last_clean":"2024-04-26T23:13:15.736602+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:15.736602+0000","last_undegraded":"2024-04-26T23:13:15.736602+0000","last_fullsized":"2024-04-26T23:13:15.736602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:03.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'834","reported_seq":862,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.056585+0000","last_change":"2024-04-26T23:04:39.143238+0000","last_active":"2024-04-26T23:12:57.056585+0000","last_peered":"2024-04-26T23:12:57.056585+0000","last_clean":"2024-04-26T23:12:57.056585+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:12:57.056585+0000","last_undegraded":"2024-04-26T23:12:57.056585+0000","last_fullsized":"2024-04-26T23:12:57.056585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:45.409063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.263878+0000","last_change":"2024-04-26T23:04:44.222311+0000","last_active":"2024-04-26T23:13:03.263878+0000","last_peered":"2024-04-26T23:13:03.263878+0000","last_clean":"2024-04-26T23:13:03.263878+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:03.263878+0000","last_undegraded":"2024-04-26T23:13:03.263878+0000","last_fullsized":"2024-04-26T23:13:03.263878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:14.581476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'218","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.733802+0000","last_change":"2024-04-26T23:04:40.152588+0000","last_active":"2024-04-26T23:13:15.733802+0000","last_peered":"2024-04-26T23:13:15.733802+0000","last_clean":"2024-04-26T23:13:15.733802+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:15.733802+0000","last_undegraded":"2024-04-26T23:13:15.733802+0000","last_fullsized":"2024-04-26T23:13:15.733802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:45.859068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'78","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:57.115707+0000","last_change":"2024-04-26T23:04:39.132181+0000","last_active":"2024-04-26T23:12:57.115707+0000","last_peered":"2024-04-26T23:12:57.115707+0000","last_clean":"2024-04-26T23:12:57.115707+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:12:57.115707+0000","last_undegraded":"2024-04-26T23:12:57.115707+0000","last_fullsized":"2024-04-26T23:12:57.115707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:52.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:54.090911+0000","last_change":"2024-04-26T23:04:39.145008+0000","last_active":"2024-04-26T23:12:54.090911+0000","last_peered":"2024-04-26T23:12:54.090911+0000","last_clean":"2024-04-26T23:12:54.090911+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:12:54.090911+0000","last_undegraded":"2024-04-26T23:12:54.090911+0000","last_fullsized":"2024-04-26T23:12:54.090911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:36:01.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'184","reported_seq":211,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.741438+0000","last_change":"2024-04-26T23:04:40.166068+0000","last_active":"2024-04-26T23:13:15.741438+0000","last_peered":"2024-04-26T23:13:15.741438+0000","last_clean":"2024-04-26T23:13:15.741438+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:15.741438+0000","last_undegraded":"2024-04-26T23:13:15.741438+0000","last_fullsized":"2024-04-26T23:13:15.741438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:01.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.045723+0000","last_change":"2024-04-26T23:04:44.209995+0000","last_active":"2024-04-26T23:13:04.045723+0000","last_peered":"2024-04-26T23:13:04.045723+0000","last_clean":"2024-04-26T23:13:04.045723+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:04.045723+0000","last_undegraded":"2024-04-26T23:13:04.045723+0000","last_fullsized":"2024-04-26T23:13:04.045723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.715136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'73","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:12:52.063000+0000","last_change":"2024-04-26T23:04:39.133038+0000","last_active":"2024-04-26T23:12:52.063000+0000","last_peered":"2024-04-26T23:12:52.063000+0000","last_clean":"2024-04-26T23:12:52.063000+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:12:52.063000+0000","last_undegraded":"2024-04-26T23:12:52.063000+0000","last_fullsized":"2024-04-26T23:12:52.063000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:38.090712+0000","last_clean_scrub_stamp":"2024-04-26T23:04:38.090712+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:36.807930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.737717+0000","last_change":"2024-04-26T23:04:40.166258+0000","last_active":"2024-04-26T23:13:15.737717+0000","last_peered":"2024-04-26T23:13:15.737717+0000","last_clean":"2024-04-26T23:13:15.737717+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:15.737717+0000","last_undegraded":"2024-04-26T23:13:15.737717+0000","last_fullsized":"2024-04-26T23:13:15.737717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:27.833661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:03.274282+0000","last_change":"2024-04-26T23:04:44.208814+0000","last_active":"2024-04-26T23:13:03.274282+0000","last_peered":"2024-04-26T23:13:03.274282+0000","last_clean":"2024-04-26T23:13:03.274282+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:03.274282+0000","last_undegraded":"2024-04-26T23:13:03.274282+0000","last_fullsized":"2024-04-26T23:13:03.274282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:56.897215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'224","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.770487+0000","last_change":"2024-04-26T23:04:40.164190+0000","last_active":"2024-04-26T23:13:15.770487+0000","last_peered":"2024-04-26T23:13:15.770487+0000","last_clean":"2024-04-26T23:13:15.770487+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:15.770487+0000","last_undegraded":"2024-04-26T23:13:15.770487+0000","last_fullsized":"2024-04-26T23:13:15.770487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:18.218884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'214","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.736474+0000","last_change":"2024-04-26T23:04:40.170852+0000","last_active":"2024-04-26T23:13:15.736474+0000","last_peered":"2024-04-26T23:13:15.736474+0000","last_clean":"2024-04-26T23:13:15.736474+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:15.736474+0000","last_undegraded":"2024-04-26T23:13:15.736474+0000","last_fullsized":"2024-04-26T23:13:15.736474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:44.461873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'232","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.784504+0000","last_change":"2024-04-26T23:04:40.173421+0000","last_active":"2024-04-26T23:13:15.784504+0000","last_peered":"2024-04-26T23:13:15.784504+0000","last_clean":"2024-04-26T23:13:15.784504+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:15.784504+0000","last_undegraded":"2024-04-26T23:13:15.784504+0000","last_fullsized":"2024-04-26T23:13:15.784504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:33.698571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.725928+0000","last_change":"2024-04-26T23:04:40.150011+0000","last_active":"2024-04-26T23:13:15.725928+0000","last_peered":"2024-04-26T23:13:15.725928+0000","last_clean":"2024-04-26T23:13:15.725928+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:15.725928+0000","last_undegraded":"2024-04-26T23:13:15.725928+0000","last_fullsized":"2024-04-26T23:13:15.725928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:29.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'192","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.741515+0000","last_change":"2024-04-26T23:05:29.866675+0000","last_active":"2024-04-26T23:13:15.741515+0000","last_peered":"2024-04-26T23:13:15.741515+0000","last_clean":"2024-04-26T23:13:15.741515+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:15.741515+0000","last_undegraded":"2024-04-26T23:13:15.741515+0000","last_fullsized":"2024-04-26T23:13:15.741515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.339856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'201","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.734704+0000","last_change":"2024-04-26T23:04:40.158481+0000","last_active":"2024-04-26T23:13:15.734704+0000","last_peered":"2024-04-26T23:13:15.734704+0000","last_clean":"2024-04-26T23:13:15.734704+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:15.734704+0000","last_undegraded":"2024-04-26T23:13:15.734704+0000","last_fullsized":"2024-04-26T23:13:15.734704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:27.913472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'240","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.804506+0000","last_change":"2024-04-26T23:04:40.172297+0000","last_active":"2024-04-26T23:13:15.804506+0000","last_peered":"2024-04-26T23:13:15.804506+0000","last_clean":"2024-04-26T23:13:15.804506+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:15.804506+0000","last_undegraded":"2024-04-26T23:13:15.804506+0000","last_fullsized":"2024-04-26T23:13:15.804506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:34.388081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'193","reported_seq":220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.725374+0000","last_change":"2024-04-26T23:04:40.159052+0000","last_active":"2024-04-26T23:13:15.725374+0000","last_peered":"2024-04-26T23:13:15.725374+0000","last_clean":"2024-04-26T23:13:15.725374+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:15.725374+0000","last_undegraded":"2024-04-26T23:13:15.725374+0000","last_fullsized":"2024-04-26T23:13:15.725374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:40.662847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'219","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.784640+0000","last_change":"2024-04-26T23:04:40.168291+0000","last_active":"2024-04-26T23:13:15.784640+0000","last_peered":"2024-04-26T23:13:15.784640+0000","last_clean":"2024-04-26T23:13:15.784640+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:15.784640+0000","last_undegraded":"2024-04-26T23:13:15.784640+0000","last_fullsized":"2024-04-26T23:13:15.784640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.308560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'202","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.741546+0000","last_change":"2024-04-26T23:04:40.180652+0000","last_active":"2024-04-26T23:13:15.741546+0000","last_peered":"2024-04-26T23:13:15.741546+0000","last_clean":"2024-04-26T23:13:15.741546+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:15.741546+0000","last_undegraded":"2024-04-26T23:13:15.741546+0000","last_fullsized":"2024-04-26T23:13:15.741546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:42.340857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'213","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.803957+0000","last_change":"2024-04-26T23:04:40.174554+0000","last_active":"2024-04-26T23:13:15.803957+0000","last_peered":"2024-04-26T23:13:15.803957+0000","last_clean":"2024-04-26T23:13:15.803957+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:15.803957+0000","last_undegraded":"2024-04-26T23:13:15.803957+0000","last_fullsized":"2024-04-26T23:13:15.803957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:11.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'203","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.803150+0000","last_change":"2024-04-26T23:04:40.172738+0000","last_active":"2024-04-26T23:13:15.803150+0000","last_peered":"2024-04-26T23:13:15.803150+0000","last_clean":"2024-04-26T23:13:15.803150+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:15.803150+0000","last_undegraded":"2024-04-26T23:13:15.803150+0000","last_fullsized":"2024-04-26T23:13:15.803150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:24.071797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'219","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.777878+0000","last_change":"2024-04-26T23:04:40.163292+0000","last_active":"2024-04-26T23:13:15.777878+0000","last_peered":"2024-04-26T23:13:15.777878+0000","last_clean":"2024-04-26T23:13:15.777878+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:15.777878+0000","last_undegraded":"2024-04-26T23:13:15.777878+0000","last_fullsized":"2024-04-26T23:13:15.777878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:37.687296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.757845+0000","last_change":"2024-04-26T23:04:40.173326+0000","last_active":"2024-04-26T23:13:15.757845+0000","last_peered":"2024-04-26T23:13:15.757845+0000","last_clean":"2024-04-26T23:13:15.757845+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:15.757845+0000","last_undegraded":"2024-04-26T23:13:15.757845+0000","last_fullsized":"2024-04-26T23:13:15.757845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:23.763850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'207","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.783819+0000","last_change":"2024-04-26T23:04:40.168539+0000","last_active":"2024-04-26T23:13:15.783819+0000","last_peered":"2024-04-26T23:13:15.783819+0000","last_clean":"2024-04-26T23:13:15.783819+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:15.783819+0000","last_undegraded":"2024-04-26T23:13:15.783819+0000","last_fullsized":"2024-04-26T23:13:15.783819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:03.346377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'208","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.802833+0000","last_change":"2024-04-26T23:04:40.182818+0000","last_active":"2024-04-26T23:13:15.802833+0000","last_peered":"2024-04-26T23:13:15.802833+0000","last_clean":"2024-04-26T23:13:15.802833+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:15.802833+0000","last_undegraded":"2024-04-26T23:13:15.802833+0000","last_fullsized":"2024-04-26T23:13:15.802833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.672392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'222","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.799576+0000","last_change":"2024-04-26T23:04:40.170965+0000","last_active":"2024-04-26T23:13:15.799576+0000","last_peered":"2024-04-26T23:13:15.799576+0000","last_clean":"2024-04-26T23:13:15.799576+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:15.799576+0000","last_undegraded":"2024-04-26T23:13:15.799576+0000","last_fullsized":"2024-04-26T23:13:15.799576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:57.336269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.738559+0000","last_change":"2024-04-26T23:04:40.187637+0000","last_active":"2024-04-26T23:13:15.738559+0000","last_peered":"2024-04-26T23:13:15.738559+0000","last_clean":"2024-04-26T23:13:15.738559+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:15.738559+0000","last_undegraded":"2024-04-26T23:13:15.738559+0000","last_fullsized":"2024-04-26T23:13:15.738559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:26.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'213","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.734377+0000","last_change":"2024-04-26T23:04:40.161768+0000","last_active":"2024-04-26T23:13:15.734377+0000","last_peered":"2024-04-26T23:13:15.734377+0000","last_clean":"2024-04-26T23:13:15.734377+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:15.734377+0000","last_undegraded":"2024-04-26T23:13:15.734377+0000","last_fullsized":"2024-04-26T23:13:15.734377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:48.426528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'204","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.763133+0000","last_change":"2024-04-26T23:04:40.167986+0000","last_active":"2024-04-26T23:13:15.763133+0000","last_peered":"2024-04-26T23:13:15.763133+0000","last_clean":"2024-04-26T23:13:15.763133+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:15.763133+0000","last_undegraded":"2024-04-26T23:13:15.763133+0000","last_fullsized":"2024-04-26T23:13:15.763133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:28.332078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'182","reported_seq":209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.777339+0000","last_change":"2024-04-26T23:04:40.179560+0000","last_active":"2024-04-26T23:13:15.777339+0000","last_peered":"2024-04-26T23:13:15.777339+0000","last_clean":"2024-04-26T23:13:15.777339+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:15.777339+0000","last_undegraded":"2024-04-26T23:13:15.777339+0000","last_fullsized":"2024-04-26T23:13:15.777339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:42.833925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'186","reported_seq":213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.790649+0000","last_change":"2024-04-26T23:04:40.177326+0000","last_active":"2024-04-26T23:13:15.790649+0000","last_peered":"2024-04-26T23:13:15.790649+0000","last_clean":"2024-04-26T23:13:15.790649+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:15.790649+0000","last_undegraded":"2024-04-26T23:13:15.790649+0000","last_fullsized":"2024-04-26T23:13:15.790649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:25:16.085505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'204","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.800879+0000","last_change":"2024-04-26T23:04:40.176172+0000","last_active":"2024-04-26T23:13:15.800879+0000","last_peered":"2024-04-26T23:13:15.800879+0000","last_clean":"2024-04-26T23:13:15.800879+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:15.800879+0000","last_undegraded":"2024-04-26T23:13:15.800879+0000","last_fullsized":"2024-04-26T23:13:15.800879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:35.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'211","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.804859+0000","last_change":"2024-04-26T23:04:40.182380+0000","last_active":"2024-04-26T23:13:15.804859+0000","last_peered":"2024-04-26T23:13:15.804859+0000","last_clean":"2024-04-26T23:13:15.804859+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:15.804859+0000","last_undegraded":"2024-04-26T23:13:15.804859+0000","last_fullsized":"2024-04-26T23:13:15.804859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:36.472667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'199","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.738767+0000","last_change":"2024-04-26T23:05:29.413874+0000","last_active":"2024-04-26T23:13:15.738767+0000","last_peered":"2024-04-26T23:13:15.738767+0000","last_clean":"2024-04-26T23:13:15.738767+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:15.738767+0000","last_undegraded":"2024-04-26T23:13:15.738767+0000","last_fullsized":"2024-04-26T23:13:15.738767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:56.983137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'212","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.787857+0000","last_change":"2024-04-26T23:04:40.173307+0000","last_active":"2024-04-26T23:13:15.787857+0000","last_peered":"2024-04-26T23:13:15.787857+0000","last_clean":"2024-04-26T23:13:15.787857+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:15.787857+0000","last_undegraded":"2024-04-26T23:13:15.787857+0000","last_fullsized":"2024-04-26T23:13:15.787857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:28.025319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'191","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.790944+0000","last_change":"2024-04-26T23:04:40.172772+0000","last_active":"2024-04-26T23:13:15.790944+0000","last_peered":"2024-04-26T23:13:15.790944+0000","last_clean":"2024-04-26T23:13:15.790944+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:15.790944+0000","last_undegraded":"2024-04-26T23:13:15.790944+0000","last_fullsized":"2024-04-26T23:13:15.790944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:49.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'206","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.785881+0000","last_change":"2024-04-26T23:04:40.172145+0000","last_active":"2024-04-26T23:13:15.785881+0000","last_peered":"2024-04-26T23:13:15.785881+0000","last_clean":"2024-04-26T23:13:15.785881+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:15.785881+0000","last_undegraded":"2024-04-26T23:13:15.785881+0000","last_fullsized":"2024-04-26T23:13:15.785881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.760518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'198","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.787733+0000","last_change":"2024-04-26T23:04:40.175905+0000","last_active":"2024-04-26T23:13:15.787733+0000","last_peered":"2024-04-26T23:13:15.787733+0000","last_clean":"2024-04-26T23:13:15.787733+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:15.787733+0000","last_undegraded":"2024-04-26T23:13:15.787733+0000","last_fullsized":"2024-04-26T23:13:15.787733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:27.021338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'190","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.731947+0000","last_change":"2024-04-26T23:04:40.153452+0000","last_active":"2024-04-26T23:13:15.731947+0000","last_peered":"2024-04-26T23:13:15.731947+0000","last_clean":"2024-04-26T23:13:15.731947+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:15.731947+0000","last_undegraded":"2024-04-26T23:13:15.731947+0000","last_fullsized":"2024-04-26T23:13:15.731947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:34.064075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'208","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.714831+0000","last_change":"2024-04-26T23:04:40.163007+0000","last_active":"2024-04-26T23:13:15.714831+0000","last_peered":"2024-04-26T23:13:15.714831+0000","last_clean":"2024-04-26T23:13:15.714831+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:15.714831+0000","last_undegraded":"2024-04-26T23:13:15.714831+0000","last_fullsized":"2024-04-26T23:13:15.714831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:17.176264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'207","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.801213+0000","last_change":"2024-04-26T23:04:40.182212+0000","last_active":"2024-04-26T23:13:15.801213+0000","last_peered":"2024-04-26T23:13:15.801213+0000","last_clean":"2024-04-26T23:13:15.801213+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:15.801213+0000","last_undegraded":"2024-04-26T23:13:15.801213+0000","last_fullsized":"2024-04-26T23:13:15.801213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:49.536377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13203,"ondisk_log_size":13203,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146760150,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6971,"num_write_kb":149053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293520300,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8243,"ondisk_log_size":8243,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53626098,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,6,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452446,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40338093,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921377,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.172 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.173 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.174 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.175 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.176 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T23:04:34.044481+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.177 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.178 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.179 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.180 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.181 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.182 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T23:04:38.090712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.183 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.184 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.185 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:23.186 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:13:43.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:13:43.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.336+0000 7f5555400640 1 Processor -- start 2024-04-26T23:13:43.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.336+0000 7f5555400640 1 -- start start 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5555400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f5550073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5555400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5550152fa0 con 0x7f55500c9b60 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5555400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5550159790 con 0x7f5550152bc0 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5555400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5550158930 con 0x7f5550072d70 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554f200640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f55500c9b60 0x7f55500c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44934/0 (socket says 172.21.15.148:44934) 2024-04-26T23:13:43.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554f200640 1 -- 172.21.15.148:0/2801849005 learned_addr learned my addr 172.21.15.148:0/2801849005 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:13:43.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5545e00640 1 --2- 172.21.15.148:0/2801849005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f5550073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:43.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629578596 0 0) 0x7f5550152fa0 con 0x7f55500c9b60 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5534003530 con 0x7f55500c9b60 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391107634 0 0) 0x7f5550159790 con 0x7f5550152bc0 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550152fa0 con 0x7f5550152bc0 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5545e00640 1 -- 172.21.15.148:0/2801849005 >> v1:172.21.15.157:6789/0 conn(0x7f5550152bc0 legacy=0x7f55500c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4128867973 0 0) 0x7f5534003530 con 0x7f55500c9b60 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5545e00640 1 -- 172.21.15.148:0/2801849005 >> v1:172.21.15.148:6789/0 conn(0x7f55500c9b60 legacy=0x7f55500c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.340+0000 7f5545e00640 1 -- 172.21.15.148:0/2801849005 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5550158c10 con 0x7f5550072d70 2024-04-26T23:13:43.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5545e00640 1 --2- 172.21.15.148:0/2801849005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f5550073190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55380097f0 tx=0x7f553801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dc3197ff0a89cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:43.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380b5070 con 0x7f5550072d70 2024-04-26T23:13:43.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380a8670 con 0x7f5550072d70 2024-04-26T23:13:43.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f554de00640 1 -- 172.21.15.148:0/2801849005 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548001680 con 0x7f5550072d70 2024-04-26T23:13:43.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- 172.21.15.148:0/2801849005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 msgr2=0x7f5550073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 --2- 172.21.15.148:0/2801849005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f5550073190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55380097f0 tx=0x7f553801ebf0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- 172.21.15.148:0/2801849005 shutdown_connections 2024-04-26T23:13:43.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 --2- 172.21.15.148:0/2801849005 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f5550073190 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- 172.21.15.148:0/2801849005 >> 172.21.15.148:0/2801849005 conn(0x7f555006c380 msgr2=0x7f555006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:43.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- 172.21.15.148:0/2801849005 shutdown_connections 2024-04-26T23:13:43.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- 172.21.15.148:0/2801849005 wait complete. 2024-04-26T23:13:43.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 Processor -- start 2024-04-26T23:13:43.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.344+0000 7f5555400640 1 -- start start 2024-04-26T23:13:43.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f55501ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 0x7f5550142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55501594b0 con 0x7f5550152bc0 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f55501591d0 con 0x7f55500c9b60 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f55500736d0 con 0x7f5550072d70 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48100/0 (socket says 172.21.15.148:48100) 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 -- 172.21.15.148:0/3454882522 learned_addr learned my addr 172.21.15.148:0/3454882522 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554e800640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f55501ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5545e00640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 0x7f5550142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 -- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 msgr2=0x7f55501ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f55501ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 -- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 msgr2=0x7f5550142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 0x7f5550142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 -- 172.21.15.148:0/3454882522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55501ee620 con 0x7f5550152bc0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5545e00640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 0x7f5550142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f554f200640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f554800c7b0 tx=0x7f554800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548017070 con 0x7f5550152bc0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5548005ae0 con 0x7f5550152bc0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548007070 con 0x7f5550152bc0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555014ed40 con 0x7f5550152bc0 2024-04-26T23:13:43.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555014e070 con 0x7f5550152bc0 2024-04-26T23:13:43.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5550077c20 con 0x7f5550152bc0 2024-04-26T23:13:43.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.348+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f554801a070 con 0x7f5550152bc0 2024-04-26T23:13:43.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.352+0000 7f5547400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 0x7f552c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:13:43.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.352+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5548086240 con 0x7f5550152bc0 2024-04-26T23:13:43.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.352+0000 7f554e800640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 0x7f552c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:13:43.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.352+0000 7f554e800640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 0x7f552c06a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5540001570 tx=0x7f5540009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:13:43.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.356+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f55501ee620 con 0x7f5550152bc0 2024-04-26T23:13:43.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.508+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55500c9940 con 0x7f552c068380 2024-04-26T23:13:43.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.532+0000 7f5547400640 1 -- 172.21.15.148:0/3454882522 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335462 (secure 0 0 0) 0x7f55500c9940 con 0x7f552c068380 2024-04-26T23:13:43.536 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:13:43.538 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 msgr2=0x7f552c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 0x7f552c06a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5540001570 tx=0x7f5540009040 comp rx=0 tx=0).stop 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 msgr2=0x7f5550156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f554800c7b0 tx=0x7f554800cc70 comp rx=0 tx=0).stop 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 shutdown_connections 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f552c068380 0x7f552c06a840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5550152bc0 0x7f5550156dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55500c9b60 0x7f5550142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 --2- 172.21.15.148:0/3454882522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5550072d70 0x7f55501ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:13:43.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 >> 172.21.15.148:0/3454882522 conn(0x7f555006c380 msgr2=0x7f55500704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:13:43.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 shutdown_connections 2024-04-26T23:13:43.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:13:43.536+0000 7f5555400640 1 -- 172.21.15.148:0/3454882522 wait complete. 2024-04-26T23:13:43.556 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-04-26T23:13:42.060644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350518,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31503,"num_write_kb":4538326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47279,"ondisk_log_size":47279,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615860,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005804"},"pg_stats":[{"pgid":"2.1f","version":"26'80","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.041581+0000","last_change":"2024-04-26T23:13:22.041615+0000","last_active":"2024-04-26T23:13:22.041581+0000","last_peered":"2024-04-26T23:13:22.041581+0000","last_clean":"2024-04-26T23:13:22.041581+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:22.041581+0000","last_undegraded":"2024-04-26T23:13:22.041581+0000","last_fullsized":"2024-04-26T23:13:22.041581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2024-04-26T23:13:22.041518+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2024-04-26T23:13:22.041518+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.041518+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:47.876079+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.098223+0000","last_change":"2024-04-26T23:13:23.098245+0000","last_active":"2024-04-26T23:13:23.098223+0000","last_peered":"2024-04-26T23:13:23.098223+0000","last_clean":"2024-04-26T23:13:23.098223+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:23.098223+0000","last_undegraded":"2024-04-26T23:13:23.098223+0000","last_fullsized":"2024-04-26T23:13:23.098223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-26T23:13:23.098165+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-26T23:13:23.098165+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.098165+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:16.994211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.058614+0000","last_change":"2024-04-26T23:13:37.058641+0000","last_active":"2024-04-26T23:13:37.058614+0000","last_peered":"2024-04-26T23:13:37.058614+0000","last_clean":"2024-04-26T23:13:37.058614+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:37.058614+0000","last_undegraded":"2024-04-26T23:13:37.058614+0000","last_fullsized":"2024-04-26T23:13:37.058614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'840","last_scrub_stamp":"2024-04-26T23:13:37.058520+0000","last_deep_scrub":"26'840","last_deep_scrub_stamp":"2024-04-26T23:13:37.058520+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.058520+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:15.908175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'92","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.116125+0000","last_change":"2024-04-26T23:13:25.116157+0000","last_active":"2024-04-26T23:13:25.116125+0000","last_peered":"2024-04-26T23:13:25.116125+0000","last_clean":"2024-04-26T23:13:25.116125+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:13:25.116125+0000","last_undegraded":"2024-04-26T23:13:25.116125+0000","last_fullsized":"2024-04-26T23:13:25.116125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2024-04-26T23:13:25.116039+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2024-04-26T23:13:25.116039+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.116039+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:30.122342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.202231+0000","last_change":"2024-04-26T23:13:29.202253+0000","last_active":"2024-04-26T23:13:29.202231+0000","last_peered":"2024-04-26T23:13:29.202231+0000","last_clean":"2024-04-26T23:13:29.202231+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:29.202231+0000","last_undegraded":"2024-04-26T23:13:29.202231+0000","last_fullsized":"2024-04-26T23:13:29.202231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-26T23:13:29.202129+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-26T23:13:29.202129+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.202129+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:43.765880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":885,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.505203+0000","last_change":"2024-04-26T23:13:29.505382+0000","last_active":"2024-04-26T23:13:29.505203+0000","last_peered":"2024-04-26T23:13:29.505203+0000","last_clean":"2024-04-26T23:13:29.505203+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:29.505203+0000","last_undegraded":"2024-04-26T23:13:29.505203+0000","last_fullsized":"2024-04-26T23:13:29.505203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'811","last_scrub_stamp":"2024-04-26T23:13:29.504983+0000","last_deep_scrub":"26'811","last_deep_scrub_stamp":"2024-04-26T23:13:29.504983+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.504983+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:54.226394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'377","reported_seq":415,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.014560+0000","last_change":"2024-04-26T23:13:30.014645+0000","last_active":"2024-04-26T23:13:30.014560+0000","last_peered":"2024-04-26T23:13:30.014560+0000","last_clean":"2024-04-26T23:13:30.014560+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:30.014560+0000","last_undegraded":"2024-04-26T23:13:30.014560+0000","last_fullsized":"2024-04-26T23:13:30.014560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'377","last_scrub_stamp":"2024-04-26T23:13:30.014365+0000","last_deep_scrub":"26'377","last_deep_scrub_stamp":"2024-04-26T23:13:30.014365+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.014365+0000","objects_scrubbed":5,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:25.854248+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'194","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.730280+0000","last_change":"2024-04-26T23:13:36.730338+0000","last_active":"2024-04-26T23:13:36.730280+0000","last_peered":"2024-04-26T23:13:36.730280+0000","last_clean":"2024-04-26T23:13:36.730280+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:36.730280+0000","last_undegraded":"2024-04-26T23:13:36.730280+0000","last_fullsized":"2024-04-26T23:13:36.730280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-26T23:13:36.730102+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-26T23:13:36.730102+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.730102+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:03.532424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.407937+0000","last_change":"2024-04-26T23:13:34.408017+0000","last_active":"2024-04-26T23:13:34.407937+0000","last_peered":"2024-04-26T23:13:34.407937+0000","last_clean":"2024-04-26T23:13:34.407937+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:34.407937+0000","last_undegraded":"2024-04-26T23:13:34.407937+0000","last_fullsized":"2024-04-26T23:13:34.407937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'784","last_scrub_stamp":"2024-04-26T23:13:34.407722+0000","last_deep_scrub":"26'784","last_deep_scrub_stamp":"2024-04-26T23:13:34.407722+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.407722+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:20.680802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'185","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.032102+0000","last_change":"2024-04-26T23:13:31.032246+0000","last_active":"2024-04-26T23:13:31.032102+0000","last_peered":"2024-04-26T23:13:31.032102+0000","last_clean":"2024-04-26T23:13:31.032102+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:31.032102+0000","last_undegraded":"2024-04-26T23:13:31.032102+0000","last_fullsized":"2024-04-26T23:13:31.032102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'185","last_scrub_stamp":"2024-04-26T23:13:31.031881+0000","last_deep_scrub":"26'185","last_deep_scrub_stamp":"2024-04-26T23:13:31.031881+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.031881+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:27.167975+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'207","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.718502+0000","last_change":"2024-04-26T23:13:37.718560+0000","last_active":"2024-04-26T23:13:37.718502+0000","last_peered":"2024-04-26T23:13:37.718502+0000","last_clean":"2024-04-26T23:13:37.718502+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:37.718502+0000","last_undegraded":"2024-04-26T23:13:37.718502+0000","last_fullsized":"2024-04-26T23:13:37.718502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:37.718320+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:37.718320+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.718320+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:51.604664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.459103+0000","last_change":"2024-04-26T23:13:27.459242+0000","last_active":"2024-04-26T23:13:27.459103+0000","last_peered":"2024-04-26T23:13:27.459103+0000","last_clean":"2024-04-26T23:13:27.459103+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:27.459103+0000","last_undegraded":"2024-04-26T23:13:27.459103+0000","last_fullsized":"2024-04-26T23:13:27.459103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'751","last_scrub_stamp":"2024-04-26T23:13:27.458846+0000","last_deep_scrub":"26'751","last_deep_scrub_stamp":"2024-04-26T23:13:27.458846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.458846+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:05.769682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'217","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.196575+0000","last_change":"2024-04-26T23:13:31.196633+0000","last_active":"2024-04-26T23:13:31.196575+0000","last_peered":"2024-04-26T23:13:31.196575+0000","last_clean":"2024-04-26T23:13:31.196575+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:31.196575+0000","last_undegraded":"2024-04-26T23:13:31.196575+0000","last_fullsized":"2024-04-26T23:13:31.196575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'217","last_scrub_stamp":"2024-04-26T23:13:31.196392+0000","last_deep_scrub":"26'217","last_deep_scrub_stamp":"2024-04-26T23:13:31.196392+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.196392+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:36.690443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'280","reported_seq":319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.082278+0000","last_change":"2024-04-26T23:13:28.082278+0000","last_active":"2024-04-26T23:13:28.082278+0000","last_peered":"2024-04-26T23:13:28.082278+0000","last_clean":"2024-04-26T23:13:28.082278+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:13:28.082278+0000","last_undegraded":"2024-04-26T23:13:28.082278+0000","last_fullsized":"2024-04-26T23:13:28.082278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'280","last_scrub_stamp":"2024-04-26T23:13:28.081984+0000","last_deep_scrub":"26'280","last_deep_scrub_stamp":"2024-04-26T23:13:28.081984+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.081984+0000","objects_scrubbed":4,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:35.468646+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":945,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.490788+0000","last_change":"2024-04-26T23:13:28.490882+0000","last_active":"2024-04-26T23:13:28.490788+0000","last_peered":"2024-04-26T23:13:28.490788+0000","last_clean":"2024-04-26T23:13:28.490788+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:28.490788+0000","last_undegraded":"2024-04-26T23:13:28.490788+0000","last_fullsized":"2024-04-26T23:13:28.490788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'863","last_scrub_stamp":"2024-04-26T23:13:28.490593+0000","last_deep_scrub":"26'863","last_deep_scrub_stamp":"2024-04-26T23:13:28.490593+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.490593+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:38.213384+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'213","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.081799+0000","last_change":"2024-04-26T23:13:28.081823+0000","last_active":"2024-04-26T23:13:28.081799+0000","last_peered":"2024-04-26T23:13:28.081799+0000","last_clean":"2024-04-26T23:13:28.081799+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:13:28.081799+0000","last_undegraded":"2024-04-26T23:13:28.081799+0000","last_fullsized":"2024-04-26T23:13:28.081799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:28.081717+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:28.081717+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.081717+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:59.633567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'171","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.566849+0000","last_change":"2024-04-26T23:13:24.566885+0000","last_active":"2024-04-26T23:13:24.566849+0000","last_peered":"2024-04-26T23:13:24.566849+0000","last_clean":"2024-04-26T23:13:24.566849+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:13:24.566849+0000","last_undegraded":"2024-04-26T23:13:24.566849+0000","last_fullsized":"2024-04-26T23:13:24.566849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'171","last_scrub_stamp":"2024-04-26T23:13:24.566764+0000","last_deep_scrub":"26'171","last_deep_scrub_stamp":"2024-04-26T23:13:24.566764+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.566764+0000","objects_scrubbed":2,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:00.375742+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.425122+0000","last_change":"2024-04-26T23:13:31.425190+0000","last_active":"2024-04-26T23:13:31.425122+0000","last_peered":"2024-04-26T23:13:31.425122+0000","last_clean":"2024-04-26T23:13:31.425122+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:31.425122+0000","last_undegraded":"2024-04-26T23:13:31.425122+0000","last_fullsized":"2024-04-26T23:13:31.425122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'852","last_scrub_stamp":"2024-04-26T23:13:31.424936+0000","last_deep_scrub":"26'852","last_deep_scrub_stamp":"2024-04-26T23:13:31.424936+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.424936+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:13.302704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'209","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.061038+0000","last_change":"2024-04-26T23:13:29.061060+0000","last_active":"2024-04-26T23:13:29.061038+0000","last_peered":"2024-04-26T23:13:29.061038+0000","last_clean":"2024-04-26T23:13:29.061038+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:29.061038+0000","last_undegraded":"2024-04-26T23:13:29.061038+0000","last_fullsized":"2024-04-26T23:13:29.061038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-26T23:13:29.060944+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-26T23:13:29.060944+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.060944+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.170296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.644886+0000","last_change":"2024-04-26T23:13:21.644913+0000","last_active":"2024-04-26T23:13:21.644886+0000","last_peered":"2024-04-26T23:13:21.644886+0000","last_clean":"2024-04-26T23:13:21.644886+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:21.644886+0000","last_undegraded":"2024-04-26T23:13:21.644886+0000","last_fullsized":"2024-04-26T23:13:21.644886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-04-26T23:13:21.644825+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-04-26T23:13:21.644825+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.644825+0000","objects_scrubbed":3,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:10.237602+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588503,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":2585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.490407+0000","last_change":"2024-04-26T23:13:35.490434+0000","last_active":"2024-04-26T23:13:35.490407+0000","last_peered":"2024-04-26T23:13:35.490407+0000","last_clean":"2024-04-26T23:13:35.490407+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:35.490407+0000","last_undegraded":"2024-04-26T23:13:35.490407+0000","last_fullsized":"2024-04-26T23:13:35.490407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-26T23:13:35.490312+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-26T23:13:35.490312+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.490312+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:22.294461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'226","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.457023+0000","last_change":"2024-04-26T23:13:24.457090+0000","last_active":"2024-04-26T23:13:24.457023+0000","last_peered":"2024-04-26T23:13:24.457023+0000","last_clean":"2024-04-26T23:13:24.457023+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:24.457023+0000","last_undegraded":"2024-04-26T23:13:24.457023+0000","last_fullsized":"2024-04-26T23:13:24.457023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'226","last_scrub_stamp":"2024-04-26T23:13:24.456846+0000","last_deep_scrub":"26'226","last_deep_scrub_stamp":"2024-04-26T23:13:24.456846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.456846+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:27.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'458","reported_seq":497,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.024017+0000","last_change":"2024-04-26T23:13:26.024084+0000","last_active":"2024-04-26T23:13:26.024017+0000","last_peered":"2024-04-26T23:13:26.024017+0000","last_clean":"2024-04-26T23:13:26.024017+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:13:26.024017+0000","last_undegraded":"2024-04-26T23:13:26.024017+0000","last_fullsized":"2024-04-26T23:13:26.024017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'458","last_scrub_stamp":"2024-04-26T23:13:26.023835+0000","last_deep_scrub":"26'458","last_deep_scrub_stamp":"2024-04-26T23:13:26.023835+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.023835+0000","objects_scrubbed":2,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:40.228191+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":795,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.429872+0000","last_change":"2024-04-26T23:13:32.429975+0000","last_active":"2024-04-26T23:13:32.429872+0000","last_peered":"2024-04-26T23:13:32.429872+0000","last_clean":"2024-04-26T23:13:32.429872+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:32.429872+0000","last_undegraded":"2024-04-26T23:13:32.429872+0000","last_fullsized":"2024-04-26T23:13:32.429872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:32.429676+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:32.429676+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.429676+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:44.351815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.108248+0000","last_change":"2024-04-26T23:13:26.108272+0000","last_active":"2024-04-26T23:13:26.108248+0000","last_peered":"2024-04-26T23:13:26.108248+0000","last_clean":"2024-04-26T23:13:26.108248+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:26.108248+0000","last_undegraded":"2024-04-26T23:13:26.108248+0000","last_fullsized":"2024-04-26T23:13:26.108248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:26.108165+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:26.108165+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.108165+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:18.423957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'79","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.211504+0000","last_change":"2024-04-26T23:13:24.211582+0000","last_active":"2024-04-26T23:13:24.211504+0000","last_peered":"2024-04-26T23:13:24.211504+0000","last_clean":"2024-04-26T23:13:24.211504+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:24.211504+0000","last_undegraded":"2024-04-26T23:13:24.211504+0000","last_fullsized":"2024-04-26T23:13:24.211504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-26T23:13:24.211341+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-26T23:13:24.211341+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.211341+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:13.485197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.396394+0000","last_change":"2024-04-26T23:13:35.396537+0000","last_active":"2024-04-26T23:13:35.396394+0000","last_peered":"2024-04-26T23:13:35.396394+0000","last_clean":"2024-04-26T23:13:35.396394+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:35.396394+0000","last_undegraded":"2024-04-26T23:13:35.396394+0000","last_fullsized":"2024-04-26T23:13:35.396394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'823","last_scrub_stamp":"2024-04-26T23:13:35.396151+0000","last_deep_scrub":"26'823","last_deep_scrub_stamp":"2024-04-26T23:13:35.396151+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.396151+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:26:01.131607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.184104+0000","last_change":"2024-04-26T23:13:28.184129+0000","last_active":"2024-04-26T23:13:28.184104+0000","last_peered":"2024-04-26T23:13:28.184104+0000","last_clean":"2024-04-26T23:13:28.184104+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:28.184104+0000","last_undegraded":"2024-04-26T23:13:28.184104+0000","last_fullsized":"2024-04-26T23:13:28.184104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'177","last_scrub_stamp":"2024-04-26T23:13:28.184030+0000","last_deep_scrub":"26'177","last_deep_scrub_stamp":"2024-04-26T23:13:28.184030+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.184030+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:18.044119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'408","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.608906+0000","last_change":"2024-04-26T23:13:22.608931+0000","last_active":"2024-04-26T23:13:22.608906+0000","last_peered":"2024-04-26T23:13:22.608906+0000","last_clean":"2024-04-26T23:13:22.608906+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:22.608906+0000","last_undegraded":"2024-04-26T23:13:22.608906+0000","last_fullsized":"2024-04-26T23:13:22.608906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'408","last_scrub_stamp":"2024-04-26T23:13:22.608843+0000","last_deep_scrub":"26'408","last_deep_scrub_stamp":"2024-04-26T23:13:22.608843+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.608843+0000","objects_scrubbed":2,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:37.774978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.038406+0000","last_change":"2024-04-26T23:13:38.038433+0000","last_active":"2024-04-26T23:13:38.038406+0000","last_peered":"2024-04-26T23:13:38.038406+0000","last_clean":"2024-04-26T23:13:38.038406+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:38.038406+0000","last_undegraded":"2024-04-26T23:13:38.038406+0000","last_fullsized":"2024-04-26T23:13:38.038406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'811","last_scrub_stamp":"2024-04-26T23:13:38.038314+0000","last_deep_scrub":"26'811","last_deep_scrub_stamp":"2024-04-26T23:13:38.038314+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.038314+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:47.500906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'195","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:19.692268+0000","last_change":"2024-04-26T23:13:19.692291+0000","last_active":"2024-04-26T23:13:19.692268+0000","last_peered":"2024-04-26T23:13:19.692268+0000","last_clean":"2024-04-26T23:13:19.692268+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:19.692268+0000","last_undegraded":"2024-04-26T23:13:19.692268+0000","last_fullsized":"2024-04-26T23:13:19.692268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-26T23:13:19.692203+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-26T23:13:19.692203+0000","last_clean_scrub_stamp":"2024-04-26T23:13:19.692203+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:52:31.536040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'173","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.021566+0000","last_change":"2024-04-26T23:13:29.021642+0000","last_active":"2024-04-26T23:13:29.021566+0000","last_peered":"2024-04-26T23:13:29.021566+0000","last_clean":"2024-04-26T23:13:29.021566+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:13:29.021566+0000","last_undegraded":"2024-04-26T23:13:29.021566+0000","last_fullsized":"2024-04-26T23:13:29.021566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'173","last_scrub_stamp":"2024-04-26T23:13:29.021380+0000","last_deep_scrub":"26'173","last_deep_scrub_stamp":"2024-04-26T23:13:29.021380+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.021380+0000","objects_scrubbed":2,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:46.950365+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.217630+0000","last_change":"2024-04-26T23:13:36.217661+0000","last_active":"2024-04-26T23:13:36.217630+0000","last_peered":"2024-04-26T23:13:36.217630+0000","last_clean":"2024-04-26T23:13:36.217630+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:36.217630+0000","last_undegraded":"2024-04-26T23:13:36.217630+0000","last_fullsized":"2024-04-26T23:13:36.217630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'786","last_scrub_stamp":"2024-04-26T23:13:36.217537+0000","last_deep_scrub":"26'786","last_deep_scrub_stamp":"2024-04-26T23:13:36.217537+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.217537+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:04.647990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'213","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.209135+0000","last_change":"2024-04-26T23:13:27.209187+0000","last_active":"2024-04-26T23:13:27.209135+0000","last_peered":"2024-04-26T23:13:27.209135+0000","last_clean":"2024-04-26T23:13:27.209135+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:27.209135+0000","last_undegraded":"2024-04-26T23:13:27.209135+0000","last_fullsized":"2024-04-26T23:13:27.209135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:27.209030+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:27.209030+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.209030+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:38.664196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.590848+0000","last_change":"2024-04-26T23:13:23.590869+0000","last_active":"2024-04-26T23:13:23.590848+0000","last_peered":"2024-04-26T23:13:23.590848+0000","last_clean":"2024-04-26T23:13:23.590848+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:13:23.590848+0000","last_undegraded":"2024-04-26T23:13:23.590848+0000","last_fullsized":"2024-04-26T23:13:23.590848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'67","last_scrub_stamp":"2024-04-26T23:13:23.590748+0000","last_deep_scrub":"26'67","last_deep_scrub_stamp":"2024-04-26T23:13:23.590748+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.590748+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:50.883128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.556863+0000","last_change":"2024-04-26T23:13:32.556892+0000","last_active":"2024-04-26T23:13:32.556863+0000","last_peered":"2024-04-26T23:13:32.556863+0000","last_clean":"2024-04-26T23:13:32.556863+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:32.556863+0000","last_undegraded":"2024-04-26T23:13:32.556863+0000","last_fullsized":"2024-04-26T23:13:32.556863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:32.556763+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:32.556763+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.556763+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:54.701598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'198","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.391297+0000","last_change":"2024-04-26T23:13:22.391368+0000","last_active":"2024-04-26T23:13:22.391297+0000","last_peered":"2024-04-26T23:13:22.391297+0000","last_clean":"2024-04-26T23:13:22.391297+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:22.391297+0000","last_undegraded":"2024-04-26T23:13:22.391297+0000","last_fullsized":"2024-04-26T23:13:22.391297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-26T23:13:22.391117+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-26T23:13:22.391117+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.391117+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.347611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'596","reported_seq":634,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.737553+0000","last_change":"2024-04-26T23:13:27.737630+0000","last_active":"2024-04-26T23:13:27.737553+0000","last_peered":"2024-04-26T23:13:27.737553+0000","last_clean":"2024-04-26T23:13:27.737553+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:13:27.737553+0000","last_undegraded":"2024-04-26T23:13:27.737553+0000","last_fullsized":"2024-04-26T23:13:27.737553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'596","last_scrub_stamp":"2024-04-26T23:13:27.737349+0000","last_deep_scrub":"26'596","last_deep_scrub_stamp":"2024-04-26T23:13:27.737349+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.737349+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:19.298861+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":780,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.490455+0000","last_change":"2024-04-26T23:13:34.490534+0000","last_active":"2024-04-26T23:13:34.490455+0000","last_peered":"2024-04-26T23:13:34.490455+0000","last_clean":"2024-04-26T23:13:34.490455+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:34.490455+0000","last_undegraded":"2024-04-26T23:13:34.490455+0000","last_fullsized":"2024-04-26T23:13:34.490455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'722","last_scrub_stamp":"2024-04-26T23:13:34.490310+0000","last_deep_scrub":"26'722","last_deep_scrub_stamp":"2024-04-26T23:13:34.490310+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.490310+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:43.632214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'210","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.601817+0000","last_change":"2024-04-26T23:13:28.601840+0000","last_active":"2024-04-26T23:13:28.601817+0000","last_peered":"2024-04-26T23:13:28.601817+0000","last_clean":"2024-04-26T23:13:28.601817+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:28.601817+0000","last_undegraded":"2024-04-26T23:13:28.601817+0000","last_fullsized":"2024-04-26T23:13:28.601817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-26T23:13:28.601729+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-26T23:13:28.601729+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.601729+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:35.398601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'375","reported_seq":703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.168260+0000","last_change":"2024-04-26T23:13:22.168305+0000","last_active":"2024-04-26T23:13:22.168260+0000","last_peered":"2024-04-26T23:13:22.168260+0000","last_clean":"2024-04-26T23:13:22.168260+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:22.168260+0000","last_undegraded":"2024-04-26T23:13:22.168260+0000","last_fullsized":"2024-04-26T23:13:22.168260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'375","last_scrub_stamp":"2024-04-26T23:13:22.168181+0000","last_deep_scrub":"26'375","last_deep_scrub_stamp":"2024-04-26T23:13:22.168181+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.168181+0000","objects_scrubbed":3,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:29.838166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.554388+0000","last_change":"2024-04-26T23:13:31.554416+0000","last_active":"2024-04-26T23:13:31.554388+0000","last_peered":"2024-04-26T23:13:31.554388+0000","last_clean":"2024-04-26T23:13:31.554388+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:31.554388+0000","last_undegraded":"2024-04-26T23:13:31.554388+0000","last_fullsized":"2024-04-26T23:13:31.554388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'753","last_scrub_stamp":"2024-04-26T23:13:31.554298+0000","last_deep_scrub":"26'753","last_deep_scrub_stamp":"2024-04-26T23:13:31.554298+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.554298+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:26.903436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.124573+0000","last_change":"2024-04-26T23:13:25.124596+0000","last_active":"2024-04-26T23:13:25.124573+0000","last_peered":"2024-04-26T23:13:25.124573+0000","last_clean":"2024-04-26T23:13:25.124573+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:25.124573+0000","last_undegraded":"2024-04-26T23:13:25.124573+0000","last_fullsized":"2024-04-26T23:13:25.124573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-26T23:13:25.124481+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-26T23:13:25.124481+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.124481+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:28.264839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'259","reported_seq":298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.071317+0000","last_change":"2024-04-26T23:13:27.071438+0000","last_active":"2024-04-26T23:13:27.071317+0000","last_peered":"2024-04-26T23:13:27.071317+0000","last_clean":"2024-04-26T23:13:27.071317+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:13:27.071317+0000","last_undegraded":"2024-04-26T23:13:27.071317+0000","last_fullsized":"2024-04-26T23:13:27.071317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'259","last_scrub_stamp":"2024-04-26T23:13:27.071106+0000","last_deep_scrub":"26'259","last_deep_scrub_stamp":"2024-04-26T23:13:27.071106+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.071106+0000","objects_scrubbed":3,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:03.692412+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.220467+0000","last_change":"2024-04-26T23:13:34.220493+0000","last_active":"2024-04-26T23:13:34.220467+0000","last_peered":"2024-04-26T23:13:34.220467+0000","last_clean":"2024-04-26T23:13:34.220467+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:34.220467+0000","last_undegraded":"2024-04-26T23:13:34.220467+0000","last_fullsized":"2024-04-26T23:13:34.220467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'894","last_scrub_stamp":"2024-04-26T23:13:34.220375+0000","last_deep_scrub":"26'894","last_deep_scrub_stamp":"2024-04-26T23:13:34.220375+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.220375+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:10.755202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'191","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.136140+0000","last_change":"2024-04-26T23:13:21.136161+0000","last_active":"2024-04-26T23:13:21.136140+0000","last_peered":"2024-04-26T23:13:21.136140+0000","last_clean":"2024-04-26T23:13:21.136140+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:21.136140+0000","last_undegraded":"2024-04-26T23:13:21.136140+0000","last_fullsized":"2024-04-26T23:13:21.136140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:21.136070+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:21.136070+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.136070+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:15.006046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'77","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.583355+0000","last_change":"2024-04-26T23:13:24.583507+0000","last_active":"2024-04-26T23:13:24.583355+0000","last_peered":"2024-04-26T23:13:24.583355+0000","last_clean":"2024-04-26T23:13:24.583355+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:24.583355+0000","last_undegraded":"2024-04-26T23:13:24.583355+0000","last_fullsized":"2024-04-26T23:13:24.583355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-26T23:13:24.583158+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-26T23:13:24.583158+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.583158+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:22.888480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.027629+0000","last_change":"2024-04-26T23:13:25.027753+0000","last_active":"2024-04-26T23:13:25.027629+0000","last_peered":"2024-04-26T23:13:25.027629+0000","last_clean":"2024-04-26T23:13:25.027629+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:13:25.027629+0000","last_undegraded":"2024-04-26T23:13:25.027629+0000","last_fullsized":"2024-04-26T23:13:25.027629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-26T23:13:25.027425+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-26T23:13:25.027425+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.027425+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:08.255194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.180965+0000","last_change":"2024-04-26T23:13:36.181124+0000","last_active":"2024-04-26T23:13:36.180965+0000","last_peered":"2024-04-26T23:13:36.180965+0000","last_clean":"2024-04-26T23:13:36.180965+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:36.180965+0000","last_undegraded":"2024-04-26T23:13:36.180965+0000","last_fullsized":"2024-04-26T23:13:36.180965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'818","last_scrub_stamp":"2024-04-26T23:13:36.180729+0000","last_deep_scrub":"26'818","last_deep_scrub_stamp":"2024-04-26T23:13:36.180729+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.180729+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:01.631715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'210","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.075040+0000","last_change":"2024-04-26T23:13:36.075099+0000","last_active":"2024-04-26T23:13:36.075040+0000","last_peered":"2024-04-26T23:13:36.075040+0000","last_clean":"2024-04-26T23:13:36.075040+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:36.075040+0000","last_undegraded":"2024-04-26T23:13:36.075040+0000","last_fullsized":"2024-04-26T23:13:36.075040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-26T23:13:36.074855+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-26T23:13:36.074855+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.074855+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:21.430796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.120980+0000","last_change":"2024-04-26T23:13:23.120980+0000","last_active":"2024-04-26T23:13:23.120980+0000","last_peered":"2024-04-26T23:13:23.120980+0000","last_clean":"2024-04-26T23:13:23.120980+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:23.120980+0000","last_undegraded":"2024-04-26T23:13:23.120980+0000","last_fullsized":"2024-04-26T23:13:23.120980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-26T23:13:23.120895+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-26T23:13:23.120895+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.120895+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:26.631821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.211284+0000","last_change":"2024-04-26T23:13:37.211349+0000","last_active":"2024-04-26T23:13:37.211284+0000","last_peered":"2024-04-26T23:13:37.211284+0000","last_clean":"2024-04-26T23:13:37.211284+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:37.211284+0000","last_undegraded":"2024-04-26T23:13:37.211284+0000","last_fullsized":"2024-04-26T23:13:37.211284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'848","last_scrub_stamp":"2024-04-26T23:13:37.211102+0000","last_deep_scrub":"26'848","last_deep_scrub_stamp":"2024-04-26T23:13:37.211102+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.211102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:43.378728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.703527+0000","last_change":"2024-04-26T23:13:33.703638+0000","last_active":"2024-04-26T23:13:33.703527+0000","last_peered":"2024-04-26T23:13:33.703527+0000","last_clean":"2024-04-26T23:13:33.703527+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:33.703527+0000","last_undegraded":"2024-04-26T23:13:33.703527+0000","last_fullsized":"2024-04-26T23:13:33.703527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:33.703316+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:33.703316+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.703316+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:10.846687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'565","reported_seq":604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:20.666617+0000","last_change":"2024-04-26T23:13:20.666617+0000","last_active":"2024-04-26T23:13:20.666617+0000","last_peered":"2024-04-26T23:13:20.666617+0000","last_clean":"2024-04-26T23:13:20.666617+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:13:20.666617+0000","last_undegraded":"2024-04-26T23:13:20.666617+0000","last_fullsized":"2024-04-26T23:13:20.666617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'565","last_scrub_stamp":"2024-04-26T23:13:20.666535+0000","last_deep_scrub":"26'565","last_deep_scrub_stamp":"2024-04-26T23:13:20.666535+0000","last_clean_scrub_stamp":"2024-04-26T23:13:20.666535+0000","objects_scrubbed":2,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:54.190018+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.237727+0000","last_change":"2024-04-26T23:13:32.237775+0000","last_active":"2024-04-26T23:13:32.237727+0000","last_peered":"2024-04-26T23:13:32.237727+0000","last_clean":"2024-04-26T23:13:32.237727+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:32.237727+0000","last_undegraded":"2024-04-26T23:13:32.237727+0000","last_fullsized":"2024-04-26T23:13:32.237727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'838","last_scrub_stamp":"2024-04-26T23:13:32.237616+0000","last_deep_scrub":"26'838","last_deep_scrub_stamp":"2024-04-26T23:13:32.237616+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.237616+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:53.029753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'200","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.805079+0000","last_change":"2024-04-26T23:04:40.187258+0000","last_active":"2024-04-26T23:13:15.805079+0000","last_peered":"2024-04-26T23:13:15.805079+0000","last_clean":"2024-04-26T23:13:15.805079+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:15.805079+0000","last_undegraded":"2024-04-26T23:13:15.805079+0000","last_fullsized":"2024-04-26T23:13:15.805079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'299","reported_seq":337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.192355+0000","last_change":"2024-04-26T23:13:21.192355+0000","last_active":"2024-04-26T23:13:21.192355+0000","last_peered":"2024-04-26T23:13:21.192355+0000","last_clean":"2024-04-26T23:13:21.192355+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:13:21.192355+0000","last_undegraded":"2024-04-26T23:13:21.192355+0000","last_fullsized":"2024-04-26T23:13:21.192355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'299","last_scrub_stamp":"2024-04-26T23:13:21.192264+0000","last_deep_scrub":"26'299","last_deep_scrub_stamp":"2024-04-26T23:13:21.192264+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.192264+0000","objects_scrubbed":2,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:16.581652+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.761134+0000","last_change":"2024-04-26T23:13:38.761205+0000","last_active":"2024-04-26T23:13:38.761134+0000","last_peered":"2024-04-26T23:13:38.761134+0000","last_clean":"2024-04-26T23:13:38.761134+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:38.761134+0000","last_undegraded":"2024-04-26T23:13:38.761134+0000","last_fullsized":"2024-04-26T23:13:38.761134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'848","last_scrub_stamp":"2024-04-26T23:13:38.760921+0000","last_deep_scrub":"26'848","last_deep_scrub_stamp":"2024-04-26T23:13:38.760921+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.760921+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:21.931804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'193","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:15.800658+0000","last_change":"2024-04-26T23:04:40.186901+0000","last_active":"2024-04-26T23:13:15.800658+0000","last_peered":"2024-04-26T23:13:15.800658+0000","last_clean":"2024-04-26T23:13:15.800658+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:15.800658+0000","last_undegraded":"2024-04-26T23:13:15.800658+0000","last_fullsized":"2024-04-26T23:13:15.800658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:39.097593+0000","last_clean_scrub_stamp":"2024-04-26T23:04:39.097593+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'171","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.429116+0000","last_change":"2024-04-26T23:13:21.429116+0000","last_active":"2024-04-26T23:13:21.429116+0000","last_peered":"2024-04-26T23:13:21.429116+0000","last_clean":"2024-04-26T23:13:21.429116+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:21.429116+0000","last_undegraded":"2024-04-26T23:13:21.429116+0000","last_fullsized":"2024-04-26T23:13:21.429116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'171","last_scrub_stamp":"2024-04-26T23:13:21.428846+0000","last_deep_scrub":"26'171","last_deep_scrub_stamp":"2024-04-26T23:13:21.428846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.428846+0000","objects_scrubbed":3,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:56.941608+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":881,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.415011+0000","last_change":"2024-04-26T23:13:33.415087+0000","last_active":"2024-04-26T23:13:33.415011+0000","last_peered":"2024-04-26T23:13:33.415011+0000","last_clean":"2024-04-26T23:13:33.415011+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:33.415011+0000","last_undegraded":"2024-04-26T23:13:33.415011+0000","last_fullsized":"2024-04-26T23:13:33.415011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'827","last_scrub_stamp":"2024-04-26T23:13:33.414822+0000","last_deep_scrub":"26'827","last_deep_scrub_stamp":"2024-04-26T23:13:33.414822+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.414822+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.843270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.059939+0000","last_change":"2024-04-26T23:13:38.060003+0000","last_active":"2024-04-26T23:13:38.059939+0000","last_peered":"2024-04-26T23:13:38.059939+0000","last_clean":"2024-04-26T23:13:38.059939+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:38.059939+0000","last_undegraded":"2024-04-26T23:13:38.059939+0000","last_fullsized":"2024-04-26T23:13:38.059939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-26T23:13:38.059768+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-26T23:13:38.059768+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.059768+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:10.012742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'375","reported_seq":412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:20.212713+0000","last_change":"2024-04-26T23:13:20.212805+0000","last_active":"2024-04-26T23:13:20.212713+0000","last_peered":"2024-04-26T23:13:20.212713+0000","last_clean":"2024-04-26T23:13:20.212713+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:20.212713+0000","last_undegraded":"2024-04-26T23:13:20.212713+0000","last_fullsized":"2024-04-26T23:13:20.212713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'375","last_scrub_stamp":"2024-04-26T23:13:20.212604+0000","last_deep_scrub":"26'375","last_deep_scrub_stamp":"2024-04-26T23:13:20.212604+0000","last_clean_scrub_stamp":"2024-04-26T23:13:20.212604+0000","objects_scrubbed":10,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:45.730268+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":860,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.213367+0000","last_change":"2024-04-26T23:13:33.213392+0000","last_active":"2024-04-26T23:13:33.213367+0000","last_peered":"2024-04-26T23:13:33.213367+0000","last_clean":"2024-04-26T23:13:33.213367+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:33.213367+0000","last_undegraded":"2024-04-26T23:13:33.213367+0000","last_fullsized":"2024-04-26T23:13:33.213367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:33.213280+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:33.213280+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.213280+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:49.674386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.184649+0000","last_change":"2024-04-26T23:13:29.184711+0000","last_active":"2024-04-26T23:13:29.184649+0000","last_peered":"2024-04-26T23:13:29.184649+0000","last_clean":"2024-04-26T23:13:29.184649+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:29.184649+0000","last_undegraded":"2024-04-26T23:13:29.184649+0000","last_fullsized":"2024-04-26T23:13:29.184649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-26T23:13:29.184473+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-26T23:13:29.184473+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.184473+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:10.780077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'69","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.165627+0000","last_change":"2024-04-26T23:13:27.165696+0000","last_active":"2024-04-26T23:13:27.165627+0000","last_peered":"2024-04-26T23:13:27.165627+0000","last_clean":"2024-04-26T23:13:27.165627+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:13:27.165627+0000","last_undegraded":"2024-04-26T23:13:27.165627+0000","last_fullsized":"2024-04-26T23:13:27.165627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-26T23:13:27.165440+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-26T23:13:27.165440+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.165440+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:46.280423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.030078+0000","last_change":"2024-04-26T23:13:36.030104+0000","last_active":"2024-04-26T23:13:36.030078+0000","last_peered":"2024-04-26T23:13:36.030078+0000","last_clean":"2024-04-26T23:13:36.030078+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:36.030078+0000","last_undegraded":"2024-04-26T23:13:36.030078+0000","last_fullsized":"2024-04-26T23:13:36.030078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'783","last_scrub_stamp":"2024-04-26T23:13:36.029977+0000","last_deep_scrub":"26'783","last_deep_scrub_stamp":"2024-04-26T23:13:36.029977+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.029977+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:37.363147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'199","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.045586+0000","last_change":"2024-04-26T23:13:37.045727+0000","last_active":"2024-04-26T23:13:37.045586+0000","last_peered":"2024-04-26T23:13:37.045586+0000","last_clean":"2024-04-26T23:13:37.045586+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:37.045586+0000","last_undegraded":"2024-04-26T23:13:37.045586+0000","last_fullsized":"2024-04-26T23:13:37.045586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-26T23:13:37.045372+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-26T23:13:37.045372+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.045372+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:10.548084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'64","reported_seq":101,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.685412+0000","last_change":"2024-04-26T23:13:28.685483+0000","last_active":"2024-04-26T23:13:28.685412+0000","last_peered":"2024-04-26T23:13:28.685412+0000","last_clean":"2024-04-26T23:13:28.685412+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:28.685412+0000","last_undegraded":"2024-04-26T23:13:28.685412+0000","last_fullsized":"2024-04-26T23:13:28.685412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'64","last_scrub_stamp":"2024-04-26T23:13:28.685214+0000","last_deep_scrub":"26'64","last_deep_scrub_stamp":"2024-04-26T23:13:28.685214+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.685214+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.665412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":814,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.983845+0000","last_change":"2024-04-26T23:13:33.983871+0000","last_active":"2024-04-26T23:13:33.983845+0000","last_peered":"2024-04-26T23:13:33.983845+0000","last_clean":"2024-04-26T23:13:33.983845+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:33.983845+0000","last_undegraded":"2024-04-26T23:13:33.983845+0000","last_fullsized":"2024-04-26T23:13:33.983845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'744","last_scrub_stamp":"2024-04-26T23:13:33.983760+0000","last_deep_scrub":"26'744","last_deep_scrub_stamp":"2024-04-26T23:13:33.983760+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.983760+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:41.001759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'207","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.219325+0000","last_change":"2024-04-26T23:13:30.219348+0000","last_active":"2024-04-26T23:13:30.219325+0000","last_peered":"2024-04-26T23:13:30.219325+0000","last_clean":"2024-04-26T23:13:30.219325+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:30.219325+0000","last_undegraded":"2024-04-26T23:13:30.219325+0000","last_fullsized":"2024-04-26T23:13:30.219325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:30.219248+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:30.219248+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.219248+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:41.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'662","reported_seq":700,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.051235+0000","last_change":"2024-04-26T23:13:21.051269+0000","last_active":"2024-04-26T23:13:21.051235+0000","last_peered":"2024-04-26T23:13:21.051235+0000","last_clean":"2024-04-26T23:13:21.051235+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:13:21.051235+0000","last_undegraded":"2024-04-26T23:13:21.051235+0000","last_fullsized":"2024-04-26T23:13:21.051235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'662","last_scrub_stamp":"2024-04-26T23:13:21.051167+0000","last_deep_scrub":"26'662","last_deep_scrub_stamp":"2024-04-26T23:13:21.051167+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.051167+0000","objects_scrubbed":6,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:09:14.958054+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:04.079881+0000","last_change":"2024-04-26T23:04:44.386113+0000","last_active":"2024-04-26T23:13:04.079881+0000","last_peered":"2024-04-26T23:13:04.079881+0000","last_clean":"2024-04-26T23:13:04.079881+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:04.079881+0000","last_undegraded":"2024-04-26T23:13:04.079881+0000","last_fullsized":"2024-04-26T23:13:04.079881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:04:43.166473+0000","last_clean_scrub_stamp":"2024-04-26T23:04:43.166473+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'208","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.038189+0000","last_change":"2024-04-26T23:13:24.038251+0000","last_active":"2024-04-26T23:13:24.038189+0000","last_peered":"2024-04-26T23:13:24.038189+0000","last_clean":"2024-04-26T23:13:24.038189+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:24.038189+0000","last_undegraded":"2024-04-26T23:13:24.038189+0000","last_fullsized":"2024-04-26T23:13:24.038189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:24.038009+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:24.038009+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.038009+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:32.283625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'362","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.286276+0000","last_change":"2024-04-26T23:13:23.286395+0000","last_active":"2024-04-26T23:13:23.286276+0000","last_peered":"2024-04-26T23:13:23.286276+0000","last_clean":"2024-04-26T23:13:23.286276+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:13:23.286276+0000","last_undegraded":"2024-04-26T23:13:23.286276+0000","last_fullsized":"2024-04-26T23:13:23.286276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'362","last_scrub_stamp":"2024-04-26T23:13:23.286152+0000","last_deep_scrub":"26'362","last_deep_scrub_stamp":"2024-04-26T23:13:23.286152+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.286152+0000","objects_scrubbed":7,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:11.397245+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.507212+0000","last_change":"2024-04-26T23:13:33.507258+0000","last_active":"2024-04-26T23:13:33.507212+0000","last_peered":"2024-04-26T23:13:33.507212+0000","last_clean":"2024-04-26T23:13:33.507212+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:33.507212+0000","last_undegraded":"2024-04-26T23:13:33.507212+0000","last_fullsized":"2024-04-26T23:13:33.507212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:33.507119+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:33.507119+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.507119+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:56.481557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'202","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.443236+0000","last_change":"2024-04-26T23:13:25.443300+0000","last_active":"2024-04-26T23:13:25.443236+0000","last_peered":"2024-04-26T23:13:25.443236+0000","last_clean":"2024-04-26T23:13:25.443236+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:25.443236+0000","last_undegraded":"2024-04-26T23:13:25.443236+0000","last_fullsized":"2024-04-26T23:13:25.443236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:25.443053+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:25.443053+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.443053+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:12.697066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'337","reported_seq":375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.531687+0000","last_change":"2024-04-26T23:13:25.531719+0000","last_active":"2024-04-26T23:13:25.531687+0000","last_peered":"2024-04-26T23:13:25.531687+0000","last_clean":"2024-04-26T23:13:25.531687+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:25.531687+0000","last_undegraded":"2024-04-26T23:13:25.531687+0000","last_fullsized":"2024-04-26T23:13:25.531687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'337","last_scrub_stamp":"2024-04-26T23:13:25.531609+0000","last_deep_scrub":"26'337","last_deep_scrub_stamp":"2024-04-26T23:13:25.531609+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.531609+0000","objects_scrubbed":4,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:24.086780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.467942+0000","last_change":"2024-04-26T23:13:30.468012+0000","last_active":"2024-04-26T23:13:30.467942+0000","last_peered":"2024-04-26T23:13:30.467942+0000","last_clean":"2024-04-26T23:13:30.467942+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:30.467942+0000","last_undegraded":"2024-04-26T23:13:30.467942+0000","last_fullsized":"2024-04-26T23:13:30.467942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:30.467754+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:30.467754+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.467754+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:14.148397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'191","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:19.985139+0000","last_change":"2024-04-26T23:13:19.985175+0000","last_active":"2024-04-26T23:13:19.985139+0000","last_peered":"2024-04-26T23:13:19.985139+0000","last_clean":"2024-04-26T23:13:19.985139+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:19.985139+0000","last_undegraded":"2024-04-26T23:13:19.985139+0000","last_fullsized":"2024-04-26T23:13:19.985139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:19.985048+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:19.985048+0000","last_clean_scrub_stamp":"2024-04-26T23:13:19.985048+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:23.782554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'108","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.662880+0000","last_change":"2024-04-26T23:13:26.662956+0000","last_active":"2024-04-26T23:13:26.662880+0000","last_peered":"2024-04-26T23:13:26.662880+0000","last_clean":"2024-04-26T23:13:26.662880+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:26.662880+0000","last_undegraded":"2024-04-26T23:13:26.662880+0000","last_fullsized":"2024-04-26T23:13:26.662880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'108","last_scrub_stamp":"2024-04-26T23:13:26.662705+0000","last_deep_scrub":"26'108","last_deep_scrub_stamp":"2024-04-26T23:13:26.662705+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.662705+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:15.904295+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":927,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.992257+0000","last_change":"2024-04-26T23:13:32.992286+0000","last_active":"2024-04-26T23:13:32.992257+0000","last_peered":"2024-04-26T23:13:32.992257+0000","last_clean":"2024-04-26T23:13:32.992257+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:32.992257+0000","last_undegraded":"2024-04-26T23:13:32.992257+0000","last_fullsized":"2024-04-26T23:13:32.992257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'857","last_scrub_stamp":"2024-04-26T23:13:32.992173+0000","last_deep_scrub":"26'857","last_deep_scrub_stamp":"2024-04-26T23:13:32.992173+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.992173+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:57.878875+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'216","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.730751+0000","last_change":"2024-04-26T23:13:34.730815+0000","last_active":"2024-04-26T23:13:34.730751+0000","last_peered":"2024-04-26T23:13:34.730751+0000","last_clean":"2024-04-26T23:13:34.730751+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:34.730751+0000","last_undegraded":"2024-04-26T23:13:34.730751+0000","last_fullsized":"2024-04-26T23:13:34.730751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-26T23:13:34.730545+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-26T23:13:34.730545+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.730545+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.890200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'79","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.176862+0000","last_change":"2024-04-26T23:13:25.176933+0000","last_active":"2024-04-26T23:13:25.176862+0000","last_peered":"2024-04-26T23:13:25.176862+0000","last_clean":"2024-04-26T23:13:25.176862+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:13:25.176862+0000","last_undegraded":"2024-04-26T23:13:25.176862+0000","last_fullsized":"2024-04-26T23:13:25.176862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-26T23:13:25.176691+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-26T23:13:25.176691+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.176691+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:03.294325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.006451+0000","last_change":"2024-04-26T23:13:35.006479+0000","last_active":"2024-04-26T23:13:35.006451+0000","last_peered":"2024-04-26T23:13:35.006451+0000","last_clean":"2024-04-26T23:13:35.006451+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:35.006451+0000","last_undegraded":"2024-04-26T23:13:35.006451+0000","last_fullsized":"2024-04-26T23:13:35.006451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'874","last_scrub_stamp":"2024-04-26T23:13:35.006346+0000","last_deep_scrub":"26'874","last_deep_scrub_stamp":"2024-04-26T23:13:35.006346+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.006346+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.164098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.231102+0000","last_change":"2024-04-26T23:13:35.231128+0000","last_active":"2024-04-26T23:13:35.231102+0000","last_peered":"2024-04-26T23:13:35.231102+0000","last_clean":"2024-04-26T23:13:35.231102+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:35.231102+0000","last_undegraded":"2024-04-26T23:13:35.231102+0000","last_fullsized":"2024-04-26T23:13:35.231102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'794","last_scrub_stamp":"2024-04-26T23:13:35.231021+0000","last_deep_scrub":"26'794","last_deep_scrub_stamp":"2024-04-26T23:13:35.231021+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.231021+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:35.859345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.530539+0000","last_change":"2024-04-26T23:13:26.530563+0000","last_active":"2024-04-26T23:13:26.530539+0000","last_peered":"2024-04-26T23:13:26.530539+0000","last_clean":"2024-04-26T23:13:26.530539+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:26.530539+0000","last_undegraded":"2024-04-26T23:13:26.530539+0000","last_fullsized":"2024-04-26T23:13:26.530539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-26T23:13:26.530452+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-26T23:13:26.530452+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.530452+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:03.690778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'836","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.667300+0000","last_change":"2024-04-26T23:13:25.667459+0000","last_active":"2024-04-26T23:13:25.667300+0000","last_peered":"2024-04-26T23:13:25.667300+0000","last_clean":"2024-04-26T23:13:25.667300+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:13:25.667300+0000","last_undegraded":"2024-04-26T23:13:25.667300+0000","last_fullsized":"2024-04-26T23:13:25.667300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'836","last_scrub_stamp":"2024-04-26T23:13:25.667078+0000","last_deep_scrub":"26'836","last_deep_scrub_stamp":"2024-04-26T23:13:25.667078+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.667078+0000","objects_scrubbed":2,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:58:44.797568+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.175010+0000","last_change":"2024-04-26T23:13:35.175073+0000","last_active":"2024-04-26T23:13:35.175010+0000","last_peered":"2024-04-26T23:13:35.175010+0000","last_clean":"2024-04-26T23:13:35.175010+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:35.175010+0000","last_undegraded":"2024-04-26T23:13:35.175010+0000","last_fullsized":"2024-04-26T23:13:35.175010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:35.174831+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:35.174831+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.174831+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:22.190894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'218","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.118664+0000","last_change":"2024-04-26T23:13:27.118690+0000","last_active":"2024-04-26T23:13:27.118664+0000","last_peered":"2024-04-26T23:13:27.118664+0000","last_clean":"2024-04-26T23:13:27.118664+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:27.118664+0000","last_undegraded":"2024-04-26T23:13:27.118664+0000","last_fullsized":"2024-04-26T23:13:27.118664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-26T23:13:27.118592+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-26T23:13:27.118592+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.118592+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:22.946256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'80","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.122729+0000","last_change":"2024-04-26T23:13:24.122762+0000","last_active":"2024-04-26T23:13:24.122729+0000","last_peered":"2024-04-26T23:13:24.122729+0000","last_clean":"2024-04-26T23:13:24.122729+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:13:24.122729+0000","last_undegraded":"2024-04-26T23:13:24.122729+0000","last_fullsized":"2024-04-26T23:13:24.122729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2024-04-26T23:13:24.122652+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2024-04-26T23:13:24.122652+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.122652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:44.476739+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'377","reported_seq":415,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.204945+0000","last_change":"2024-04-26T23:13:26.205094+0000","last_active":"2024-04-26T23:13:26.204945+0000","last_peered":"2024-04-26T23:13:26.204945+0000","last_clean":"2024-04-26T23:13:26.204945+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:13:26.204945+0000","last_undegraded":"2024-04-26T23:13:26.204945+0000","last_fullsized":"2024-04-26T23:13:26.204945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'377","last_scrub_stamp":"2024-04-26T23:13:26.204663+0000","last_deep_scrub":"26'377","last_deep_scrub_stamp":"2024-04-26T23:13:26.204663+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.204663+0000","objects_scrubbed":4,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:40.947545+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'184","reported_seq":220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.152820+0000","last_change":"2024-04-26T23:13:28.152847+0000","last_active":"2024-04-26T23:13:28.152820+0000","last_peered":"2024-04-26T23:13:28.152820+0000","last_clean":"2024-04-26T23:13:28.152820+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:28.152820+0000","last_undegraded":"2024-04-26T23:13:28.152820+0000","last_fullsized":"2024-04-26T23:13:28.152820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'184","last_scrub_stamp":"2024-04-26T23:13:28.152728+0000","last_deep_scrub":"26'184","last_deep_scrub_stamp":"2024-04-26T23:13:28.152728+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.152728+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:07.167773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.181981+0000","last_change":"2024-04-26T23:13:26.182008+0000","last_active":"2024-04-26T23:13:26.181981+0000","last_peered":"2024-04-26T23:13:26.181981+0000","last_clean":"2024-04-26T23:13:26.181981+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:26.181981+0000","last_undegraded":"2024-04-26T23:13:26.181981+0000","last_fullsized":"2024-04-26T23:13:26.181981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'756","last_scrub_stamp":"2024-04-26T23:13:26.181879+0000","last_deep_scrub":"26'756","last_deep_scrub_stamp":"2024-04-26T23:13:26.181879+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.181879+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:25:22.287815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'76","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.094870+0000","last_change":"2024-04-26T23:13:26.094900+0000","last_active":"2024-04-26T23:13:26.094870+0000","last_peered":"2024-04-26T23:13:26.094870+0000","last_clean":"2024-04-26T23:13:26.094870+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:13:26.094870+0000","last_undegraded":"2024-04-26T23:13:26.094870+0000","last_fullsized":"2024-04-26T23:13:26.094870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2024-04-26T23:13:26.094749+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2024-04-26T23:13:26.094749+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.094749+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:24.662531+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'202","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.421571+0000","last_change":"2024-04-26T23:13:23.421632+0000","last_active":"2024-04-26T23:13:23.421571+0000","last_peered":"2024-04-26T23:13:23.421571+0000","last_clean":"2024-04-26T23:13:23.421571+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:23.421571+0000","last_undegraded":"2024-04-26T23:13:23.421571+0000","last_fullsized":"2024-04-26T23:13:23.421571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:23.421393+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:23.421393+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.421393+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:11.578933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.028462+0000","last_change":"2024-04-26T23:13:32.028486+0000","last_active":"2024-04-26T23:13:32.028462+0000","last_peered":"2024-04-26T23:13:32.028462+0000","last_clean":"2024-04-26T23:13:32.028462+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:32.028462+0000","last_undegraded":"2024-04-26T23:13:32.028462+0000","last_fullsized":"2024-04-26T23:13:32.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-26T23:13:32.028378+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-26T23:13:32.028378+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.028378+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:32.055310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.199416+0000","last_change":"2024-04-26T23:13:30.199537+0000","last_active":"2024-04-26T23:13:30.199416+0000","last_peered":"2024-04-26T23:13:30.199416+0000","last_clean":"2024-04-26T23:13:30.199416+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:30.199416+0000","last_undegraded":"2024-04-26T23:13:30.199416+0000","last_fullsized":"2024-04-26T23:13:30.199416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:30.199200+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:30.199200+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.199200+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:56.993008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'214","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.128561+0000","last_change":"2024-04-26T23:13:25.128584+0000","last_active":"2024-04-26T23:13:25.128561+0000","last_peered":"2024-04-26T23:13:25.128561+0000","last_clean":"2024-04-26T23:13:25.128561+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:25.128561+0000","last_undegraded":"2024-04-26T23:13:25.128561+0000","last_fullsized":"2024-04-26T23:13:25.128561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-26T23:13:25.128457+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-26T23:13:25.128457+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.128457+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:58.277495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'232","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.623107+0000","last_change":"2024-04-26T23:13:23.623166+0000","last_active":"2024-04-26T23:13:23.623107+0000","last_peered":"2024-04-26T23:13:23.623107+0000","last_clean":"2024-04-26T23:13:23.623107+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:23.623107+0000","last_undegraded":"2024-04-26T23:13:23.623107+0000","last_fullsized":"2024-04-26T23:13:23.623107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'232","last_scrub_stamp":"2024-04-26T23:13:23.622930+0000","last_deep_scrub":"26'232","last_deep_scrub_stamp":"2024-04-26T23:13:23.622930+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.622930+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:21.091070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.056767+0000","last_change":"2024-04-26T23:13:23.056787+0000","last_active":"2024-04-26T23:13:23.056767+0000","last_peered":"2024-04-26T23:13:23.056767+0000","last_clean":"2024-04-26T23:13:23.056767+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:23.056767+0000","last_undegraded":"2024-04-26T23:13:23.056767+0000","last_fullsized":"2024-04-26T23:13:23.056767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:23.056699+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:23.056699+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.056699+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:56.178517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'192","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.208169+0000","last_change":"2024-04-26T23:13:29.208192+0000","last_active":"2024-04-26T23:13:29.208169+0000","last_peered":"2024-04-26T23:13:29.208169+0000","last_clean":"2024-04-26T23:13:29.208169+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:29.208169+0000","last_undegraded":"2024-04-26T23:13:29.208169+0000","last_fullsized":"2024-04-26T23:13:29.208169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-26T23:13:29.208088+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-26T23:13:29.208088+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.208088+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.757884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'201","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.558676+0000","last_change":"2024-04-26T23:13:27.558703+0000","last_active":"2024-04-26T23:13:27.558676+0000","last_peered":"2024-04-26T23:13:27.558676+0000","last_clean":"2024-04-26T23:13:27.558676+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:27.558676+0000","last_undegraded":"2024-04-26T23:13:27.558676+0000","last_fullsized":"2024-04-26T23:13:27.558676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-26T23:13:27.558597+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-26T23:13:27.558597+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.558597+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:58.913554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'240","reported_seq":277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.148625+0000","last_change":"2024-04-26T23:13:32.148684+0000","last_active":"2024-04-26T23:13:32.148625+0000","last_peered":"2024-04-26T23:13:32.148625+0000","last_clean":"2024-04-26T23:13:32.148625+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:32.148625+0000","last_undegraded":"2024-04-26T23:13:32.148625+0000","last_fullsized":"2024-04-26T23:13:32.148625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-26T23:13:32.148453+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-26T23:13:32.148453+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.148453+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:09.931693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'193","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.056219+0000","last_change":"2024-04-26T23:13:30.056246+0000","last_active":"2024-04-26T23:13:30.056219+0000","last_peered":"2024-04-26T23:13:30.056219+0000","last_clean":"2024-04-26T23:13:30.056219+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:30.056219+0000","last_undegraded":"2024-04-26T23:13:30.056219+0000","last_fullsized":"2024-04-26T23:13:30.056219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'193","last_scrub_stamp":"2024-04-26T23:13:30.056138+0000","last_deep_scrub":"26'193","last_deep_scrub_stamp":"2024-04-26T23:13:30.056138+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.056138+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:43.540670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'219","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.708375+0000","last_change":"2024-04-26T23:13:29.708433+0000","last_active":"2024-04-26T23:13:29.708375+0000","last_peered":"2024-04-26T23:13:29.708375+0000","last_clean":"2024-04-26T23:13:29.708375+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:29.708375+0000","last_undegraded":"2024-04-26T23:13:29.708375+0000","last_fullsized":"2024-04-26T23:13:29.708375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-26T23:13:29.708196+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-26T23:13:29.708196+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.708196+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:27.075013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'202","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.087226+0000","last_change":"2024-04-26T23:13:22.087247+0000","last_active":"2024-04-26T23:13:22.087226+0000","last_peered":"2024-04-26T23:13:22.087226+0000","last_clean":"2024-04-26T23:13:22.087226+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:22.087226+0000","last_undegraded":"2024-04-26T23:13:22.087226+0000","last_fullsized":"2024-04-26T23:13:22.087226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:22.087157+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:22.087157+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.087157+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:31.522223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'213","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.593703+0000","last_change":"2024-04-26T23:13:22.593762+0000","last_active":"2024-04-26T23:13:22.593703+0000","last_peered":"2024-04-26T23:13:22.593703+0000","last_clean":"2024-04-26T23:13:22.593703+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:22.593703+0000","last_undegraded":"2024-04-26T23:13:22.593703+0000","last_fullsized":"2024-04-26T23:13:22.593703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:22.593525+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:22.593525+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.593525+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:57.702621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'203","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.259115+0000","last_change":"2024-04-26T23:13:31.259141+0000","last_active":"2024-04-26T23:13:31.259115+0000","last_peered":"2024-04-26T23:13:31.259115+0000","last_clean":"2024-04-26T23:13:31.259115+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:31.259115+0000","last_undegraded":"2024-04-26T23:13:31.259115+0000","last_fullsized":"2024-04-26T23:13:31.259115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-26T23:13:31.259026+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-26T23:13:31.259026+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.259026+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:36.020873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'219","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.176556+0000","last_change":"2024-04-26T23:13:28.176675+0000","last_active":"2024-04-26T23:13:28.176556+0000","last_peered":"2024-04-26T23:13:28.176556+0000","last_clean":"2024-04-26T23:13:28.176556+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:28.176556+0000","last_undegraded":"2024-04-26T23:13:28.176556+0000","last_fullsized":"2024-04-26T23:13:28.176556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-26T23:13:28.176381+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-26T23:13:28.176381+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.176381+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:06.558134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.092865+0000","last_change":"2024-04-26T23:13:33.092927+0000","last_active":"2024-04-26T23:13:33.092865+0000","last_peered":"2024-04-26T23:13:33.092865+0000","last_clean":"2024-04-26T23:13:33.092865+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:33.092865+0000","last_undegraded":"2024-04-26T23:13:33.092865+0000","last_fullsized":"2024-04-26T23:13:33.092865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-26T23:13:33.092698+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-26T23:13:33.092698+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.092698+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:44.910795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'207","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.148778+0000","last_change":"2024-04-26T23:13:24.148804+0000","last_active":"2024-04-26T23:13:24.148778+0000","last_peered":"2024-04-26T23:13:24.148778+0000","last_clean":"2024-04-26T23:13:24.148778+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:24.148778+0000","last_undegraded":"2024-04-26T23:13:24.148778+0000","last_fullsized":"2024-04-26T23:13:24.148778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:24.148672+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:24.148672+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.148672+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:28:31.106508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'208","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.777594+0000","last_change":"2024-04-26T23:13:35.777655+0000","last_active":"2024-04-26T23:13:35.777594+0000","last_peered":"2024-04-26T23:13:35.777594+0000","last_clean":"2024-04-26T23:13:35.777594+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:35.777594+0000","last_undegraded":"2024-04-26T23:13:35.777594+0000","last_fullsized":"2024-04-26T23:13:35.777594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:35.777415+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:35.777415+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.777415+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:12.754933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'222","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.676712+0000","last_change":"2024-04-26T23:13:30.676774+0000","last_active":"2024-04-26T23:13:30.676712+0000","last_peered":"2024-04-26T23:13:30.676712+0000","last_clean":"2024-04-26T23:13:30.676712+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:30.676712+0000","last_undegraded":"2024-04-26T23:13:30.676712+0000","last_fullsized":"2024-04-26T23:13:30.676712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'222","last_scrub_stamp":"2024-04-26T23:13:30.676518+0000","last_deep_scrub":"26'222","last_deep_scrub_stamp":"2024-04-26T23:13:30.676518+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.676518+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:30.531120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.559188+0000","last_change":"2024-04-26T23:13:30.559211+0000","last_active":"2024-04-26T23:13:30.559188+0000","last_peered":"2024-04-26T23:13:30.559188+0000","last_clean":"2024-04-26T23:13:30.559188+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:30.559188+0000","last_undegraded":"2024-04-26T23:13:30.559188+0000","last_fullsized":"2024-04-26T23:13:30.559188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-26T23:13:30.559113+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-26T23:13:30.559113+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.559113+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:30.207453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'213","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.146906+0000","last_change":"2024-04-26T23:13:27.146953+0000","last_active":"2024-04-26T23:13:27.146906+0000","last_peered":"2024-04-26T23:13:27.146906+0000","last_clean":"2024-04-26T23:13:27.146906+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:27.146906+0000","last_undegraded":"2024-04-26T23:13:27.146906+0000","last_fullsized":"2024-04-26T23:13:27.146906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:27.146808+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:27.146808+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.146808+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:27.178064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'204","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.060051+0000","last_change":"2024-04-26T23:13:31.060078+0000","last_active":"2024-04-26T23:13:31.060051+0000","last_peered":"2024-04-26T23:13:31.060051+0000","last_clean":"2024-04-26T23:13:31.060051+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:31.060051+0000","last_undegraded":"2024-04-26T23:13:31.060051+0000","last_fullsized":"2024-04-26T23:13:31.060051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:31.059967+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:31.059967+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.059967+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:35.277882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'182","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.436947+0000","last_change":"2024-04-26T23:13:26.437011+0000","last_active":"2024-04-26T23:13:26.436947+0000","last_peered":"2024-04-26T23:13:26.436947+0000","last_clean":"2024-04-26T23:13:26.436947+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:26.436947+0000","last_undegraded":"2024-04-26T23:13:26.436947+0000","last_fullsized":"2024-04-26T23:13:26.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-26T23:13:26.436723+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-26T23:13:26.436723+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.436723+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:43.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'186","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.207841+0000","last_change":"2024-04-26T23:13:34.207898+0000","last_active":"2024-04-26T23:13:34.207841+0000","last_peered":"2024-04-26T23:13:34.207841+0000","last_clean":"2024-04-26T23:13:34.207841+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:34.207841+0000","last_undegraded":"2024-04-26T23:13:34.207841+0000","last_fullsized":"2024-04-26T23:13:34.207841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'186","last_scrub_stamp":"2024-04-26T23:13:34.207671+0000","last_deep_scrub":"26'186","last_deep_scrub_stamp":"2024-04-26T23:13:34.207671+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.207671+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:44.222088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'204","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.171883+0000","last_change":"2024-04-26T23:13:33.171946+0000","last_active":"2024-04-26T23:13:33.171883+0000","last_peered":"2024-04-26T23:13:33.171883+0000","last_clean":"2024-04-26T23:13:33.171883+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:33.171883+0000","last_undegraded":"2024-04-26T23:13:33.171883+0000","last_fullsized":"2024-04-26T23:13:33.171883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:33.171708+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:33.171708+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.171708+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.783075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'211","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.074750+0000","last_change":"2024-04-26T23:13:35.074875+0000","last_active":"2024-04-26T23:13:35.074750+0000","last_peered":"2024-04-26T23:13:35.074750+0000","last_clean":"2024-04-26T23:13:35.074750+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:35.074750+0000","last_undegraded":"2024-04-26T23:13:35.074750+0000","last_fullsized":"2024-04-26T23:13:35.074750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-26T23:13:35.074535+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-26T23:13:35.074535+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.074535+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:02.601277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'199","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.992195+0000","last_change":"2024-04-26T23:13:38.992255+0000","last_active":"2024-04-26T23:13:38.992195+0000","last_peered":"2024-04-26T23:13:38.992195+0000","last_clean":"2024-04-26T23:13:38.992195+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:38.992195+0000","last_undegraded":"2024-04-26T23:13:38.992195+0000","last_fullsized":"2024-04-26T23:13:38.992195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-26T23:13:38.992092+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-26T23:13:38.992092+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.992092+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:13.693502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'212","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.086263+0000","last_change":"2024-04-26T23:13:23.086322+0000","last_active":"2024-04-26T23:13:23.086263+0000","last_peered":"2024-04-26T23:13:23.086263+0000","last_clean":"2024-04-26T23:13:23.086263+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:23.086263+0000","last_undegraded":"2024-04-26T23:13:23.086263+0000","last_fullsized":"2024-04-26T23:13:23.086263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-26T23:13:23.086079+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-26T23:13:23.086079+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.086079+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:18.389291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'191","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.703618+0000","last_change":"2024-04-26T23:13:31.703677+0000","last_active":"2024-04-26T23:13:31.703618+0000","last_peered":"2024-04-26T23:13:31.703618+0000","last_clean":"2024-04-26T23:13:31.703618+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:31.703618+0000","last_undegraded":"2024-04-26T23:13:31.703618+0000","last_fullsized":"2024-04-26T23:13:31.703618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:31.703441+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:31.703441+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.703441+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:20.290046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'206","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.049621+0000","last_change":"2024-04-26T23:13:32.049680+0000","last_active":"2024-04-26T23:13:32.049621+0000","last_peered":"2024-04-26T23:13:32.049621+0000","last_clean":"2024-04-26T23:13:32.049621+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:32.049621+0000","last_undegraded":"2024-04-26T23:13:32.049621+0000","last_fullsized":"2024-04-26T23:13:32.049621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-26T23:13:32.049435+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-26T23:13:32.049435+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.049435+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:59:43.726173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'198","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.730750+0000","last_change":"2024-04-26T23:13:32.730810+0000","last_active":"2024-04-26T23:13:32.730750+0000","last_peered":"2024-04-26T23:13:32.730750+0000","last_clean":"2024-04-26T23:13:32.730750+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:32.730750+0000","last_undegraded":"2024-04-26T23:13:32.730750+0000","last_fullsized":"2024-04-26T23:13:32.730750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-26T23:13:32.730575+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-26T23:13:32.730575+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.730575+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:48.339525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'190","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.099511+0000","last_change":"2024-04-26T23:13:24.099535+0000","last_active":"2024-04-26T23:13:24.099511+0000","last_peered":"2024-04-26T23:13:24.099511+0000","last_clean":"2024-04-26T23:13:24.099511+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:24.099511+0000","last_undegraded":"2024-04-26T23:13:24.099511+0000","last_fullsized":"2024-04-26T23:13:24.099511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-26T23:13:24.099427+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-26T23:13:24.099427+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.099427+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'208","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.572489+0000","last_change":"2024-04-26T23:13:29.572551+0000","last_active":"2024-04-26T23:13:29.572489+0000","last_peered":"2024-04-26T23:13:29.572489+0000","last_clean":"2024-04-26T23:13:29.572489+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:29.572489+0000","last_undegraded":"2024-04-26T23:13:29.572489+0000","last_fullsized":"2024-04-26T23:13:29.572489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:29.572398+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:29.572398+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.572398+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:13.998402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'207","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.095803+0000","last_change":"2024-04-26T23:13:34.095860+0000","last_active":"2024-04-26T23:13:34.095803+0000","last_peered":"2024-04-26T23:13:34.095803+0000","last_clean":"2024-04-26T23:13:34.095803+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:34.095803+0000","last_undegraded":"2024-04-26T23:13:34.095803+0000","last_fullsized":"2024-04-26T23:13:34.095803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:34.095637+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:34.095637+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.095637+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:47.754360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13203,"ondisk_log_size":13203,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146760150,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6971,"num_write_kb":149053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293520300,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8332,"ondisk_log_size":8332,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53626098,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452446,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40338093,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921377,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:13:43.563 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:43.563 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T23:04:39.097593+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:43.564 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T23:04:43.166473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=4, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=13, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:13:43.564 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:13:44.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:13:44.730 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:03.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:14:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 Processor -- start 2024-04-26T23:14:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 -- start start 2024-04-26T23:14:03.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8501589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8500ca330 con 0x7fc850152120 2024-04-26T23:14:03.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc850072eb0 con 0x7fc850072a40 2024-04-26T23:14:03.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc855a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8500c8f40 con 0x7fc8500708f0 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84ea00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc850152120 0x7fc8500c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60844/0 (socket says 172.21.15.148:60844) 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84ea00640 1 -- 172.21.15.148:0/3013172195 learned_addr learned my addr 172.21.15.148:0/3013172195 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84e000640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8501589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294030466 0 0) 0x7fc8400014a0 con 0x7fc850152120 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc834003530 con 0x7fc850152120 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 704759298 0 0) 0x7fc834003530 con 0x7fc850152120 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 msgr2=0x7fc8501589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8501589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 >> v1:172.21.15.157:6789/0 conn(0x7fc850072a40 legacy=0x7fc8500c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8500c9190 con 0x7fc850152120 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7fc840001bd0 con 0x7fc850152120 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 >> v1:172.21.15.148:6789/0 conn(0x7fc850152120 legacy=0x7fc8500c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834003f50 0x7fc834004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc834004d50 0x7fc8340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8500c8f40 con 0x7fc834004d50 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc83400ba80 con 0x7fc834003f50 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc83400bc50 con 0x7fc8500708f0 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84ea00640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84e000640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834003f50 0x7fc834004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.716+0000 7fc84f400640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc834004d50 0x7fc8340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 -- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 msgr2=0x7fc8340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8500708f0 0x7fc8340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 -- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834003f50 msgr2=0x7fc834004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834003f50 0x7fc834004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 -- 172.21.15.148:0/3013172195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc834003530 con 0x7fc834004d50 2024-04-26T23:14:03.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc834004d50 0x7fc8340051d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc848001890 tx=0x7fc84801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4df1b4d3379f7bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848001460 con 0x7fc834004d50 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8480b0070 con 0x7fc834004d50 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84d600640 1 -- 172.21.15.148:0/3013172195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480ab8a0 con 0x7fc834004d50 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 -- 172.21.15.148:0/3013172195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc834004d50 msgr2=0x7fc8340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 --2- 172.21.15.148:0/3013172195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc834004d50 0x7fc8340051d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc848001890 tx=0x7fc84801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc84f400640 1 -- 172.21.15.148:0/3013172195 reap_dead start 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 -- 172.21.15.148:0/3013172195 shutdown_connections 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 -- 172.21.15.148:0/3013172195 >> 172.21.15.148:0/3013172195 conn(0x7fc85006c380 msgr2=0x7fc85006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 -- 172.21.15.148:0/3013172195 shutdown_connections 2024-04-26T23:14:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.720+0000 7fc855a00640 1 -- 172.21.15.148:0/3013172195 wait complete. 2024-04-26T23:14:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 Processor -- start 2024-04-26T23:14:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 -- start start 2024-04-26T23:14:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834004d50 0x7fc8501e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8501e7fe0 0x7fc8501e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8500c81e0 con 0x7fc850148ec0 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc8500c7f00 con 0x7fc834004d50 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc855a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8500c9470 con 0x7fc8501e7fe0 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46092/0 (socket says 172.21.15.148:46092) 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 -- 172.21.15.148:0/4253539398 learned_addr learned my addr 172.21.15.148:0/4253539398 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84ea00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834004d50 0x7fc8501e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84f400640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8501e7fe0 0x7fc8501e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 -- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8501e7fe0 msgr2=0x7fc8501e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8501e7fe0 0x7fc8501e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 -- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834004d50 msgr2=0x7fc8501e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834004d50 0x7fc8501e75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 -- 172.21.15.148:0/4253539398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850155ec0 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc84e000640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc83c011a30 tx=0x7fc83c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00fbb0 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c00fd50 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.724+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c014680 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501f3840 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501f3e00 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc850077c20 con 0x7fc850148ec0 2024-04-26T23:14:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc83c012040 con 0x7fc850148ec0 2024-04-26T23:14:03.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc846a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 0x7fc83006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:03.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc83c0872f0 con 0x7fc850148ec0 2024-04-26T23:14:03.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.728+0000 7fc84ea00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 0x7fc83006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:03.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.732+0000 7fc84ea00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 0x7fc83006a870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc840002100 tx=0x7fc840002070 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:03.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.732+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc83c019030 con 0x7fc850148ec0 2024-04-26T23:14:03.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.884+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 --> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc850156130 con 0x7fc8300683b0 2024-04-26T23:14:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc846a00640 1 -- 172.21.15.148:0/4253539398 <== mgr.4115 v2:172.21.15.157:6832/726741875 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335587 (secure 0 0 0) 0x7fc850156130 con 0x7fc8300683b0 2024-04-26T23:14:03.911 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:14:03.913 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 msgr2=0x7fc83006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 0x7fc83006a870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc840002100 tx=0x7fc840002070 comp rx=0 tx=0).stop 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 msgr2=0x7fc8501f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc83c011a30 tx=0x7fc83c011ef0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 shutdown_connections 2024-04-26T23:14:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7fc8300683b0 0x7fc83006a870 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8501e7fe0 0x7fc8501e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850148ec0 0x7fc8501f4600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 --2- 172.21.15.148:0/4253539398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc834004d50 0x7fc8501e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 >> 172.21.15.148:0/4253539398 conn(0x7fc85006c380 msgr2=0x7fc8500c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 shutdown_connections 2024-04-26T23:14:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:03.912+0000 7fc855a00640 1 -- 172.21.15.148:0/4253539398 wait complete. 2024-04-26T23:14:03.932 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-26T23:14:02.069603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147350518,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1604,"num_read_kb":3563889,"num_write":31503,"num_write_kb":4538326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47279,"ondisk_log_size":47279,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":674016,"kb_used_data":98528,"kb_used_omap":12,"kb_used_meta":575411,"kb_avail":754300704,"statfs":{"total":773094113280,"available":772403920896,"internally_reserved":0,"allocated":100892672,"data_stored":295615860,"data_compressed":45743398,"data_compressed_allocated":58875904,"data_compressed_original":255074304,"omap_allocated":12750,"internal_metadata":589221426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005611"},"pg_stats":[{"pgid":"2.1f","version":"26'80","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.041581+0000","last_change":"2024-04-26T23:13:22.041615+0000","last_active":"2024-04-26T23:13:22.041581+0000","last_peered":"2024-04-26T23:13:22.041581+0000","last_clean":"2024-04-26T23:13:22.041581+0000","last_became_active":"2024-04-26T23:04:39.154465+0000","last_became_peered":"2024-04-26T23:04:39.154465+0000","last_unstale":"2024-04-26T23:13:22.041581+0000","last_undegraded":"2024-04-26T23:13:22.041581+0000","last_fullsized":"2024-04-26T23:13:22.041581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2024-04-26T23:13:22.041518+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2024-04-26T23:13:22.041518+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.041518+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:47.876079+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.098223+0000","last_change":"2024-04-26T23:13:23.098245+0000","last_active":"2024-04-26T23:13:23.098223+0000","last_peered":"2024-04-26T23:13:23.098223+0000","last_clean":"2024-04-26T23:13:23.098223+0000","last_became_active":"2024-04-26T23:04:40.168552+0000","last_became_peered":"2024-04-26T23:04:40.168552+0000","last_unstale":"2024-04-26T23:13:23.098223+0000","last_undegraded":"2024-04-26T23:13:23.098223+0000","last_fullsized":"2024-04-26T23:13:23.098223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-26T23:13:23.098165+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-26T23:13:23.098165+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.098165+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:16.994211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'840","reported_seq":901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.058614+0000","last_change":"2024-04-26T23:13:37.058641+0000","last_active":"2024-04-26T23:13:37.058614+0000","last_peered":"2024-04-26T23:13:37.058614+0000","last_clean":"2024-04-26T23:13:37.058614+0000","last_became_active":"2024-04-26T23:04:44.387960+0000","last_became_peered":"2024-04-26T23:04:44.387960+0000","last_unstale":"2024-04-26T23:13:37.058614+0000","last_undegraded":"2024-04-26T23:13:37.058614+0000","last_fullsized":"2024-04-26T23:13:37.058614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'840","last_scrub_stamp":"2024-04-26T23:13:37.058520+0000","last_deep_scrub":"26'840","last_deep_scrub_stamp":"2024-04-26T23:13:37.058520+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.058520+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:15.908175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":117298,"num_write":810,"num_write_kb":184611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'92","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.116125+0000","last_change":"2024-04-26T23:13:25.116157+0000","last_active":"2024-04-26T23:13:25.116125+0000","last_peered":"2024-04-26T23:13:25.116125+0000","last_clean":"2024-04-26T23:13:25.116125+0000","last_became_active":"2024-04-26T23:04:39.132600+0000","last_became_peered":"2024-04-26T23:04:39.132600+0000","last_unstale":"2024-04-26T23:13:25.116125+0000","last_undegraded":"2024-04-26T23:13:25.116125+0000","last_fullsized":"2024-04-26T23:13:25.116125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'92","last_scrub_stamp":"2024-04-26T23:13:25.116039+0000","last_deep_scrub":"26'92","last_deep_scrub_stamp":"2024-04-26T23:13:25.116039+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.116039+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:30.122342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.202231+0000","last_change":"2024-04-26T23:13:29.202253+0000","last_active":"2024-04-26T23:13:29.202231+0000","last_peered":"2024-04-26T23:13:29.202231+0000","last_clean":"2024-04-26T23:13:29.202231+0000","last_became_active":"2024-04-26T23:04:40.169074+0000","last_became_peered":"2024-04-26T23:04:40.169074+0000","last_unstale":"2024-04-26T23:13:29.202231+0000","last_undegraded":"2024-04-26T23:13:29.202231+0000","last_fullsized":"2024-04-26T23:13:29.202231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-26T23:13:29.202129+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-26T23:13:29.202129+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.202129+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:43.765880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'811","reported_seq":885,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.505203+0000","last_change":"2024-04-26T23:13:29.505382+0000","last_active":"2024-04-26T23:13:29.505203+0000","last_peered":"2024-04-26T23:13:29.505203+0000","last_clean":"2024-04-26T23:13:29.505203+0000","last_became_active":"2024-04-26T23:04:44.221539+0000","last_became_peered":"2024-04-26T23:04:44.221539+0000","last_unstale":"2024-04-26T23:13:29.505203+0000","last_undegraded":"2024-04-26T23:13:29.505203+0000","last_fullsized":"2024-04-26T23:13:29.505203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'811","last_scrub_stamp":"2024-04-26T23:13:29.504983+0000","last_deep_scrub":"26'811","last_deep_scrub_stamp":"2024-04-26T23:13:29.504983+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.504983+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:54.226394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":123787,"num_write":763,"num_write_kb":176187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'377","reported_seq":415,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.014560+0000","last_change":"2024-04-26T23:13:30.014645+0000","last_active":"2024-04-26T23:13:30.014560+0000","last_peered":"2024-04-26T23:13:30.014560+0000","last_clean":"2024-04-26T23:13:30.014560+0000","last_became_active":"2024-04-26T23:04:39.157702+0000","last_became_peered":"2024-04-26T23:04:39.157702+0000","last_unstale":"2024-04-26T23:13:30.014560+0000","last_undegraded":"2024-04-26T23:13:30.014560+0000","last_fullsized":"2024-04-26T23:13:30.014560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'377","last_scrub_stamp":"2024-04-26T23:13:30.014365+0000","last_deep_scrub":"26'377","last_deep_scrub_stamp":"2024-04-26T23:13:30.014365+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.014365+0000","objects_scrubbed":5,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:25.854248+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'194","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.730280+0000","last_change":"2024-04-26T23:13:36.730338+0000","last_active":"2024-04-26T23:13:36.730280+0000","last_peered":"2024-04-26T23:13:36.730280+0000","last_clean":"2024-04-26T23:13:36.730280+0000","last_became_active":"2024-04-26T23:04:40.187677+0000","last_became_peered":"2024-04-26T23:04:40.187677+0000","last_unstale":"2024-04-26T23:13:36.730280+0000","last_undegraded":"2024-04-26T23:13:36.730280+0000","last_fullsized":"2024-04-26T23:13:36.730280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-26T23:13:36.730102+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-26T23:13:36.730102+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.730102+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:03.532424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'784","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.407937+0000","last_change":"2024-04-26T23:13:34.408017+0000","last_active":"2024-04-26T23:13:34.407937+0000","last_peered":"2024-04-26T23:13:34.407937+0000","last_clean":"2024-04-26T23:13:34.407937+0000","last_became_active":"2024-04-26T23:04:44.229335+0000","last_became_peered":"2024-04-26T23:04:44.229335+0000","last_unstale":"2024-04-26T23:13:34.407937+0000","last_undegraded":"2024-04-26T23:13:34.407937+0000","last_fullsized":"2024-04-26T23:13:34.407937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'784","last_scrub_stamp":"2024-04-26T23:13:34.407722+0000","last_deep_scrub":"26'784","last_deep_scrub_stamp":"2024-04-26T23:13:34.407722+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.407722+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:20.680802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":175231,"num_write":753,"num_write_kb":155645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'185","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.032102+0000","last_change":"2024-04-26T23:13:31.032246+0000","last_active":"2024-04-26T23:13:31.032102+0000","last_peered":"2024-04-26T23:13:31.032102+0000","last_clean":"2024-04-26T23:13:31.032102+0000","last_became_active":"2024-04-26T23:04:39.159424+0000","last_became_peered":"2024-04-26T23:04:39.159424+0000","last_unstale":"2024-04-26T23:13:31.032102+0000","last_undegraded":"2024-04-26T23:13:31.032102+0000","last_fullsized":"2024-04-26T23:13:31.032102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'185","last_scrub_stamp":"2024-04-26T23:13:31.031881+0000","last_deep_scrub":"26'185","last_deep_scrub_stamp":"2024-04-26T23:13:31.031881+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.031881+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:27.167975+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'207","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.718502+0000","last_change":"2024-04-26T23:13:37.718560+0000","last_active":"2024-04-26T23:13:37.718502+0000","last_peered":"2024-04-26T23:13:37.718502+0000","last_clean":"2024-04-26T23:13:37.718502+0000","last_became_active":"2024-04-26T23:04:40.187827+0000","last_became_peered":"2024-04-26T23:04:40.187827+0000","last_unstale":"2024-04-26T23:13:37.718502+0000","last_undegraded":"2024-04-26T23:13:37.718502+0000","last_fullsized":"2024-04-26T23:13:37.718502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:37.718320+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:37.718320+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.718320+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:51.604664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'751","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.459103+0000","last_change":"2024-04-26T23:13:27.459242+0000","last_active":"2024-04-26T23:13:27.459103+0000","last_peered":"2024-04-26T23:13:27.459103+0000","last_clean":"2024-04-26T23:13:27.459103+0000","last_became_active":"2024-04-26T23:04:44.212234+0000","last_became_peered":"2024-04-26T23:04:44.212234+0000","last_unstale":"2024-04-26T23:13:27.459103+0000","last_undegraded":"2024-04-26T23:13:27.459103+0000","last_fullsized":"2024-04-26T23:13:27.459103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'751","last_scrub_stamp":"2024-04-26T23:13:27.458846+0000","last_deep_scrub":"26'751","last_deep_scrub_stamp":"2024-04-26T23:13:27.458846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.458846+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:05.769682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":53422,"num_write":714,"num_write_kb":101400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'217","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.196575+0000","last_change":"2024-04-26T23:13:31.196633+0000","last_active":"2024-04-26T23:13:31.196575+0000","last_peered":"2024-04-26T23:13:31.196575+0000","last_clean":"2024-04-26T23:13:31.196575+0000","last_became_active":"2024-04-26T23:04:40.166974+0000","last_became_peered":"2024-04-26T23:04:40.166974+0000","last_unstale":"2024-04-26T23:13:31.196575+0000","last_undegraded":"2024-04-26T23:13:31.196575+0000","last_fullsized":"2024-04-26T23:13:31.196575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'217","last_scrub_stamp":"2024-04-26T23:13:31.196392+0000","last_deep_scrub":"26'217","last_deep_scrub_stamp":"2024-04-26T23:13:31.196392+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.196392+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:36.690443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'280","reported_seq":319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.082278+0000","last_change":"2024-04-26T23:13:28.082278+0000","last_active":"2024-04-26T23:13:28.082278+0000","last_peered":"2024-04-26T23:13:28.082278+0000","last_clean":"2024-04-26T23:13:28.082278+0000","last_became_active":"2024-04-26T23:04:39.150374+0000","last_became_peered":"2024-04-26T23:04:39.150374+0000","last_unstale":"2024-04-26T23:13:28.082278+0000","last_undegraded":"2024-04-26T23:13:28.082278+0000","last_fullsized":"2024-04-26T23:13:28.082278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'280","last_scrub_stamp":"2024-04-26T23:13:28.081984+0000","last_deep_scrub":"26'280","last_deep_scrub_stamp":"2024-04-26T23:13:28.081984+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.081984+0000","objects_scrubbed":4,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:35.468646+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'863","reported_seq":946,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.490882+0000","last_change":"2024-04-26T23:13:28.490882+0000","last_active":"2024-04-26T23:13:28.490882+0000","last_peered":"2024-04-26T23:13:28.490882+0000","last_clean":"2024-04-26T23:13:28.490882+0000","last_became_active":"2024-04-26T23:04:44.219783+0000","last_became_peered":"2024-04-26T23:04:44.219783+0000","last_unstale":"2024-04-26T23:13:28.490882+0000","last_undegraded":"2024-04-26T23:13:28.490882+0000","last_fullsized":"2024-04-26T23:13:28.490882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'863","last_scrub_stamp":"2024-04-26T23:13:28.490593+0000","last_deep_scrub":"26'863","last_deep_scrub_stamp":"2024-04-26T23:13:28.490593+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.490593+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:38.213384+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":134396,"num_write":805,"num_write_kb":173147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'213","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.081823+0000","last_change":"2024-04-26T23:13:28.081823+0000","last_active":"2024-04-26T23:13:28.081823+0000","last_peered":"2024-04-26T23:13:28.081823+0000","last_clean":"2024-04-26T23:13:28.081823+0000","last_became_active":"2024-04-26T23:04:40.152695+0000","last_became_peered":"2024-04-26T23:04:40.152695+0000","last_unstale":"2024-04-26T23:13:28.081823+0000","last_undegraded":"2024-04-26T23:13:28.081823+0000","last_fullsized":"2024-04-26T23:13:28.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:28.081717+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:28.081717+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.081717+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:59.633567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'171","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.566849+0000","last_change":"2024-04-26T23:13:24.566885+0000","last_active":"2024-04-26T23:13:24.566849+0000","last_peered":"2024-04-26T23:13:24.566849+0000","last_clean":"2024-04-26T23:13:24.566849+0000","last_became_active":"2024-04-26T23:04:39.128963+0000","last_became_peered":"2024-04-26T23:04:39.128963+0000","last_unstale":"2024-04-26T23:13:24.566849+0000","last_undegraded":"2024-04-26T23:13:24.566849+0000","last_fullsized":"2024-04-26T23:13:24.566849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'171","last_scrub_stamp":"2024-04-26T23:13:24.566764+0000","last_deep_scrub":"26'171","last_deep_scrub_stamp":"2024-04-26T23:13:24.566764+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.566764+0000","objects_scrubbed":2,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:00.375742+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'852","reported_seq":916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.425190+0000","last_change":"2024-04-26T23:13:31.425190+0000","last_active":"2024-04-26T23:13:31.425190+0000","last_peered":"2024-04-26T23:13:31.425190+0000","last_clean":"2024-04-26T23:13:31.425190+0000","last_became_active":"2024-04-26T23:04:44.224755+0000","last_became_peered":"2024-04-26T23:04:44.224755+0000","last_unstale":"2024-04-26T23:13:31.425190+0000","last_undegraded":"2024-04-26T23:13:31.425190+0000","last_fullsized":"2024-04-26T23:13:31.425190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'852","last_scrub_stamp":"2024-04-26T23:13:31.424936+0000","last_deep_scrub":"26'852","last_deep_scrub_stamp":"2024-04-26T23:13:31.424936+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.424936+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:13.302704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":88293,"num_write":817,"num_write_kb":81605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'209","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.061038+0000","last_change":"2024-04-26T23:13:29.061060+0000","last_active":"2024-04-26T23:13:29.061038+0000","last_peered":"2024-04-26T23:13:29.061038+0000","last_clean":"2024-04-26T23:13:29.061038+0000","last_became_active":"2024-04-26T23:04:40.156372+0000","last_became_peered":"2024-04-26T23:04:40.156372+0000","last_unstale":"2024-04-26T23:13:29.061038+0000","last_undegraded":"2024-04-26T23:13:29.061038+0000","last_fullsized":"2024-04-26T23:13:29.061038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-26T23:13:29.060944+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-26T23:13:29.060944+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.060944+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.170296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.644886+0000","last_change":"2024-04-26T23:13:21.644913+0000","last_active":"2024-04-26T23:13:21.644886+0000","last_peered":"2024-04-26T23:13:21.644886+0000","last_clean":"2024-04-26T23:13:21.644886+0000","last_became_active":"2024-04-26T23:04:39.124057+0000","last_became_peered":"2024-04-26T23:04:39.124057+0000","last_unstale":"2024-04-26T23:13:21.644886+0000","last_undegraded":"2024-04-26T23:13:21.644886+0000","last_fullsized":"2024-04-26T23:13:21.644886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-04-26T23:13:21.644825+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-04-26T23:13:21.644825+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.644825+0000","objects_scrubbed":3,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:10.237602+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2588503,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":2585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'777","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.490434+0000","last_change":"2024-04-26T23:13:35.490434+0000","last_active":"2024-04-26T23:13:35.490434+0000","last_peered":"2024-04-26T23:13:35.490434+0000","last_clean":"2024-04-26T23:13:35.490434+0000","last_became_active":"2024-04-26T23:04:44.383451+0000","last_became_peered":"2024-04-26T23:04:44.383451+0000","last_unstale":"2024-04-26T23:13:35.490434+0000","last_undegraded":"2024-04-26T23:13:35.490434+0000","last_fullsized":"2024-04-26T23:13:35.490434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-26T23:13:35.490312+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-26T23:13:35.490312+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.490312+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:22.294461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":86667,"num_write":737,"num_write_kb":106427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'226","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.457023+0000","last_change":"2024-04-26T23:13:24.457090+0000","last_active":"2024-04-26T23:13:24.457023+0000","last_peered":"2024-04-26T23:13:24.457023+0000","last_clean":"2024-04-26T23:13:24.457023+0000","last_became_active":"2024-04-26T23:04:40.157612+0000","last_became_peered":"2024-04-26T23:04:40.157612+0000","last_unstale":"2024-04-26T23:13:24.457023+0000","last_undegraded":"2024-04-26T23:13:24.457023+0000","last_fullsized":"2024-04-26T23:13:24.457023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'226","last_scrub_stamp":"2024-04-26T23:13:24.456846+0000","last_deep_scrub":"26'226","last_deep_scrub_stamp":"2024-04-26T23:13:24.456846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.456846+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:27.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'458","reported_seq":497,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.024017+0000","last_change":"2024-04-26T23:13:26.024084+0000","last_active":"2024-04-26T23:13:26.024017+0000","last_peered":"2024-04-26T23:13:26.024017+0000","last_clean":"2024-04-26T23:13:26.024017+0000","last_became_active":"2024-04-26T23:04:39.148821+0000","last_became_peered":"2024-04-26T23:04:39.148821+0000","last_unstale":"2024-04-26T23:13:26.024017+0000","last_undegraded":"2024-04-26T23:13:26.024017+0000","last_fullsized":"2024-04-26T23:13:26.024017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'458","last_scrub_stamp":"2024-04-26T23:13:26.023835+0000","last_deep_scrub":"26'458","last_deep_scrub_stamp":"2024-04-26T23:13:26.023835+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.023835+0000","objects_scrubbed":2,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:40.228191+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'747","reported_seq":796,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.429975+0000","last_change":"2024-04-26T23:13:32.429975+0000","last_active":"2024-04-26T23:13:32.429975+0000","last_peered":"2024-04-26T23:13:32.429975+0000","last_clean":"2024-04-26T23:13:32.429975+0000","last_became_active":"2024-04-26T23:04:44.224931+0000","last_became_peered":"2024-04-26T23:04:44.224931+0000","last_unstale":"2024-04-26T23:13:32.429975+0000","last_undegraded":"2024-04-26T23:13:32.429975+0000","last_fullsized":"2024-04-26T23:13:32.429975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:32.429676+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:32.429676+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.429676+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:44.351815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":62727,"num_write":704,"num_write_kb":121537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.108248+0000","last_change":"2024-04-26T23:13:26.108272+0000","last_active":"2024-04-26T23:13:26.108248+0000","last_peered":"2024-04-26T23:13:26.108248+0000","last_clean":"2024-04-26T23:13:26.108248+0000","last_became_active":"2024-04-26T23:04:40.157686+0000","last_became_peered":"2024-04-26T23:04:40.157686+0000","last_unstale":"2024-04-26T23:13:26.108248+0000","last_undegraded":"2024-04-26T23:13:26.108248+0000","last_fullsized":"2024-04-26T23:13:26.108248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:26.108165+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:26.108165+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.108165+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:18.423957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'79","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.211504+0000","last_change":"2024-04-26T23:13:24.211582+0000","last_active":"2024-04-26T23:13:24.211504+0000","last_peered":"2024-04-26T23:13:24.211504+0000","last_clean":"2024-04-26T23:13:24.211504+0000","last_became_active":"2024-04-26T23:04:39.133414+0000","last_became_peered":"2024-04-26T23:04:39.133414+0000","last_unstale":"2024-04-26T23:13:24.211504+0000","last_undegraded":"2024-04-26T23:13:24.211504+0000","last_fullsized":"2024-04-26T23:13:24.211504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-26T23:13:24.211341+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-26T23:13:24.211341+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.211341+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:13.485197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'823","reported_seq":909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.396394+0000","last_change":"2024-04-26T23:13:35.396537+0000","last_active":"2024-04-26T23:13:35.396394+0000","last_peered":"2024-04-26T23:13:35.396394+0000","last_clean":"2024-04-26T23:13:35.396394+0000","last_became_active":"2024-04-26T23:04:44.387330+0000","last_became_peered":"2024-04-26T23:04:44.387330+0000","last_unstale":"2024-04-26T23:13:35.396394+0000","last_undegraded":"2024-04-26T23:13:35.396394+0000","last_fullsized":"2024-04-26T23:13:35.396394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'823","last_scrub_stamp":"2024-04-26T23:13:35.396151+0000","last_deep_scrub":"26'823","last_deep_scrub_stamp":"2024-04-26T23:13:35.396151+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.396151+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:26:01.131607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":141149,"num_write":792,"num_write_kb":197145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.184104+0000","last_change":"2024-04-26T23:13:28.184129+0000","last_active":"2024-04-26T23:13:28.184104+0000","last_peered":"2024-04-26T23:13:28.184104+0000","last_clean":"2024-04-26T23:13:28.184104+0000","last_became_active":"2024-04-26T23:05:29.214929+0000","last_became_peered":"2024-04-26T23:05:29.214929+0000","last_unstale":"2024-04-26T23:13:28.184104+0000","last_undegraded":"2024-04-26T23:13:28.184104+0000","last_fullsized":"2024-04-26T23:13:28.184104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'177","last_scrub_stamp":"2024-04-26T23:13:28.184030+0000","last_deep_scrub":"26'177","last_deep_scrub_stamp":"2024-04-26T23:13:28.184030+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.184030+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:18.044119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'408","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.608906+0000","last_change":"2024-04-26T23:13:22.608931+0000","last_active":"2024-04-26T23:13:22.608906+0000","last_peered":"2024-04-26T23:13:22.608906+0000","last_clean":"2024-04-26T23:13:22.608906+0000","last_became_active":"2024-04-26T23:04:39.128680+0000","last_became_peered":"2024-04-26T23:04:39.128680+0000","last_unstale":"2024-04-26T23:13:22.608906+0000","last_undegraded":"2024-04-26T23:13:22.608906+0000","last_fullsized":"2024-04-26T23:13:22.608906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'408","last_scrub_stamp":"2024-04-26T23:13:22.608843+0000","last_deep_scrub":"26'408","last_deep_scrub_stamp":"2024-04-26T23:13:22.608843+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.608843+0000","objects_scrubbed":2,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:37.774978+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'811","reported_seq":876,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.038406+0000","last_change":"2024-04-26T23:13:38.038433+0000","last_active":"2024-04-26T23:13:38.038406+0000","last_peered":"2024-04-26T23:13:38.038406+0000","last_clean":"2024-04-26T23:13:38.038406+0000","last_became_active":"2024-04-26T23:05:29.212557+0000","last_became_peered":"2024-04-26T23:05:29.212557+0000","last_unstale":"2024-04-26T23:13:38.038406+0000","last_undegraded":"2024-04-26T23:13:38.038406+0000","last_fullsized":"2024-04-26T23:13:38.038406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'811","last_scrub_stamp":"2024-04-26T23:13:38.038314+0000","last_deep_scrub":"26'811","last_deep_scrub_stamp":"2024-04-26T23:13:38.038314+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.038314+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:47.500906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":101647,"num_write":773,"num_write_kb":122102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'195","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:19.692268+0000","last_change":"2024-04-26T23:13:19.692291+0000","last_active":"2024-04-26T23:13:19.692268+0000","last_peered":"2024-04-26T23:13:19.692268+0000","last_clean":"2024-04-26T23:13:19.692268+0000","last_became_active":"2024-04-26T23:04:40.158944+0000","last_became_peered":"2024-04-26T23:04:40.158944+0000","last_unstale":"2024-04-26T23:13:19.692268+0000","last_undegraded":"2024-04-26T23:13:19.692268+0000","last_fullsized":"2024-04-26T23:13:19.692268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-26T23:13:19.692203+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-26T23:13:19.692203+0000","last_clean_scrub_stamp":"2024-04-26T23:13:19.692203+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:52:31.536040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'173","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.021566+0000","last_change":"2024-04-26T23:13:29.021642+0000","last_active":"2024-04-26T23:13:29.021566+0000","last_peered":"2024-04-26T23:13:29.021566+0000","last_clean":"2024-04-26T23:13:29.021566+0000","last_became_active":"2024-04-26T23:04:39.151711+0000","last_became_peered":"2024-04-26T23:04:39.151711+0000","last_unstale":"2024-04-26T23:13:29.021566+0000","last_undegraded":"2024-04-26T23:13:29.021566+0000","last_fullsized":"2024-04-26T23:13:29.021566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'173","last_scrub_stamp":"2024-04-26T23:13:29.021380+0000","last_deep_scrub":"26'173","last_deep_scrub_stamp":"2024-04-26T23:13:29.021380+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.021380+0000","objects_scrubbed":2,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:46.950365+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'786","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.217630+0000","last_change":"2024-04-26T23:13:36.217661+0000","last_active":"2024-04-26T23:13:36.217630+0000","last_peered":"2024-04-26T23:13:36.217630+0000","last_clean":"2024-04-26T23:13:36.217630+0000","last_became_active":"2024-04-26T23:05:29.212556+0000","last_became_peered":"2024-04-26T23:05:29.212556+0000","last_unstale":"2024-04-26T23:13:36.217630+0000","last_undegraded":"2024-04-26T23:13:36.217630+0000","last_fullsized":"2024-04-26T23:13:36.217630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'786","last_scrub_stamp":"2024-04-26T23:13:36.217537+0000","last_deep_scrub":"26'786","last_deep_scrub_stamp":"2024-04-26T23:13:36.217537+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.217537+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:04.647990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":82824,"num_write":742,"num_write_kb":118059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'213","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.209187+0000","last_change":"2024-04-26T23:13:27.209187+0000","last_active":"2024-04-26T23:13:27.209187+0000","last_peered":"2024-04-26T23:13:27.209187+0000","last_clean":"2024-04-26T23:13:27.209187+0000","last_became_active":"2024-04-26T23:05:29.047853+0000","last_became_peered":"2024-04-26T23:05:29.047853+0000","last_unstale":"2024-04-26T23:13:27.209187+0000","last_undegraded":"2024-04-26T23:13:27.209187+0000","last_fullsized":"2024-04-26T23:13:27.209187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:27.209030+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:27.209030+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.209030+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:38.664196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.590848+0000","last_change":"2024-04-26T23:13:23.590869+0000","last_active":"2024-04-26T23:13:23.590848+0000","last_peered":"2024-04-26T23:13:23.590848+0000","last_clean":"2024-04-26T23:13:23.590848+0000","last_became_active":"2024-04-26T23:04:39.128833+0000","last_became_peered":"2024-04-26T23:04:39.128833+0000","last_unstale":"2024-04-26T23:13:23.590848+0000","last_undegraded":"2024-04-26T23:13:23.590848+0000","last_fullsized":"2024-04-26T23:13:23.590848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'67","last_scrub_stamp":"2024-04-26T23:13:23.590748+0000","last_deep_scrub":"26'67","last_deep_scrub_stamp":"2024-04-26T23:13:23.590748+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.590748+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:50.883128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'800","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.556863+0000","last_change":"2024-04-26T23:13:32.556892+0000","last_active":"2024-04-26T23:13:32.556863+0000","last_peered":"2024-04-26T23:13:32.556863+0000","last_clean":"2024-04-26T23:13:32.556863+0000","last_became_active":"2024-04-26T23:04:44.218149+0000","last_became_peered":"2024-04-26T23:04:44.218149+0000","last_unstale":"2024-04-26T23:13:32.556863+0000","last_undegraded":"2024-04-26T23:13:32.556863+0000","last_fullsized":"2024-04-26T23:13:32.556863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:32.556763+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:32.556763+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.556763+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:54.701598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":150231,"num_write":766,"num_write_kb":146626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'198","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.391297+0000","last_change":"2024-04-26T23:13:22.391368+0000","last_active":"2024-04-26T23:13:22.391297+0000","last_peered":"2024-04-26T23:13:22.391297+0000","last_clean":"2024-04-26T23:13:22.391297+0000","last_became_active":"2024-04-26T23:04:40.153023+0000","last_became_peered":"2024-04-26T23:04:40.153023+0000","last_unstale":"2024-04-26T23:13:22.391297+0000","last_undegraded":"2024-04-26T23:13:22.391297+0000","last_fullsized":"2024-04-26T23:13:22.391297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-26T23:13:22.391117+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-26T23:13:22.391117+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.391117+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.347611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'596","reported_seq":634,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.737553+0000","last_change":"2024-04-26T23:13:27.737630+0000","last_active":"2024-04-26T23:13:27.737553+0000","last_peered":"2024-04-26T23:13:27.737553+0000","last_clean":"2024-04-26T23:13:27.737553+0000","last_became_active":"2024-04-26T23:04:39.154987+0000","last_became_peered":"2024-04-26T23:04:39.154987+0000","last_unstale":"2024-04-26T23:13:27.737553+0000","last_undegraded":"2024-04-26T23:13:27.737553+0000","last_fullsized":"2024-04-26T23:13:27.737553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'596","last_scrub_stamp":"2024-04-26T23:13:27.737349+0000","last_deep_scrub":"26'596","last_deep_scrub_stamp":"2024-04-26T23:13:27.737349+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.737349+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:19.298861+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":8514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'722","reported_seq":780,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.490455+0000","last_change":"2024-04-26T23:13:34.490534+0000","last_active":"2024-04-26T23:13:34.490455+0000","last_peered":"2024-04-26T23:13:34.490455+0000","last_clean":"2024-04-26T23:13:34.490455+0000","last_became_active":"2024-04-26T23:04:44.224743+0000","last_became_peered":"2024-04-26T23:04:44.224743+0000","last_unstale":"2024-04-26T23:13:34.490455+0000","last_undegraded":"2024-04-26T23:13:34.490455+0000","last_fullsized":"2024-04-26T23:13:34.490455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'722","last_scrub_stamp":"2024-04-26T23:13:34.490310+0000","last_deep_scrub":"26'722","last_deep_scrub_stamp":"2024-04-26T23:13:34.490310+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.490310+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:43.632214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":74108,"num_write":684,"num_write_kb":89657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'210","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.601817+0000","last_change":"2024-04-26T23:13:28.601840+0000","last_active":"2024-04-26T23:13:28.601817+0000","last_peered":"2024-04-26T23:13:28.601817+0000","last_clean":"2024-04-26T23:13:28.601817+0000","last_became_active":"2024-04-26T23:04:40.159139+0000","last_became_peered":"2024-04-26T23:04:40.159139+0000","last_unstale":"2024-04-26T23:13:28.601817+0000","last_undegraded":"2024-04-26T23:13:28.601817+0000","last_fullsized":"2024-04-26T23:13:28.601817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-26T23:13:28.601729+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-26T23:13:28.601729+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.601729+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:35.398601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'375","reported_seq":703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.168260+0000","last_change":"2024-04-26T23:13:22.168305+0000","last_active":"2024-04-26T23:13:22.168260+0000","last_peered":"2024-04-26T23:13:22.168260+0000","last_clean":"2024-04-26T23:13:22.168260+0000","last_became_active":"2024-04-26T23:04:39.126515+0000","last_became_peered":"2024-04-26T23:04:39.126515+0000","last_unstale":"2024-04-26T23:13:22.168260+0000","last_undegraded":"2024-04-26T23:13:22.168260+0000","last_fullsized":"2024-04-26T23:13:22.168260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'375","last_scrub_stamp":"2024-04-26T23:13:22.168181+0000","last_deep_scrub":"26'375","last_deep_scrub_stamp":"2024-04-26T23:13:22.168181+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.168181+0000","objects_scrubbed":3,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:29.838166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":305,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'753","reported_seq":816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.554388+0000","last_change":"2024-04-26T23:13:31.554416+0000","last_active":"2024-04-26T23:13:31.554388+0000","last_peered":"2024-04-26T23:13:31.554388+0000","last_clean":"2024-04-26T23:13:31.554388+0000","last_became_active":"2024-04-26T23:04:44.215878+0000","last_became_peered":"2024-04-26T23:04:44.215878+0000","last_unstale":"2024-04-26T23:13:31.554388+0000","last_undegraded":"2024-04-26T23:13:31.554388+0000","last_fullsized":"2024-04-26T23:13:31.554388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'753","last_scrub_stamp":"2024-04-26T23:13:31.554298+0000","last_deep_scrub":"26'753","last_deep_scrub_stamp":"2024-04-26T23:13:31.554298+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.554298+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:26.903436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":106096,"num_write":723,"num_write_kb":122284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.124573+0000","last_change":"2024-04-26T23:13:25.124596+0000","last_active":"2024-04-26T23:13:25.124573+0000","last_peered":"2024-04-26T23:13:25.124573+0000","last_clean":"2024-04-26T23:13:25.124573+0000","last_became_active":"2024-04-26T23:04:40.155630+0000","last_became_peered":"2024-04-26T23:04:40.155630+0000","last_unstale":"2024-04-26T23:13:25.124573+0000","last_undegraded":"2024-04-26T23:13:25.124573+0000","last_fullsized":"2024-04-26T23:13:25.124573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-26T23:13:25.124481+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-26T23:13:25.124481+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.124481+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:28.264839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'259","reported_seq":298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.071317+0000","last_change":"2024-04-26T23:13:27.071438+0000","last_active":"2024-04-26T23:13:27.071317+0000","last_peered":"2024-04-26T23:13:27.071317+0000","last_clean":"2024-04-26T23:13:27.071317+0000","last_became_active":"2024-04-26T23:04:39.150143+0000","last_became_peered":"2024-04-26T23:04:39.150143+0000","last_unstale":"2024-04-26T23:13:27.071317+0000","last_undegraded":"2024-04-26T23:13:27.071317+0000","last_fullsized":"2024-04-26T23:13:27.071317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'259","last_scrub_stamp":"2024-04-26T23:13:27.071106+0000","last_deep_scrub":"26'259","last_deep_scrub_stamp":"2024-04-26T23:13:27.071106+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.071106+0000","objects_scrubbed":3,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:03.692412+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'894","reported_seq":987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.220467+0000","last_change":"2024-04-26T23:13:34.220493+0000","last_active":"2024-04-26T23:13:34.220467+0000","last_peered":"2024-04-26T23:13:34.220467+0000","last_clean":"2024-04-26T23:13:34.220467+0000","last_became_active":"2024-04-26T23:04:44.384608+0000","last_became_peered":"2024-04-26T23:04:44.384608+0000","last_unstale":"2024-04-26T23:13:34.220467+0000","last_undegraded":"2024-04-26T23:13:34.220467+0000","last_fullsized":"2024-04-26T23:13:34.220467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'894","last_scrub_stamp":"2024-04-26T23:13:34.220375+0000","last_deep_scrub":"26'894","last_deep_scrub_stamp":"2024-04-26T23:13:34.220375+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.220375+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:10.755202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":175630,"num_write":854,"num_write_kb":160985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'191","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.136140+0000","last_change":"2024-04-26T23:13:21.136161+0000","last_active":"2024-04-26T23:13:21.136140+0000","last_peered":"2024-04-26T23:13:21.136140+0000","last_clean":"2024-04-26T23:13:21.136140+0000","last_became_active":"2024-04-26T23:04:40.173408+0000","last_became_peered":"2024-04-26T23:04:40.173408+0000","last_unstale":"2024-04-26T23:13:21.136140+0000","last_undegraded":"2024-04-26T23:13:21.136140+0000","last_fullsized":"2024-04-26T23:13:21.136140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:21.136070+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:21.136070+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.136070+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:15.006046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'77","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.583355+0000","last_change":"2024-04-26T23:13:24.583507+0000","last_active":"2024-04-26T23:13:24.583355+0000","last_peered":"2024-04-26T23:13:24.583355+0000","last_clean":"2024-04-26T23:13:24.583355+0000","last_became_active":"2024-04-26T23:04:39.139049+0000","last_became_peered":"2024-04-26T23:04:39.139049+0000","last_unstale":"2024-04-26T23:13:24.583355+0000","last_undegraded":"2024-04-26T23:13:24.583355+0000","last_fullsized":"2024-04-26T23:13:24.583355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-26T23:13:24.583158+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-26T23:13:24.583158+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.583158+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:22.888480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.027629+0000","last_change":"2024-04-26T23:13:25.027753+0000","last_active":"2024-04-26T23:13:25.027629+0000","last_peered":"2024-04-26T23:13:25.027629+0000","last_clean":"2024-04-26T23:13:25.027629+0000","last_became_active":"2024-04-26T23:04:35.260220+0000","last_became_peered":"2024-04-26T23:04:35.260220+0000","last_unstale":"2024-04-26T23:13:25.027629+0000","last_undegraded":"2024-04-26T23:13:25.027629+0000","last_fullsized":"2024-04-26T23:13:25.027629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-26T23:13:25.027425+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-26T23:13:25.027425+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.027425+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:08.255194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'818","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.180965+0000","last_change":"2024-04-26T23:13:36.181124+0000","last_active":"2024-04-26T23:13:36.180965+0000","last_peered":"2024-04-26T23:13:36.180965+0000","last_clean":"2024-04-26T23:13:36.180965+0000","last_became_active":"2024-04-26T23:04:44.383697+0000","last_became_peered":"2024-04-26T23:04:44.383697+0000","last_unstale":"2024-04-26T23:13:36.180965+0000","last_undegraded":"2024-04-26T23:13:36.180965+0000","last_fullsized":"2024-04-26T23:13:36.180965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'818","last_scrub_stamp":"2024-04-26T23:13:36.180729+0000","last_deep_scrub":"26'818","last_deep_scrub_stamp":"2024-04-26T23:13:36.180729+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.180729+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:01.631715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":143901,"num_write":782,"num_write_kb":168514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'210","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.075099+0000","last_change":"2024-04-26T23:13:36.075099+0000","last_active":"2024-04-26T23:13:36.075099+0000","last_peered":"2024-04-26T23:13:36.075099+0000","last_clean":"2024-04-26T23:13:36.075099+0000","last_became_active":"2024-04-26T23:04:40.180718+0000","last_became_peered":"2024-04-26T23:04:40.180718+0000","last_unstale":"2024-04-26T23:13:36.075099+0000","last_undegraded":"2024-04-26T23:13:36.075099+0000","last_fullsized":"2024-04-26T23:13:36.075099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-26T23:13:36.074855+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-26T23:13:36.074855+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.074855+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:21.430796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.120980+0000","last_change":"2024-04-26T23:13:23.120980+0000","last_active":"2024-04-26T23:13:23.120980+0000","last_peered":"2024-04-26T23:13:23.120980+0000","last_clean":"2024-04-26T23:13:23.120980+0000","last_became_active":"2024-04-26T23:04:39.156283+0000","last_became_peered":"2024-04-26T23:04:39.156283+0000","last_unstale":"2024-04-26T23:13:23.120980+0000","last_undegraded":"2024-04-26T23:13:23.120980+0000","last_fullsized":"2024-04-26T23:13:23.120980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-26T23:13:23.120895+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-26T23:13:23.120895+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.120895+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:26.631821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'848","reported_seq":925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.211284+0000","last_change":"2024-04-26T23:13:37.211349+0000","last_active":"2024-04-26T23:13:37.211284+0000","last_peered":"2024-04-26T23:13:37.211284+0000","last_clean":"2024-04-26T23:13:37.211284+0000","last_became_active":"2024-04-26T23:04:44.384319+0000","last_became_peered":"2024-04-26T23:04:44.384319+0000","last_unstale":"2024-04-26T23:13:37.211284+0000","last_undegraded":"2024-04-26T23:13:37.211284+0000","last_fullsized":"2024-04-26T23:13:37.211284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'848","last_scrub_stamp":"2024-04-26T23:13:37.211102+0000","last_deep_scrub":"26'848","last_deep_scrub_stamp":"2024-04-26T23:13:37.211102+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.211102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:43.378728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":106636,"num_write":803,"num_write_kb":172049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.703638+0000","last_change":"2024-04-26T23:13:33.703638+0000","last_active":"2024-04-26T23:13:33.703638+0000","last_peered":"2024-04-26T23:13:33.703638+0000","last_clean":"2024-04-26T23:13:33.703638+0000","last_became_active":"2024-04-26T23:04:40.175302+0000","last_became_peered":"2024-04-26T23:04:40.175302+0000","last_unstale":"2024-04-26T23:13:33.703638+0000","last_undegraded":"2024-04-26T23:13:33.703638+0000","last_fullsized":"2024-04-26T23:13:33.703638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:33.703316+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:33.703316+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.703316+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:10.846687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'565","reported_seq":604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:20.666617+0000","last_change":"2024-04-26T23:13:20.666617+0000","last_active":"2024-04-26T23:13:20.666617+0000","last_peered":"2024-04-26T23:13:20.666617+0000","last_clean":"2024-04-26T23:13:20.666617+0000","last_became_active":"2024-04-26T23:04:39.122307+0000","last_became_peered":"2024-04-26T23:04:39.122307+0000","last_unstale":"2024-04-26T23:13:20.666617+0000","last_undegraded":"2024-04-26T23:13:20.666617+0000","last_fullsized":"2024-04-26T23:13:20.666617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'565","last_scrub_stamp":"2024-04-26T23:13:20.666535+0000","last_deep_scrub":"26'565","last_deep_scrub_stamp":"2024-04-26T23:13:20.666535+0000","last_clean_scrub_stamp":"2024-04-26T23:13:20.666535+0000","objects_scrubbed":2,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:54.190018+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":4356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'838","reported_seq":921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.237775+0000","last_change":"2024-04-26T23:13:32.237775+0000","last_active":"2024-04-26T23:13:32.237775+0000","last_peered":"2024-04-26T23:13:32.237775+0000","last_clean":"2024-04-26T23:13:32.237775+0000","last_became_active":"2024-04-26T23:04:44.210728+0000","last_became_peered":"2024-04-26T23:04:44.210728+0000","last_unstale":"2024-04-26T23:13:32.237775+0000","last_undegraded":"2024-04-26T23:13:32.237775+0000","last_fullsized":"2024-04-26T23:13:32.237775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'838","last_scrub_stamp":"2024-04-26T23:13:32.237616+0000","last_deep_scrub":"26'838","last_deep_scrub_stamp":"2024-04-26T23:13:32.237616+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.237616+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:53.029753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":151848,"num_write":785,"num_write_kb":175762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'200","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:40.010482+0000","last_change":"2024-04-26T23:13:40.010482+0000","last_active":"2024-04-26T23:13:40.010482+0000","last_peered":"2024-04-26T23:13:40.010482+0000","last_clean":"2024-04-26T23:13:40.010482+0000","last_became_active":"2024-04-26T23:04:40.186643+0000","last_became_peered":"2024-04-26T23:04:40.186643+0000","last_unstale":"2024-04-26T23:13:40.010482+0000","last_undegraded":"2024-04-26T23:13:40.010482+0000","last_fullsized":"2024-04-26T23:13:40.010482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-26T23:13:40.010242+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-26T23:13:40.010242+0000","last_clean_scrub_stamp":"2024-04-26T23:13:40.010242+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:51.362405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'299","reported_seq":337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.192355+0000","last_change":"2024-04-26T23:13:21.192355+0000","last_active":"2024-04-26T23:13:21.192355+0000","last_peered":"2024-04-26T23:13:21.192355+0000","last_clean":"2024-04-26T23:13:21.192355+0000","last_became_active":"2024-04-26T23:04:39.121032+0000","last_became_peered":"2024-04-26T23:04:39.121032+0000","last_unstale":"2024-04-26T23:13:21.192355+0000","last_undegraded":"2024-04-26T23:13:21.192355+0000","last_fullsized":"2024-04-26T23:13:21.192355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'299","last_scrub_stamp":"2024-04-26T23:13:21.192264+0000","last_deep_scrub":"26'299","last_deep_scrub_stamp":"2024-04-26T23:13:21.192264+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.192264+0000","objects_scrubbed":2,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:16.581652+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'848","reported_seq":926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.761134+0000","last_change":"2024-04-26T23:13:38.761205+0000","last_active":"2024-04-26T23:13:38.761134+0000","last_peered":"2024-04-26T23:13:38.761134+0000","last_clean":"2024-04-26T23:13:38.761134+0000","last_became_active":"2024-04-26T23:04:44.384087+0000","last_became_peered":"2024-04-26T23:04:44.384087+0000","last_unstale":"2024-04-26T23:13:38.761134+0000","last_undegraded":"2024-04-26T23:13:38.761134+0000","last_fullsized":"2024-04-26T23:13:38.761134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'848","last_scrub_stamp":"2024-04-26T23:13:38.760921+0000","last_deep_scrub":"26'848","last_deep_scrub_stamp":"2024-04-26T23:13:38.760921+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.760921+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:21.931804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":147065,"num_write":804,"num_write_kb":159905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'193","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:39.041559+0000","last_change":"2024-04-26T23:13:39.041559+0000","last_active":"2024-04-26T23:13:39.041559+0000","last_peered":"2024-04-26T23:13:39.041559+0000","last_clean":"2024-04-26T23:13:39.041559+0000","last_became_active":"2024-04-26T23:04:40.186523+0000","last_became_peered":"2024-04-26T23:04:40.186523+0000","last_unstale":"2024-04-26T23:13:39.041559+0000","last_undegraded":"2024-04-26T23:13:39.041559+0000","last_fullsized":"2024-04-26T23:13:39.041559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'193","last_scrub_stamp":"2024-04-26T23:13:39.041304+0000","last_deep_scrub":"26'193","last_deep_scrub_stamp":"2024-04-26T23:13:39.041304+0000","last_clean_scrub_stamp":"2024-04-26T23:13:39.041304+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:55.890340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'171","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.429116+0000","last_change":"2024-04-26T23:13:21.429116+0000","last_active":"2024-04-26T23:13:21.429116+0000","last_peered":"2024-04-26T23:13:21.429116+0000","last_clean":"2024-04-26T23:13:21.429116+0000","last_became_active":"2024-04-26T23:04:39.132038+0000","last_became_peered":"2024-04-26T23:04:39.132038+0000","last_unstale":"2024-04-26T23:13:21.429116+0000","last_undegraded":"2024-04-26T23:13:21.429116+0000","last_fullsized":"2024-04-26T23:13:21.429116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'171","last_scrub_stamp":"2024-04-26T23:13:21.428846+0000","last_deep_scrub":"26'171","last_deep_scrub_stamp":"2024-04-26T23:13:21.428846+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.428846+0000","objects_scrubbed":3,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:56.941608+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'827","reported_seq":881,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.415011+0000","last_change":"2024-04-26T23:13:33.415087+0000","last_active":"2024-04-26T23:13:33.415011+0000","last_peered":"2024-04-26T23:13:33.415011+0000","last_clean":"2024-04-26T23:13:33.415011+0000","last_became_active":"2024-04-26T23:04:44.228678+0000","last_became_peered":"2024-04-26T23:04:44.228678+0000","last_unstale":"2024-04-26T23:13:33.415011+0000","last_undegraded":"2024-04-26T23:13:33.415011+0000","last_fullsized":"2024-04-26T23:13:33.415011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'827","last_scrub_stamp":"2024-04-26T23:13:33.414822+0000","last_deep_scrub":"26'827","last_deep_scrub_stamp":"2024-04-26T23:13:33.414822+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.414822+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:14.843270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":92286,"num_write":783,"num_write_kb":118015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.059939+0000","last_change":"2024-04-26T23:13:38.060003+0000","last_active":"2024-04-26T23:13:38.059939+0000","last_peered":"2024-04-26T23:13:38.059939+0000","last_clean":"2024-04-26T23:13:38.059939+0000","last_became_active":"2024-04-26T23:04:40.186571+0000","last_became_peered":"2024-04-26T23:04:40.186571+0000","last_unstale":"2024-04-26T23:13:38.059939+0000","last_undegraded":"2024-04-26T23:13:38.059939+0000","last_fullsized":"2024-04-26T23:13:38.059939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-26T23:13:38.059768+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-26T23:13:38.059768+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.059768+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:10.012742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'375","reported_seq":413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:20.212805+0000","last_change":"2024-04-26T23:13:20.212805+0000","last_active":"2024-04-26T23:13:20.212805+0000","last_peered":"2024-04-26T23:13:20.212805+0000","last_clean":"2024-04-26T23:13:20.212805+0000","last_became_active":"2024-04-26T23:04:39.121106+0000","last_became_peered":"2024-04-26T23:04:39.121106+0000","last_unstale":"2024-04-26T23:13:20.212805+0000","last_undegraded":"2024-04-26T23:13:20.212805+0000","last_fullsized":"2024-04-26T23:13:20.212805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'375","last_scrub_stamp":"2024-04-26T23:13:20.212604+0000","last_deep_scrub":"26'375","last_deep_scrub_stamp":"2024-04-26T23:13:20.212604+0000","last_clean_scrub_stamp":"2024-04-26T23:13:20.212604+0000","objects_scrubbed":10,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:45.730268+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'800","reported_seq":860,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.213367+0000","last_change":"2024-04-26T23:13:33.213392+0000","last_active":"2024-04-26T23:13:33.213367+0000","last_peered":"2024-04-26T23:13:33.213367+0000","last_clean":"2024-04-26T23:13:33.213367+0000","last_became_active":"2024-04-26T23:04:44.224927+0000","last_became_peered":"2024-04-26T23:04:44.224927+0000","last_unstale":"2024-04-26T23:13:33.213367+0000","last_undegraded":"2024-04-26T23:13:33.213367+0000","last_fullsized":"2024-04-26T23:13:33.213367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:33.213280+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:33.213280+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.213280+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:49.674386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":109199,"num_write":760,"num_write_kb":155279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.184649+0000","last_change":"2024-04-26T23:13:29.184711+0000","last_active":"2024-04-26T23:13:29.184649+0000","last_peered":"2024-04-26T23:13:29.184649+0000","last_clean":"2024-04-26T23:13:29.184649+0000","last_became_active":"2024-04-26T23:04:40.163468+0000","last_became_peered":"2024-04-26T23:04:40.163468+0000","last_unstale":"2024-04-26T23:13:29.184649+0000","last_undegraded":"2024-04-26T23:13:29.184649+0000","last_fullsized":"2024-04-26T23:13:29.184649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-26T23:13:29.184473+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-26T23:13:29.184473+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.184473+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:10.780077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'69","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.165696+0000","last_change":"2024-04-26T23:13:27.165696+0000","last_active":"2024-04-26T23:13:27.165696+0000","last_peered":"2024-04-26T23:13:27.165696+0000","last_clean":"2024-04-26T23:13:27.165696+0000","last_became_active":"2024-04-26T23:04:39.144793+0000","last_became_peered":"2024-04-26T23:04:39.144793+0000","last_unstale":"2024-04-26T23:13:27.165696+0000","last_undegraded":"2024-04-26T23:13:27.165696+0000","last_fullsized":"2024-04-26T23:13:27.165696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-26T23:13:27.165440+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-26T23:13:27.165440+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.165440+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:45:46.280423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'783","reported_seq":865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:36.030078+0000","last_change":"2024-04-26T23:13:36.030104+0000","last_active":"2024-04-26T23:13:36.030078+0000","last_peered":"2024-04-26T23:13:36.030078+0000","last_clean":"2024-04-26T23:13:36.030078+0000","last_became_active":"2024-04-26T23:04:44.383197+0000","last_became_peered":"2024-04-26T23:04:44.383197+0000","last_unstale":"2024-04-26T23:13:36.030078+0000","last_undegraded":"2024-04-26T23:13:36.030078+0000","last_fullsized":"2024-04-26T23:13:36.030078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'783","last_scrub_stamp":"2024-04-26T23:13:36.029977+0000","last_deep_scrub":"26'783","last_deep_scrub_stamp":"2024-04-26T23:13:36.029977+0000","last_clean_scrub_stamp":"2024-04-26T23:13:36.029977+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:37.363147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":142462,"num_write":751,"num_write_kb":148767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'199","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:37.045586+0000","last_change":"2024-04-26T23:13:37.045727+0000","last_active":"2024-04-26T23:13:37.045586+0000","last_peered":"2024-04-26T23:13:37.045586+0000","last_clean":"2024-04-26T23:13:37.045586+0000","last_became_active":"2024-04-26T23:04:40.186468+0000","last_became_peered":"2024-04-26T23:04:40.186468+0000","last_unstale":"2024-04-26T23:13:37.045586+0000","last_undegraded":"2024-04-26T23:13:37.045586+0000","last_fullsized":"2024-04-26T23:13:37.045586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-26T23:13:37.045372+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-26T23:13:37.045372+0000","last_clean_scrub_stamp":"2024-04-26T23:13:37.045372+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:10.548084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'64","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.685483+0000","last_change":"2024-04-26T23:13:28.685483+0000","last_active":"2024-04-26T23:13:28.685483+0000","last_peered":"2024-04-26T23:13:28.685483+0000","last_clean":"2024-04-26T23:13:28.685483+0000","last_became_active":"2024-04-26T23:04:39.155183+0000","last_became_peered":"2024-04-26T23:04:39.155183+0000","last_unstale":"2024-04-26T23:13:28.685483+0000","last_undegraded":"2024-04-26T23:13:28.685483+0000","last_fullsized":"2024-04-26T23:13:28.685483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'64","last_scrub_stamp":"2024-04-26T23:13:28.685214+0000","last_deep_scrub":"26'64","last_deep_scrub_stamp":"2024-04-26T23:13:28.685214+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.685214+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.665412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'744","reported_seq":814,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.983845+0000","last_change":"2024-04-26T23:13:33.983871+0000","last_active":"2024-04-26T23:13:33.983845+0000","last_peered":"2024-04-26T23:13:33.983845+0000","last_clean":"2024-04-26T23:13:33.983845+0000","last_became_active":"2024-04-26T23:04:44.378387+0000","last_became_peered":"2024-04-26T23:04:44.378387+0000","last_unstale":"2024-04-26T23:13:33.983845+0000","last_undegraded":"2024-04-26T23:13:33.983845+0000","last_fullsized":"2024-04-26T23:13:33.983845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'744","last_scrub_stamp":"2024-04-26T23:13:33.983760+0000","last_deep_scrub":"26'744","last_deep_scrub_stamp":"2024-04-26T23:13:33.983760+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.983760+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:41.001759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":105106,"num_write":712,"num_write_kb":127091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'207","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.219325+0000","last_change":"2024-04-26T23:13:30.219348+0000","last_active":"2024-04-26T23:13:30.219325+0000","last_peered":"2024-04-26T23:13:30.219325+0000","last_clean":"2024-04-26T23:13:30.219325+0000","last_became_active":"2024-04-26T23:04:40.172433+0000","last_became_peered":"2024-04-26T23:04:40.172433+0000","last_unstale":"2024-04-26T23:13:30.219325+0000","last_undegraded":"2024-04-26T23:13:30.219325+0000","last_fullsized":"2024-04-26T23:13:30.219325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:30.219248+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:30.219248+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.219248+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:41.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'662","reported_seq":701,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:21.051269+0000","last_change":"2024-04-26T23:13:21.051269+0000","last_active":"2024-04-26T23:13:21.051269+0000","last_peered":"2024-04-26T23:13:21.051269+0000","last_clean":"2024-04-26T23:13:21.051269+0000","last_became_active":"2024-04-26T23:04:39.142774+0000","last_became_peered":"2024-04-26T23:04:39.142774+0000","last_unstale":"2024-04-26T23:13:21.051269+0000","last_undegraded":"2024-04-26T23:13:21.051269+0000","last_fullsized":"2024-04-26T23:13:21.051269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'662","last_scrub_stamp":"2024-04-26T23:13:21.051167+0000","last_deep_scrub":"26'662","last_deep_scrub_stamp":"2024-04-26T23:13:21.051167+0000","last_clean_scrub_stamp":"2024-04-26T23:13:21.051167+0000","objects_scrubbed":6,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:09:14.958054+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":8485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":814,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:39.749934+0000","last_change":"2024-04-26T23:13:39.749998+0000","last_active":"2024-04-26T23:13:39.749934+0000","last_peered":"2024-04-26T23:13:39.749934+0000","last_clean":"2024-04-26T23:13:39.749934+0000","last_became_active":"2024-04-26T23:04:44.384652+0000","last_became_peered":"2024-04-26T23:04:44.384652+0000","last_unstale":"2024-04-26T23:13:39.749934+0000","last_undegraded":"2024-04-26T23:13:39.749934+0000","last_fullsized":"2024-04-26T23:13:39.749934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'753","last_scrub_stamp":"2024-04-26T23:13:39.749744+0000","last_deep_scrub":"26'753","last_deep_scrub_stamp":"2024-04-26T23:13:39.749744+0000","last_clean_scrub_stamp":"2024-04-26T23:13:39.749744+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:19.698074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":107838,"num_write":718,"num_write_kb":117693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'208","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.038189+0000","last_change":"2024-04-26T23:13:24.038251+0000","last_active":"2024-04-26T23:13:24.038189+0000","last_peered":"2024-04-26T23:13:24.038189+0000","last_clean":"2024-04-26T23:13:24.038189+0000","last_became_active":"2024-04-26T23:04:40.171988+0000","last_became_peered":"2024-04-26T23:04:40.171988+0000","last_unstale":"2024-04-26T23:13:24.038189+0000","last_undegraded":"2024-04-26T23:13:24.038189+0000","last_fullsized":"2024-04-26T23:13:24.038189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:24.038009+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:24.038009+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.038009+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:32.283625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'362","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.286395+0000","last_change":"2024-04-26T23:13:23.286395+0000","last_active":"2024-04-26T23:13:23.286395+0000","last_peered":"2024-04-26T23:13:23.286395+0000","last_clean":"2024-04-26T23:13:23.286395+0000","last_became_active":"2024-04-26T23:04:39.127322+0000","last_became_peered":"2024-04-26T23:04:39.127322+0000","last_unstale":"2024-04-26T23:13:23.286395+0000","last_undegraded":"2024-04-26T23:13:23.286395+0000","last_fullsized":"2024-04-26T23:13:23.286395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'362","last_scrub_stamp":"2024-04-26T23:13:23.286152+0000","last_deep_scrub":"26'362","last_deep_scrub_stamp":"2024-04-26T23:13:23.286152+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.286152+0000","objects_scrubbed":7,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:11.397245+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":12462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'800","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.507212+0000","last_change":"2024-04-26T23:13:33.507258+0000","last_active":"2024-04-26T23:13:33.507212+0000","last_peered":"2024-04-26T23:13:33.507212+0000","last_clean":"2024-04-26T23:13:33.507212+0000","last_became_active":"2024-04-26T23:04:44.220307+0000","last_became_peered":"2024-04-26T23:04:44.220307+0000","last_unstale":"2024-04-26T23:13:33.507212+0000","last_undegraded":"2024-04-26T23:13:33.507212+0000","last_fullsized":"2024-04-26T23:13:33.507212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-26T23:13:33.507119+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-26T23:13:33.507119+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.507119+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:56.481557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43845,"num_write":760,"num_write_kb":90657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'202","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.443236+0000","last_change":"2024-04-26T23:13:25.443300+0000","last_active":"2024-04-26T23:13:25.443236+0000","last_peered":"2024-04-26T23:13:25.443236+0000","last_clean":"2024-04-26T23:13:25.443236+0000","last_became_active":"2024-04-26T23:04:40.179055+0000","last_became_peered":"2024-04-26T23:04:40.179055+0000","last_unstale":"2024-04-26T23:13:25.443236+0000","last_undegraded":"2024-04-26T23:13:25.443236+0000","last_fullsized":"2024-04-26T23:13:25.443236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:25.443053+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:25.443053+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.443053+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:12.697066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'337","reported_seq":375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.531687+0000","last_change":"2024-04-26T23:13:25.531719+0000","last_active":"2024-04-26T23:13:25.531687+0000","last_peered":"2024-04-26T23:13:25.531687+0000","last_clean":"2024-04-26T23:13:25.531687+0000","last_became_active":"2024-04-26T23:04:39.155347+0000","last_became_peered":"2024-04-26T23:04:39.155347+0000","last_unstale":"2024-04-26T23:13:25.531687+0000","last_undegraded":"2024-04-26T23:13:25.531687+0000","last_fullsized":"2024-04-26T23:13:25.531687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'337","last_scrub_stamp":"2024-04-26T23:13:25.531609+0000","last_deep_scrub":"26'337","last_deep_scrub_stamp":"2024-04-26T23:13:25.531609+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.531609+0000","objects_scrubbed":4,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:24.086780+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'747","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.467942+0000","last_change":"2024-04-26T23:13:30.468012+0000","last_active":"2024-04-26T23:13:30.467942+0000","last_peered":"2024-04-26T23:13:30.467942+0000","last_clean":"2024-04-26T23:13:30.467942+0000","last_became_active":"2024-04-26T23:04:44.222173+0000","last_became_peered":"2024-04-26T23:04:44.222173+0000","last_unstale":"2024-04-26T23:13:30.467942+0000","last_undegraded":"2024-04-26T23:13:30.467942+0000","last_fullsized":"2024-04-26T23:13:30.467942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:30.467754+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:30.467754+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.467754+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:14.148397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":48437,"num_write":702,"num_write_kb":90128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'191","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:19.985139+0000","last_change":"2024-04-26T23:13:19.985175+0000","last_active":"2024-04-26T23:13:19.985139+0000","last_peered":"2024-04-26T23:13:19.985139+0000","last_clean":"2024-04-26T23:13:19.985139+0000","last_became_active":"2024-04-26T23:04:40.168969+0000","last_became_peered":"2024-04-26T23:04:40.168969+0000","last_unstale":"2024-04-26T23:13:19.985139+0000","last_undegraded":"2024-04-26T23:13:19.985139+0000","last_fullsized":"2024-04-26T23:13:19.985139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:19.985048+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:19.985048+0000","last_clean_scrub_stamp":"2024-04-26T23:13:19.985048+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:23.782554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'108","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.662880+0000","last_change":"2024-04-26T23:13:26.662956+0000","last_active":"2024-04-26T23:13:26.662880+0000","last_peered":"2024-04-26T23:13:26.662880+0000","last_clean":"2024-04-26T23:13:26.662880+0000","last_became_active":"2024-04-26T23:04:39.152932+0000","last_became_peered":"2024-04-26T23:04:39.152932+0000","last_unstale":"2024-04-26T23:13:26.662880+0000","last_undegraded":"2024-04-26T23:13:26.662880+0000","last_fullsized":"2024-04-26T23:13:26.662880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'108","last_scrub_stamp":"2024-04-26T23:13:26.662705+0000","last_deep_scrub":"26'108","last_deep_scrub_stamp":"2024-04-26T23:13:26.662705+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.662705+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:15.904295+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'857","reported_seq":927,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.992257+0000","last_change":"2024-04-26T23:13:32.992286+0000","last_active":"2024-04-26T23:13:32.992257+0000","last_peered":"2024-04-26T23:13:32.992257+0000","last_clean":"2024-04-26T23:13:32.992257+0000","last_became_active":"2024-04-26T23:04:44.214876+0000","last_became_peered":"2024-04-26T23:04:44.214876+0000","last_unstale":"2024-04-26T23:13:32.992257+0000","last_undegraded":"2024-04-26T23:13:32.992257+0000","last_fullsized":"2024-04-26T23:13:32.992257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'857","last_scrub_stamp":"2024-04-26T23:13:32.992173+0000","last_deep_scrub":"26'857","last_deep_scrub_stamp":"2024-04-26T23:13:32.992173+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.992173+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:57.878875+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":138352,"num_write":818,"num_write_kb":142731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'216","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.730751+0000","last_change":"2024-04-26T23:13:34.730815+0000","last_active":"2024-04-26T23:13:34.730751+0000","last_peered":"2024-04-26T23:13:34.730751+0000","last_clean":"2024-04-26T23:13:34.730751+0000","last_became_active":"2024-04-26T23:04:40.180817+0000","last_became_peered":"2024-04-26T23:04:40.180817+0000","last_unstale":"2024-04-26T23:13:34.730751+0000","last_undegraded":"2024-04-26T23:13:34.730751+0000","last_fullsized":"2024-04-26T23:13:34.730751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-26T23:13:34.730545+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-26T23:13:34.730545+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.730545+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.890200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'79","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.176862+0000","last_change":"2024-04-26T23:13:25.176933+0000","last_active":"2024-04-26T23:13:25.176862+0000","last_peered":"2024-04-26T23:13:25.176862+0000","last_clean":"2024-04-26T23:13:25.176862+0000","last_became_active":"2024-04-26T23:04:39.141335+0000","last_became_peered":"2024-04-26T23:04:39.141335+0000","last_unstale":"2024-04-26T23:13:25.176862+0000","last_undegraded":"2024-04-26T23:13:25.176862+0000","last_fullsized":"2024-04-26T23:13:25.176862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-26T23:13:25.176691+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-26T23:13:25.176691+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.176691+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:03.294325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'874","reported_seq":958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.006451+0000","last_change":"2024-04-26T23:13:35.006479+0000","last_active":"2024-04-26T23:13:35.006451+0000","last_peered":"2024-04-26T23:13:35.006451+0000","last_clean":"2024-04-26T23:13:35.006451+0000","last_became_active":"2024-04-26T23:04:44.379861+0000","last_became_peered":"2024-04-26T23:04:44.379861+0000","last_unstale":"2024-04-26T23:13:35.006451+0000","last_undegraded":"2024-04-26T23:13:35.006451+0000","last_fullsized":"2024-04-26T23:13:35.006451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'874","last_scrub_stamp":"2024-04-26T23:13:35.006346+0000","last_deep_scrub":"26'874","last_deep_scrub_stamp":"2024-04-26T23:13:35.006346+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.006346+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.164098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":156471,"num_write":845,"num_write_kb":160963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'794","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.231102+0000","last_change":"2024-04-26T23:13:35.231128+0000","last_active":"2024-04-26T23:13:35.231102+0000","last_peered":"2024-04-26T23:13:35.231102+0000","last_clean":"2024-04-26T23:13:35.231102+0000","last_became_active":"2024-04-26T23:05:29.212055+0000","last_became_peered":"2024-04-26T23:05:29.212055+0000","last_unstale":"2024-04-26T23:13:35.231102+0000","last_undegraded":"2024-04-26T23:13:35.231102+0000","last_fullsized":"2024-04-26T23:13:35.231102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'794","last_scrub_stamp":"2024-04-26T23:13:35.231021+0000","last_deep_scrub":"26'794","last_deep_scrub_stamp":"2024-04-26T23:13:35.231021+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.231021+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:35.859345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":61167,"num_write":750,"num_write_kb":94280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.530539+0000","last_change":"2024-04-26T23:13:26.530563+0000","last_active":"2024-04-26T23:13:26.530539+0000","last_peered":"2024-04-26T23:13:26.530539+0000","last_clean":"2024-04-26T23:13:26.530539+0000","last_became_active":"2024-04-26T23:04:40.156592+0000","last_became_peered":"2024-04-26T23:04:40.156592+0000","last_unstale":"2024-04-26T23:13:26.530539+0000","last_undegraded":"2024-04-26T23:13:26.530539+0000","last_fullsized":"2024-04-26T23:13:26.530539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-26T23:13:26.530452+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-26T23:13:26.530452+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.530452+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:03.690778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'836","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.667300+0000","last_change":"2024-04-26T23:13:25.667459+0000","last_active":"2024-04-26T23:13:25.667300+0000","last_peered":"2024-04-26T23:13:25.667300+0000","last_clean":"2024-04-26T23:13:25.667300+0000","last_became_active":"2024-04-26T23:04:39.142547+0000","last_became_peered":"2024-04-26T23:04:39.142547+0000","last_unstale":"2024-04-26T23:13:25.667300+0000","last_undegraded":"2024-04-26T23:13:25.667300+0000","last_fullsized":"2024-04-26T23:13:25.667300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'836","last_scrub_stamp":"2024-04-26T23:13:25.667078+0000","last_deep_scrub":"26'836","last_deep_scrub_stamp":"2024-04-26T23:13:25.667078+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.667078+0000","objects_scrubbed":2,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:58:44.797568+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.175010+0000","last_change":"2024-04-26T23:13:35.175073+0000","last_active":"2024-04-26T23:13:35.175010+0000","last_peered":"2024-04-26T23:13:35.175010+0000","last_clean":"2024-04-26T23:13:35.175010+0000","last_became_active":"2024-04-26T23:04:44.221089+0000","last_became_peered":"2024-04-26T23:04:44.221089+0000","last_unstale":"2024-04-26T23:13:35.175010+0000","last_undegraded":"2024-04-26T23:13:35.175010+0000","last_fullsized":"2024-04-26T23:13:35.175010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-26T23:13:35.174831+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-26T23:13:35.174831+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.174831+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:22.190894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":92285,"num_write":709,"num_write_kb":98277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'218","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.118664+0000","last_change":"2024-04-26T23:13:27.118690+0000","last_active":"2024-04-26T23:13:27.118664+0000","last_peered":"2024-04-26T23:13:27.118664+0000","last_clean":"2024-04-26T23:13:27.118664+0000","last_became_active":"2024-04-26T23:04:40.152055+0000","last_became_peered":"2024-04-26T23:04:40.152055+0000","last_unstale":"2024-04-26T23:13:27.118664+0000","last_undegraded":"2024-04-26T23:13:27.118664+0000","last_fullsized":"2024-04-26T23:13:27.118664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-26T23:13:27.118592+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-26T23:13:27.118592+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.118592+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:22.946256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'80","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.122729+0000","last_change":"2024-04-26T23:13:24.122762+0000","last_active":"2024-04-26T23:13:24.122729+0000","last_peered":"2024-04-26T23:13:24.122729+0000","last_clean":"2024-04-26T23:13:24.122729+0000","last_became_active":"2024-04-26T23:04:39.131858+0000","last_became_peered":"2024-04-26T23:04:39.131858+0000","last_unstale":"2024-04-26T23:13:24.122729+0000","last_undegraded":"2024-04-26T23:13:24.122729+0000","last_fullsized":"2024-04-26T23:13:24.122729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'80","last_scrub_stamp":"2024-04-26T23:13:24.122652+0000","last_deep_scrub":"26'80","last_deep_scrub_stamp":"2024-04-26T23:13:24.122652+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.122652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:44.476739+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'377","reported_seq":415,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.204945+0000","last_change":"2024-04-26T23:13:26.205094+0000","last_active":"2024-04-26T23:13:26.204945+0000","last_peered":"2024-04-26T23:13:26.204945+0000","last_clean":"2024-04-26T23:13:26.204945+0000","last_became_active":"2024-04-26T23:04:39.144344+0000","last_became_peered":"2024-04-26T23:04:39.144344+0000","last_unstale":"2024-04-26T23:13:26.204945+0000","last_undegraded":"2024-04-26T23:13:26.204945+0000","last_fullsized":"2024-04-26T23:13:26.204945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'377","last_scrub_stamp":"2024-04-26T23:13:26.204663+0000","last_deep_scrub":"26'377","last_deep_scrub_stamp":"2024-04-26T23:13:26.204663+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.204663+0000","objects_scrubbed":4,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:40.947545+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'184","reported_seq":220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.152820+0000","last_change":"2024-04-26T23:13:28.152847+0000","last_active":"2024-04-26T23:13:28.152820+0000","last_peered":"2024-04-26T23:13:28.152820+0000","last_clean":"2024-04-26T23:13:28.152820+0000","last_became_active":"2024-04-26T23:04:40.165737+0000","last_became_peered":"2024-04-26T23:04:40.165737+0000","last_unstale":"2024-04-26T23:13:28.152820+0000","last_undegraded":"2024-04-26T23:13:28.152820+0000","last_fullsized":"2024-04-26T23:13:28.152820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'184","last_scrub_stamp":"2024-04-26T23:13:28.152728+0000","last_deep_scrub":"26'184","last_deep_scrub_stamp":"2024-04-26T23:13:28.152728+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.152728+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:07.167773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'756","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.181981+0000","last_change":"2024-04-26T23:13:26.182008+0000","last_active":"2024-04-26T23:13:26.181981+0000","last_peered":"2024-04-26T23:13:26.181981+0000","last_clean":"2024-04-26T23:13:26.181981+0000","last_became_active":"2024-04-26T23:04:44.209607+0000","last_became_peered":"2024-04-26T23:04:44.209607+0000","last_unstale":"2024-04-26T23:13:26.181981+0000","last_undegraded":"2024-04-26T23:13:26.181981+0000","last_fullsized":"2024-04-26T23:13:26.181981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'756","last_scrub_stamp":"2024-04-26T23:13:26.181879+0000","last_deep_scrub":"26'756","last_deep_scrub_stamp":"2024-04-26T23:13:26.181879+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.181879+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:25:22.287815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":115113,"num_write":716,"num_write_kb":143357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'76","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.094870+0000","last_change":"2024-04-26T23:13:26.094900+0000","last_active":"2024-04-26T23:13:26.094870+0000","last_peered":"2024-04-26T23:13:26.094870+0000","last_clean":"2024-04-26T23:13:26.094870+0000","last_became_active":"2024-04-26T23:04:39.132724+0000","last_became_peered":"2024-04-26T23:04:39.132724+0000","last_unstale":"2024-04-26T23:13:26.094870+0000","last_undegraded":"2024-04-26T23:13:26.094870+0000","last_fullsized":"2024-04-26T23:13:26.094870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'76","last_scrub_stamp":"2024-04-26T23:13:26.094749+0000","last_deep_scrub":"26'76","last_deep_scrub_stamp":"2024-04-26T23:13:26.094749+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.094749+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:24.662531+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194926,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'202","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.421571+0000","last_change":"2024-04-26T23:13:23.421632+0000","last_active":"2024-04-26T23:13:23.421571+0000","last_peered":"2024-04-26T23:13:23.421571+0000","last_clean":"2024-04-26T23:13:23.421571+0000","last_became_active":"2024-04-26T23:04:40.165873+0000","last_became_peered":"2024-04-26T23:04:40.165873+0000","last_unstale":"2024-04-26T23:13:23.421571+0000","last_undegraded":"2024-04-26T23:13:23.421571+0000","last_fullsized":"2024-04-26T23:13:23.421571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:23.421393+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:23.421393+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.421393+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:11.578933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'777","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.028462+0000","last_change":"2024-04-26T23:13:32.028486+0000","last_active":"2024-04-26T23:13:32.028462+0000","last_peered":"2024-04-26T23:13:32.028462+0000","last_clean":"2024-04-26T23:13:32.028462+0000","last_became_active":"2024-04-26T23:04:44.208351+0000","last_became_peered":"2024-04-26T23:04:44.208351+0000","last_unstale":"2024-04-26T23:13:32.028462+0000","last_undegraded":"2024-04-26T23:13:32.028462+0000","last_fullsized":"2024-04-26T23:13:32.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-26T23:13:32.028378+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-26T23:13:32.028378+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.028378+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:32.055310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":126565,"num_write":738,"num_write_kb":165972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.199416+0000","last_change":"2024-04-26T23:13:30.199537+0000","last_active":"2024-04-26T23:13:30.199416+0000","last_peered":"2024-04-26T23:13:30.199416+0000","last_clean":"2024-04-26T23:13:30.199416+0000","last_became_active":"2024-04-26T23:04:40.162675+0000","last_became_peered":"2024-04-26T23:04:40.162675+0000","last_unstale":"2024-04-26T23:13:30.199416+0000","last_undegraded":"2024-04-26T23:13:30.199416+0000","last_fullsized":"2024-04-26T23:13:30.199416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-26T23:13:30.199200+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-26T23:13:30.199200+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.199200+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:56.993008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'214","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:25.128561+0000","last_change":"2024-04-26T23:13:25.128584+0000","last_active":"2024-04-26T23:13:25.128561+0000","last_peered":"2024-04-26T23:13:25.128561+0000","last_clean":"2024-04-26T23:13:25.128561+0000","last_became_active":"2024-04-26T23:04:40.170562+0000","last_became_peered":"2024-04-26T23:04:40.170562+0000","last_unstale":"2024-04-26T23:13:25.128561+0000","last_undegraded":"2024-04-26T23:13:25.128561+0000","last_fullsized":"2024-04-26T23:13:25.128561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-26T23:13:25.128457+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-26T23:13:25.128457+0000","last_clean_scrub_stamp":"2024-04-26T23:13:25.128457+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:58.277495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'232","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.623107+0000","last_change":"2024-04-26T23:13:23.623166+0000","last_active":"2024-04-26T23:13:23.623107+0000","last_peered":"2024-04-26T23:13:23.623107+0000","last_clean":"2024-04-26T23:13:23.623107+0000","last_became_active":"2024-04-26T23:04:40.173032+0000","last_became_peered":"2024-04-26T23:04:40.173032+0000","last_unstale":"2024-04-26T23:13:23.623107+0000","last_undegraded":"2024-04-26T23:13:23.623107+0000","last_fullsized":"2024-04-26T23:13:23.623107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'232","last_scrub_stamp":"2024-04-26T23:13:23.622930+0000","last_deep_scrub":"26'232","last_deep_scrub_stamp":"2024-04-26T23:13:23.622930+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.622930+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:21.091070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.056767+0000","last_change":"2024-04-26T23:13:23.056787+0000","last_active":"2024-04-26T23:13:23.056767+0000","last_peered":"2024-04-26T23:13:23.056767+0000","last_clean":"2024-04-26T23:13:23.056767+0000","last_became_active":"2024-04-26T23:04:40.149525+0000","last_became_peered":"2024-04-26T23:04:40.149525+0000","last_unstale":"2024-04-26T23:13:23.056767+0000","last_undegraded":"2024-04-26T23:13:23.056767+0000","last_fullsized":"2024-04-26T23:13:23.056767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:23.056699+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:23.056699+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.056699+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:56.178517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'192","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.208169+0000","last_change":"2024-04-26T23:13:29.208192+0000","last_active":"2024-04-26T23:13:29.208169+0000","last_peered":"2024-04-26T23:13:29.208169+0000","last_clean":"2024-04-26T23:13:29.208169+0000","last_became_active":"2024-04-26T23:05:29.866453+0000","last_became_peered":"2024-04-26T23:05:29.866453+0000","last_unstale":"2024-04-26T23:13:29.208169+0000","last_undegraded":"2024-04-26T23:13:29.208169+0000","last_fullsized":"2024-04-26T23:13:29.208169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-26T23:13:29.208088+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-26T23:13:29.208088+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.208088+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.757884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"26'201","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.558676+0000","last_change":"2024-04-26T23:13:27.558703+0000","last_active":"2024-04-26T23:13:27.558676+0000","last_peered":"2024-04-26T23:13:27.558676+0000","last_clean":"2024-04-26T23:13:27.558676+0000","last_became_active":"2024-04-26T23:04:40.157194+0000","last_became_peered":"2024-04-26T23:04:40.157194+0000","last_unstale":"2024-04-26T23:13:27.558676+0000","last_undegraded":"2024-04-26T23:13:27.558676+0000","last_fullsized":"2024-04-26T23:13:27.558676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-26T23:13:27.558597+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-26T23:13:27.558597+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.558597+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:58.913554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'240","reported_seq":277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.148625+0000","last_change":"2024-04-26T23:13:32.148684+0000","last_active":"2024-04-26T23:13:32.148625+0000","last_peered":"2024-04-26T23:13:32.148625+0000","last_clean":"2024-04-26T23:13:32.148625+0000","last_became_active":"2024-04-26T23:04:40.171938+0000","last_became_peered":"2024-04-26T23:04:40.171938+0000","last_unstale":"2024-04-26T23:13:32.148625+0000","last_undegraded":"2024-04-26T23:13:32.148625+0000","last_fullsized":"2024-04-26T23:13:32.148625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-26T23:13:32.148453+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-26T23:13:32.148453+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.148453+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:09.931693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'193","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.056219+0000","last_change":"2024-04-26T23:13:30.056246+0000","last_active":"2024-04-26T23:13:30.056219+0000","last_peered":"2024-04-26T23:13:30.056219+0000","last_clean":"2024-04-26T23:13:30.056219+0000","last_became_active":"2024-04-26T23:04:40.158704+0000","last_became_peered":"2024-04-26T23:04:40.158704+0000","last_unstale":"2024-04-26T23:13:30.056219+0000","last_undegraded":"2024-04-26T23:13:30.056219+0000","last_fullsized":"2024-04-26T23:13:30.056219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'193","last_scrub_stamp":"2024-04-26T23:13:30.056138+0000","last_deep_scrub":"26'193","last_deep_scrub_stamp":"2024-04-26T23:13:30.056138+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.056138+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:43.540670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'219","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.708375+0000","last_change":"2024-04-26T23:13:29.708433+0000","last_active":"2024-04-26T23:13:29.708375+0000","last_peered":"2024-04-26T23:13:29.708375+0000","last_clean":"2024-04-26T23:13:29.708375+0000","last_became_active":"2024-04-26T23:04:40.167856+0000","last_became_peered":"2024-04-26T23:04:40.167856+0000","last_unstale":"2024-04-26T23:13:29.708375+0000","last_undegraded":"2024-04-26T23:13:29.708375+0000","last_fullsized":"2024-04-26T23:13:29.708375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-26T23:13:29.708196+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-26T23:13:29.708196+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.708196+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:27.075013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'202","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.087247+0000","last_change":"2024-04-26T23:13:22.087247+0000","last_active":"2024-04-26T23:13:22.087247+0000","last_peered":"2024-04-26T23:13:22.087247+0000","last_clean":"2024-04-26T23:13:22.087247+0000","last_became_active":"2024-04-26T23:04:40.180271+0000","last_became_peered":"2024-04-26T23:04:40.180271+0000","last_unstale":"2024-04-26T23:13:22.087247+0000","last_undegraded":"2024-04-26T23:13:22.087247+0000","last_fullsized":"2024-04-26T23:13:22.087247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-26T23:13:22.087157+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-26T23:13:22.087157+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.087157+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:31.522223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'213","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:22.593762+0000","last_change":"2024-04-26T23:13:22.593762+0000","last_active":"2024-04-26T23:13:22.593762+0000","last_peered":"2024-04-26T23:13:22.593762+0000","last_clean":"2024-04-26T23:13:22.593762+0000","last_became_active":"2024-04-26T23:04:40.173936+0000","last_became_peered":"2024-04-26T23:04:40.173936+0000","last_unstale":"2024-04-26T23:13:22.593762+0000","last_undegraded":"2024-04-26T23:13:22.593762+0000","last_fullsized":"2024-04-26T23:13:22.593762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:22.593525+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:22.593525+0000","last_clean_scrub_stamp":"2024-04-26T23:13:22.593525+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:57.702621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'203","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.259141+0000","last_change":"2024-04-26T23:13:31.259141+0000","last_active":"2024-04-26T23:13:31.259141+0000","last_peered":"2024-04-26T23:13:31.259141+0000","last_clean":"2024-04-26T23:13:31.259141+0000","last_became_active":"2024-04-26T23:04:40.172420+0000","last_became_peered":"2024-04-26T23:04:40.172420+0000","last_unstale":"2024-04-26T23:13:31.259141+0000","last_undegraded":"2024-04-26T23:13:31.259141+0000","last_fullsized":"2024-04-26T23:13:31.259141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-26T23:13:31.259026+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-26T23:13:31.259026+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.259026+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:36.020873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'219","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:28.176675+0000","last_change":"2024-04-26T23:13:28.176675+0000","last_active":"2024-04-26T23:13:28.176675+0000","last_peered":"2024-04-26T23:13:28.176675+0000","last_clean":"2024-04-26T23:13:28.176675+0000","last_became_active":"2024-04-26T23:04:40.162516+0000","last_became_peered":"2024-04-26T23:04:40.162516+0000","last_unstale":"2024-04-26T23:13:28.176675+0000","last_undegraded":"2024-04-26T23:13:28.176675+0000","last_fullsized":"2024-04-26T23:13:28.176675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-26T23:13:28.176381+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-26T23:13:28.176381+0000","last_clean_scrub_stamp":"2024-04-26T23:13:28.176381+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:06.558134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.092927+0000","last_change":"2024-04-26T23:13:33.092927+0000","last_active":"2024-04-26T23:13:33.092927+0000","last_peered":"2024-04-26T23:13:33.092927+0000","last_clean":"2024-04-26T23:13:33.092927+0000","last_became_active":"2024-04-26T23:04:40.172729+0000","last_became_peered":"2024-04-26T23:04:40.172729+0000","last_unstale":"2024-04-26T23:13:33.092927+0000","last_undegraded":"2024-04-26T23:13:33.092927+0000","last_fullsized":"2024-04-26T23:13:33.092927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-26T23:13:33.092698+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-26T23:13:33.092698+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.092698+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:44.910795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'207","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.148778+0000","last_change":"2024-04-26T23:13:24.148804+0000","last_active":"2024-04-26T23:13:24.148778+0000","last_peered":"2024-04-26T23:13:24.148778+0000","last_clean":"2024-04-26T23:13:24.148778+0000","last_became_active":"2024-04-26T23:04:40.168204+0000","last_became_peered":"2024-04-26T23:04:40.168204+0000","last_unstale":"2024-04-26T23:13:24.148778+0000","last_undegraded":"2024-04-26T23:13:24.148778+0000","last_fullsized":"2024-04-26T23:13:24.148778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:24.148672+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:24.148672+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.148672+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:28:31.106508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'208","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.777594+0000","last_change":"2024-04-26T23:13:35.777655+0000","last_active":"2024-04-26T23:13:35.777594+0000","last_peered":"2024-04-26T23:13:35.777594+0000","last_clean":"2024-04-26T23:13:35.777594+0000","last_became_active":"2024-04-26T23:04:40.182525+0000","last_became_peered":"2024-04-26T23:04:40.182525+0000","last_unstale":"2024-04-26T23:13:35.777594+0000","last_undegraded":"2024-04-26T23:13:35.777594+0000","last_fullsized":"2024-04-26T23:13:35.777594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:35.777415+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:35.777415+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.777415+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:12.754933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'222","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.676712+0000","last_change":"2024-04-26T23:13:30.676774+0000","last_active":"2024-04-26T23:13:30.676712+0000","last_peered":"2024-04-26T23:13:30.676712+0000","last_clean":"2024-04-26T23:13:30.676712+0000","last_became_active":"2024-04-26T23:04:40.170587+0000","last_became_peered":"2024-04-26T23:04:40.170587+0000","last_unstale":"2024-04-26T23:13:30.676712+0000","last_undegraded":"2024-04-26T23:13:30.676712+0000","last_fullsized":"2024-04-26T23:13:30.676712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'222","last_scrub_stamp":"2024-04-26T23:13:30.676518+0000","last_deep_scrub":"26'222","last_deep_scrub_stamp":"2024-04-26T23:13:30.676518+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.676518+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:30.531120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:30.559188+0000","last_change":"2024-04-26T23:13:30.559211+0000","last_active":"2024-04-26T23:13:30.559188+0000","last_peered":"2024-04-26T23:13:30.559188+0000","last_clean":"2024-04-26T23:13:30.559188+0000","last_became_active":"2024-04-26T23:04:40.187388+0000","last_became_peered":"2024-04-26T23:04:40.187388+0000","last_unstale":"2024-04-26T23:13:30.559188+0000","last_undegraded":"2024-04-26T23:13:30.559188+0000","last_fullsized":"2024-04-26T23:13:30.559188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-26T23:13:30.559113+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-26T23:13:30.559113+0000","last_clean_scrub_stamp":"2024-04-26T23:13:30.559113+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:30.207453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'213","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:27.146906+0000","last_change":"2024-04-26T23:13:27.146953+0000","last_active":"2024-04-26T23:13:27.146906+0000","last_peered":"2024-04-26T23:13:27.146906+0000","last_clean":"2024-04-26T23:13:27.146906+0000","last_became_active":"2024-04-26T23:04:40.161465+0000","last_became_peered":"2024-04-26T23:04:40.161465+0000","last_unstale":"2024-04-26T23:13:27.146906+0000","last_undegraded":"2024-04-26T23:13:27.146906+0000","last_fullsized":"2024-04-26T23:13:27.146906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-26T23:13:27.146808+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-26T23:13:27.146808+0000","last_clean_scrub_stamp":"2024-04-26T23:13:27.146808+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:27.178064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'204","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.060051+0000","last_change":"2024-04-26T23:13:31.060078+0000","last_active":"2024-04-26T23:13:31.060051+0000","last_peered":"2024-04-26T23:13:31.060051+0000","last_clean":"2024-04-26T23:13:31.060051+0000","last_became_active":"2024-04-26T23:04:40.167681+0000","last_became_peered":"2024-04-26T23:04:40.167681+0000","last_unstale":"2024-04-26T23:13:31.060051+0000","last_undegraded":"2024-04-26T23:13:31.060051+0000","last_fullsized":"2024-04-26T23:13:31.060051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:31.059967+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:31.059967+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.059967+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:35.277882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'182","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:26.436947+0000","last_change":"2024-04-26T23:13:26.437011+0000","last_active":"2024-04-26T23:13:26.436947+0000","last_peered":"2024-04-26T23:13:26.436947+0000","last_clean":"2024-04-26T23:13:26.436947+0000","last_became_active":"2024-04-26T23:04:40.179036+0000","last_became_peered":"2024-04-26T23:04:40.179036+0000","last_unstale":"2024-04-26T23:13:26.436947+0000","last_undegraded":"2024-04-26T23:13:26.436947+0000","last_fullsized":"2024-04-26T23:13:26.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-26T23:13:26.436723+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-26T23:13:26.436723+0000","last_clean_scrub_stamp":"2024-04-26T23:13:26.436723+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:43.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'186","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.207841+0000","last_change":"2024-04-26T23:13:34.207898+0000","last_active":"2024-04-26T23:13:34.207841+0000","last_peered":"2024-04-26T23:13:34.207841+0000","last_clean":"2024-04-26T23:13:34.207841+0000","last_became_active":"2024-04-26T23:04:40.176822+0000","last_became_peered":"2024-04-26T23:04:40.176822+0000","last_unstale":"2024-04-26T23:13:34.207841+0000","last_undegraded":"2024-04-26T23:13:34.207841+0000","last_fullsized":"2024-04-26T23:13:34.207841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'186","last_scrub_stamp":"2024-04-26T23:13:34.207671+0000","last_deep_scrub":"26'186","last_deep_scrub_stamp":"2024-04-26T23:13:34.207671+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.207671+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:44.222088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'204","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:33.171883+0000","last_change":"2024-04-26T23:13:33.171946+0000","last_active":"2024-04-26T23:13:33.171883+0000","last_peered":"2024-04-26T23:13:33.171883+0000","last_clean":"2024-04-26T23:13:33.171883+0000","last_became_active":"2024-04-26T23:04:40.175790+0000","last_became_peered":"2024-04-26T23:04:40.175790+0000","last_unstale":"2024-04-26T23:13:33.171883+0000","last_undegraded":"2024-04-26T23:13:33.171883+0000","last_fullsized":"2024-04-26T23:13:33.171883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-26T23:13:33.171708+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-26T23:13:33.171708+0000","last_clean_scrub_stamp":"2024-04-26T23:13:33.171708+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.783075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'211","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:35.074750+0000","last_change":"2024-04-26T23:13:35.074875+0000","last_active":"2024-04-26T23:13:35.074750+0000","last_peered":"2024-04-26T23:13:35.074750+0000","last_clean":"2024-04-26T23:13:35.074750+0000","last_became_active":"2024-04-26T23:04:40.181645+0000","last_became_peered":"2024-04-26T23:04:40.181645+0000","last_unstale":"2024-04-26T23:13:35.074750+0000","last_undegraded":"2024-04-26T23:13:35.074750+0000","last_fullsized":"2024-04-26T23:13:35.074750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-26T23:13:35.074535+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-26T23:13:35.074535+0000","last_clean_scrub_stamp":"2024-04-26T23:13:35.074535+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:02.601277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'199","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:38.992195+0000","last_change":"2024-04-26T23:13:38.992255+0000","last_active":"2024-04-26T23:13:38.992195+0000","last_peered":"2024-04-26T23:13:38.992195+0000","last_clean":"2024-04-26T23:13:38.992195+0000","last_became_active":"2024-04-26T23:05:29.413557+0000","last_became_peered":"2024-04-26T23:05:29.413557+0000","last_unstale":"2024-04-26T23:13:38.992195+0000","last_undegraded":"2024-04-26T23:13:38.992195+0000","last_fullsized":"2024-04-26T23:13:38.992195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-26T23:13:38.992092+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-26T23:13:38.992092+0000","last_clean_scrub_stamp":"2024-04-26T23:13:38.992092+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:13.693502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'212","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:23.086263+0000","last_change":"2024-04-26T23:13:23.086322+0000","last_active":"2024-04-26T23:13:23.086263+0000","last_peered":"2024-04-26T23:13:23.086263+0000","last_clean":"2024-04-26T23:13:23.086263+0000","last_became_active":"2024-04-26T23:04:40.172894+0000","last_became_peered":"2024-04-26T23:04:40.172894+0000","last_unstale":"2024-04-26T23:13:23.086263+0000","last_undegraded":"2024-04-26T23:13:23.086263+0000","last_fullsized":"2024-04-26T23:13:23.086263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-26T23:13:23.086079+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-26T23:13:23.086079+0000","last_clean_scrub_stamp":"2024-04-26T23:13:23.086079+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:18.389291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'191","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:31.703618+0000","last_change":"2024-04-26T23:13:31.703677+0000","last_active":"2024-04-26T23:13:31.703618+0000","last_peered":"2024-04-26T23:13:31.703618+0000","last_clean":"2024-04-26T23:13:31.703618+0000","last_became_active":"2024-04-26T23:04:40.172058+0000","last_became_peered":"2024-04-26T23:04:40.172058+0000","last_unstale":"2024-04-26T23:13:31.703618+0000","last_undegraded":"2024-04-26T23:13:31.703618+0000","last_fullsized":"2024-04-26T23:13:31.703618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-26T23:13:31.703441+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-26T23:13:31.703441+0000","last_clean_scrub_stamp":"2024-04-26T23:13:31.703441+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:20.290046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'206","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.049621+0000","last_change":"2024-04-26T23:13:32.049680+0000","last_active":"2024-04-26T23:13:32.049621+0000","last_peered":"2024-04-26T23:13:32.049621+0000","last_clean":"2024-04-26T23:13:32.049621+0000","last_became_active":"2024-04-26T23:04:40.171842+0000","last_became_peered":"2024-04-26T23:04:40.171842+0000","last_unstale":"2024-04-26T23:13:32.049621+0000","last_undegraded":"2024-04-26T23:13:32.049621+0000","last_fullsized":"2024-04-26T23:13:32.049621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-26T23:13:32.049435+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-26T23:13:32.049435+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.049435+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:59:43.726173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'198","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:32.730750+0000","last_change":"2024-04-26T23:13:32.730810+0000","last_active":"2024-04-26T23:13:32.730750+0000","last_peered":"2024-04-26T23:13:32.730750+0000","last_clean":"2024-04-26T23:13:32.730750+0000","last_became_active":"2024-04-26T23:04:40.175502+0000","last_became_peered":"2024-04-26T23:04:40.175502+0000","last_unstale":"2024-04-26T23:13:32.730750+0000","last_undegraded":"2024-04-26T23:13:32.730750+0000","last_fullsized":"2024-04-26T23:13:32.730750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-26T23:13:32.730575+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-26T23:13:32.730575+0000","last_clean_scrub_stamp":"2024-04-26T23:13:32.730575+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:48.339525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'190","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:24.099511+0000","last_change":"2024-04-26T23:13:24.099535+0000","last_active":"2024-04-26T23:13:24.099511+0000","last_peered":"2024-04-26T23:13:24.099511+0000","last_clean":"2024-04-26T23:13:24.099511+0000","last_became_active":"2024-04-26T23:04:40.153140+0000","last_became_peered":"2024-04-26T23:04:40.153140+0000","last_unstale":"2024-04-26T23:13:24.099511+0000","last_undegraded":"2024-04-26T23:13:24.099511+0000","last_fullsized":"2024-04-26T23:13:24.099511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-26T23:13:24.099427+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-26T23:13:24.099427+0000","last_clean_scrub_stamp":"2024-04-26T23:13:24.099427+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'208","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:29.572489+0000","last_change":"2024-04-26T23:13:29.572551+0000","last_active":"2024-04-26T23:13:29.572489+0000","last_peered":"2024-04-26T23:13:29.572489+0000","last_clean":"2024-04-26T23:13:29.572489+0000","last_became_active":"2024-04-26T23:04:40.162743+0000","last_became_peered":"2024-04-26T23:04:40.162743+0000","last_unstale":"2024-04-26T23:13:29.572489+0000","last_undegraded":"2024-04-26T23:13:29.572489+0000","last_fullsized":"2024-04-26T23:13:29.572489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-26T23:13:29.572398+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-26T23:13:29.572398+0000","last_clean_scrub_stamp":"2024-04-26T23:13:29.572398+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:13.998402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'207","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:13:34.095803+0000","last_change":"2024-04-26T23:13:34.095860+0000","last_active":"2024-04-26T23:13:34.095803+0000","last_peered":"2024-04-26T23:13:34.095803+0000","last_clean":"2024-04-26T23:13:34.095803+0000","last_became_active":"2024-04-26T23:04:40.180449+0000","last_became_peered":"2024-04-26T23:04:40.180449+0000","last_unstale":"2024-04-26T23:13:34.095803+0000","last_undegraded":"2024-04-26T23:13:34.095803+0000","last_fullsized":"2024-04-26T23:13:34.095803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-26T23:13:34.095637+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-26T23:13:34.095637+0000","last_clean_scrub_stamp":"2024-04-26T23:13:34.095637+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:47.754360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":3562082,"num_write":24373,"num_write_kb":4386857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25625,"ondisk_log_size":25625,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13203,"ondisk_log_size":13203,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":146760150,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":290,"num_read_kb":1707,"num_write":6971,"num_write_kb":149053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98533376,"data_stored":293520300,"data_compressed":45676422,"data_compressed_allocated":58785792,"data_compressed_original":253927424,"omap_allocated":0,"internal_metadata":0},"log_size":8332,"ondisk_log_size":8332,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82580,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94289260,"statfs":{"total":96636764160,"available":96552202240,"internally_reserved":0,"allocated":15675392,"data_stored":53626098,"data_compressed":8350272,"data_compressed_allocated":10506240,"data_compressed_original":48644096,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79484,"kb_used_data":12212,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292356,"statfs":{"total":96636764160,"available":96555372544,"internally_reserved":0,"allocated":12505088,"data_stored":46253047,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69316,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302524,"statfs":{"total":96636764160,"available":96565784576,"internally_reserved":0,"allocated":12054528,"data_stored":29475859,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107008,"kb_used_data":17592,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264832,"statfs":{"total":96636764160,"available":96527187968,"internally_reserved":0,"allocated":18014208,"data_stored":46252411,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81852,"kb_used_data":10420,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94289988,"statfs":{"total":96636764160,"available":96552947712,"internally_reserved":0,"allocated":10670080,"data_stored":35231288,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":6072,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":6217728,"data_stored":14259202,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":14764,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":15118336,"data_stored":40452446,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77660,"kb_used_data":10388,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94294180,"statfs":{"total":96636764160,"available":96557240320,"internally_reserved":0,"allocated":10637312,"data_stored":30065509,"data_compressed":4598603,"data_compressed_allocated":5840896,"data_compressed_original":25452544,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10293248,"data_stored":29360788,"data_compressed":4565115,"data_compressed_allocated":5795840,"data_compressed_original":24879104,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":40338093,"data_compressed":6260954,"data_compressed_allocated":8343552,"data_compressed_original":33865728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5939200,"data_stored":14144849,"data_compressed":2143583,"data_compressed_allocated":3051520,"data_compressed_original":11280384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10391552,"data_stored":35116935,"data_compressed":5723177,"data_compressed_allocated":7102464,"data_compressed_original":31850496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":46138058,"data_compressed":6831866,"data_compressed_allocated":9011200,"data_compressed_original":37429248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11776000,"data_stored":29361506,"data_compressed":4323124,"data_compressed_allocated":5857280,"data_compressed_original":23461888,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12226560,"data_stored":46138694,"data_compressed":7511819,"data_compressed_allocated":9162752,"data_compressed_original":43089920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15331328,"data_stored":52921377,"data_compressed":8316784,"data_compressed_allocated":10461184,"data_compressed_original":48070656,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:14:03.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T23:14:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 Processor -- start 2024-04-26T23:14:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 -- start start 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f322c073940 0x7f322c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f322c15c070 0x7f322c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322c0c4b30 con 0x7f322c152d00 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f322c0c6f60 con 0x7f322c073940 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3232c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f322c0c7240 con 0x7f322c15c070 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f322c073940 0x7f322c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f322c073940 0x7f322c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46100/0 (socket says 172.21.15.148:46100) 2024-04-26T23:14:04.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 -- 172.21.15.148:0/1543534971 learned_addr learned my addr 172.21.15.148:0/1543534971 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f3230c00640 1 --2- 172.21.15.148:0/1543534971 >> v2:172.21.15.157:3300/0 conn(0x7f322c15c070 0x7f322c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 -- 172.21.15.148:0/1543534971 >> v2:172.21.15.157:3300/0 conn(0x7f322c15c070 msgr2=0x7f322c15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 --2- 172.21.15.148:0/1543534971 >> v2:172.21.15.157:3300/0 conn(0x7f322c15c070 0x7f322c15c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.108+0000 7f322b400640 1 -- 172.21.15.148:0/1543534971 >> v1:172.21.15.157:6789/0 conn(0x7f322c152d00 legacy=0x7f322c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f322b400640 1 -- 172.21.15.148:0/1543534971 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c0c7520 con 0x7f322c073940 2024-04-26T23:14:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f322b400640 1 --2- 172.21.15.148:0/1543534971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c073940 0x7f322c0c97d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f322c0747d0 tx=0x7f321801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10c516cfb3d134e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f322aa00640 1 -- 172.21.15.148:0/1543534971 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32180aa620 con 0x7f322c073940 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f322aa00640 1 -- 172.21.15.148:0/1543534971 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32180af070 con 0x7f322c073940 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f322aa00640 1 -- 172.21.15.148:0/1543534971 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32180aa9e0 con 0x7f322c073940 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 -- 172.21.15.148:0/1543534971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c073940 msgr2=0x7f322c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 --2- 172.21.15.148:0/1543534971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c073940 0x7f322c0c97d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f322c0747d0 tx=0x7f321801c520 comp rx=0 tx=0).stop 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 -- 172.21.15.148:0/1543534971 shutdown_connections 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 --2- 172.21.15.148:0/1543534971 >> v2:172.21.15.157:3300/0 conn(0x7f322c15c070 0x7f322c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 --2- 172.21.15.148:0/1543534971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c073940 0x7f322c0c97d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 -- 172.21.15.148:0/1543534971 >> 172.21.15.148:0/1543534971 conn(0x7f322c0c9d10 msgr2=0x7f322c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 -- 172.21.15.148:0/1543534971 shutdown_connections 2024-04-26T23:14:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.112+0000 7f3232c00640 1 -- 172.21.15.148:0/1543534971 wait complete. 2024-04-26T23:14:04.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 Processor -- start 2024-04-26T23:14:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- start start 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 0x7f322c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f322c15c070 0x7f322c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f322c15cf70 con 0x7f322c152d00 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f322c15cdf0 con 0x7f322c15c070 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f322c165c20 con 0x7f322c073940 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46112/0 (socket says 172.21.15.148:46112) 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 -- 172.21.15.148:0/1701921631 learned_addr learned my addr 172.21.15.148:0/1701921631 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3230c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f322c15c070 0x7f322c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322be00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 0x7f322c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 -- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 msgr2=0x7f322c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 0x7f322c148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 -- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f322c15c070 msgr2=0x7f322c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f322c15c070 0x7f322c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 -- 172.21.15.148:0/1701921631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c0cbfa0 con 0x7f322c152d00 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322be00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 0x7f322c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f322b400640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3218019130 tx=0x7f321801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32180aad00 con 0x7f322c152d00 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32180bd3f0 con 0x7f322c152d00 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32180bd7a0 con 0x7f322c152d00 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c14f8a0 con 0x7f322c152d00 2024-04-26T23:14:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.116+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c14fe60 con 0x7f322c152d00 2024-04-26T23:14:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c077c20 con 0x7f322c152d00 2024-04-26T23:14:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32180c6440 con 0x7f322c152d00 2024-04-26T23:14:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f3223e00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f32181211a0 con 0x7f322c152d00 2024-04-26T23:14:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f322be00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.120+0000 7f322be00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 0x7f320c06a840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f321c001e10 tx=0x7f321c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.124+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3218016110 con 0x7f322c152d00 2024-04-26T23:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.284+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f322c162ae0 con 0x7f322c152d00 2024-04-26T23:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.288+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f32180f0d00 con 0x7f322c152d00 2024-04-26T23:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3223e00640 1 -- 172.21.15.148:0/1701921631 <== mon.0 v2:172.21.15.148:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f32180f5000 con 0x7f322c152d00 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 msgr2=0x7f320c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 0x7f320c06a840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f321c001e10 tx=0x7f321c009040 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 msgr2=0x7f322c150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3218019130 tx=0x7f321801ad60 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 shutdown_connections 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f322c15c070 0x7f322c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f322c152d00 0x7f322c150660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 --2- 172.21.15.148:0/1701921631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f322c073940 0x7f322c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 >> 172.21.15.148:0/1701921631 conn(0x7f322c0c9d10 msgr2=0x7f322c151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:04.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 shutdown_connections 2024-04-26T23:14:04.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.292+0000 7f3232c00640 1 -- 172.21.15.148:0/1701921631 wait complete. 2024-04-26T23:14:04.311 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:14:04.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:14:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 Processor -- start 2024-04-26T23:14:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 -- start start 2024-04-26T23:14:04.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5078152bc0 0x7f50780c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f50780c9340 0x7f5078072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50780732b0 0x7f50780c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.452+0000 7f507d000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f5078152fa0 con 0x7f5078152bc0 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f507d000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5078073700 con 0x7f50780c9340 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f507d000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5078159790 con 0x7f50780732b0 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5078152bc0 0x7f50780c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5078152bc0 0x7f50780c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46122/0 (socket says 172.21.15.148:46122) 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 -- 172.21.15.148:0/3271530653 learned_addr learned my addr 172.21.15.148:0/3271530653 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5076800640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50780732b0 0x7f50780c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f506d400640 1 --2- 172.21.15.148:0/3271530653 >> v2:172.21.15.157:3300/0 conn(0x7f50780c9340 0x7f5078072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 -- 172.21.15.148:0/3271530653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50780732b0 msgr2=0x7f50780c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50780732b0 0x7f50780c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 -- 172.21.15.148:0/3271530653 >> v2:172.21.15.157:3300/0 conn(0x7f50780c9340 msgr2=0x7f5078072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 --2- 172.21.15.148:0/3271530653 >> v2:172.21.15.157:3300/0 conn(0x7f50780c9340 0x7f5078072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 -- 172.21.15.148:0/3271530653 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078158930 con 0x7f5078152bc0 2024-04-26T23:14:04.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.456+0000 7f5075e00640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5078152bc0 0x7f50780c8e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5078071cb0 tx=0x7f506801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec3c0cfd0454be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f5075400640 1 -- 172.21.15.148:0/3271530653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50680b5070 con 0x7f5078152bc0 2024-04-26T23:14:04.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f5075400640 1 -- 172.21.15.148:0/3271530653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f50680a89d0 con 0x7f5078152bc0 2024-04-26T23:14:04.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f5075400640 1 -- 172.21.15.148:0/3271530653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50680a8dc0 con 0x7f5078152bc0 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- 172.21.15.148:0/3271530653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5078152bc0 msgr2=0x7f50780c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5078152bc0 0x7f50780c8e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5078071cb0 tx=0x7f506801ed10 comp rx=0 tx=0).stop 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- 172.21.15.148:0/3271530653 shutdown_connections 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50780732b0 0x7f50780c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- 172.21.15.148:0/3271530653 >> v2:172.21.15.157:3300/0 conn(0x7f50780c9340 0x7f5078072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- 172.21.15.148:0/3271530653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5078152bc0 0x7f50780c8e00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- 172.21.15.148:0/3271530653 >> 172.21.15.148:0/3271530653 conn(0x7f507806c380 msgr2=0x7f507806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- 172.21.15.148:0/3271530653 shutdown_connections 2024-04-26T23:14:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- 172.21.15.148:0/3271530653 wait complete. 2024-04-26T23:14:04.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 Processor -- start 2024-04-26T23:14:04.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- start start 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50780732b0 0x7f50781f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5078152bc0 0x7f50781f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f50781591d0 con 0x7f50780c9340 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5078158ef0 con 0x7f50780732b0 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f507d000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f50781594b0 con 0x7f5078152bc0 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f506d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f506d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46126/0 (socket says 172.21.15.148:46126) 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.460+0000 7f506d400640 1 -- 172.21.15.148:0/813186221 learned_addr learned my addr 172.21.15.148:0/813186221 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f5076800640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5078152bc0 0x7f50781f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f5075e00640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50780732b0 0x7f50781f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 -- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5078152bc0 msgr2=0x7f50781f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5078152bc0 0x7f50781f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 -- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50780732b0 msgr2=0x7f50781f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50780732b0 0x7f50781f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 -- 172.21.15.148:0/813186221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50781f2340 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506d400640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5060007f20 tx=0x7f506000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060014620 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5060019070 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50781f2600 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060014a20 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50781f2bc0 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5078077c20 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5060014bc0 con 0x7f50780c9340 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.464+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f50600877a0 con 0x7f50780c9340 2024-04-26T23:14:04.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.468+0000 7f5075e00640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.468+0000 7f5075e00640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 0x7f505406a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50680b2000 tx=0x7f5068009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.468+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f50600571e0 con 0x7f50780c9340 2024-04-26T23:14:04.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.660+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50780c9940 con 0x7f50780c9340 2024-04-26T23:14:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.660+0000 7f506ea00640 1 -- 172.21.15.148:0/813186221 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7f506005b4e0 con 0x7f50780c9340 2024-04-26T23:14:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:14:04.660 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:14:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:14:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 msgr2=0x7f505406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 0x7f505406a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50680b2000 tx=0x7f5068009040 comp rx=0 tx=0).stop 2024-04-26T23:14:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 msgr2=0x7f5078154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5060007f20 tx=0x7f506000e570 comp rx=0 tx=0).stop 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 shutdown_connections 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5078152bc0 0x7f50781f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50780c9340 0x7f5078154440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 --2- 172.21.15.148:0/813186221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50780732b0 0x7f50781f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 >> 172.21.15.148:0/813186221 conn(0x7f507806c380 msgr2=0x7f50780703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 shutdown_connections 2024-04-26T23:14:04.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.664+0000 7f507d000640 1 -- 172.21.15.148:0/813186221 wait complete. 2024-04-26T23:14:04.682 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:14:04.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 Processor -- start 2024-04-26T23:14:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 -- start start 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f9c153af0 0x7f2f9c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c0c9d90 con 0x7f2f9c0c9010 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c0ca630 con 0x7f2f9c153af0 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2fa2000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ca070 con 0x7f2f9c0c7b80 2024-04-26T23:14:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f9c153af0 0x7f2f9c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2f9c153af0 0x7f2f9c15d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46138/0 (socket says 172.21.15.148:46138) 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 -- 172.21.15.148:0/2753189251 learned_addr learned my addr 172.21.15.148:0/2753189251 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f92a00640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 -- 172.21.15.148:0/2753189251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 msgr2=0x7f2f9c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 -- 172.21.15.148:0/2753189251 >> v1:172.21.15.157:6789/0 conn(0x7f2f9c0c9010 legacy=0x7f2f9c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.820+0000 7f2f9b400640 1 -- 172.21.15.148:0/2753189251 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0ca350 con 0x7f2f9c153af0 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2f9b400640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153af0 0x7f2f9c15d7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009870 tx=0x7f2f8c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfdab8b461ed75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2f9aa00640 1 -- 172.21.15.148:0/2753189251 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0b5070 con 0x7f2f9c153af0 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2f9aa00640 1 -- 172.21.15.148:0/2753189251 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f8c0a89d0 con 0x7f2f9c153af0 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2f9aa00640 1 -- 172.21.15.148:0/2753189251 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0a8dc0 con 0x7f2f9c153af0 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 -- 172.21.15.148:0/2753189251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153af0 msgr2=0x7f2f9c15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153af0 0x7f2f9c15d7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009870 tx=0x7f2f8c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:14:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 -- 172.21.15.148:0/2753189251 shutdown_connections 2024-04-26T23:14:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 --2- 172.21.15.148:0/2753189251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c153af0 0x7f2f9c15d7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 -- 172.21.15.148:0/2753189251 >> 172.21.15.148:0/2753189251 conn(0x7f2f9c06c380 msgr2=0x7f2f9c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 -- 172.21.15.148:0/2753189251 shutdown_connections 2024-04-26T23:14:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.824+0000 7f2fa2000640 1 -- 172.21.15.148:0/2753189251 wait complete. 2024-04-26T23:14:04.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 Processor -- start 2024-04-26T23:14:04.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- start start 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f9c153af0 0x7f2f9c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c153ed0 con 0x7f2f9c0c9010 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c15d290 con 0x7f2f9c153af0 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c154050 con 0x7f2f9c0c7b80 2024-04-26T23:14:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46146/0 (socket says 172.21.15.148:46146) 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 -- 172.21.15.148:0/3290213981 learned_addr learned my addr 172.21.15.148:0/3290213981 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f9b400640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f9be00640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f9c153af0 0x7f2f9c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 -- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 msgr2=0x7f2f9c157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 -- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f9c153af0 msgr2=0x7f2f9c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f9c153af0 0x7f2f9c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 -- 172.21.15.148:0/3290213981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c14cd80 con 0x7f2f9c0c9010 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f92a00640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400d800 tx=0x7f2f8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400b6c0 con 0x7f2f9c0c9010 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f84019070 con 0x7f2f9c0c9010 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400ba80 con 0x7f2f9c0c9010 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c1e3df0 con 0x7f2f9c0c9010 2024-04-26T23:14:04.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c14d300 con 0x7f2f9c0c9010 2024-04-26T23:14:04.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.828+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9c077c20 con 0x7f2f9c0c9010 2024-04-26T23:14:04.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.832+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f8400bc20 con 0x7f2f9c0c9010 2024-04-26T23:14:04.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.832+0000 7f2f93e00640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 0x7f2f7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:04.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.832+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2f840872e0 con 0x7f2f9c0c9010 2024-04-26T23:14:04.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.832+0000 7f2f9b400640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 0x7f2f7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:04.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.832+0000 7f2f9b400640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 0x7f2f7806a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0b2000 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:04.836+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2f84057370 con 0x7f2f9c0c9010 2024-04-26T23:14:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f9c0c8670 con 0x7f2f9c0c9010 2024-04-26T23:14:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2f93e00640 1 -- 172.21.15.148:0/3290213981 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6888 (secure 0 0 0) 0x7f2f84056c70 con 0x7f2f9c0c9010 2024-04-26T23:14:05.022 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:14:05.022 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1857939436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1857939436},{"type":"v1","addr":"172.21.15.148:6834","nonce":1857939436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4227,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6836/2662552562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2662552562},{"type":"v1","addr":"172.21.15.148:6836","nonce":2662552562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2981512973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6835","nonce":2981512973},{"type":"v1","addr":"172.21.15.148:6837","nonce":2981512973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:04:39.499207+0000","modified":"2024-04-26T23:05:15.993167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4309,"mds_2":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.157:6836/4095294629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":4095294629},{"type":"v1","addr":"172.21.15.157:6836","nonce":4095294629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.157:6837/4088233623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6835","nonce":4088233623},{"type":"v1","addr":"172.21.15.157:6837","nonce":4088233623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4312":{"gid":4312,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.157:6839/1573676603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":1573676603},{"type":"v1","addr":"172.21.15.157:6839","nonce":1573676603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4312,"qdb_cluster":[4245,4309,4312]},"id":1}]} 2024-04-26T23:14:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-04-26T23:14:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 msgr2=0x7f2f7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 0x7f2f7806a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0b2000 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 msgr2=0x7f2f9c1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400d800 tx=0x7f2f8400dcc0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 shutdown_connections 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f2f78068380 0x7f2f7806a840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f9c153af0 0x7f2f9c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f9c0c9010 0x7f2f9c1590b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 --2- 172.21.15.148:0/3290213981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f9c0c7b80 0x7f2f9c157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 >> 172.21.15.148:0/3290213981 conn(0x7f2f9c06c380 msgr2=0x7f2f9c0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 shutdown_connections 2024-04-26T23:14:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.024+0000 7f2fa2000640 1 -- 172.21.15.148:0/3290213981 wait complete. 2024-04-26T23:14:05.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:14:05.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 Processor -- start 2024-04-26T23:14:05.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 -- start start 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8114152bc0 0x7f81140c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f8114072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8114152fa0 con 0x7f81140732b0 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8114073700 con 0x7f8114152bc0 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f811a400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8114159790 con 0x7f81140c9340 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f8113e00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f81140732b0 0x7f81140c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60856/0 (socket says 172.21.15.148:60856) 2024-04-26T23:14:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f8113e00640 1 -- 172.21.15.148:0/1779093304 learned_addr learned my addr 172.21.15.148:0/1779093304 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:14:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f8112a00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f8114072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f8113400640 1 --2- 172.21.15.148:0/1779093304 >> v2:172.21.15.157:3300/0 conn(0x7f8114152bc0 0x7f81140c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.180+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013397838 0 0) 0x7f8114152fa0 con 0x7f81140732b0 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f8003530 con 0x7f81140732b0 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900617289 0 0) 0x7f80f8003530 con 0x7f81140732b0 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 msgr2=0x7f8114072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f8114072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 >> v2:172.21.15.157:3300/0 conn(0x7f8114152bc0 msgr2=0x7f81140c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 --2- 172.21.15.148:0/1779093304 >> v2:172.21.15.157:3300/0 conn(0x7f8114152bc0 0x7f81140c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8114158930 con 0x7f81140732b0 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 112310406 0 0) 0x7f810c001a00 con 0x7f81140732b0 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 >> v1:172.21.15.148:6789/0 conn(0x7f81140732b0 legacy=0x7f81140c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f80f80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f8003f40 0x7f80f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8004d50 0x7f80f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8114073700 con 0x7f80f8003f40 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8114159790 con 0x7f80f8004d50 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f80f800dc10 con 0x7f81140c9340 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f8003f40 0x7f80f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8113400640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f80f80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8113e00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8004d50 0x7f80f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 -- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 msgr2=0x7f80f80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81140c9340 0x7f80f80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 -- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8004d50 msgr2=0x7f80f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8004d50 0x7f80f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8112a00640 1 -- 172.21.15.148:0/1779093304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f8003530 con 0x7f80f8003f40 2024-04-26T23:14:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.184+0000 7f8113e00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8004d50 0x7f80f80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f8112a00640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f8003f40 0x7f80f8004810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8100009ae0 tx=0x7f810001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e5375b17af58f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000b2070 con 0x7f80f8003f40 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f81000a5660 con 0x7f80f8003f40 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f8112000640 1 -- 172.21.15.148:0/1779093304 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000096b0 con 0x7f80f8003f40 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- 172.21.15.148:0/1779093304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f8003f40 msgr2=0x7f80f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 --2- 172.21.15.148:0/1779093304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f8003f40 0x7f80f8004810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8100009ae0 tx=0x7f810001ca70 comp rx=0 tx=0).stop 2024-04-26T23:14:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f8113e00640 1 -- 172.21.15.148:0/1779093304 reap_dead start 2024-04-26T23:14:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- 172.21.15.148:0/1779093304 shutdown_connections 2024-04-26T23:14:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- 172.21.15.148:0/1779093304 >> 172.21.15.148:0/1779093304 conn(0x7f811406c380 msgr2=0x7f811406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- 172.21.15.148:0/1779093304 shutdown_connections 2024-04-26T23:14:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- 172.21.15.148:0/1779093304 wait complete. 2024-04-26T23:14:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 Processor -- start 2024-04-26T23:14:05.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- start start 2024-04-26T23:14:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 0x7f8114159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f811415c660 0x7f8114151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81141591d0 con 0x7f81141eddf0 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8114158ef0 con 0x7f80f8003f40 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.188+0000 7f811a400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f81141594b0 con 0x7f811415c660 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46166/0 (socket says 172.21.15.148:46166) 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 -- 172.21.15.148:0/3495873549 learned_addr learned my addr 172.21.15.148:0/3495873549 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8112a00640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f811415c660 0x7f8114151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 0x7f8114159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 -- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f811415c660 msgr2=0x7f8114151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f811415c660 0x7f8114151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 -- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 msgr2=0x7f8114159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 0x7f8114159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 -- 172.21.15.148:0/3495873549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81141ed660 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 0x7f8114159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f8113e00640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f90 tx=0x7f810c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00ed20 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f810c014430 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811415a710 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c014840 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811415acd0 con 0x7f81141eddf0 2024-04-26T23:14:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8114077c20 con 0x7f81141eddf0 2024-04-26T23:14:05.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f810c0149e0 con 0x7f81141eddf0 2024-04-26T23:14:05.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 0x7f80f406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.192+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f810c086c90 con 0x7f81141eddf0 2024-04-26T23:14:05.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.196+0000 7f8113400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 0x7f80f406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.196+0000 7f8113400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 0x7f80f406a7e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8104009b70 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.196+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f810c0566d0 con 0x7f81141eddf0 2024-04-26T23:14:05.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81140c9940 con 0x7f81141eddf0 2024-04-26T23:14:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f810b400640 1 -- 172.21.15.148:0/3495873549 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18925 (secure 0 0 0) 0x7f810c05a9d0 con 0x7f81141eddf0 2024-04-26T23:14:05.358 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-26T23:14:05.358 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"fsid":"d6966320-e81f-47bf-b2a0-b4169b90f47b","created":"2024-04-26T23:04:22.408709+0000","modified":"2024-04-26T23:05:29.036622+0000","last_up_change":"2024-04-26T23:04:33.042351+0000","last_in_change":"2024-04-26T23:04:24.688439+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:04:33.886491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:04:37.655445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:04:38.707996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T23:04:42.177236+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"10a69ee9-4018-402f-8547-13adf2c2574d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6809","nonce":2413441377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6811","nonce":2413441377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6815","nonce":2413441377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2413441377},{"type":"v1","addr":"172.21.15.148:6813","nonce":2413441377}]},"public_addr":"172.21.15.148:6809/2413441377","cluster_addr":"172.21.15.148:6811/2413441377","heartbeat_back_addr":"172.21.15.148:6815/2413441377","heartbeat_front_addr":"172.21.15.148:6813/2413441377","state":["exists","up"]},{"osd":1,"uuid":"0b9f989e-da91-488e-9df8-af5cf73cdc20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6801","nonce":2370517083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6803","nonce":2370517083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6807","nonce":2370517083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2370517083},{"type":"v1","addr":"172.21.15.148:6805","nonce":2370517083}]},"public_addr":"172.21.15.148:6801/2370517083","cluster_addr":"172.21.15.148:6803/2370517083","heartbeat_back_addr":"172.21.15.148:6807/2370517083","heartbeat_front_addr":"172.21.15.148:6805/2370517083","state":["exists","up"]},{"osd":2,"uuid":"0d6172ac-4f3e-4ef9-9f02-1507d9902fde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6818","nonce":2623535582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6822","nonce":2623535582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6830","nonce":2623535582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2623535582},{"type":"v1","addr":"172.21.15.148:6826","nonce":2623535582}]},"public_addr":"172.21.15.148:6818/2623535582","cluster_addr":"172.21.15.148:6822/2623535582","heartbeat_back_addr":"172.21.15.148:6830/2623535582","heartbeat_front_addr":"172.21.15.148:6826/2623535582","state":["exists","up"]},{"osd":3,"uuid":"f67fe7d2-584e-4a47-84f6-724fd887b0d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6819","nonce":3094791832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6823","nonce":3094791832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6831","nonce":3094791832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":3094791832},{"type":"v1","addr":"172.21.15.148:6827","nonce":3094791832}]},"public_addr":"172.21.15.148:6819/3094791832","cluster_addr":"172.21.15.148:6823/3094791832","heartbeat_back_addr":"172.21.15.148:6831/3094791832","heartbeat_front_addr":"172.21.15.148:6827/3094791832","state":["exists","up"]},{"osd":4,"uuid":"61fcfd7e-1353-4932-8174-c4fe21917be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6812","nonce":734957518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6816","nonce":734957518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6823","nonce":734957518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":734957518},{"type":"v1","addr":"172.21.15.157:6821","nonce":734957518}]},"public_addr":"172.21.15.157:6812/734957518","cluster_addr":"172.21.15.157:6816/734957518","heartbeat_back_addr":"172.21.15.157:6823/734957518","heartbeat_front_addr":"172.21.15.157:6821/734957518","state":["exists","up"]},{"osd":5,"uuid":"7b2beef6-eb63-4291-ac63-a44c15afaa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6801","nonce":549691601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6803","nonce":549691601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6807","nonce":549691601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":549691601},{"type":"v1","addr":"172.21.15.157:6805","nonce":549691601}]},"public_addr":"172.21.15.157:6801/549691601","cluster_addr":"172.21.15.157:6803/549691601","heartbeat_back_addr":"172.21.15.157:6807/549691601","heartbeat_front_addr":"172.21.15.157:6805/549691601","state":["exists","up"]},{"osd":6,"uuid":"a696f6f8-ec0e-4a0f-85fa-9c3df949ed1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6825","nonce":1080565004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6827","nonce":1080565004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6831","nonce":1080565004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1080565004},{"type":"v1","addr":"172.21.15.157:6829","nonce":1080565004}]},"public_addr":"172.21.15.157:6825/1080565004","cluster_addr":"172.21.15.157:6827/1080565004","heartbeat_back_addr":"172.21.15.157:6831/1080565004","heartbeat_front_addr":"172.21.15.157:6829/1080565004","state":["exists","up"]},{"osd":7,"uuid":"fc166f8d-f54d-4a5d-81a3-23ad10f3dea9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6809","nonce":939880062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6813","nonce":939880062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6820","nonce":939880062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":939880062},{"type":"v1","addr":"172.21.15.157:6817","nonce":939880062}]},"public_addr":"172.21.15.157:6809/939880062","cluster_addr":"172.21.15.157:6813/939880062","heartbeat_back_addr":"172.21.15.157:6820/939880062","heartbeat_front_addr":"172.21.15.157:6817/939880062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.359478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.315821+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.519607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.476446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.136816+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.137317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.225389+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:04:30.009847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 msgr2=0x7f80f406a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 0x7f80f406a7e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8104009b70 tx=0x7f8104008040 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 msgr2=0x7f81141488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f90 tx=0x7f810c00e530 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 shutdown_connections 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f80f4068320 0x7f80f406a7e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81141eddf0 0x7f81141488e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f811415c660 0x7f8114151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 --2- 172.21.15.148:0/3495873549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80f8003f40 0x7f8114159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 >> 172.21.15.148:0/3495873549 conn(0x7f811406c380 msgr2=0x7f81140c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 shutdown_connections 2024-04-26T23:14:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.360+0000 7f811a400640 1 -- 172.21.15.148:0/3495873549 wait complete. 2024-04-26T23:14:05.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:14:05.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 Processor -- start 2024-04-26T23:14:05.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 -- start start 2024-04-26T23:14:05.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29e006f460 0x7f29e015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e0153eb0 0x7f29e006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e00c96a0 con 0x7f29e006fd80 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f29e015ac00 con 0x7f29e006f460 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e8800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f29e0070210 con 0x7f29e0153eb0 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29e006f460 0x7f29e015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29e006f460 0x7f29e015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46180/0 (socket says 172.21.15.148:46180) 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 -- 172.21.15.148:0/1013752129 learned_addr learned my addr 172.21.15.148:0/1013752129 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5400640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e0153eb0 0x7f29e006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 -- 172.21.15.148:0/1013752129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e0153eb0 msgr2=0x7f29e006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e0153eb0 0x7f29e006f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 -- 172.21.15.148:0/1013752129 >> v1:172.21.15.157:6789/0 conn(0x7f29e006fd80 legacy=0x7f29e00c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.520+0000 7f29e5e00640 1 -- 172.21.15.148:0/1013752129 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e00c9980 con 0x7f29e006f460 2024-04-26T23:14:05.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e5e00640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e015a6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098a0 tx=0x7f29d401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53569384e4850f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e4a00640 1 -- 172.21.15.148:0/1013752129 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b5070 con 0x7f29e006f460 2024-04-26T23:14:05.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e4a00640 1 -- 172.21.15.148:0/1013752129 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f29d40a8a30 con 0x7f29e006f460 2024-04-26T23:14:05.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e4a00640 1 -- 172.21.15.148:0/1013752129 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40a8e20 con 0x7f29e006f460 2024-04-26T23:14:05.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- 172.21.15.148:0/1013752129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 msgr2=0x7f29e015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e015a6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098a0 tx=0x7f29d401ed30 comp rx=0 tx=0).stop 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- 172.21.15.148:0/1013752129 shutdown_connections 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e0153eb0 0x7f29e006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 --2- 172.21.15.148:0/1013752129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e015a6c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- 172.21.15.148:0/1013752129 >> 172.21.15.148:0/1013752129 conn(0x7f29e00c9d10 msgr2=0x7f29e00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- 172.21.15.148:0/1013752129 shutdown_connections 2024-04-26T23:14:05.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- 172.21.15.148:0/1013752129 wait complete. 2024-04-26T23:14:05.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 Processor -- start 2024-04-26T23:14:05.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.524+0000 7f29e8800640 1 -- start start 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e006fd80 0x7f29e01f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29e01471e0 0x7f29e01f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00c5120 con 0x7f29e006f460 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00708f0 con 0x7f29e01471e0 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f29e00c4d70 con 0x7f29e006fd80 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46188/0 (socket says 172.21.15.148:46188) 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 -- 172.21.15.148:0/2952740777 learned_addr learned my addr 172.21.15.148:0/2952740777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5400640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e006fd80 0x7f29e01f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e6800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29e01471e0 0x7f29e01f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 -- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e006fd80 msgr2=0x7f29e01f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e006fd80 0x7f29e01f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 -- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29e01471e0 msgr2=0x7f29e01f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29e01471e0 0x7f29e01f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 -- 172.21.15.148:0/2952740777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e014b930 con 0x7f29e006f460 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e5e00640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29d40b3040 tx=0x7f29d401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b5070 con 0x7f29e006f460 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f29d40b0c20 con 0x7f29e006f460 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e014bc10 con 0x7f29e006f460 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40bb410 con 0x7f29e006f460 2024-04-26T23:14:05.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e014c1d0 con 0x7f29e006f460 2024-04-26T23:14:05.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.528+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0077c20 con 0x7f29e006f460 2024-04-26T23:14:05.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.532+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f29d40c2060 con 0x7f29e006f460 2024-04-26T23:14:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.532+0000 7f29da000640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 0x7f29c406a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.532+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f29d4124140 con 0x7f29e006f460 2024-04-26T23:14:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.532+0000 7f29e5400640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 0x7f29c406a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.532+0000 7f29e5400640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 0x7f29c406a860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f29e015a1d0 tx=0x7f29d0008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.536+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f29d4018890 con 0x7f29e006f460 2024-04-26T23:14:05.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.724+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f29e0070c20 con 0x7f29e006f460 2024-04-26T23:14:05.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29da000640 1 -- 172.21.15.148:0/2952740777 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f29d40af3a0 con 0x7f29e006f460 2024-04-26T23:14:05.725 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:14:05.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 msgr2=0x7f29c406a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 0x7f29c406a860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f29e015a1d0 tx=0x7f29d0008040 comp rx=0 tx=0).stop 2024-04-26T23:14:05.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 msgr2=0x7f29e0144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29d40b3040 tx=0x7f29d401bad0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 shutdown_connections 2024-04-26T23:14:05.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f29c40683a0 0x7f29c406a860 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29e01471e0 0x7f29e01f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29e006fd80 0x7f29e01f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 --2- 172.21.15.148:0/2952740777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29e006f460 0x7f29e0144570 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.728+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 >> 172.21.15.148:0/2952740777 conn(0x7f29e00c9d10 msgr2=0x7f29e0149f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.732+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 shutdown_connections 2024-04-26T23:14:05.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.732+0000 7f29e8800640 1 -- 172.21.15.148:0/2952740777 wait complete. 2024-04-26T23:14:05.749 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:14:05.813 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-04-26T23:14:05.832 INFO:tasks.ceph.mds.f.smithi157.stdout:starting mds.f at 2024-04-26T23:14:05.832 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 Processor -- start 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 -- start start 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a41601b0 con 0x7f83a40ccc10 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a406d610 con 0x7f83a40b1f60 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83abe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83a415f3f0 con 0x7f83a4155e80 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a8a00640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f83a40ccc10 0x7f83a406ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60866/0 (socket says 172.21.15.148:60866) 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a8a00640 1 -- 172.21.15.148:0/1164342385 learned_addr learned my addr 172.21.15.148:0/1164342385 (peer_addr_for_me v1:172.21.15.148:0/0) 2024-04-26T23:14:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a9400640 1 --2- 172.21.15.148:0/1164342385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137015977 0 0) 0x7f83a41601b0 con 0x7f83a40ccc10 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f838c003530 con 0x7f83a40ccc10 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469088075 0 0) 0x7f83a406d610 con 0x7f83a40b1f60 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a41601b0 con 0x7f83a40b1f60 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a9400640 1 -- 172.21.15.148:0/1164342385 >> v1:172.21.15.157:6789/0 conn(0x7f83a40b1f60 legacy=0x7f83a41665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a9400640 1 -- 172.21.15.148:0/1164342385 >> v1:172.21.15.148:6789/0 conn(0x7f83a40ccc10 legacy=0x7f83a406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.892+0000 7f83a9400640 1 -- 172.21.15.148:0/1164342385 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a415f6d0 con 0x7f83a4155e80 2024-04-26T23:14:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83a9400640 1 --2- 172.21.15.148:0/1164342385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a415bc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8398009dc0 tx=0x7f839801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47a0f1c5903f43a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83980a66c0 con 0x7f83a4155e80 2024-04-26T23:14:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f83980a6860 con 0x7f83a4155e80 2024-04-26T23:14:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83a3e00640 1 -- 172.21.15.148:0/1164342385 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83980a6c10 con 0x7f83a4155e80 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 -- 172.21.15.148:0/1164342385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 msgr2=0x7f83a415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 --2- 172.21.15.148:0/1164342385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a415bc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8398009dc0 tx=0x7f839801c900 comp rx=0 tx=0).stop 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 -- 172.21.15.148:0/1164342385 shutdown_connections 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 --2- 172.21.15.148:0/1164342385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a415bc60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 -- 172.21.15.148:0/1164342385 >> 172.21.15.148:0/1164342385 conn(0x7f83a4068140 msgr2=0x7f83a4068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 -- 172.21.15.148:0/1164342385 shutdown_connections 2024-04-26T23:14:05.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.896+0000 7f83abe00640 1 -- 172.21.15.148:0/1164342385 wait complete. 2024-04-26T23:14:05.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 Processor -- start 2024-04-26T23:14:05.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- start start 2024-04-26T23:14:05.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83a40b1f60 0x7f83a40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a41f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4070790 con 0x7f83a40ccc10 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4070610 con 0x7f83a40b1f60 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83a416a520 con 0x7f83a4155e80 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46204/0 (socket says 172.21.15.148:46204) 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 -- 172.21.15.148:0/3021950163 learned_addr learned my addr 172.21.15.148:0/3021950163 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a9400640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83a40b1f60 0x7f83a40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a9e00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a41f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 -- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 msgr2=0x7f83a41f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a41f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 -- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83a40b1f60 msgr2=0x7f83a40cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83a40b1f60 0x7f83a40cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 -- 172.21.15.148:0/3021950163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4157fc0 con 0x7f83a40ccc10 2024-04-26T23:14:05.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a9e00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a41f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a8a00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f839000c450 tx=0x7f839000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390017070 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8390005cf0 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900072d0 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a4157440 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.900+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a4157a00 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a4077c20 con 0x7f83a40ccc10 2024-04-26T23:14:05.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f839001a070 con 0x7f83a40ccc10 2024-04-26T23:14:05.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83a1600640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 0x7f838406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:05.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6993+0+0 (secure 0 0 0) 0x7f8390086310 con 0x7f83a40ccc10 2024-04-26T23:14:05.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83a9400640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 0x7f838406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:05.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.904+0000 7f83a9400640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 0x7f838406a840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83980af000 tx=0x7f83980a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:05.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:05.908+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8390055c40 con 0x7f83a40ccc10 2024-04-26T23:14:06.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.100+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f83a40ca540 con 0x7f83a40ccc10 2024-04-26T23:14:06.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83a1600640 1 -- 172.21.15.148:0/3021950163 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f8390059f40 con 0x7f83a40ccc10 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 msgr2=0x7f838406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 0x7f838406a840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83980af000 tx=0x7f83980a7000 comp rx=0 tx=0).stop 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 msgr2=0x7f83a41567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f839000c450 tx=0x7f839000c910 comp rx=0 tx=0).stop 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 shutdown_connections 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f8384068380 0x7f838406a840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83a4155e80 0x7f83a41f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83a40ccc10 0x7f83a41567b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 --2- 172.21.15.148:0/3021950163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83a40b1f60 0x7f83a40cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 >> 172.21.15.148:0/3021950163 conn(0x7f83a4068140 msgr2=0x7f83a414af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:06.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 shutdown_connections 2024-04-26T23:14:06.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.736+0000 7f83abe00640 1 -- 172.21.15.148:0/3021950163 wait complete. 2024-04-26T23:14:06.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:14:06.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 Processor -- start 2024-04-26T23:14:06.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 -- start start 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3614153df0 0x7f36140c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36141541d0 0x7f36140c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361415a820 con 0x7f36140c8c90 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f36140c7c90 con 0x7f36141541d0 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.900+0000 7f361b800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f361415aac0 con 0x7f3614153df0 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36141541d0 0x7f36140c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36141541d0 0x7f36140c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41290/0 (socket says 172.21.15.148:41290) 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 -- 172.21.15.148:0/1976804087 learned_addr learned my addr 172.21.15.148:0/1976804087 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:06.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3619800640 1 --1- 172.21.15.148:0/1976804087 >> v1:172.21.15.148:6789/0 conn(0x7f36140c8c90 0x7f36140c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59678/0 (socket says 172.21.15.148:59678) 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3618e00640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3614153df0 0x7f36140c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 -- 172.21.15.148:0/1976804087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3614153df0 msgr2=0x7f36140c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3614153df0 0x7f36140c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 -- 172.21.15.148:0/1976804087 >> v1:172.21.15.148:6789/0 conn(0x7f36140c8c90 legacy=0x7f36140c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 -- 172.21.15.148:0/1976804087 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36140c7f50 con 0x7f36141541d0 2024-04-26T23:14:06.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3613e00640 1 -- 172.21.15.148:0/1976804087 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590778532 0 0) 0x7f361415a820 con 0x7f36140c8c90 2024-04-26T23:14:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f360be00640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141541d0 0x7f36140c8750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dbb6059faac988 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3613e00640 1 -- 172.21.15.148:0/1976804087 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0aa610 con 0x7f36141541d0 2024-04-26T23:14:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3613e00640 1 -- 172.21.15.148:0/1976804087 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35fc0af070 con 0x7f36141541d0 2024-04-26T23:14:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.904+0000 7f3613e00640 1 -- 172.21.15.148:0/1976804087 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0aa9f0 con 0x7f36141541d0 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- 172.21.15.148:0/1976804087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141541d0 msgr2=0x7f36140c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141541d0 0x7f36140c8750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- 172.21.15.148:0/1976804087 shutdown_connections 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141541d0 0x7f36140c8750 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- 172.21.15.148:0/1976804087 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3614153df0 0x7f36140c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- 172.21.15.148:0/1976804087 >> 172.21.15.148:0/1976804087 conn(0x7f36140c9d10 msgr2=0x7f36140ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- 172.21.15.148:0/1976804087 shutdown_connections 2024-04-26T23:14:06.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- 172.21.15.148:0/1976804087 wait complete. 2024-04-26T23:14:06.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 Processor -- start 2024-04-26T23:14:06.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- start start 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 0x7f36141f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36141541d0 0x7f3614072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3614166810 con 0x7f36140c8c90 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3614166690 con 0x7f3614153df0 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f361b800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3614166990 con 0x7f36141541d0 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41298/0 (socket says 172.21.15.148:41298) 2024-04-26T23:14:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 -- 172.21.15.148:0/1160632379 learned_addr learned my addr 172.21.15.148:0/1160632379 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3619800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36141541d0 0x7f3614072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f360be00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 0x7f36141f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 -- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36141541d0 msgr2=0x7f3614072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36141541d0 0x7f3614072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 -- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 msgr2=0x7f36141f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 0x7f36141f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f3618e00640 1 -- 172.21.15.148:0/1160632379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361414df10 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.908+0000 7f360be00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 0x7f36141f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3618e00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f360400e960 tx=0x7f360400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604017070 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f360400ca00 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361414e460 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360400cdd0 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36141f8cf0 con 0x7f36140c8c90 2024-04-26T23:14:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3614077c20 con 0x7f36140c8c90 2024-04-26T23:14:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f360401a070 con 0x7f36140c8c90 2024-04-26T23:14:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 0x7f35f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6993+0+0 (secure 0 0 0) 0x7f3604086ff0 con 0x7f36140c8c90 2024-04-26T23:14:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.912+0000 7f360be00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 0x7f35f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.916+0000 7f360be00640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 0x7f35f006a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ae000 tx=0x7f35fc0a7000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:06.916+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3604057000 con 0x7f36140c8c90 2024-04-26T23:14:07.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.076+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3614157720 con 0x7f36140c8c90 2024-04-26T23:14:07.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.736+0000 7f3611600640 1 -- 172.21.15.148:0/1160632379 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f3604056900 con 0x7f36140c8c90 2024-04-26T23:14:07.735 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 msgr2=0x7f35f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 0x7f35f006a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ae000 tx=0x7f35fc0a7000 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 msgr2=0x7f3614148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f360400e960 tx=0x7f360400ee20 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 shutdown_connections 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f35f0068380 0x7f35f006a840 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36141541d0 0x7f3614072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3614153df0 0x7f36141f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 --2- 172.21.15.148:0/1160632379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36140c8c90 0x7f3614148610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 >> 172.21.15.148:0/1160632379 conn(0x7f36140c9d10 msgr2=0x7f36140ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:07.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 shutdown_connections 2024-04-26T23:14:07.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.740+0000 7f361b800640 1 -- 172.21.15.148:0/1160632379 wait complete. 2024-04-26T23:14:07.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:14:07.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.924+0000 7f9b75400640 1 Processor -- start 2024-04-26T23:14:07.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.924+0000 7f9b75400640 1 -- start start 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b75400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9b700c9760 0x7f9b70152880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b75400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b7006f810 0x7f9b70152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b75400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7015ce80 con 0x7f9b7015c0e0 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b75400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7015cbd0 con 0x7f9b7006f810 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b75400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9b700c6f80 con 0x7f9b700c9760 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b7006f810 0x7f9b70152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b7006f810 0x7f9b70152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41308/0 (socket says 172.21.15.148:41308) 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 -- 172.21.15.148:0/3854313090 learned_addr learned my addr 172.21.15.148:0/3854313090 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6de00640 1 --2- 172.21.15.148:0/3854313090 >> v2:172.21.15.157:3300/0 conn(0x7f9b700c9760 0x7f9b70152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 -- 172.21.15.148:0/3854313090 >> v2:172.21.15.157:3300/0 conn(0x7f9b700c9760 msgr2=0x7f9b70152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 --2- 172.21.15.148:0/3854313090 >> v2:172.21.15.157:3300/0 conn(0x7f9b700c9760 0x7f9b70152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 -- 172.21.15.148:0/3854313090 >> v1:172.21.15.157:6789/0 conn(0x7f9b7015c0e0 legacy=0x7f9b7015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 -- 172.21.15.148:0/3854313090 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b700c7520 con 0x7f9b7006f810 2024-04-26T23:14:07.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.928+0000 7f9b6f200640 1 --2- 172.21.15.148:0/3854313090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b7006f810 0x7f9b70152dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b7006d8a0 tx=0x7f9b6801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eafdf007df46ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:07.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6d400640 1 -- 172.21.15.148:0/3854313090 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b680b4070 con 0x7f9b7006f810 2024-04-26T23:14:07.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6d400640 1 -- 172.21.15.148:0/3854313090 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9b680af400 con 0x7f9b7006f810 2024-04-26T23:14:07.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6d400640 1 -- 172.21.15.148:0/3854313090 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b680af7f0 con 0x7f9b7006f810 2024-04-26T23:14:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- 172.21.15.148:0/3854313090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b7006f810 msgr2=0x7f9b70152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- 172.21.15.148:0/3854313090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b7006f810 0x7f9b70152dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b7006d8a0 tx=0x7f9b6801f1e0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- 172.21.15.148:0/3854313090 shutdown_connections 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- 172.21.15.148:0/3854313090 >> v2:172.21.15.157:3300/0 conn(0x7f9b700c9760 0x7f9b70152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- 172.21.15.148:0/3854313090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b7006f810 0x7f9b70152dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- 172.21.15.148:0/3854313090 >> 172.21.15.148:0/3854313090 conn(0x7f9b700c9d10 msgr2=0x7f9b700ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- 172.21.15.148:0/3854313090 shutdown_connections 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- 172.21.15.148:0/3854313090 wait complete. 2024-04-26T23:14:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 Processor -- start 2024-04-26T23:14:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- start start 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b7006f810 0x7f9b70162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b7015c0e0 0x7f9b701638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9b700c4a90 con 0x7f9b700c9760 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9b700c47b0 con 0x7f9b7015c0e0 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b75400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9b700c4d70 con 0x7f9b7006f810 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41316/0 (socket says 172.21.15.148:41316) 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6de00640 1 -- 172.21.15.148:0/4028473753 learned_addr learned my addr 172.21.15.148:0/4028473753 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6f200640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b7015c0e0 0x7f9b701638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.932+0000 7f9b6e800640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b7006f810 0x7f9b70162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 -- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b7006f810 msgr2=0x7f9b70162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b7006f810 0x7f9b70162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 -- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b7015c0e0 msgr2=0x7f9b701638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b7015c0e0 0x7f9b701638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 -- 172.21.15.148:0/4028473753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b701f26e0 con 0x7f9b700c9760 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6de00640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00d5f0 tx=0x7f9b5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0125f0 con 0x7f9b700c9760 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9b5c019070 con 0x7f9b700c9760 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0129d0 con 0x7f9b700c9760 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b70164520 con 0x7f9b700c9760 2024-04-26T23:14:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701f1c00 con 0x7f9b700c9760 2024-04-26T23:14:07.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b70077c20 con 0x7f9b700c9760 2024-04-26T23:14:07.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b5c012b70 con 0x7f9b700c9760 2024-04-26T23:14:07.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 0x7f9b5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:07.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6555+0+0 (secure 0 0 0) 0x7f9b5c0870e0 con 0x7f9b700c9760 2024-04-26T23:14:07.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.936+0000 7f9b6e800640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 0x7f9b5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:07.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.940+0000 7f9b6e800640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 0x7f9b5006a840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b60001810 tx=0x7f9b60009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:07.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:07.940+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b5c056c60 con 0x7f9b700c9760 2024-04-26T23:14:08.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.096+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9b70072990 con 0x7f9b700c9760 2024-04-26T23:14:08.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.744+0000 7f9b66a00640 1 -- 172.21.15.148:0/4028473753 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f9b5c05af60 con 0x7f9b700c9760 2024-04-26T23:14:08.743 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2024-04-26T23:14:08.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 msgr2=0x7f9b5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:08.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 0x7f9b5006a840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b60001810 tx=0x7f9b60009040 comp rx=0 tx=0).stop 2024-04-26T23:14:08.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 msgr2=0x7f9b70164ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:08.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00d5f0 tx=0x7f9b5c00dab0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 shutdown_connections 2024-04-26T23:14:08.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f9b50068380 0x7f9b5006a840 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b7015c0e0 0x7f9b701638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700c9760 0x7f9b70164ff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 --2- 172.21.15.148:0/4028473753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b7006f810 0x7f9b70162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 >> 172.21.15.148:0/4028473753 conn(0x7f9b700c9d10 msgr2=0x7f9b700734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:08.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 shutdown_connections 2024-04-26T23:14:08.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.748+0000 7f9b75400640 1 -- 172.21.15.148:0/4028473753 wait complete. 2024-04-26T23:14:08.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T23:14:08.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.916+0000 7f0c69400640 1 Processor -- start 2024-04-26T23:14:08.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.916+0000 7f0c69400640 1 -- start start 2024-04-26T23:14:08.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c69400640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c6415c0e0 0x7f0c6415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c69400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c640c9760 0x7f0c64073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c69400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6415ce80 con 0x7f0c6415ca00 2024-04-26T23:14:08.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c69400640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 -- 0x7f0c640c6f80 con 0x7f0c6415c0e0 2024-04-26T23:14:08.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c69400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0c640c7520 con 0x7f0c640c9760 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c6415c0e0 0x7f0c6415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c6415c0e0 0x7f0c6415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41320/0 (socket says 172.21.15.148:41320) 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 -- 172.21.15.148:0/2696540 learned_addr learned my addr 172.21.15.148:0/2696540 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c63200640 1 --2- 172.21.15.148:0/2696540 >> v2:172.21.15.157:3300/0 conn(0x7f0c640c9760 0x7f0c64073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 -- 172.21.15.148:0/2696540 >> v2:172.21.15.157:3300/0 conn(0x7f0c640c9760 msgr2=0x7f0c64073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 --2- 172.21.15.148:0/2696540 >> v2:172.21.15.157:3300/0 conn(0x7f0c640c9760 0x7f0c64073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 -- 172.21.15.148:0/2696540 >> v1:172.21.15.157:6789/0 conn(0x7f0c6415ca00 legacy=0x7f0c64152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:14:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.920+0000 7f0c62800640 1 -- 172.21.15.148:0/2696540 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640c7240 con 0x7f0c6415c0e0 2024-04-26T23:14:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c62800640 1 --2- 172.21.15.148:0/2696540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415c0e0 0x7f0c6415c4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c64159b00 tx=0x7f0c540213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f004ee26e74e949c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c61e00640 1 -- 172.21.15.148:0/2696540 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c540b6070 con 0x7f0c6415c0e0 2024-04-26T23:14:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c61e00640 1 -- 172.21.15.148:0/2696540 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c5400b2d0 con 0x7f0c6415c0e0 2024-04-26T23:14:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c61e00640 1 -- 172.21.15.148:0/2696540 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400b480 con 0x7f0c6415c0e0 2024-04-26T23:14:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- 172.21.15.148:0/2696540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415c0e0 msgr2=0x7f0c6415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- 172.21.15.148:0/2696540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415c0e0 0x7f0c6415c4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c64159b00 tx=0x7f0c540213a0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- 172.21.15.148:0/2696540 shutdown_connections 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- 172.21.15.148:0/2696540 >> v2:172.21.15.157:3300/0 conn(0x7f0c640c9760 0x7f0c64073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- 172.21.15.148:0/2696540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415c0e0 0x7f0c6415c4c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- 172.21.15.148:0/2696540 >> 172.21.15.148:0/2696540 conn(0x7f0c640c9d10 msgr2=0x7f0c640ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- 172.21.15.148:0/2696540 shutdown_connections 2024-04-26T23:14:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- 172.21.15.148:0/2696540 wait complete. 2024-04-26T23:14:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 Processor -- start 2024-04-26T23:14:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- start start 2024-04-26T23:14:08.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 0x7f0c641f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c6415c0e0 0x7f0c641f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640c4d70 con 0x7f0c6415ca00 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640c4a90 con 0x7f0c640c9760 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.924+0000 7f0c69400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0c640723d0 con 0x7f0c6415c0e0 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41336/0 (socket says 172.21.15.148:41336) 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 -- 172.21.15.148:0/3144562779 learned_addr learned my addr 172.21.15.148:0/3144562779 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c62800640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 0x7f0c641f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c59e00640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c6415c0e0 0x7f0c641f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 -- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c6415c0e0 msgr2=0x7f0c641f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c6415c0e0 0x7f0c641f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 -- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 msgr2=0x7f0c641f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 0x7f0c641f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:08.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 -- 172.21.15.148:0/3144562779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c64155970 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c62800640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 0x7f0c641f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c63200640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006e90 tx=0x7f0c5c00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0125f0 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c5c019070 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0129f0 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6415b320 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c641f51a0 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c64077c20 con 0x7f0c6415ca00 2024-04-26T23:14:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.928+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c5c012b90 con 0x7f0c6415ca00 2024-04-26T23:14:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.932+0000 7f0c5b400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 0x7f0c4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:14:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.932+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6025+0+0 (secure 0 0 0) 0x7f0c5c086fc0 con 0x7f0c6415ca00 2024-04-26T23:14:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.932+0000 7f0c62800640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 0x7f0c4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:14:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.932+0000 7f0c62800640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 0x7f0c4006a840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c540b3000 tx=0x7f0c540ac000 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:14:08.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:08.936+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c5c057390 con 0x7f0c6415ca00 2024-04-26T23:14:09.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.096+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c640736c0 con 0x7f0c6415ca00 2024-04-26T23:14:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.748+0000 7f0c5b400640 1 -- 172.21.15.148:0/3144562779 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f0c5c056c90 con 0x7f0c6415ca00 2024-04-26T23:14:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data_ec' removed 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 msgr2=0x7f0c4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 0x7f0c4006a840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c540b3000 tx=0x7f0c540ac000 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 msgr2=0x7f0c64070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006e90 tx=0x7f0c5c00d9e0 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 shutdown_connections 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:6832/726741875,v1:172.21.15.157:6833/726741875] conn(0x7f0c40068380 0x7f0c4006a840 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c6415ca00 0x7f0c64070410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c6415c0e0 0x7f0c641f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 --2- 172.21.15.148:0/3144562779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c640c9760 0x7f0c641f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 >> 172.21.15.148:0/3144562779 conn(0x7f0c640c9d10 msgr2=0x7f0c640cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:14:09.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 shutdown_connections 2024-04-26T23:14:09.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-26T23:14:09.752+0000 7f0c69400640 1 -- 172.21.15.148:0/3144562779 wait complete. 2024-04-26T23:14:09.788 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T23:14:09.788 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:14:09.788 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:09.804 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:14:09.805 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:14:09.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:09.861 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:14:09.861 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-26T23:14:09.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:09.916 INFO:tasks.ceph.mds.e:Stopped 2024-04-26T23:14:09.916 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:14:09.916 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:09.929 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:14:09.930 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:14:09.930 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:09.987 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:14:09.988 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-26T23:14:09.988 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:10.045 INFO:tasks.ceph.mds.f:Stopped 2024-04-26T23:14:10.045 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T23:14:10.045 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T23:14:10.045 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:10.136 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T23:14:10.137 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T23:14:10.137 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:10.237 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T23:14:10.237 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T23:14:10.237 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:10.338 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T23:14:10.338 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T23:14:10.338 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:12.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T23:14:14.883 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:14.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:16.439 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T23:14:16.440 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T23:14:16.440 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:18.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-26T23:14:18.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T23:14:22.542 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T23:14:22.543 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T23:14:22.543 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:22.643 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T23:14:22.644 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T23:14:22.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:22.736 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T23:14:22.737 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T23:14:22.737 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:23.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-26T23:14:23.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-26T23:14:28.839 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T23:14:28.839 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T23:14:28.840 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T23:14:28.840 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:28.894 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T23:14:28.895 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T23:14:28.895 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:28.924 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T23:14:28.924 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T23:14:28.924 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:14:28.924 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:28.941 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:14:28.941 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:14:28.941 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:28.980 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:14:28.981 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:14:28.981 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:14:29.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2024-04-26T23:14:29.036 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:14:29.036 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T23:14:29.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-04-26T23:14:29.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:14:29.085 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T23:14:29.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:14:29.366 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T23:14:29.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:14:29.590 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T23:14:29.777 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:14:29.777 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T23:14:29.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:14:29.987 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T23:14:30.229 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:14:30.229 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T23:14:30.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:14:30.430 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T23:14:30.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:14:30.592 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T23:14:30.740 INFO:tasks.ceph:Archiving mon data... 2024-04-26T23:14:30.742 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/data/mon.a.tgz 2024-04-26T23:14:30.742 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-04-26T23:14:30.751 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.Hc9xpOiWKy 2024-04-26T23:14:30.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Hc9xpOiWKy 2024-04-26T23:14:30.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.Hc9xpOiWKy 2024-04-26T23:14:30.980 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.Hc9xpOiWKy is 495KB 2024-04-26T23:14:31.046 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.Hc9xpOiWKy 2024-04-26T23:14:31.054 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/data/mon.b.tgz 2024-04-26T23:14:31.054 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-26T23:14:31.060 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.VCfg04Eq77 2024-04-26T23:14:31.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VCfg04Eq77 2024-04-26T23:14:31.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.VCfg04Eq77 2024-04-26T23:14:31.281 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.VCfg04Eq77 is 513KB 2024-04-26T23:14:31.343 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.VCfg04Eq77 2024-04-26T23:14:31.348 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/data/mon.c.tgz 2024-04-26T23:14:31.349 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-26T23:14:31.397 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.7BUpOwgQRw 2024-04-26T23:14:31.398 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7BUpOwgQRw 2024-04-26T23:14:31.556 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.7BUpOwgQRw 2024-04-26T23:14:31.620 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.7BUpOwgQRw is 519KB 2024-04-26T23:14:31.687 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.7BUpOwgQRw 2024-04-26T23:14:31.691 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T23:14:31.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:14:31.695 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:14:31.764 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:14:31.793 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:14:31.793 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T23:14:31.795 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi148/crash 2024-04-26T23:14:31.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:14:31.828 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi157/crash 2024-04-26T23:14:31.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:14:31.849 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T23:14:31.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:31.874 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:31.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:31.954 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:14:31.988 INFO:tasks.ceph:Compressing logs... 2024-04-26T23:14:31.988 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:14:31.998 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:14:32.027 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-04-26T23:14:32.027 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36331.log 2024-04-26T23:14:32.028 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37347.log 2024-04-26T23:14:32.029 INFO:teuthology.orchestra.run.smithi148.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-04-26T23:14:32.029 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-04-26T23:14:32.029 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36331.log.gz 2024-04-26T23:14:32.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33902.log 2024-04-26T23:14:32.030 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz 2024-04-26T23:14:32.031 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35299.log 2024-04-26T23:14:32.031 INFO:teuthology.orchestra.run.smithi148.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-04-26T23:14:32.032 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35601.log 2024-04-26T23:14:32.032 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33902.log.gz 2024-04-26T23:14:32.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35112.log 2024-04-26T23:14:32.033 INFO:teuthology.orchestra.run.smithi148.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.35299.log.gz 2024-04-26T23:14:32.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-04-26T23:14:32.033 INFO:teuthology.orchestra.run.smithi148.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35601.log.gz 2024-04-26T23:14:32.035 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27658.log 2024-04-26T23:14:32.035 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35112.log.gz 2024-04-26T23:14:32.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33772.log 2024-04-26T23:14:32.036 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-04-26T23:14:32.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35839.log 2024-04-26T23:14:32.037 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27658.log.gz 2024-04-26T23:14:32.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36453.log 2024-04-26T23:14:32.037 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33772.log.gz 2024-04-26T23:14:32.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35839.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T23:14:32.038 INFO:teuthology.orchestra.run.smithi148.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.35839.log.gz 2024-04-26T23:14:32.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34404.log 2024-04-26T23:14:32.038 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36453.log.gz 2024-04-26T23:14:32.039 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37137.log 2024-04-26T23:14:32.040 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2024-04-26T23:14:32.040 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34404.log.gz 2024-04-26T23:14:32.041 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-04-26T23:14:32.041 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37137.log.gz 2024-04-26T23:14:32.042 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31805.log 2024-04-26T23:14:32.042 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2024-04-26T23:14:32.043 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-04-26T23:14:32.043 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-04-26T23:14:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-04-26T23:14:32.044 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31805.log.gz 2024-04-26T23:14:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35731.log 2024-04-26T23:14:32.045 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz 2024-04-26T23:14:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33175.log 2024-04-26T23:14:32.046 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-04-26T23:14:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35731.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T23:14:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36302.log 2024-04-26T23:14:32.047 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35731.log.gz 2024-04-26T23:14:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32069.log 2024-04-26T23:14:32.047 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33175.log.gz 2024-04-26T23:14:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37583.log 2024-04-26T23:14:32.049 INFO:teuthology.orchestra.run.smithi148.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.36302.log.gz 2024-04-26T23:14:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32992.log 2024-04-26T23:14:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37583.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.32069.log.gz 2024-04-26T23:14:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35138.log 2024-04-26T23:14:32.050 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37583.log.gz 2024-04-26T23:14:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-04-26T23:14:32.051 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32992.log.gz 2024-04-26T23:14:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35138.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T23:14:32.052 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35138.log.gz 2024-04-26T23:14:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32305.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.38345.log -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-04-26T23:14:32.052 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-04-26T23:14:32.053 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2024-04-26T23:14:32.054 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31913.log 2024-04-26T23:14:32.054 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38345.log.gz 2024-04-26T23:14:32.055 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33588.log 2024-04-26T23:14:32.055 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2024-04-26T23:14:32.055 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2024-04-26T23:14:32.056 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31913.log.gz 2024-04-26T23:14:32.056 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T23:14:32.057 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T23:14:32.059 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2024-04-26T23:14:32.059 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33588.log.gz 2024-04-26T23:14:32.059 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34885.log 2024-04-26T23:14:32.059 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2024-04-26T23:14:32.059 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-04-26T23:14:32.060 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2024-04-26T23:14:32.060 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35243.log 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28257.log 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28257.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28121.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28257.log.gz 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28097.log 2024-04-26T23:14:32.062 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28097.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28097.log.gz 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28233.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28185.log 2024-04-26T23:14:32.063 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28233.log.gz 2024-04-26T23:14:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:14:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28185.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28185.log.gz 2024-04-26T23:14:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T23:14:32.067 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34885.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34911.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32017.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35243.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34911.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32017.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32017.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38490.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35351.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35575.log 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38490.log.gz 2024-04-26T23:14:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2024-04-26T23:14:32.069 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35351.log.gz 2024-04-26T23:14:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2024-04-26T23:14:32.069 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35575.log.gz 2024-04-26T23:14:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35523.log 2024-04-26T23:14:32.069 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2024-04-26T23:14:32.073 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:14:32.073 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28281.log 2024-04-26T23:14:32.073 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.d.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:14:32.073 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28161.log 2024-04-26T23:14:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28281.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28281.log.gz 2024-04-26T23:14:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T23:14:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28161.log.gz 2024-04-26T23:14:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34612.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35523.log.gz 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35627.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34612.log.gz 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33200.log 2024-04-26T23:14:32.075 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35627.log.gz 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35190.log 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37399.log 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33200.log.gz 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33386.log 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35190.log.gz 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-04-26T23:14:32.076 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37399.log.gz 2024-04-26T23:14:32.077 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32566.log 2024-04-26T23:14:32.078 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33386.log.gz 2024-04-26T23:14:32.078 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-04-26T23:14:32.078 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-04-26T23:14:32.078 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-04-26T23:14:32.078 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32566.log.gz 2024-04-26T23:14:32.079 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-04-26T23:14:32.079 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-04-26T23:14:32.079 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37862.log 2024-04-26T23:14:32.079 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-04-26T23:14:32.080 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-04-26T23:14:32.080 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-04-26T23:14:32.081 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36872.log 2024-04-26T23:14:32.081 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-04-26T23:14:32.082 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32247.log 2024-04-26T23:14:32.082 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-04-26T23:14:32.082 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35434.log 2024-04-26T23:14:32.083 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36872.log.gz 2024-04-26T23:14:32.083 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-04-26T23:14:32.084 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35434.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T23:14:32.084 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35434.log.gz 2024-04-26T23:14:32.084 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T23:14:32.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37028.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.32247.log.gz 2024-04-26T23:14:32.086 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34639.log 2024-04-26T23:14:32.086 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-04-26T23:14:32.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37968.log 2024-04-26T23:14:32.087 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32409.log 2024-04-26T23:14:32.087 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34639.log.gz 2024-04-26T23:14:32.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37968.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37968.log.gz 2024-04-26T23:14:32.088 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31619.log 2024-04-26T23:14:32.089 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35164.log 2024-04-26T23:14:32.089 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32409.log.gz 2024-04-26T23:14:32.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2024-04-26T23:14:32.090 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31619.log.gz 2024-04-26T23:14:32.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-04-26T23:14:32.091 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35164.log.gz 2024-04-26T23:14:32.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-04-26T23:14:32.092 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2024-04-26T23:14:32.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35786.log 2024-04-26T23:14:32.093 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-04-26T23:14:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36016.log 2024-04-26T23:14:32.094 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-04-26T23:14:32.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37321.log 2024-04-26T23:14:32.095 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35786.log.gz 2024-04-26T23:14:32.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38103.log 2024-04-26T23:14:32.096 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36016.log.gz 2024-04-26T23:14:32.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37321.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T23:14:32.097 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37321.log.gz 2024-04-26T23:14:32.097 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38103.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38103.log.gz 2024-04-26T23:14:32.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-04-26T23:14:32.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33403.log 2024-04-26T23:14:32.099 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.32986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-04-26T23:14:32.099 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-04-26T23:14:32.100 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39167.log 2024-04-26T23:14:32.100 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33403.log.gz 2024-04-26T23:14:32.101 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-04-26T23:14:32.101 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-04-26T23:14:32.102 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31671.log 2024-04-26T23:14:32.102 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39167.log.gz 2024-04-26T23:14:32.103 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38568.log 2024-04-26T23:14:32.103 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-04-26T23:14:32.104 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35705.log 2024-04-26T23:14:32.104 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31671.log.gz 2024-04-26T23:14:32.105 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-26T23:14:32.106 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2024-04-26T23:14:32.106 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38568.log.gz 2024-04-26T23:14:32.106 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32782.log 2024-04-26T23:14:32.106 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28209.log 2024-04-26T23:14:32.107 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35705.log.gz 2024-04-26T23:14:32.107 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-04-26T23:14:32.107 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz 2024-04-26T23:14:32.108 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-04-26T23:14:32.108 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32782.log.gz 2024-04-26T23:14:32.109 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-04-26T23:14:32.109 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-04-26T23:14:32.109 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31965.log 2024-04-26T23:14:32.110 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-04-26T23:14:32.110 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39193.log 2024-04-26T23:14:32.111 INFO:teuthology.orchestra.run.smithi148.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-04-26T23:14:32.112 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T23:14:32.112 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37425.log 2024-04-26T23:14:32.112 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31965.log.gz 2024-04-26T23:14:32.113 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33191.log 2024-04-26T23:14:32.113 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39193.log.gz 2024-04-26T23:14:32.113 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32978.log 2024-04-26T23:14:32.114 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37425.log.gz 2024-04-26T23:14:32.114 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-04-26T23:14:32.114 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33191.log.gz 2024-04-26T23:14:32.115 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37191.log 2024-04-26T23:14:32.116 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32978.log.gz 2024-04-26T23:14:32.116 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33562.log 2024-04-26T23:14:32.116 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-04-26T23:14:32.117 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36146.log 2024-04-26T23:14:32.118 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37191.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37191.log.gz 2024-04-26T23:14:32.118 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37269.log 2024-04-26T23:14:32.118 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33562.log.gz 2024-04-26T23:14:32.119 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36198.log 2024-04-26T23:14:32.119 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36146.log.gz 2024-04-26T23:14:32.120 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2024-04-26T23:14:32.120 INFO:teuthology.orchestra.run.smithi148.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37269.log.gz 2024-04-26T23:14:32.121 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.28209.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28209.log.gz 2024-04-26T23:14:32.122 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33746.log 2024-04-26T23:14:32.122 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36198.log.gz 2024-04-26T23:14:32.122 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-04-26T23:14:32.122 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38933.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2024-04-26T23:14:32.123 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34057.log 2024-04-26T23:14:32.123 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33746.log.gz 2024-04-26T23:14:32.124 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38959.log 2024-04-26T23:14:32.124 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-04-26T23:14:32.125 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38265.log 2024-04-26T23:14:32.125 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38959.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.34057.log.gz 2024-04-26T23:14:32.126 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-04-26T23:14:32.126 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38959.log.gz 2024-04-26T23:14:32.127 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38265.log: /var/log/ceph/ceph-client.admin.32119.log 2024-04-26T23:14:32.127 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38265.log.gz 2024-04-26T23:14:32.128 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36820.log 2024-04-26T23:14:32.128 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-04-26T23:14:32.129 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-04-26T23:14:32.129 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32119.log.gz 2024-04-26T23:14:32.129 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31413.log 2024-04-26T23:14:32.130 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36820.log.gz 2024-04-26T23:14:32.131 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32488.log 2024-04-26T23:14:32.131 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-04-26T23:14:32.131 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35216.log 2024-04-26T23:14:32.132 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31413.log.gz 2024-04-26T23:14:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34326.log 2024-04-26T23:14:32.133 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32488.log.gz 2024-04-26T23:14:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-04-26T23:14:32.134 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35216.log.gz 2024-04-26T23:14:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-04-26T23:14:32.134 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34326.log.gz 2024-04-26T23:14:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39037.log 2024-04-26T23:14:32.136 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-04-26T23:14:32.136 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-04-26T23:14:32.136 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-04-26T23:14:32.137 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39037.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T23:14:32.137 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39037.log.gz 2024-04-26T23:14:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-04-26T23:14:32.138 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-04-26T23:14:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32756.log 2024-04-26T23:14:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-04-26T23:14:32.140 INFO:teuthology.orchestra.run.smithi148.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-04-26T23:14:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-04-26T23:14:32.141 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32756.log.gz 2024-04-26T23:14:32.142 INFO:teuthology.orchestra.run.smithi148.stderr:gzip/var/log/ceph/ceph-client.admin.34430.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37758.log 2024-04-26T23:14:32.142 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-04-26T23:14:32.143 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33798.log 2024-04-26T23:14:32.143 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-04-26T23:14:32.144 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-04-26T23:14:32.144 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37758.log.gz 2024-04-26T23:14:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31697.log 2024-04-26T23:14:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34700.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33798.log.gz 2024-04-26T23:14:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33694.log 2024-04-26T23:14:32.146 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-04-26T23:14:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-04-26T23:14:32.147 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31697.log.gz 2024-04-26T23:14:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2024-04-26T23:14:32.149 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33694.log.gz 2024-04-26T23:14:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31779.log 2024-04-26T23:14:32.150 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-04-26T23:14:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37503.log 2024-04-26T23:14:32.151 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2024-04-26T23:14:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38620.log 2024-04-26T23:14:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31779.log: /var/log/ceph/ceph-client.admin.37503.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31779.log.gz 2024-04-26T23:14:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32540.log 2024-04-26T23:14:32.153 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37503.log.gz 2024-04-26T23:14:32.154 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-04-26T23:14:32.154 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38620.log.gz 2024-04-26T23:14:32.154 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-04-26T23:14:32.155 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32540.log.gz 2024-04-26T23:14:32.156 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38542.log 2024-04-26T23:14:32.156 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-04-26T23:14:32.156 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37451.log 2024-04-26T23:14:32.157 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-04-26T23:14:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33642.log 2024-04-26T23:14:32.158 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38542.log.gz 2024-04-26T23:14:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32985.log 2024-04-26T23:14:32.159 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37451.log.gz 2024-04-26T23:14:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33642.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.33642.log.gz -- 2024-04-26T23:14:32.160 INFO:teuthology.orchestra.run.smithi148.stderr: /var/log/ceph/ceph-client.admin.36224.log 2024-04-26T23:14:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-04-26T23:14:32.161 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32985.log.gz 2024-04-26T23:14:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38155.log 2024-04-26T23:14:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36224.log: /var/log/ceph/ceph-client.admin.32704.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36224.log.gz 2024-04-26T23:14:32.163 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-04-26T23:14:32.163 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-04-26T23:14:32.164 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-04-26T23:14:32.164 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38155.log.gz 2024-04-26T23:14:32.165 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37243.log 2024-04-26T23:14:32.165 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-04-26T23:14:32.166 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36276.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T23:14:32.166 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-04-26T23:14:32.167 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35273.log 2024-04-26T23:14:32.167 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37243.log.gz 2024-04-26T23:14:32.168 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34302.log 2024-04-26T23:14:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-04-26T23:14:32.170 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35273.log.gz 2024-04-26T23:14:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.34302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34302.log.gz 2024-04-26T23:14:32.171 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27768.log 2024-04-26T23:14:32.172 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32981.log 2024-04-26T23:14:32.172 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-04-26T23:14:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-04-26T23:14:32.173 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27768.log.gz 2024-04-26T23:14:32.174 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32981.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32981.log.gz 2024-04-26T23:14:32.174 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-04-26T23:14:32.175 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2024-04-26T23:14:32.175 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-04-26T23:14:32.176 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2024-04-26T23:14:32.178 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32938.log: /var/log/ceph/ceph-client.admin.38987.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-04-26T23:14:32.178 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2024-04-26T23:14:32.178 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-04-26T23:14:32.179 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-04-26T23:14:32.179 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2024-04-26T23:14:32.180 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T23:14:32.180 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-04-26T23:14:32.181 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-04-26T23:14:32.182 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-04-26T23:14:32.183 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-04-26T23:14:32.183 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35325.log 2024-04-26T23:14:32.183 INFO:teuthology.orchestra.run.smithi148.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-04-26T23:14:32.184 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35031.log 2024-04-26T23:14:32.185 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-04-26T23:14:32.185 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35325.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.35325.log.gz 2024-04-26T23:14:32.186 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39141.log 2024-04-26T23:14:32.187 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35031.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35031.log.gz 2024-04-26T23:14:32.187 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-04-26T23:14:32.188 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-04-26T23:14:32.189 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39141.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39141.log.gz/var/log/ceph/ceph-client.admin.38855.log: 2024-04-26T23:14:32.189 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-04-26T23:14:32.190 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-04-26T23:14:32.190 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33192.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2024-04-26T23:14:32.191 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34352.log 2024-04-26T23:14:32.192 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31533.log 2024-04-26T23:14:32.193 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32435.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz/var/log/ceph/ceph-client.admin.34352.log: 2024-04-26T23:14:32.193 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34352.log.gz 2024-04-26T23:14:32.194 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37295.log 2024-04-26T23:14:32.194 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31533.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31533.log.gz 2024-04-26T23:14:32.195 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36629.log 2024-04-26T23:14:32.196 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34482.log 2024-04-26T23:14:32.197 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37295.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37295.log.gz/var/log/ceph/ceph-client.admin.36629.log: 2024-04-26T23:14:32.197 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36629.log.gz 2024-04-26T23:14:32.198 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33397.log 2024-04-26T23:14:32.198 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34482.log.gz 2024-04-26T23:14:32.199 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22742.log 2024-04-26T23:14:32.199 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:14:32.200 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33397.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33397.log.gz 2024-04-26T23:14:32.201 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.tmp-client.admin.22742.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22742.log.gz 2024-04-26T23:14:32.201 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2024-04-26T23:14:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-04-26T23:14:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2024-04-26T23:14:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37002.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:14:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33824.log 2024-04-26T23:14:32.205 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-04-26T23:14:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31645.log 2024-04-26T23:14:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2024-04-26T23:14:32.208 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33824.log.gz 2024-04-26T23:14:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38319.log 2024-04-26T23:14:32.209 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31645.log.gz 2024-04-26T23:14:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32043.log 2024-04-26T23:14:32.210 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2024-04-26T23:14:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33182.log 2024-04-26T23:14:32.211 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38319.log.gz 2024-04-26T23:14:32.212 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32043.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32043.log.gz 2024-04-26T23:14:32.213 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-04-26T23:14:32.214 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-04-26T23:14:32.214 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33182.log.gz 2024-04-26T23:14:32.215 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-04-26T23:14:32.215 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-04-26T23:14:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31449.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-04-26T23:14:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35057.log 2024-04-26T23:14:32.217 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36479.log 2024-04-26T23:14:32.217 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz 2024-04-26T23:14:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34168.log 2024-04-26T23:14:32.219 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35057.log.gz 2024-04-26T23:14:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36479.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36479.log.gz 2024-04-26T23:14:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34284.log 2024-04-26T23:14:32.221 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27548.log 2024-04-26T23:14:32.221 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34168.log.gz 2024-04-26T23:14:32.222 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.34284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34284.log.gz 2024-04-26T23:14:32.222 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38025.log 2024-04-26T23:14:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27548.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.27548.log.gz 2024-04-26T23:14:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32357.log 2024-04-26T23:14:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31725.log 2024-04-26T23:14:32.225 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38025.log.gz 2024-04-26T23:14:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31753.log 2024-04-26T23:14:32.226 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32357.log.gz 2024-04-26T23:14:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31725.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31725.log.gz 2024-04-26T23:14:32.227 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37914.log 2024-04-26T23:14:32.227 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38077.log 2024-04-26T23:14:32.228 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31753.log.gz 2024-04-26T23:14:32.229 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-04-26T23:14:32.230 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38077.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.37914.log.gz 2024-04-26T23:14:32.231 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35679.log 2024-04-26T23:14:32.231 INFO:teuthology.orchestra.run.smithi148.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38077.log.gz 2024-04-26T23:14:32.231 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-04-26T23:14:32.232 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-04-26T23:14:32.233 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35679.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35679.log.gz 2024-04-26T23:14:32.233 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36736.log 2024-04-26T23:14:32.234 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34560.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-04-26T23:14:32.234 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33387.log 2024-04-26T23:14:32.235 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37810.log 2024-04-26T23:14:32.236 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36736.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36736.log.gz 2024-04-26T23:14:32.236 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33387.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33387.log.gz 2024-04-26T23:14:32.237 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-04-26T23:14:32.238 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37810.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37810.log.gz 2024-04-26T23:14:32.238 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-04-26T23:14:32.239 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-04-26T23:14:32.240 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33183.log: /var/log/ceph/ceph-client.admin.36386.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-04-26T23:14:32.240 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-04-26T23:14:32.241 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38750.log 2024-04-26T23:14:32.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36794.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-04-26T23:14:32.246 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38051.log 2024-04-26T23:14:32.247 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35005.log 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38750.log.gz 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38051.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38051.log.gz 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35005.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35005.log.gz 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-04-26T23:14:32.248 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34534.log 2024-04-26T23:14:32.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35757.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz/var/log/ceph/ceph-client.admin.36898.log: 2024-04-26T23:14:32.249 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-04-26T23:14:32.249 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33668.log 2024-04-26T23:14:32.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34534.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34534.log.gz 2024-04-26T23:14:32.250 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35925.log 2024-04-26T23:14:32.251 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:14:32.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33668.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33668.log.gz/var/log/ceph/ceph-client.admin.35925.log: 2024-04-26T23:14:32.252 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35925.log.gz 2024-04-26T23:14:32.252 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-04-26T23:14:32.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T23:14:32.254 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-client.admin.37613.log: 2024-04-26T23:14:32.255 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39063.log 2024-04-26T23:14:32.255 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2024-04-26T23:14:32.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38698.log 2024-04-26T23:14:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39063.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39063.log.gz 2024-04-26T23:14:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T23:14:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38698.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38698.log.gz 2024-04-26T23:14:32.259 INFO:teuthology.orchestra.run.smithi148.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T23:14:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38829.log 2024-04-26T23:14:32.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31861.log 2024-04-26T23:14:32.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38829.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38829.log.gz 2024-04-26T23:14:32.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31861.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31861.log.gz 2024-04-26T23:14:32.264 INFO:teuthology.orchestra.run.smithi148.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T23:14:32.264 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37477.log 2024-04-26T23:14:32.264 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38239.log 2024-04-26T23:14:32.266 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33980.log 2024-04-26T23:14:32.266 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37477.log.gz 2024-04-26T23:14:32.267 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34586.log 2024-04-26T23:14:32.267 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38239.log.gz 2024-04-26T23:14:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33980.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33980.log.gz 2024-04-26T23:14:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-04-26T23:14:32.269 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34586.log.gz 2024-04-26T23:14:32.269 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-04-26T23:14:32.270 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37110.log 2024-04-26T23:14:32.271 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33928.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz/var/log/ceph/ceph-client.admin.32860.log: 2024-04-26T23:14:32.272 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-04-26T23:14:32.272 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34508.log 2024-04-26T23:14:32.273 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37110.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37110.log.gz 2024-04-26T23:14:32.273 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37999.log 2024-04-26T23:14:32.274 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-04-26T23:14:32.275 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34508.log: 89.6%/var/log/ceph/ceph-client.admin.37999.log: -- replaced with /var/log/ceph/ceph-client.admin.34508.log.gz 2024-04-26T23:14:32.275 INFO:teuthology.orchestra.run.smithi148.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37999.log.gz 2024-04-26T23:14:32.276 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-04-26T23:14:32.277 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-04-26T23:14:32.277 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33850.log 2024-04-26T23:14:32.278 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-04-26T23:14:32.279 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32808.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-04-26T23:14:32.279 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33850.log.gz 2024-04-26T23:14:32.280 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37163.log 2024-04-26T23:14:32.281 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-04-26T23:14:32.281 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33404.log 2024-04-26T23:14:32.282 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31587.log 2024-04-26T23:14:32.283 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37163.log: /var/log/ceph/ceph-client.admin.33404.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37163.log.gz 2024-04-26T23:14:32.283 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33404.log.gz 2024-04-26T23:14:32.284 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-04-26T23:14:32.284 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31587.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31587.log.gz 2024-04-26T23:14:32.285 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2024-04-26T23:14:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38777.log 2024-04-26T23:14:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36603.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-04-26T23:14:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32652.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2024-04-26T23:14:32.288 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32678.log 2024-04-26T23:14:32.288 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38777.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38777.log.gz 2024-04-26T23:14:32.289 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36172.log 2024-04-26T23:14:32.290 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33400.log 2024-04-26T23:14:32.290 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32678.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32678.log.gz 2024-04-26T23:14:32.291 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36172.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36172.log.gz 2024-04-26T23:14:32.292 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-04-26T23:14:32.292 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33400.log.gz 2024-04-26T23:14:32.293 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-04-26T23:14:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33954.log 2024-04-26T23:14:32.294 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-04-26T23:14:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35083.log 2024-04-26T23:14:32.296 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-04-26T23:14:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33954.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33954.log.gz 2024-04-26T23:14:32.297 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32331.log 2024-04-26T23:14:32.298 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35083.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35083.log.gz 2024-04-26T23:14:32.298 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-04-26T23:14:32.299 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-04-26T23:14:32.300 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32331.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32331.log.gz/var/log/ceph/ceph-client.admin.38672.log: 2024-04-26T23:14:32.300 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-04-26T23:14:32.301 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2024-04-26T23:14:32.302 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35868.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-04-26T23:14:32.302 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32514.log 2024-04-26T23:14:32.303 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36505.log 2024-04-26T23:14:32.304 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34006.log: /var/log/ceph/ceph-client.admin.32514.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gz 2024-04-26T23:14:32.304 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32514.log.gz 2024-04-26T23:14:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32383.log 2024-04-26T23:14:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36505.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36505.log.gz 2024-04-26T23:14:32.306 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-04-26T23:14:32.307 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32383.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32383.log.gz 2024-04-26T23:14:32.307 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-04-26T23:14:32.309 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-04-26T23:14:32.309 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-04-26T23:14:32.310 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32626.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-04-26T23:14:32.310 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38129.log 2024-04-26T23:14:32.310 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-04-26T23:14:32.311 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36846.log 2024-04-26T23:14:32.312 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-04-26T23:14:32.313 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38129.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38129.log.gz 2024-04-26T23:14:32.313 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36846.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36846.log.gz 2024-04-26T23:14:32.314 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-04-26T23:14:32.314 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-04-26T23:14:32.315 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-04-26T23:14:32.316 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-04-26T23:14:32.317 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz/var/log/ceph/ceph-client.admin.38646.log: 2024-04-26T23:14:32.317 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-04-26T23:14:32.318 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34378.log 2024-04-26T23:14:32.319 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-04-26T23:14:32.319 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-04-26T23:14:32.320 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-04-26T23:14:32.320 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34378.log.gz 2024-04-26T23:14:32.321 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.36681.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-04-26T23:14:32.322 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T23:14:32.322 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32730.log 2024-04-26T23:14:32.323 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-04-26T23:14:32.323 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-04-26T23:14:32.324 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39089.log 2024-04-26T23:14:32.325 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32730.log: 89.4%/var/log/ceph/ceph-client.admin.37529.log: -- replaced with /var/log/ceph/ceph-client.admin.32730.log.gz 2024-04-26T23:14:32.325 INFO:teuthology.orchestra.run.smithi148.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-04-26T23:14:32.326 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.39089.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-26T23:14:32.326 INFO:teuthology.orchestra.run.smithi148.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39089.log.gz 2024-04-26T23:14:32.327 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36710.log 2024-04-26T23:14:32.328 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38211.log 2024-04-26T23:14:32.330 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.36710.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2024-04-26T23:14:32.330 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38516.log 2024-04-26T23:14:32.330 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38211.log.gz 2024-04-26T23:14:32.331 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-26T23:14:32.331 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-04-26T23:14:32.332 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T23:14:32.332 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-04-26T23:14:32.333 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38516.log.gz 2024-04-26T23:14:32.333 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-04-26T23:14:32.334 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-04-26T23:14:32.335 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31991.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-04-26T23:14:32.335 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33388.log 2024-04-26T23:14:32.336 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.35549.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-04-26T23:14:32.336 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-04-26T23:14:32.337 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37557.log 2024-04-26T23:14:32.338 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33388.log: /var/log/ceph/ceph-client.admin.32991.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33388.log.gz 2024-04-26T23:14:32.339 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-04-26T23:14:32.340 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.37557.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37557.log.gz 2024-04-26T23:14:32.499 INFO:teuthology.orchestra.run.smithi148.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T23:14:34.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-26T23:14:37.478 INFO:teuthology.orchestra.run.smithi148.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T23:14:38.257 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T23:14:38.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T23:14:39.729 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T23:14:41.387 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T23:14:41.572 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T23:14:42.156 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T23:14:42.158 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-04-26T23:14:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m10.157s 2024-04-26T23:14:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m30.895s 2024-04-26T23:14:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m2.783s 2024-04-26T23:14:43.480 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T23:15:16.140 INFO:teuthology.orchestra.run.smithi157.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T23:15:16.141 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-04-26T23:15:16.141 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m44.105s 2024-04-26T23:15:16.141 INFO:teuthology.orchestra.run.smithi157.stderr:user 1m15.693s 2024-04-26T23:15:16.141 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m2.382s 2024-04-26T23:15:16.142 INFO:tasks.ceph:Archiving logs... 2024-04-26T23:15:16.142 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi148/log 2024-04-26T23:15:16.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:15:20.807 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi157/log 2024-04-26T23:15:20.808 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:15:30.983 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T23:15:30.993 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T23:15:30.993 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:15:30.997 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:15:31.075 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T23:15:31.162 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T23:15:31.162 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:15:31.166 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:*hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.071 -1.692 4.309 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.071 -2.558 2.834 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.090 -0.187 2.436 2024-04-26T23:15:31.179 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout:*hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.088 -5.100 1.201 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout:+hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.097 -3.056 0.824 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.089 +1.613 1.835 2024-04-26T23:15:31.181 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T23:15:31.181 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T23:15:31.191 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T23:15:31.192 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T23:15:31.229 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T23:15:31.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T23:15:31.262 INFO:teuthology.task.internal:Duration was 1346.340363 seconds 2024-04-26T23:15:31.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T23:15:31.349 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T23:15:31.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:15:31.353 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:15:31.449 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T23:15:31.449 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-04-26T23:15:31.449 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:15:31.470 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-04-26T23:15:31.470 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:15:31.480 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T23:15:31.480 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:15:31.514 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:15:31.550 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T23:15:31.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:15:31.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:15:31.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T23:15:31.678 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T23:15:31.679 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:15:31.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:15:31.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T23:15:31.722 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:15:31.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:15:31.759 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-04-26T23:15:31.762 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-04-26T23:15:31.783 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:15:31.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:15:31.830 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:15:31.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:15:31.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T23:15:31.845 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T23:15:31.846 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi148 2024-04-26T23:15:31.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:15:31.897 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675285/remote/smithi157 2024-04-26T23:15:31.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:15:31.919 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T23:15:31.920 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:15:31.941 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:15:31.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T23:15:31.976 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T23:15:31.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T23:15:31.986 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T23:15:31.986 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:15:31.993 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:15:31.998 INFO:teuthology.orchestra.run.smithi148.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:15 /home/ubuntu/cephtest 2024-04-26T23:15:32.013 INFO:teuthology.orchestra.run.smithi157.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:15 /home/ubuntu/cephtest 2024-04-26T23:15:32.014 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T23:15:32.071 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T23:15:32.160 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} duration: 1346.3403625488281 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-26T23:15:32.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:15:32.278 INFO:teuthology.run:pass